Class cascading.detail.EveryEveryPipeAssemblyPlatformTest

40

tests

0

failures

0

ignored

18.256s

duration

100%

successful

Tests

Test Duration Result
-1_'field'_RESULTS.-1_'field2'_'field'[hadoop2-tez] 0.665s passed
-1_'field'_RESULTS.-1_'field2'_'field2'[hadoop2-tez] 0.721s passed
-1_'field'_RESULTS.-1_'field2'_-1[hadoop2-tez] 3.520s passed
-1_'field'_RESULTS.-1_'field2'_ALL[hadoop2-tez] 0.555s passed
-1_'field'_RESULTS.-1_'field2'_RESULTS[hadoop2-tez] 0.542s passed
-1_'field'_RESULTS.-1_ARGS_'field2'[hadoop2-tez] 0.062s passed
-1_'field'_RESULTS.-1_ARGS_ALL[hadoop2-tez] 0.056s passed
-1_'field'_RESULTS.-1_ARGS_RESULTS[hadoop2-tez] 0.477s passed
-1_'field'_RESULTS.-1_UNKNOWN_'field'[hadoop2-tez] 0.578s passed
-1_'field'_RESULTS.-1_UNKNOWN_'field2'[hadoop2-tez] 0.090s passed
-1_'field'_RESULTS.-1_UNKNOWN_-1[hadoop2-tez] 0.660s passed
-1_'field'_RESULTS.-1_UNKNOWN_ALL[hadoop2-tez] 0.527s passed
-1_'field'_RESULTS.-1_UNKNOWN_RESULTS[hadoop2-tez] 0.523s passed
-1_'field'_RESULTS.-1_VALUES_'field2'[hadoop2-tez] 0.071s passed
-1_'field'_RESULTS.-1_VALUES_-1[hadoop2-tez] 0.414s passed
-1_'field'_RESULTS.-1_VALUES_ALL[hadoop2-tez] 0.440s passed
-1_'field'_RESULTS.-1_VALUES_RESULTS[hadoop2-tez] 0.428s passed
-1_'field'_RESULTS.0_'field2'_'field2'[hadoop2-tez] 0.453s passed
-1_'field'_RESULTS.0_'field2'_-1[hadoop2-tez] 0.460s passed
-1_'field'_RESULTS.0_'field2'_ALL[hadoop2-tez] 0.448s passed
-1_'field'_RESULTS.0_'field2'_RESULTS[hadoop2-tez] 0.463s passed
-1_'field'_RESULTS.0_ARGS_'field2'[hadoop2-tez] 0.049s passed
-1_'field'_RESULTS.0_ARGS_-1[hadoop2-tez] 0.404s passed
-1_'field'_RESULTS.0_ARGS_ALL[hadoop2-tez] 0.049s passed
-1_'field'_RESULTS.0_ARGS_RESULTS[hadoop2-tez] 0.461s passed
-1_'field'_RESULTS.0_UNKNOWN_'field2'[hadoop2-tez] 0.051s passed
-1_'field'_RESULTS.0_UNKNOWN_-1[hadoop2-tez] 0.487s passed
-1_'field'_RESULTS.0_UNKNOWN_ALL[hadoop2-tez] 0.439s passed
-1_'field'_RESULTS.0_UNKNOWN_RESULTS[hadoop2-tez] 0.428s passed
-1_'field'_RESULTS.0_VALUES_'field2'[hadoop2-tez] 0.073s passed
-1_'field'_RESULTS.0_VALUES_-1[hadoop2-tez] 0.358s passed
-1_'field'_RESULTS.0_VALUES_ALL[hadoop2-tez] 0.366s passed
-1_'field'_RESULTS.0_VALUES_RESULTS[hadoop2-tez] 0.415s passed
-1_'field'_RESULTS.ALL_'field2'_'field'[hadoop2-tez] 0.420s passed
-1_'field'_RESULTS.ALL_'field2'_'field2'[hadoop2-tez] 0.401s passed
-1_'field'_RESULTS.ALL_'field2'_-1[hadoop2-tez] 0.409s passed
-1_'field'_RESULTS.ALL_'field2'_ALL[hadoop2-tez] 0.417s passed
-1_'field'_RESULTS.ALL_'field2'_RESULTS[hadoop2-tez] 0.411s passed
-1_'field'_RESULTS.ALL_UNKNOWN_'field2'[hadoop2-tez] 0.045s passed
-1_'field'_RESULTS.ALL_UNKNOWN_-1[hadoop2-tez] 0.420s passed

Standard output

2016-01-14 16:08:14,983 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 16:08:15,005 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.detail.EveryEveryPipeAssemblyPlatformTest, with platform: hadoop2-tez
2016-01-14 16:08:15,486 INFO  tez.Hadoop2TezPlatform (Hadoop2TezPlatform.java:setUp(136)) - not using cluster
2016-01-14 16:08:15,838 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-01-14 16:08:16,170 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides: 
2016-01-14 16:08:16,356 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:16,358 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:16,483 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 3DAC785768B9442DB1D9F42F5E5329C9
2016-01-14 16:08:16,666 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.062
2016-01-14 16:08:16,678 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.074
2016-01-14 16:08:16,679 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:16,679 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:16,681 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:16,827 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:16,830 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:17,037 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 16:08:17,040 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:17,040 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:17,041 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_-1"]
2016-01-14 16:08:17,041 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:17,041 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:17,042 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:17,043 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...d'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:17,043 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:17,071 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:17,232 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:17,238 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:17,238 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:17,284 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8/.tez/application_1452787697237_0001 doesn't exist and is created
2016-01-14 16:08:17,350 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:17,350 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:17,351 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8/.tez/application_1452787697237_0001
2016-01-14 16:08:17,383 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787697237_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:17,428 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:17,443 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:17,451 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: NEW
2016-01-14 16:08:17,451 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(238)) - DAGAppMaster is not started wait for 100ms...
2016-01-14 16:08:17,451 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:17,468 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:17,472 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:17,476 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8/.tez/application_1452787697237_0001/localmode-log-dir
2016-01-14 16:08:17,476 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8/.tez/application_1452787697237_0001/localmode-log-dir/history.txt.appattempt_1452787697237_0001_000000, maxErrors=10
2016-01-14 16:08:17,476 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:17,479 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787697237_0001_000000, appSubmitTime=1452787697369, launchTime=1452787697381
2016-01-14 16:08:17,484 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:17,485 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:17,489 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:17,489 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:17,547 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:33229
2016-01-14 16:08:17,552 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-01-14 16:08:17,552 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-01-14 16:08:17,552 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:17,590 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:17,652 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-01-14 16:08:17,653 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-01-14 16:08:17,653 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:17,664 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:17,664 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787697237_0001_000000, startTime=1452787697663
2016-01-14 16:08:17,665 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:17,753 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:17,771 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:17,772 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...d'_RESULTS.-1_'field2'_-1, applicationId=application_1452787697237_0001, dagName=[130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8] every.every/(1/1) ...d'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:18,013 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8] every.every/(1/1) ...d'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:18,106 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787697237_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8/.tez/application_1452787697237_0001/localmode-log-dir/dag_1452787697237_0001_1.dot
2016-01-14 16:08:18,108 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8/.tez/application_1452787697237_0001/localmode-log-dir/dag_1452787697237_0001_1-tez-dag.pb.txt
2016-01-14 16:08:18,187 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787697237_0001_1
2016-01-14 16:08:18,187 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:18,187 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8] every.every/(1/1) ...d'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:18 Running Dag: dag_1452787697237_0001_1
2016-01-14 16:08:18,231 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:18,235 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787697237_0001_1, submitTime=1452787698014
2016-01-14 16:08:18,265 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex A22A3F022D8B47BC885BA516B3D54236
2016-01-14 16:08:18,267 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:18,270 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:18,273 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787697237_0001_1, initTime=1452787698236
2016-01-14 16:08:18,274 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787697237_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:18,275 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:DAG_STARTED]: dagID=dag_1452787697237_0001_1, startTime=1452787698275
2016-01-14 16:08:18,276 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:18,276 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:18,277 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787697237_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:18,278 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: A22A3F022D8B47BC885BA516B3D54236 : {DFACFE4CBED44F3999344566A27E20E0={InputName=DFACFE4CBED44F3999344566A27E20E0}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:18,279 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: DFACFE4CBED44F3999344566A27E20E0, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:18,280 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,288 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,288 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,290 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...d'_RESULTS.-1_'field2'_-1, applicationId=application_1452787697237_0001, dagName=[130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8] every.every/(1/1) ...d'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:18,291 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]. Starting root input initializers: 1
2016-01-14 16:08:18,305 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: DFACFE4CBED44F3999344566A27E20E0 on vertex vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,313 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:18,328 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:18,330 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input DFACFE4CBED44F3999344566A27E20E0 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:18,331 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:18,332 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:18,333 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787697237_0001, with dag id: dag_1452787697237_0001_1
2016-01-14 16:08:18,386 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:18,389 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: DFACFE4CBED44F3999344566A27E20E0 on vertex vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,391 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:18,391 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {DFACFE4CBED44F3999344566A27E20E0=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:18,410 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236] parallelism set to 1
2016-01-14 16:08:18,411 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:18,422 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787697237_0001_1_00, eventCount=1
2016-01-14 16:08:18,424 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,424 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=CEE1E11A10F847828338500899E40E2A, vertexId=vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:18,428 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=CEE1E11A10F847828338500899E40E2A, vertexId=vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,445 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=CEE1E11A10F847828338500899E40E2A, vertexName=A22A3F022D8B47BC885BA516B3D54236, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:18,455 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=CEE1E11A10F847828338500899E40E2A, vertexId=vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,457 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:18,457 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:VERTEX_INITIALIZED]: vertexName=A22A3F022D8B47BC885BA516B3D54236, vertexId=vertex_1452787697237_0001_1_00, initRequestedTime=1452787698277, initedTime=1452787698457, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:18,458 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236] with distanceFromRoot: 0
2016-01-14 16:08:18,458 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:18,460 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in A22A3F022D8B47BC885BA516B3D54236
2016-01-14 16:08:18,460 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,462 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:18,462 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787697237_0001_1_00, startRequestedTime=1452787698459, startedTime=1452787698459
2016-01-14 16:08:18,463 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:18,484 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:18,485 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:TASK_STARTED]: vertexName=A22A3F022D8B47BC885BA516B3D54236, taskId=task_1452787697237_0001_1_00_000000, scheduledTime=1452787698484, launchTime=1452787698484
2016-01-14 16:08:18,485 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787697237_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:18,488 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,491 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8] every.every/(1/1) ...d'_RESULTS.-1_'field2'_-1, VertexName: A22A3F022D8B47BC885BA516B3D54236, VertexParallelism: 1, TaskAttemptID:attempt_1452787697237_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=DFACFE4CBED44F3999344566A27E20E0, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=CEE1E11A10F847828338500899E40E2A, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:18,493 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787697237_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:18,493 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:18,546 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:18,549 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:18,549 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:18,555 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787697237_0001_00_000001
2016-01-14 16:08:18,555 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787697237_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:18,567 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787697237_0001_00_000001
2016-01-14 16:08:18,568 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:18,572 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787697237_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:18,573 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:18,574 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787697237_0001_00_000001, launchTime=1452787698573
2016-01-14 16:08:18,578 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787697237_0001_00_000001
2016-01-14 16:08:18,582 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787697237_0001_1_00_000000_0] to container: [container_1452787697237_0001_00_000001]
2016-01-14 16:08:18,582 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787697237_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:18,583 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787697237_0001_00_000001 given task: attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18,583 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787697237_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18 Starting to run new task attempt: attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18,585 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18,585 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:18,585 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787697237_0001_1_00_000000_0] started. Is using containerId: [container_1452787697237_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:18,587 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=A22A3F022D8B47BC885BA516B3D54236, taskAttemptId=attempt_1452787697237_0001_1_00_000000_0, startTime=1452787698583, containerId=container_1452787697237_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787697237_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:18,587 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:18,587 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:18,588 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:18,589 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:18,590 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787697237_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:18,592 INFO  counters.Limits (Limits.java:ensureInitialized(59)) - Counter limits initialized with parameters:  GROUP_NAME_MAX=128, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200
2016-01-14 16:08:18,593 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:18,599 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787697237_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:18,617 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:18,618 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8] every.every/(1/1) ...d'_RESULTS.-1_'field2'_-1, VertexName: A22A3F022D8B47BC885BA516B3D54236, VertexParallelism: 1, TaskAttemptID:attempt_1452787697237_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=DFACFE4CBED44F3999344566A27E20E0, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=CEE1E11A10F847828338500899E40E2A, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:18,620 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:18,624 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18,626 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:18,627 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:18,629 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787697237_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:18,631 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=DFACFE4CBED44F3999344566A27E20E0, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:18,632 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:18,633 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=CEE1E11A10F847828338500899E40E2A, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:18,633 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:18,634 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:18,634 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: DFACFE4CBED44F3999344566A27E20E0
2016-01-14 16:08:18,634 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: CEE1E11A10F847828338500899E40E2A
2016-01-14 16:08:18,635 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:18,640 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: DFACFE4CBED44F3999344566A27E20E0
2016-01-14 16:08:18,640 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: CEE1E11A10F847828338500899E40E2A
2016-01-14 16:08:18,657 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:18,658 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: DFACFE4CBED44F3999344566A27E20E0
2016-01-14 16:08:18,658 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: DFACFE4CBED44F3999344566A27E20E0
2016-01-14 16:08:18,664 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:18,683 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:18,683 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: CEE1E11A10F847828338500899E40E2A
2016-01-14 16:08:18,687 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: A22A3F022D8B47BC885BA516B3D54236, ordinal: 0
2016-01-14 16:08:18,688 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A22A3F022D8B47BC885BA516B3D54236, mem on start (mb), free: 218, total: 281, max: 672
2016-01-14 16:08:18,688 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:18,688 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:18,688 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:18,689 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:18,689 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:18,695 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:18,696 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:18,696 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:18,696 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:18,697 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:18,697 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:18,698 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, DFACFE4CBED44F3999344566A27E20E0, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:18,698 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, CEE1E11A10F847828338500899E40E2A, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:18,698 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:18,699 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: DFACFE4CBED44F3999344566A27E20E0 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:18,699 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: DFACFE4CBED44F3999344566A27E20E0
2016-01-14 16:08:18,700 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:18,700 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: DFACFE4CBED44F3999344566A27E20E0
2016-01-14 16:08:18,700 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:18,701 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:18,701 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:18,702 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18,704 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:18,712 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@4c838c64
2016-01-14 16:08:18,723 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@4c838c64
2016-01-14 16:08:18,724 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:18,724 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:18,741 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:18,764 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: DFACFE4CBED44F3999344566A27E20E0
2016-01-14 16:08:18,764 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_-1"], id: CEE1E11A10F847828338500899E40E2A
2016-01-14 16:08:18,765 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_-1"]
2016-01-14 16:08:18,767 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:18,767 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:18,771 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: A22A3F022D8B47BC885BA516B3D54236, all 1 inputs ready in: 00:00:00.003
2016-01-14 16:08:18,779 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:18,780 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:18,780 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18,781 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787697237_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:18,782 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18,782 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A22A3F022D8B47BC885BA516B3D54236, mem on close (mb), free: 211, total: 281, max: 672
2016-01-14 16:08:18 Completed running task attempt: attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18,789 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787697237_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:18,793 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787698771, Process_Duration=11, Process_End_Time=1452787698782, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:18,793 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:18,794 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:18,795 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:18,795 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787697237_0001_00_000001
2016-01-14 16:08:18,798 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=A22A3F022D8B47BC885BA516B3D54236, taskAttemptId=attempt_1452787697237_0001_1_00_000000_0, startTime=1452787698583, finishTime=1452787698790, timeTaken=207, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787698771, Process_Duration=11, Process_End_Time=1452787698782, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:18,799 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787697237_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:18,799 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:18,804 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18,806 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:18,808 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:TASK_FINISHED]: vertexName=A22A3F022D8B47BC885BA516B3D54236, taskId=task_1452787697237_0001_1_00_000000, startTime=1452787698583, finishTime=1452787698805, timeTaken=222, status=SUCCEEDED, successfulAttemptID=attempt_1452787697237_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787698771, Process_Duration=11, Process_End_Time=1452787698782, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:18,812 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787697237_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:18,812 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787697237_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:18,813 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:18,815 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787697237_0001_00_000001, stoppedTime=1452787698813, exitStatus=0
2016-01-14 16:08:18,816 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787697237_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:18,816 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236] : 1
2016-01-14 16:08:18,817 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,822 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:18,826 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:VERTEX_FINISHED]: vertexName=A22A3F022D8B47BC885BA516B3D54236, vertexId=vertex_1452787697237_0001_1_00, initRequestedTime=1452787698277, initedTime=1452787698457, startRequestedTime=1452787698459, startedTime=1452787698459, finishTime=1452787698817, timeTaken=358, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787698771, Process_Duration=11, Process_End_Time=1452787698782, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787698583, firstTasksToStart=[ task_1452787697237_0001_1_00_000000 ], lastTaskFinishTime=1452787698790, lastTasksToFinish=[ task_1452787697237_0001_1_00_000000 ], minTaskDuration=207, maxTaskDuration=207, avgTaskDuration=207.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787697237_0001_1_00_000000 ], longestDurationTasks=[ task_1452787697237_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:18,827 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:18,827 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:18,828 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787697237_0001_1
2016-01-14 16:08:18,828 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1452787697237_0001_00_000001. Relying on regular task shutdown for it to end
2016-01-14 16:08:18,830 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787697237_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:18,830 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787697237_0001_00_000001: 35 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:18,830 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787697237_0001_00_000001, Exiting
2016-01-14 16:08:18,830 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787697237_0001_00_000001
2016-01-14 16:08:18,830 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787697237_0001_00_000001
2016-01-14 16:08:18,833 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787697237_0001_1
2016-01-14 16:08:18,833 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: CEE1E11A10F847828338500899E40E2A for vertex: vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,839 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787697237_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:18,840 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787697237_0001_00_000001 completed successfully
2016-01-14 16:08:18,854 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787697237_0001_1, queueSize=0
2016-01-14 16:08:18,854 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:18,855 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787697237_0001_1, startTime=1452787698275, finishTime=1452787698848, timeTaken=573, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787698771, Process_Duration=11, Process_End_Time=1452787698782, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:18,858 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787697237_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:18,858 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787697237_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:18,858 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787697237_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 16:08:18,859 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787697237_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 16:08:18 Completed Dag: dag_1452787697237_0001_1
2016-01-14 16:08:18,860 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787697237_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:18,860 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787697237_0001_1_post
2016-01-14 16:08:18,861 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:18,861 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:18,870 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...d'_RESULTS.-1_'field2'_-1, applicationId=application_1452787697237_0001
2016-01-14 16:08:18,874 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:18,874 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:18,874 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:18,874 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:18,874 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:18,875 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:18,878 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:18,878 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:18,878 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:18,878 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:18,878 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:18,879 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:18,879 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:18,885 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8/.tez/application_1452787697237_0001
2016-01-14 16:08:18,887 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:01.846
2016-01-14 16:08:19,004 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:19,045 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:19,046 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:19,119 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.027
2016-01-14 16:08:19,140 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.045
2016-01-14 16:08:19,141 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:19,141 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:19,142 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:19,165 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:19,167 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field2'
2016-01-14 16:08:19,204 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:19,204 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:19,204 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field2'"]
2016-01-14 16:08:19,205 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:19,205 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:19,206 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:19,207 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ULTS.-1_'field2'_'field2'
2016-01-14 16:08:19,207 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:19,231 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:19,237 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:19,237 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:19,237 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:19,248 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70/.tez/application_1452787699237_0001 doesn't exist and is created
2016-01-14 16:08:19,274 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:19,274 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:19,275 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70/.tez/application_1452787699237_0001
2016-01-14 16:08:19,279 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787699237_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:19,298 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:19,299 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:19,301 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:19,302 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:19,302 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70/.tez/application_1452787699237_0001/localmode-log-dir
2016-01-14 16:08:19,302 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70/.tez/application_1452787699237_0001/localmode-log-dir/history.txt.appattempt_1452787699237_0001_000000, maxErrors=10
2016-01-14 16:08:19,303 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:19,303 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787699237_0001_000000, appSubmitTime=1452787699278, launchTime=1452787699279
2016-01-14 16:08:19,311 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:19,340 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:35139
2016-01-14 16:08:19,341 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:19,343 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:19,345 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:19,349 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:19,354 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787699237_0001_000000, startTime=1452787699354
2016-01-14 16:08:19,354 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:19,354 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:19,374 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:19,374 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:19,375 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ULTS.-1_'field2'_'field2', applicationId=application_1452787699237_0001, dagName=[3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70] every.every/(1/1) ...ULTS.-1_'field2'_'field2'
2016-01-14 16:08:19,410 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70] every.every/(1/1) ...ULTS.-1_'field2'_'field2'
2016-01-14 16:08:19,415 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787699237_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70/.tez/application_1452787699237_0001/localmode-log-dir/dag_1452787699237_0001_1.dot
2016-01-14 16:08:19,417 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70/.tez/application_1452787699237_0001/localmode-log-dir/dag_1452787699237_0001_1-tez-dag.pb.txt
2016-01-14 16:08:19,447 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787699237_0001_1
2016-01-14 16:08:19,447 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:19,448 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70] every.every/(1/1) ...ULTS.-1_'field2'_'field2'
2016-01-14 16:08:19 Running Dag: dag_1452787699237_0001_1
2016-01-14 16:08:19,463 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:19,463 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787699237_0001_1, submitTime=1452787699411
2016-01-14 16:08:19,465 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex D113F7F2069D4DC79D81AC459805D0DB
2016-01-14 16:08:19,465 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:19,466 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787699237_0001_1, initTime=1452787699463
2016-01-14 16:08:19,466 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:19,467 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787699237_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:19,468 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:DAG_STARTED]: dagID=dag_1452787699237_0001_1, startTime=1452787699468
2016-01-14 16:08:19,469 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:19,469 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ULTS.-1_'field2'_'field2', applicationId=application_1452787699237_0001, dagName=[3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70] every.every/(1/1) ...ULTS.-1_'field2'_'field2'
2016-01-14 16:08:19,469 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:19,469 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787699237_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:19,469 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: D113F7F2069D4DC79D81AC459805D0DB : {B0CAEB56B69345B1AC818B8CB3306D74={InputName=B0CAEB56B69345B1AC818B8CB3306D74}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:19,470 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: B0CAEB56B69345B1AC818B8CB3306D74, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:19,470 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,470 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,470 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,470 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]. Starting root input initializers: 1
2016-01-14 16:08:19,472 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:19,472 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: B0CAEB56B69345B1AC818B8CB3306D74 on vertex vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,477 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:19,478 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input B0CAEB56B69345B1AC818B8CB3306D74 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:19,479 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:19,480 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:19,482 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:19,483 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: B0CAEB56B69345B1AC818B8CB3306D74 on vertex vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,483 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:19,483 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {B0CAEB56B69345B1AC818B8CB3306D74=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:19,484 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB] parallelism set to 1
2016-01-14 16:08:19,484 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:19,484 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787699237_0001_1_00, eventCount=1
2016-01-14 16:08:19,484 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,485 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=FA50B415C695449F886C68138175778F, vertexId=vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:19,485 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=FA50B415C695449F886C68138175778F, vertexId=vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,491 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=FA50B415C695449F886C68138175778F, vertexName=D113F7F2069D4DC79D81AC459805D0DB, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:19,492 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=FA50B415C695449F886C68138175778F, vertexId=vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,493 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:19,493 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:VERTEX_INITIALIZED]: vertexName=D113F7F2069D4DC79D81AC459805D0DB, vertexId=vertex_1452787699237_0001_1_00, initRequestedTime=1452787699469, initedTime=1452787699493, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:19,494 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB] with distanceFromRoot: 0
2016-01-14 16:08:19,494 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:19,494 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in D113F7F2069D4DC79D81AC459805D0DB
2016-01-14 16:08:19,495 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,496 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:19,496 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787699237_0001_1_00, startRequestedTime=1452787699494, startedTime=1452787699494
2016-01-14 16:08:19,496 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:19,497 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:19,497 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:TASK_STARTED]: vertexName=D113F7F2069D4DC79D81AC459805D0DB, taskId=task_1452787699237_0001_1_00_000000, scheduledTime=1452787699497, launchTime=1452787699497
2016-01-14 16:08:19,498 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787699237_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:19,498 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,499 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787699237_0001, with dag id: dag_1452787699237_0001_1
2016-01-14 16:08:19,500 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70] every.every/(1/1) ...ULTS.-1_'field2'_'field2', VertexName: D113F7F2069D4DC79D81AC459805D0DB, VertexParallelism: 1, TaskAttemptID:attempt_1452787699237_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=B0CAEB56B69345B1AC818B8CB3306D74, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=FA50B415C695449F886C68138175778F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:19,500 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787699237_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:19,501 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:19,501 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:19,502 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:19,503 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:19,503 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787699237_0001_00_000001
2016-01-14 16:08:19,504 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699237_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:19,507 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787699237_0001_00_000001
2016-01-14 16:08:19,508 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:19,509 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699237_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:19,509 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:19,511 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787699237_0001_00_000001, launchTime=1452787699509
2016-01-14 16:08:19,511 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787699237_0001_00_000001
2016-01-14 16:08:19,512 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787699237_0001_1_00_000000_0] to container: [container_1452787699237_0001_00_000001]
2016-01-14 16:08:19,513 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699237_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:19,514 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787699237_0001_1_00_000000_0] started. Is using containerId: [container_1452787699237_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:19,514 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=D113F7F2069D4DC79D81AC459805D0DB, taskAttemptId=attempt_1452787699237_0001_1_00_000000_0, startTime=1452787699513, containerId=container_1452787699237_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787699237_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:19,514 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787699237_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:19,514 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:19,514 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787699237_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:19,515 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787699237_0001_00_000001 given task: attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19,515 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787699237_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19 Starting to run new task attempt: attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19,516 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19,516 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:19,516 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:19,516 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:19,516 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:19,516 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:19,517 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:19,517 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70] every.every/(1/1) ...ULTS.-1_'field2'_'field2', VertexName: D113F7F2069D4DC79D81AC459805D0DB, VertexParallelism: 1, TaskAttemptID:attempt_1452787699237_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=B0CAEB56B69345B1AC818B8CB3306D74, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=FA50B415C695449F886C68138175778F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:19,517 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:19,518 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19,518 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:19,521 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:19,521 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787699237_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:19,523 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:19,523 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=B0CAEB56B69345B1AC818B8CB3306D74, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:19,524 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:19,524 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: B0CAEB56B69345B1AC818B8CB3306D74
2016-01-14 16:08:19,524 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: B0CAEB56B69345B1AC818B8CB3306D74
2016-01-14 16:08:19,523 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=FA50B415C695449F886C68138175778F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:19,529 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:19,531 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:19,536 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: B0CAEB56B69345B1AC818B8CB3306D74
2016-01-14 16:08:19,537 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: B0CAEB56B69345B1AC818B8CB3306D74
2016-01-14 16:08:19,531 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:19,539 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: FA50B415C695449F886C68138175778F
2016-01-14 16:08:19,539 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:19,539 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: FA50B415C695449F886C68138175778F
2016-01-14 16:08:19,554 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: D113F7F2069D4DC79D81AC459805D0DB, ordinal: 0
2016-01-14 16:08:19,554 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:19,554 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: FA50B415C695449F886C68138175778F
2016-01-14 16:08:19,554 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D113F7F2069D4DC79D81AC459805D0DB, mem on start (mb), free: 236, total: 281, max: 672
2016-01-14 16:08:19,555 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:19,556 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:19,556 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:19,556 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:19,558 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:19,558 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:19,558 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:19,558 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:19,558 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:19,559 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:19,559 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:19,559 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, B0CAEB56B69345B1AC818B8CB3306D74, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:19,559 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, FA50B415C695449F886C68138175778F, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:19,559 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:19,560 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: B0CAEB56B69345B1AC818B8CB3306D74
2016-01-14 16:08:19,560 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:19,560 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: B0CAEB56B69345B1AC818B8CB3306D74
2016-01-14 16:08:19,560 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: B0CAEB56B69345B1AC818B8CB3306D74 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:19,561 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:19,561 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:19,561 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:19,561 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19,570 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:19,572 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@64763385
2016-01-14 16:08:19,574 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@64763385
2016-01-14 16:08:19,574 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:19,575 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:19,575 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:19,576 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: B0CAEB56B69345B1AC818B8CB3306D74
2016-01-14 16:08:19,576 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field2'"], id: FA50B415C695449F886C68138175778F
2016-01-14 16:08:19,577 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field2'"]
2016-01-14 16:08:19,577 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:19,577 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:19,577 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: D113F7F2069D4DC79D81AC459805D0DB, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:19,582 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:19,582 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:19,583 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19,583 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787699237_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:19,584 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19,584 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D113F7F2069D4DC79D81AC459805D0DB, mem on close (mb), free: 234, total: 281, max: 672
2016-01-14 16:08:19 Completed running task attempt: attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19,586 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787699237_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:19,588 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:19,589 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=D113F7F2069D4DC79D81AC459805D0DB, taskAttemptId=attempt_1452787699237_0001_1_00_000000_0, startTime=1452787699513, finishTime=1452787699587, timeTaken=74, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787699578, Process_Duration=6, Process_End_Time=1452787699584, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:19,589 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787699578, Process_Duration=6, Process_End_Time=1452787699584, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:19,589 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787699237_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:19,589 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:19,589 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:19,590 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19,590 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:19,590 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:19,591 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787699237_0001_00_000001
2016-01-14 16:08:19,591 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:TASK_FINISHED]: vertexName=D113F7F2069D4DC79D81AC459805D0DB, taskId=task_1452787699237_0001_1_00_000000, startTime=1452787699513, finishTime=1452787699590, timeTaken=77, status=SUCCEEDED, successfulAttemptID=attempt_1452787699237_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787699578, Process_Duration=6, Process_End_Time=1452787699584, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:19,592 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787699237_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:19,592 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB] : 1
2016-01-14 16:08:19,592 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,593 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:19,594 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:VERTEX_FINISHED]: vertexName=D113F7F2069D4DC79D81AC459805D0DB, vertexId=vertex_1452787699237_0001_1_00, initRequestedTime=1452787699469, initedTime=1452787699493, startRequestedTime=1452787699494, startedTime=1452787699494, finishTime=1452787699592, timeTaken=98, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787699578, Process_Duration=6, Process_End_Time=1452787699584, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787699513, firstTasksToStart=[ task_1452787699237_0001_1_00_000000 ], lastTaskFinishTime=1452787699587, lastTasksToFinish=[ task_1452787699237_0001_1_00_000000 ], minTaskDuration=74, maxTaskDuration=74, avgTaskDuration=74.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787699237_0001_1_00_000000 ], longestDurationTasks=[ task_1452787699237_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:19,595 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:19,595 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699237_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:19,595 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787699237_0001_00_000001, stoppedTime=1452787699595, exitStatus=0
2016-01-14 16:08:19,596 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699237_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:19,596 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:19,596 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787699237_0001_1
2016-01-14 16:08:19,597 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787699237_0001_1
2016-01-14 16:08:19,597 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: FA50B415C695449F886C68138175778F for vertex: vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,596 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:19,601 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787699237_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:19,602 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787699237_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:19,602 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787699237_0001_00_000001, Exiting
2016-01-14 16:08:19,602 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787699237_0001_00_000001
2016-01-14 16:08:19,602 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787699237_0001_00_000001
2016-01-14 16:08:19,604 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787699237_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:19,605 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787699237_0001_00_000001 completed successfully
2016-01-14 16:08:19,609 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787699237_0001_1, queueSize=0
2016-01-14 16:08:19,609 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:19,610 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787699237_0001_1, startTime=1452787699468, finishTime=1452787699608, timeTaken=140, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787699578, Process_Duration=6, Process_End_Time=1452787699584, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:19,610 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787699237_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:19,610 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787699237_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:19,610 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787699237_0001_00_000001
2016-01-14 16:08:19,610 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699237_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:19 Completed Dag: dag_1452787699237_0001_1
2016-01-14 16:08:19,612 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787699237_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:19,612 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787699237_0001_1_post
2016-01-14 16:08:19,612 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:19,612 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:19,619 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ULTS.-1_'field2'_'field2', applicationId=application_1452787699237_0001
2016-01-14 16:08:19,622 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:19,622 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:19,622 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:19,622 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:19,622 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:19,623 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:19,624 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:19,624 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:19,624 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:19,625 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:19,625 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:19,626 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:19,626 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:19,632 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70/.tez/application_1452787699237_0001
2016-01-14 16:08:19,633 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.429
2016-01-14 16:08:19,726 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_'field2'_'field2'
2016-01-14 16:08:19,763 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:19,763 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:19,832 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-01-14 16:08:19,853 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.045
2016-01-14 16:08:19,854 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:19,854 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:19,854 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:19,872 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:19,873 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field'
2016-01-14 16:08:19,893 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:19,893 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:19,894 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field'"]
2016-01-14 16:08:19,894 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:19,895 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:19,896 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:19,896 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...SULTS.-1_'field2'_'field'
2016-01-14 16:08:19,897 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:19,912 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:19,917 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:19,918 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:19,918 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:19,928 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752/.tez/application_1452787699917_0001 doesn't exist and is created
2016-01-14 16:08:19,954 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:19,954 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:19,955 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752/.tez/application_1452787699917_0001
2016-01-14 16:08:19,961 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787699917_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:19,974 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:19,975 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:19,977 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:19,978 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:19,978 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752/.tez/application_1452787699917_0001/localmode-log-dir
2016-01-14 16:08:19,979 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752/.tez/application_1452787699917_0001/localmode-log-dir/history.txt.appattempt_1452787699917_0001_000000, maxErrors=10
2016-01-14 16:08:19,979 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:19,979 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787699917_0001_000000, appSubmitTime=1452787699960, launchTime=1452787699961
2016-01-14 16:08:19,984 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:19,989 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:19,991 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:19,991 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:19,994 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:46444
2016-01-14 16:08:19,995 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:19,998 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:19,998 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787699917_0001_000000, startTime=1452787699998
2016-01-14 16:08:19,998 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:20,054 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:20,055 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:20,055 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...SULTS.-1_'field2'_'field', applicationId=application_1452787699917_0001, dagName=[57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752] every.every/(1/1) ...SULTS.-1_'field2'_'field'
2016-01-14 16:08:20,075 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752] every.every/(1/1) ...SULTS.-1_'field2'_'field'
2016-01-14 16:08:20,077 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787699917_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752/.tez/application_1452787699917_0001/localmode-log-dir/dag_1452787699917_0001_1.dot
2016-01-14 16:08:20,078 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752/.tez/application_1452787699917_0001/localmode-log-dir/dag_1452787699917_0001_1-tez-dag.pb.txt
2016-01-14 16:08:20,103 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787699917_0001_1
2016-01-14 16:08:20,103 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:20,103 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752] every.every/(1/1) ...SULTS.-1_'field2'_'field'
2016-01-14 16:08:20 Running Dag: dag_1452787699917_0001_1
2016-01-14 16:08:20,116 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787699917_0001_1, submitTime=1452787700076
2016-01-14 16:08:20,117 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:20,117 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E4D5AA5C295A4ED5A28FF485FE5FB206
2016-01-14 16:08:20,117 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:20,117 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787699917_0001_1, initTime=1452787700117
2016-01-14 16:08:20,117 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:20,118 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787699917_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:20,119 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:DAG_STARTED]: dagID=dag_1452787699917_0001_1, startTime=1452787700119
2016-01-14 16:08:20,119 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:20,119 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:20,119 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787699917_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:20,119 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E4D5AA5C295A4ED5A28FF485FE5FB206 : {4B93711BE0BD4AAAAC274BD46CF85015={InputName=4B93711BE0BD4AAAAC274BD46CF85015}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:20,119 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 4B93711BE0BD4AAAAC274BD46CF85015, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:20,120 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,120 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,120 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,120 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]. Starting root input initializers: 1
2016-01-14 16:08:20,121 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:20,122 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 4B93711BE0BD4AAAAC274BD46CF85015 on vertex vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,123 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...SULTS.-1_'field2'_'field', applicationId=application_1452787699917_0001, dagName=[57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752] every.every/(1/1) ...SULTS.-1_'field2'_'field'
2016-01-14 16:08:20,124 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:20,124 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 4B93711BE0BD4AAAAC274BD46CF85015 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:20,126 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:20,126 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:20,128 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:20,129 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 4B93711BE0BD4AAAAC274BD46CF85015 on vertex vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,129 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:20,129 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {4B93711BE0BD4AAAAC274BD46CF85015=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:20,130 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206] parallelism set to 1
2016-01-14 16:08:20,130 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:20,130 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787699917_0001_1_00, eventCount=1
2016-01-14 16:08:20,130 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,131 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=B190C7DE36BA4D8CBE1226ED75F65F11, vertexId=vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:20,131 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=B190C7DE36BA4D8CBE1226ED75F65F11, vertexId=vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,135 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=B190C7DE36BA4D8CBE1226ED75F65F11, vertexName=E4D5AA5C295A4ED5A28FF485FE5FB206, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:20,135 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=B190C7DE36BA4D8CBE1226ED75F65F11, vertexId=vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,137 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:20,137 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E4D5AA5C295A4ED5A28FF485FE5FB206, vertexId=vertex_1452787699917_0001_1_00, initRequestedTime=1452787700119, initedTime=1452787700136, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:20,137 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206] with distanceFromRoot: 0
2016-01-14 16:08:20,138 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:20,138 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E4D5AA5C295A4ED5A28FF485FE5FB206
2016-01-14 16:08:20,138 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,138 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:20,139 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787699917_0001_1_00, startRequestedTime=1452787700138, startedTime=1452787700138
2016-01-14 16:08:20,139 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:20,140 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:20,140 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:TASK_STARTED]: vertexName=E4D5AA5C295A4ED5A28FF485FE5FB206, taskId=task_1452787699917_0001_1_00_000000, scheduledTime=1452787700139, launchTime=1452787700139
2016-01-14 16:08:20,140 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787699917_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:20,140 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,141 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752] every.every/(1/1) ...SULTS.-1_'field2'_'field', VertexName: E4D5AA5C295A4ED5A28FF485FE5FB206, VertexParallelism: 1, TaskAttemptID:attempt_1452787699917_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=4B93711BE0BD4AAAAC274BD46CF85015, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=B190C7DE36BA4D8CBE1226ED75F65F11, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:20,141 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787699917_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:20,141 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:20,143 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:20,143 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:20,143 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:20,144 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787699917_0001_00_000001
2016-01-14 16:08:20,144 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699917_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:20,146 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787699917_0001_00_000001
2016-01-14 16:08:20,147 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:20,148 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699917_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:20,148 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:20,148 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787699917_0001_00_000001, launchTime=1452787700147
2016-01-14 16:08:20,149 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787699917_0001_00_000001
2016-01-14 16:08:20,150 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787699917_0001_1_00_000000_0] to container: [container_1452787699917_0001_00_000001]
2016-01-14 16:08:20,150 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699917_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:20,151 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787699917_0001_00_000001 given task: attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20,151 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787699917_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20,151 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787699917_0001_1_00_000000_0] started. Is using containerId: [container_1452787699917_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:20,151 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787699917_0001, with dag id: dag_1452787699917_0001_1
2016-01-14 16:08:20,152 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:20 Starting to run new task attempt: attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20,151 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E4D5AA5C295A4ED5A28FF485FE5FB206, taskAttemptId=attempt_1452787699917_0001_1_00_000000_0, startTime=1452787700151, containerId=container_1452787699917_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787699917_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:20,152 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20,152 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787699917_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:20,153 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:20,155 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:20,155 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:20,155 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:20,156 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:20,156 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:20,156 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787699917_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:20,156 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752] every.every/(1/1) ...SULTS.-1_'field2'_'field', VertexName: E4D5AA5C295A4ED5A28FF485FE5FB206, VertexParallelism: 1, TaskAttemptID:attempt_1452787699917_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=4B93711BE0BD4AAAAC274BD46CF85015, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=B190C7DE36BA4D8CBE1226ED75F65F11, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:20,157 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:20,157 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20,159 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:20,159 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:20,163 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:20,163 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=B190C7DE36BA4D8CBE1226ED75F65F11, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:20,164 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:20,164 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: B190C7DE36BA4D8CBE1226ED75F65F11
2016-01-14 16:08:20,165 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:20,165 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: B190C7DE36BA4D8CBE1226ED75F65F11
2016-01-14 16:08:20,169 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787699917_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:20,169 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=4B93711BE0BD4AAAAC274BD46CF85015, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:20,170 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:20,172 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:20,172 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 4B93711BE0BD4AAAAC274BD46CF85015
2016-01-14 16:08:20,173 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 4B93711BE0BD4AAAAC274BD46CF85015
2016-01-14 16:08:20,183 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:20,183 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 4B93711BE0BD4AAAAC274BD46CF85015
2016-01-14 16:08:20,183 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 4B93711BE0BD4AAAAC274BD46CF85015
2016-01-14 16:08:20,186 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:20,186 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: B190C7DE36BA4D8CBE1226ED75F65F11
2016-01-14 16:08:20,193 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E4D5AA5C295A4ED5A28FF485FE5FB206, ordinal: 0
2016-01-14 16:08:20,193 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E4D5AA5C295A4ED5A28FF485FE5FB206, mem on start (mb), free: 159, total: 281, max: 672
2016-01-14 16:08:20,194 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:20,194 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:20,194 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:20,195 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:20,195 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:20,195 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:20,196 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:20,196 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:20,196 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:20,197 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:20,197 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:20,197 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, B190C7DE36BA4D8CBE1226ED75F65F11, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:20,198 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 4B93711BE0BD4AAAAC274BD46CF85015, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:20,198 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:20,198 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 4B93711BE0BD4AAAAC274BD46CF85015 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:20,198 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 4B93711BE0BD4AAAAC274BD46CF85015
2016-01-14 16:08:20,199 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:20,199 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 4B93711BE0BD4AAAAC274BD46CF85015
2016-01-14 16:08:20,199 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:20,200 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:20,201 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:20,201 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20,201 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:20,203 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@22fc32f0
2016-01-14 16:08:20,204 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@22fc32f0
2016-01-14 16:08:20,205 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:20,206 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:20,207 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:20,208 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 4B93711BE0BD4AAAAC274BD46CF85015
2016-01-14 16:08:20,208 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field'"], id: B190C7DE36BA4D8CBE1226ED75F65F11
2016-01-14 16:08:20,208 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field'"]
2016-01-14 16:08:20,209 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:20,210 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:20,210 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E4D5AA5C295A4ED5A28FF485FE5FB206, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:20,213 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:20,214 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:20,214 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20,215 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787699917_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:20,216 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20,216 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E4D5AA5C295A4ED5A28FF485FE5FB206, mem on close (mb), free: 157, total: 281, max: 672
2016-01-14 16:08:20 Completed running task attempt: attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20,218 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787699917_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:20,221 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787700210, Process_Duration=6, Process_End_Time=1452787700216, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:20,221 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:20,222 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E4D5AA5C295A4ED5A28FF485FE5FB206, taskAttemptId=attempt_1452787699917_0001_1_00_000000_0, startTime=1452787700151, finishTime=1452787700221, timeTaken=70, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787700210, Process_Duration=6, Process_End_Time=1452787700216, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:20,222 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787699917_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:20,222 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20,222 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:20,223 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:20,223 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:20,224 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:20,224 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:TASK_FINISHED]: vertexName=E4D5AA5C295A4ED5A28FF485FE5FB206, taskId=task_1452787699917_0001_1_00_000000, startTime=1452787700151, finishTime=1452787700223, timeTaken=72, status=SUCCEEDED, successfulAttemptID=attempt_1452787699917_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787700210, Process_Duration=6, Process_End_Time=1452787700216, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:20,226 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787699917_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:20,226 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206] : 1
2016-01-14 16:08:20,226 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,226 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787699917_0001_00_000001
2016-01-14 16:08:20,228 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:20,229 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:VERTEX_FINISHED]: vertexName=E4D5AA5C295A4ED5A28FF485FE5FB206, vertexId=vertex_1452787699917_0001_1_00, initRequestedTime=1452787700119, initedTime=1452787700136, startRequestedTime=1452787700138, startedTime=1452787700138, finishTime=1452787700226, timeTaken=88, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787700210, Process_Duration=6, Process_End_Time=1452787700216, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787700151, firstTasksToStart=[ task_1452787699917_0001_1_00_000000 ], lastTaskFinishTime=1452787700221, lastTasksToFinish=[ task_1452787699917_0001_1_00_000000 ], minTaskDuration=70, maxTaskDuration=70, avgTaskDuration=70.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787699917_0001_1_00_000000 ], longestDurationTasks=[ task_1452787699917_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:20,229 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:20,229 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699917_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:20,230 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:20,230 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787699917_0001_00_000001, stoppedTime=1452787700230, exitStatus=0
2016-01-14 16:08:20,232 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699917_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:20,233 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:20,233 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787699917_0001_1
2016-01-14 16:08:20,233 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787699917_0001_1
2016-01-14 16:08:20,233 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: B190C7DE36BA4D8CBE1226ED75F65F11 for vertex: vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,237 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787699917_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:20,238 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787699917_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:20,238 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787699917_0001_00_000001, Exiting
2016-01-14 16:08:20,238 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787699917_0001_00_000001
2016-01-14 16:08:20,238 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787699917_0001_00_000001
2016-01-14 16:08:20,242 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787699917_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:20,242 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787699917_0001_00_000001 completed successfully
2016-01-14 16:08:20,248 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787699917_0001_1, queueSize=0
2016-01-14 16:08:20,248 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:20,248 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787699917_0001_1, startTime=1452787700119, finishTime=1452787700246, timeTaken=127, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787700210, Process_Duration=6, Process_End_Time=1452787700216, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:20,249 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787699917_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:20,249 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787699917_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:20,250 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787699917_0001_00_000001
2016-01-14 16:08:20,250 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699917_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:20 Completed Dag: dag_1452787699917_0001_1
2016-01-14 16:08:20,253 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787699917_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:20,253 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787699917_0001_1_post
2016-01-14 16:08:20,253 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:20,254 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:20,260 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...SULTS.-1_'field2'_'field', applicationId=application_1452787699917_0001
2016-01-14 16:08:20,262 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:20,263 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:20,263 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:20,263 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:20,263 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:20,263 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:20,264 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:20,264 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:20,264 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:20,264 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:20,264 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:20,265 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:20,265 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:20,270 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752/.tez/application_1452787699917_0001
2016-01-14 16:08:20,271 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.378
2016-01-14 16:08:20,392 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_'field2'_'field'
2016-01-14 16:08:20,418 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:20,419 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:20,469 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.021
2016-01-14 16:08:20,474 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.026
2016-01-14 16:08:20,475 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:20,476 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:20,476 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:20,495 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:20,496 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_RESULTS
2016-01-14 16:08:20,514 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:20,514 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:20,514 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_RESULTS"]
2016-01-14 16:08:20,514 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:20,514 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:20,515 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:20,515 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...SULTS.-1_'field2'_RESULTS
2016-01-14 16:08:20,516 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:20,531 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:20,536 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:20,537 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:20,537 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:20,547 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81/.tez/application_1452787700536_0001 doesn't exist and is created
2016-01-14 16:08:20,565 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:20,565 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:20,566 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81/.tez/application_1452787700536_0001
2016-01-14 16:08:20,570 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787700536_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:20,582 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:20,583 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:20,584 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:20,585 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:20,585 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81/.tez/application_1452787700536_0001/localmode-log-dir
2016-01-14 16:08:20,585 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81/.tez/application_1452787700536_0001/localmode-log-dir/history.txt.appattempt_1452787700536_0001_000000, maxErrors=10
2016-01-14 16:08:20,585 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:20,586 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787700536_0001_000000, appSubmitTime=1452787700570, launchTime=1452787700570
2016-01-14 16:08:20,592 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:20,593 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:55570
2016-01-14 16:08:20,595 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:20,596 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:20,596 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:20,597 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:20,599 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787700536_0001_000000, startTime=1452787700599
2016-01-14 16:08:20,599 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:20,600 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:20,666 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:20,666 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:20,666 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...SULTS.-1_'field2'_RESULTS, applicationId=application_1452787700536_0001, dagName=[3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81] every.every/(1/1) ...SULTS.-1_'field2'_RESULTS
2016-01-14 16:08:20,685 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81] every.every/(1/1) ...SULTS.-1_'field2'_RESULTS
2016-01-14 16:08:20,687 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787700536_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81/.tez/application_1452787700536_0001/localmode-log-dir/dag_1452787700536_0001_1.dot
2016-01-14 16:08:20,688 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81/.tez/application_1452787700536_0001/localmode-log-dir/dag_1452787700536_0001_1-tez-dag.pb.txt
2016-01-14 16:08:20,711 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787700536_0001_1
2016-01-14 16:08:20,711 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:20,711 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81] every.every/(1/1) ...SULTS.-1_'field2'_RESULTS
2016-01-14 16:08:20 Running Dag: dag_1452787700536_0001_1
2016-01-14 16:08:20,725 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787700536_0001_1, submitTime=1452787700685
2016-01-14 16:08:20,725 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:20,725 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex B62DA04B2C114C44B408B32F00886226
2016-01-14 16:08:20,725 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:20,726 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787700536_0001_1, initTime=1452787700725
2016-01-14 16:08:20,726 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787700536_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:20,726 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:20,727 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:DAG_STARTED]: dagID=dag_1452787700536_0001_1, startTime=1452787700727
2016-01-14 16:08:20,727 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:20,727 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:20,728 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787700536_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:20,728 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: B62DA04B2C114C44B408B32F00886226 : {3446956DAEA74FC688039AA475862FA6={InputName=3446956DAEA74FC688039AA475862FA6}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:20,728 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 3446956DAEA74FC688039AA475862FA6, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:20,728 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,728 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,728 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,729 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]. Starting root input initializers: 1
2016-01-14 16:08:20,729 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:20,729 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 3446956DAEA74FC688039AA475862FA6 on vertex vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,730 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...SULTS.-1_'field2'_RESULTS, applicationId=application_1452787700536_0001, dagName=[3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81] every.every/(1/1) ...SULTS.-1_'field2'_RESULTS
2016-01-14 16:08:20,731 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:20,731 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 3446956DAEA74FC688039AA475862FA6 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:20,732 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:20,733 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:20,735 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:20,735 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 3446956DAEA74FC688039AA475862FA6 on vertex vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,735 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:20,735 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {3446956DAEA74FC688039AA475862FA6=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:20,736 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226] parallelism set to 1
2016-01-14 16:08:20,736 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:20,737 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787700536_0001_1_00, eventCount=1
2016-01-14 16:08:20,737 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,737 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=07A28693682745118BDE55BF4ADA3676, vertexId=vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:20,738 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=07A28693682745118BDE55BF4ADA3676, vertexId=vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,739 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=07A28693682745118BDE55BF4ADA3676, vertexName=B62DA04B2C114C44B408B32F00886226, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:20,739 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=07A28693682745118BDE55BF4ADA3676, vertexId=vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,741 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:20,741 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B62DA04B2C114C44B408B32F00886226, vertexId=vertex_1452787700536_0001_1_00, initRequestedTime=1452787700728, initedTime=1452787700740, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:20,741 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226] with distanceFromRoot: 0
2016-01-14 16:08:20,741 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:20,741 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in B62DA04B2C114C44B408B32F00886226
2016-01-14 16:08:20,741 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,742 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:20,742 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787700536_0001_1_00, startRequestedTime=1452787700741, startedTime=1452787700741
2016-01-14 16:08:20,742 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:20,743 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:20,743 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:TASK_STARTED]: vertexName=B62DA04B2C114C44B408B32F00886226, taskId=task_1452787700536_0001_1_00_000000, scheduledTime=1452787700743, launchTime=1452787700743
2016-01-14 16:08:20,744 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787700536_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:20,744 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,744 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81] every.every/(1/1) ...SULTS.-1_'field2'_RESULTS, VertexName: B62DA04B2C114C44B408B32F00886226, VertexParallelism: 1, TaskAttemptID:attempt_1452787700536_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=3446956DAEA74FC688039AA475862FA6, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=07A28693682745118BDE55BF4ADA3676, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:20,745 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787700536_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:20,745 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:20,748 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:20,749 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:20,749 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:20,749 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787700536_0001_00_000001
2016-01-14 16:08:20,749 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787700536_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:20,751 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787700536_0001_00_000001
2016-01-14 16:08:20,752 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:20,753 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787700536_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:20,753 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:20,754 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787700536_0001_00_000001, launchTime=1452787700753
2016-01-14 16:08:20,754 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787700536_0001_00_000001
2016-01-14 16:08:20,755 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787700536_0001, with dag id: dag_1452787700536_0001_1
2016-01-14 16:08:20,755 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787700536_0001_1_00_000000_0] to container: [container_1452787700536_0001_00_000001]
2016-01-14 16:08:20,755 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787700536_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:20,757 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787700536_0001_00_000001 given task: attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20,757 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787700536_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20,757 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787700536_0001_1_00_000000_0] started. Is using containerId: [container_1452787700536_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:20,758 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B62DA04B2C114C44B408B32F00886226, taskAttemptId=attempt_1452787700536_0001_1_00_000000_0, startTime=1452787700757, containerId=container_1452787700536_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787700536_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:20,758 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787700536_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:20,758 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787700536_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:20,758 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:20 Starting to run new task attempt: attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20,761 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20,761 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:20,761 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:20,761 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:20,761 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:20,762 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:20,762 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:20,762 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81] every.every/(1/1) ...SULTS.-1_'field2'_RESULTS, VertexName: B62DA04B2C114C44B408B32F00886226, VertexParallelism: 1, TaskAttemptID:attempt_1452787700536_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=3446956DAEA74FC688039AA475862FA6, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=07A28693682745118BDE55BF4ADA3676, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:20,763 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:20,763 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20,764 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:20,764 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:20,765 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:20,765 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=3446956DAEA74FC688039AA475862FA6, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:20,768 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:20,768 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:20,767 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=07A28693682745118BDE55BF4ADA3676, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:20,766 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787700536_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:20,769 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 3446956DAEA74FC688039AA475862FA6
2016-01-14 16:08:20,771 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 3446956DAEA74FC688039AA475862FA6
2016-01-14 16:08:20,771 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:20,772 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 07A28693682745118BDE55BF4ADA3676
2016-01-14 16:08:20,772 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:20,772 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 07A28693682745118BDE55BF4ADA3676
2016-01-14 16:08:20,777 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:20,777 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 3446956DAEA74FC688039AA475862FA6
2016-01-14 16:08:20,778 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 3446956DAEA74FC688039AA475862FA6
2016-01-14 16:08:20,784 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B62DA04B2C114C44B408B32F00886226, ordinal: 0
2016-01-14 16:08:20,785 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B62DA04B2C114C44B408B32F00886226, mem on start (mb), free: 298, total: 387, max: 672
2016-01-14 16:08:20,785 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:20,785 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:20,786 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:20,793 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:20,793 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 07A28693682745118BDE55BF4ADA3676
2016-01-14 16:08:20,793 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:20,793 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:20,793 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:20,793 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:20,793 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:20,793 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:20,793 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:20,794 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:20,794 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 3446956DAEA74FC688039AA475862FA6, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:20,794 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 07A28693682745118BDE55BF4ADA3676, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:20,794 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:20,795 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 3446956DAEA74FC688039AA475862FA6 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:20,795 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:20,795 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:20,795 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 3446956DAEA74FC688039AA475862FA6
2016-01-14 16:08:20,796 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:20,796 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 3446956DAEA74FC688039AA475862FA6
2016-01-14 16:08:20,796 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:20,797 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20,798 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:20,799 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@5b52e370
2016-01-14 16:08:20,800 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:20,801 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 3446956DAEA74FC688039AA475862FA6
2016-01-14 16:08:20,801 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_RESULTS"], id: 07A28693682745118BDE55BF4ADA3676
2016-01-14 16:08:20,801 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@5b52e370
2016-01-14 16:08:20,801 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:20,801 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:20,801 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_RESULTS"]
2016-01-14 16:08:20,802 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:20,803 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:20,803 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B62DA04B2C114C44B408B32F00886226, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:20,805 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:20,806 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:20,807 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20,807 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787700536_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:20,808 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20,808 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B62DA04B2C114C44B408B32F00886226, mem on close (mb), free: 296, total: 387, max: 672
2016-01-14 16:08:20 Completed running task attempt: attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20,810 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787700536_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:20,811 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787700803, Process_Duration=5, Process_End_Time=1452787700808, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:20,811 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:20,812 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:20,812 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B62DA04B2C114C44B408B32F00886226, taskAttemptId=attempt_1452787700536_0001_1_00_000000_0, startTime=1452787700757, finishTime=1452787700811, timeTaken=54, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787700803, Process_Duration=5, Process_End_Time=1452787700808, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:20,813 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787700536_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:20,813 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:20,813 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:20,813 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787700536_0001_00_000001
2016-01-14 16:08:20,813 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20,816 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:20,816 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:TASK_FINISHED]: vertexName=B62DA04B2C114C44B408B32F00886226, taskId=task_1452787700536_0001_1_00_000000, startTime=1452787700757, finishTime=1452787700815, timeTaken=58, status=SUCCEEDED, successfulAttemptID=attempt_1452787700536_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787700803, Process_Duration=5, Process_End_Time=1452787700808, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:20,816 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787700536_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:20,816 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226] : 1
2016-01-14 16:08:20,816 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,817 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:20,818 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:VERTEX_FINISHED]: vertexName=B62DA04B2C114C44B408B32F00886226, vertexId=vertex_1452787700536_0001_1_00, initRequestedTime=1452787700728, initedTime=1452787700740, startRequestedTime=1452787700741, startedTime=1452787700741, finishTime=1452787700817, timeTaken=76, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787700803, Process_Duration=5, Process_End_Time=1452787700808, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787700757, firstTasksToStart=[ task_1452787700536_0001_1_00_000000 ], lastTaskFinishTime=1452787700811, lastTasksToFinish=[ task_1452787700536_0001_1_00_000000 ], minTaskDuration=54, maxTaskDuration=54, avgTaskDuration=54.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787700536_0001_1_00_000000 ], longestDurationTasks=[ task_1452787700536_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:20,818 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:20,819 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787700536_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:20,819 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787700536_0001_00_000001, stoppedTime=1452787700819, exitStatus=0
2016-01-14 16:08:20,819 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787700536_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:20,819 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:20,820 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787700536_0001_1
2016-01-14 16:08:20,821 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787700536_0001_1
2016-01-14 16:08:20,821 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 07A28693682745118BDE55BF4ADA3676 for vertex: vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,819 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:20,825 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787700536_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:20,826 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787700536_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:20,826 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787700536_0001_00_000001, Exiting
2016-01-14 16:08:20,826 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787700536_0001_00_000001
2016-01-14 16:08:20,826 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787700536_0001_00_000001
2016-01-14 16:08:20,828 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787700536_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:20,828 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787700536_0001_00_000001 completed successfully
2016-01-14 16:08:20,832 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787700536_0001_1, queueSize=0
2016-01-14 16:08:20,832 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:20,833 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787700536_0001_1, startTime=1452787700727, finishTime=1452787700831, timeTaken=104, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787700803, Process_Duration=5, Process_End_Time=1452787700808, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:20,833 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787700536_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:20,833 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787700536_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:20,833 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787700536_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:20,833 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787700536_0001_00_000001
2016-01-14 16:08:20 Completed Dag: dag_1452787700536_0001_1
2016-01-14 16:08:20,834 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787700536_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:20,835 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787700536_0001_1_post
2016-01-14 16:08:20,835 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:20,835 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:20,842 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...SULTS.-1_'field2'_RESULTS, applicationId=application_1452787700536_0001
2016-01-14 16:08:20,847 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:20,847 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:20,847 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:20,847 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:20,847 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:20,848 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:20,848 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:20,848 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:20,850 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:20,850 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:20,850 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:20,851 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:20,851 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:20,857 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81/.tez/application_1452787700536_0001
2016-01-14 16:08:20,857 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.343
2016-01-14 16:08:20,935 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_'field2'_RESULTS
2016-01-14 16:08:20,960 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:20,961 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:21,017 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-01-14 16:08:21,030 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.035
2016-01-14 16:08:21,031 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:21,031 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:21,031 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:21,050 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:21,051 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:21,062 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:21,063 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:21,063 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_ALL"]
2016-01-14 16:08:21,064 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:21,064 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:21,064 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:21,066 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:21,066 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:21,079 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:21,083 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:21,083 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:21,083 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:21,093 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F/.tez/application_1452787701083_0001 doesn't exist and is created
2016-01-14 16:08:21,109 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:21,109 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:21,109 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F/.tez/application_1452787701083_0001
2016-01-14 16:08:21,113 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787701083_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:21,125 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:21,126 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:21,128 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:21,128 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:21,128 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F/.tez/application_1452787701083_0001/localmode-log-dir
2016-01-14 16:08:21,128 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F/.tez/application_1452787701083_0001/localmode-log-dir/history.txt.appattempt_1452787701083_0001_000000, maxErrors=10
2016-01-14 16:08:21,128 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:21,129 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787701083_0001_000000, appSubmitTime=1452787701112, launchTime=1452787701112
2016-01-14 16:08:21,133 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:21,136 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:21,137 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:58619
2016-01-14 16:08:21,137 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:21,139 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:21,140 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:21,142 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787701083_0001_000000, startTime=1452787701142
2016-01-14 16:08:21,142 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:21,142 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:21,209 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:21,209 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:21,210 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...'_RESULTS.-1_'field2'_ALL, applicationId=application_1452787701083_0001, dagName=[35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F] every.every/(1/1) ...'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:21,231 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F] every.every/(1/1) ...'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:21,233 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787701083_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F/.tez/application_1452787701083_0001/localmode-log-dir/dag_1452787701083_0001_1.dot
2016-01-14 16:08:21,234 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F/.tez/application_1452787701083_0001/localmode-log-dir/dag_1452787701083_0001_1-tez-dag.pb.txt
2016-01-14 16:08:21,253 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787701083_0001_1
2016-01-14 16:08:21,254 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:21,254 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F] every.every/(1/1) ...'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:21 Running Dag: dag_1452787701083_0001_1
2016-01-14 16:08:21,267 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787701083_0001_1, submitTime=1452787701231
2016-01-14 16:08:21,267 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:21,267 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex BBFD17641189442CA3522A7F85558F2E
2016-01-14 16:08:21,268 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:21,268 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787701083_0001_1, initTime=1452787701267
2016-01-14 16:08:21,269 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787701083_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:21,269 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:21,270 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:DAG_STARTED]: dagID=dag_1452787701083_0001_1, startTime=1452787701269
2016-01-14 16:08:21,270 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:21,270 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:21,270 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787701083_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:21,270 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: BBFD17641189442CA3522A7F85558F2E : {C26AEA7100A1422CBCE82357896F09C1={InputName=C26AEA7100A1422CBCE82357896F09C1}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:21,270 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: C26AEA7100A1422CBCE82357896F09C1, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:21,271 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,271 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,271 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,272 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...'_RESULTS.-1_'field2'_ALL, applicationId=application_1452787701083_0001, dagName=[35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F] every.every/(1/1) ...'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:21,272 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]. Starting root input initializers: 1
2016-01-14 16:08:21,272 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:21,273 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: C26AEA7100A1422CBCE82357896F09C1 on vertex vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,275 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:21,275 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input C26AEA7100A1422CBCE82357896F09C1 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:21,276 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:21,276 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:21,279 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:21,279 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: C26AEA7100A1422CBCE82357896F09C1 on vertex vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,280 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:21,280 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {C26AEA7100A1422CBCE82357896F09C1=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:21,280 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E] parallelism set to 1
2016-01-14 16:08:21,280 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:21,280 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787701083_0001_1_00, eventCount=1
2016-01-14 16:08:21,281 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,281 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=C0222321DC6B409A9579B76958B0856F, vertexId=vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:21,281 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=C0222321DC6B409A9579B76958B0856F, vertexId=vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,283 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=C0222321DC6B409A9579B76958B0856F, vertexName=BBFD17641189442CA3522A7F85558F2E, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:21,284 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=C0222321DC6B409A9579B76958B0856F, vertexId=vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,285 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:21,286 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:VERTEX_INITIALIZED]: vertexName=BBFD17641189442CA3522A7F85558F2E, vertexId=vertex_1452787701083_0001_1_00, initRequestedTime=1452787701270, initedTime=1452787701285, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:21,286 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E] with distanceFromRoot: 0
2016-01-14 16:08:21,286 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:21,286 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in BBFD17641189442CA3522A7F85558F2E
2016-01-14 16:08:21,287 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,287 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:21,287 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787701083_0001_1_00, startRequestedTime=1452787701286, startedTime=1452787701286
2016-01-14 16:08:21,288 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:21,288 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:21,288 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:TASK_STARTED]: vertexName=BBFD17641189442CA3522A7F85558F2E, taskId=task_1452787701083_0001_1_00_000000, scheduledTime=1452787701288, launchTime=1452787701288
2016-01-14 16:08:21,289 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787701083_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:21,289 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,289 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F] every.every/(1/1) ...'_RESULTS.-1_'field2'_ALL, VertexName: BBFD17641189442CA3522A7F85558F2E, VertexParallelism: 1, TaskAttemptID:attempt_1452787701083_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=C26AEA7100A1422CBCE82357896F09C1, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=C0222321DC6B409A9579B76958B0856F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:21,290 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787701083_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:21,290 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:21,291 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:21,292 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:21,292 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:21,293 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787701083_0001_00_000001
2016-01-14 16:08:21,293 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701083_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:21,296 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787701083_0001_00_000001
2016-01-14 16:08:21,296 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:21,297 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701083_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:21,297 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787701083_0001_00_000001, launchTime=1452787701297
2016-01-14 16:08:21,297 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:21,298 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787701083_0001_00_000001
2016-01-14 16:08:21,299 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787701083_0001_1_00_000000_0] to container: [container_1452787701083_0001_00_000001]
2016-01-14 16:08:21,299 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701083_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:21,299 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787701083_0001_00_000001 given task: attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21,299 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787701083_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21,300 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787701083_0001_1_00_000000_0] started. Is using containerId: [container_1452787701083_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:21,300 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=BBFD17641189442CA3522A7F85558F2E, taskAttemptId=attempt_1452787701083_0001_1_00_000000_0, startTime=1452787701299, containerId=container_1452787701083_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787701083_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:21 Starting to run new task attempt: attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21,300 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787701083_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:21,300 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21,300 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:21,300 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:21,301 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:21,300 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787701083_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:21,301 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:21,301 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:21,301 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:21,301 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:21,301 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F] every.every/(1/1) ...'_RESULTS.-1_'field2'_ALL, VertexName: BBFD17641189442CA3522A7F85558F2E, VertexParallelism: 1, TaskAttemptID:attempt_1452787701083_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=C26AEA7100A1422CBCE82357896F09C1, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=C0222321DC6B409A9579B76958B0856F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:21,302 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:21,302 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21,304 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:21,304 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:21,305 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=C26AEA7100A1422CBCE82357896F09C1, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:21,305 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=C0222321DC6B409A9579B76958B0856F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:21,306 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:21,305 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:21,306 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: C26AEA7100A1422CBCE82357896F09C1
2016-01-14 16:08:21,307 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: C26AEA7100A1422CBCE82357896F09C1
2016-01-14 16:08:21,307 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787701083_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:21,309 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787701083_0001, with dag id: dag_1452787701083_0001_1
2016-01-14 16:08:21,306 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:21,310 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: C0222321DC6B409A9579B76958B0856F
2016-01-14 16:08:21,310 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:21,310 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: C0222321DC6B409A9579B76958B0856F
2016-01-14 16:08:21,316 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:21,317 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:21,317 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: C26AEA7100A1422CBCE82357896F09C1
2016-01-14 16:08:21,317 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: C26AEA7100A1422CBCE82357896F09C1
2016-01-14 16:08:21,329 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:21,330 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: C0222321DC6B409A9579B76958B0856F
2016-01-14 16:08:21,335 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: BBFD17641189442CA3522A7F85558F2E, ordinal: 0
2016-01-14 16:08:21,335 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BBFD17641189442CA3522A7F85558F2E, mem on start (mb), free: 217, total: 387, max: 672
2016-01-14 16:08:21,335 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:21,335 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:21,335 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:21,335 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:21,336 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:21,336 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:21,337 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:21,337 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:21,337 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:21,338 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:21,338 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:21,338 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, C26AEA7100A1422CBCE82357896F09C1, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:21,339 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, C0222321DC6B409A9579B76958B0856F, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:21,339 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:21,339 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: C26AEA7100A1422CBCE82357896F09C1
2016-01-14 16:08:21,339 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:21,339 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: C26AEA7100A1422CBCE82357896F09C1
2016-01-14 16:08:21,340 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: C26AEA7100A1422CBCE82357896F09C1 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:21,340 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:21,340 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:21,341 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:21,341 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21,341 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:21,342 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@20ea1c31
2016-01-14 16:08:21,344 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@20ea1c31
2016-01-14 16:08:21,344 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:21,344 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:21,346 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:21,347 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: C26AEA7100A1422CBCE82357896F09C1
2016-01-14 16:08:21,347 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_ALL"], id: C0222321DC6B409A9579B76958B0856F
2016-01-14 16:08:21,348 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_ALL"]
2016-01-14 16:08:21,348 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:21,348 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:21,348 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: BBFD17641189442CA3522A7F85558F2E, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:21,351 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:21,351 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:21,352 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21,352 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787701083_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:21,353 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21,353 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BBFD17641189442CA3522A7F85558F2E, mem on close (mb), free: 215, total: 387, max: 672
2016-01-14 16:08:21 Completed running task attempt: attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21,354 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787701083_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:21,355 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787701349, Process_Duration=4, Process_End_Time=1452787701353, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:21,356 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=BBFD17641189442CA3522A7F85558F2E, taskAttemptId=attempt_1452787701083_0001_1_00_000000_0, startTime=1452787701299, finishTime=1452787701355, timeTaken=56, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787701349, Process_Duration=4, Process_End_Time=1452787701353, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:21,356 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:21,357 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787701083_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:21,356 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:21,357 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:21,357 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:21,357 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21,359 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:TASK_FINISHED]: vertexName=BBFD17641189442CA3522A7F85558F2E, taskId=task_1452787701083_0001_1_00_000000, startTime=1452787701299, finishTime=1452787701358, timeTaken=59, status=SUCCEEDED, successfulAttemptID=attempt_1452787701083_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787701349, Process_Duration=4, Process_End_Time=1452787701353, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:21,359 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787701083_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:21,360 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E] : 1
2016-01-14 16:08:21,360 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,360 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:21,360 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787701083_0001_00_000001
2016-01-14 16:08:21,362 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:21,363 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:VERTEX_FINISHED]: vertexName=BBFD17641189442CA3522A7F85558F2E, vertexId=vertex_1452787701083_0001_1_00, initRequestedTime=1452787701270, initedTime=1452787701285, startRequestedTime=1452787701286, startedTime=1452787701286, finishTime=1452787701360, timeTaken=74, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787701349, Process_Duration=4, Process_End_Time=1452787701353, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787701299, firstTasksToStart=[ task_1452787701083_0001_1_00_000000 ], lastTaskFinishTime=1452787701355, lastTasksToFinish=[ task_1452787701083_0001_1_00_000000 ], minTaskDuration=56, maxTaskDuration=56, avgTaskDuration=56.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787701083_0001_1_00_000000 ], longestDurationTasks=[ task_1452787701083_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:21,363 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:21,363 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701083_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:21,363 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787701083_0001_00_000001, stoppedTime=1452787701363, exitStatus=0
2016-01-14 16:08:21,363 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:21,364 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701083_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:21,364 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:21,364 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787701083_0001_1
2016-01-14 16:08:21,365 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787701083_0001_1
2016-01-14 16:08:21,365 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: C0222321DC6B409A9579B76958B0856F for vertex: vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,372 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787701083_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:21,372 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787701083_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:21,372 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787701083_0001_00_000001, Exiting
2016-01-14 16:08:21,372 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787701083_0001_00_000001
2016-01-14 16:08:21,372 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787701083_0001_00_000001
2016-01-14 16:08:21,375 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787701083_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:21,376 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787701083_0001_00_000001 completed successfully
2016-01-14 16:08:21,376 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787701083_0001_1, queueSize=0
2016-01-14 16:08:21,376 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:21,376 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787701083_0001_1, startTime=1452787701269, finishTime=1452787701374, timeTaken=105, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787701349, Process_Duration=4, Process_End_Time=1452787701353, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:21,377 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787701083_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:21,377 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787701083_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:21,377 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787701083_0001_00_000001
2016-01-14 16:08:21,377 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701083_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:21 Completed Dag: dag_1452787701083_0001_1
2016-01-14 16:08:21,379 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787701083_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:21,379 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787701083_0001_1_post
2016-01-14 16:08:21,379 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:21,380 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:21,384 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...'_RESULTS.-1_'field2'_ALL, applicationId=application_1452787701083_0001
2016-01-14 16:08:21,386 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:21,386 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:21,387 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:21,387 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:21,387 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:21,388 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:21,388 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:21,388 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:21,388 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:21,389 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:21,389 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:21,390 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:21,390 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:21,395 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F/.tez/application_1452787701083_0001
2016-01-14 16:08:21,395 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.333
2016-01-14 16:08:21,489 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:21,524 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:21,526 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:21,583 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-01-14 16:08:21,589 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.026
2016-01-14 16:08:21,590 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:21,590 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:21,591 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:21,614 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:21,616 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:21,630 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:21,630 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:21,631 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_-1"]
2016-01-14 16:08:21,631 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:21,631 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:21,631 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:21,632 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ld'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:21,632 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:21,650 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:21,656 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:21,657 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:21,657 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:21,667 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9/.tez/application_1452787701656_0001 doesn't exist and is created
2016-01-14 16:08:21,685 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:21,685 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:21,685 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9/.tez/application_1452787701656_0001
2016-01-14 16:08:21,689 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787701656_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:21,705 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:21,706 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:21,708 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:21,708 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:21,709 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9/.tez/application_1452787701656_0001/localmode-log-dir
2016-01-14 16:08:21,709 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9/.tez/application_1452787701656_0001/localmode-log-dir/history.txt.appattempt_1452787701656_0001_000000, maxErrors=10
2016-01-14 16:08:21,709 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:21,710 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787701656_0001_000000, appSubmitTime=1452787701689, launchTime=1452787701689
2016-01-14 16:08:21,714 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:21,716 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:21,717 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:21,718 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:21,722 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:43625
2016-01-14 16:08:21,725 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:21,728 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787701656_0001_000000, startTime=1452787701728
2016-01-14 16:08:21,728 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:21,728 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:21,785 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:21,785 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:21,786 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1, applicationId=application_1452787701656_0001, dagName=[175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9] every.every/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:21,811 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9] every.every/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:21,813 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787701656_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9/.tez/application_1452787701656_0001/localmode-log-dir/dag_1452787701656_0001_1.dot
2016-01-14 16:08:21,814 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9/.tez/application_1452787701656_0001/localmode-log-dir/dag_1452787701656_0001_1-tez-dag.pb.txt
2016-01-14 16:08:21,862 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787701656_0001_1
2016-01-14 16:08:21,863 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:21,863 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9] every.every/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:21 Running Dag: dag_1452787701656_0001_1
2016-01-14 16:08:21,880 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787701656_0001_1, submitTime=1452787701811
2016-01-14 16:08:21,880 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:21,881 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex FA5EC746EBF84D1494D061EF6FBA33ED
2016-01-14 16:08:21,881 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:21,882 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787701656_0001_1, initTime=1452787701880
2016-01-14 16:08:21,882 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:21,883 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787701656_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:21,883 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:DAG_STARTED]: dagID=dag_1452787701656_0001_1, startTime=1452787701883
2016-01-14 16:08:21,884 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:21,883 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:21,884 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787701656_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:21,885 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: FA5EC746EBF84D1494D061EF6FBA33ED : {D347A587508E49818C096A89A533073E={InputName=D347A587508E49818C096A89A533073E}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:21,885 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: D347A587508E49818C096A89A533073E, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:21,885 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,885 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,885 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,886 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]. Starting root input initializers: 1
2016-01-14 16:08:21,886 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:21,887 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: D347A587508E49818C096A89A533073E on vertex vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,889 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1, applicationId=application_1452787701656_0001, dagName=[175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9] every.every/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:21,889 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:21,889 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input D347A587508E49818C096A89A533073E asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:21,890 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:21,890 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:21,893 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:21,895 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: D347A587508E49818C096A89A533073E on vertex vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,896 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:21,896 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {D347A587508E49818C096A89A533073E=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:21,896 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED] parallelism set to 1
2016-01-14 16:08:21,896 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:21,897 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787701656_0001_1_00, eventCount=1
2016-01-14 16:08:21,897 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,898 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=102790C3E0694CAB8CFD774F8CCBB7B4, vertexId=vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:21,898 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=102790C3E0694CAB8CFD774F8CCBB7B4, vertexId=vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,901 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=102790C3E0694CAB8CFD774F8CCBB7B4, vertexName=FA5EC746EBF84D1494D061EF6FBA33ED, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:21,901 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=102790C3E0694CAB8CFD774F8CCBB7B4, vertexId=vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,903 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:21,903 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:VERTEX_INITIALIZED]: vertexName=FA5EC746EBF84D1494D061EF6FBA33ED, vertexId=vertex_1452787701656_0001_1_00, initRequestedTime=1452787701885, initedTime=1452787701902, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:21,903 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED] with distanceFromRoot: 0
2016-01-14 16:08:21,904 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:21,904 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in FA5EC746EBF84D1494D061EF6FBA33ED
2016-01-14 16:08:21,904 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,905 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:21,905 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787701656_0001_1_00, startRequestedTime=1452787701904, startedTime=1452787701904
2016-01-14 16:08:21,905 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:21,906 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:21,906 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:TASK_STARTED]: vertexName=FA5EC746EBF84D1494D061EF6FBA33ED, taskId=task_1452787701656_0001_1_00_000000, scheduledTime=1452787701906, launchTime=1452787701906
2016-01-14 16:08:21,907 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787701656_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:21,907 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,907 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9] every.every/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1, VertexName: FA5EC746EBF84D1494D061EF6FBA33ED, VertexParallelism: 1, TaskAttemptID:attempt_1452787701656_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=D347A587508E49818C096A89A533073E, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=102790C3E0694CAB8CFD774F8CCBB7B4, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:21,908 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787701656_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:21,908 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:21,909 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:21,910 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:21,910 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:21,911 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787701656_0001_00_000001
2016-01-14 16:08:21,911 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701656_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:21,917 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787701656_0001_00_000001
2016-01-14 16:08:21,917 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:21,918 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701656_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:21,918 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:21,918 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787701656_0001_00_000001, launchTime=1452787701918
2016-01-14 16:08:21,919 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787701656_0001_00_000001
2016-01-14 16:08:21,921 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787701656_0001_1_00_000000_0] to container: [container_1452787701656_0001_00_000001]
2016-01-14 16:08:21,921 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701656_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:21,921 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787701656_0001_00_000001 given task: attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21,922 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787701656_0001_00_000001: 1 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21,922 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787701656_0001_1_00_000000_0] started. Is using containerId: [container_1452787701656_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:21 Starting to run new task attempt: attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21,922 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=FA5EC746EBF84D1494D061EF6FBA33ED, taskAttemptId=attempt_1452787701656_0001_1_00_000000_0, startTime=1452787701922, containerId=container_1452787701656_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787701656_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:21,922 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21,922 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787701656_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:21,923 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787701656_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:21,923 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:21,923 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:21,923 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:21,923 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:21,923 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:21,924 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:21,924 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:21,924 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9] every.every/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1, VertexName: FA5EC746EBF84D1494D061EF6FBA33ED, VertexParallelism: 1, TaskAttemptID:attempt_1452787701656_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=D347A587508E49818C096A89A533073E, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=102790C3E0694CAB8CFD774F8CCBB7B4, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:21,924 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:21,926 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787701656_0001, with dag id: dag_1452787701656_0001_1
2016-01-14 16:08:21,929 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21,929 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:21,930 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:21,931 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787701656_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:21,934 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=D347A587508E49818C096A89A533073E, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:21,935 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:21,936 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: D347A587508E49818C096A89A533073E
2016-01-14 16:08:21,935 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:21,937 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=102790C3E0694CAB8CFD774F8CCBB7B4, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:21,940 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:21,940 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:21,942 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 102790C3E0694CAB8CFD774F8CCBB7B4
2016-01-14 16:08:21,943 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:21,943 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: D347A587508E49818C096A89A533073E
2016-01-14 16:08:21,943 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 102790C3E0694CAB8CFD774F8CCBB7B4
2016-01-14 16:08:21,952 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:21,952 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: D347A587508E49818C096A89A533073E
2016-01-14 16:08:21,953 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: D347A587508E49818C096A89A533073E
2016-01-14 16:08:21,957 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: FA5EC746EBF84D1494D061EF6FBA33ED, ordinal: 0
2016-01-14 16:08:21,957 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FA5EC746EBF84D1494D061EF6FBA33ED, mem on start (mb), free: 341, total: 386, max: 672
2016-01-14 16:08:21,957 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:21,958 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:21,958 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:21,963 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:21,963 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 102790C3E0694CAB8CFD774F8CCBB7B4
2016-01-14 16:08:21,963 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:21,964 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:21,964 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:21,964 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:21,964 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:21,965 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:21,965 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:21,965 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:21,965 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, D347A587508E49818C096A89A533073E, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:21,965 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 102790C3E0694CAB8CFD774F8CCBB7B4, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:21,965 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:21,966 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: D347A587508E49818C096A89A533073E being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:21,966 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: D347A587508E49818C096A89A533073E
2016-01-14 16:08:21,966 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:21,966 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: D347A587508E49818C096A89A533073E
2016-01-14 16:08:21,967 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:21,967 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:21,968 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:21,968 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21,971 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:21,972 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:21,973 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: D347A587508E49818C096A89A533073E
2016-01-14 16:08:21,974 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_-1"], id: 102790C3E0694CAB8CFD774F8CCBB7B4
2016-01-14 16:08:21,975 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_-1"]
2016-01-14 16:08:21,976 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:21,977 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:21,973 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@4e17c516
2016-01-14 16:08:21,979 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@4e17c516
2016-01-14 16:08:21,979 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:21,979 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:21,980 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: FA5EC746EBF84D1494D061EF6FBA33ED, all 1 inputs ready in: 00:00:00.001
2016-01-14 16:08:21,984 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:21,984 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:21,985 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21,985 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787701656_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:21,986 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21,987 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FA5EC746EBF84D1494D061EF6FBA33ED, mem on close (mb), free: 340, total: 386, max: 672
2016-01-14 16:08:21 Completed running task attempt: attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21,988 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787701656_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:21,990 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=FA5EC746EBF84D1494D061EF6FBA33ED, taskAttemptId=attempt_1452787701656_0001_1_00_000000_0, startTime=1452787701922, finishTime=1452787701989, timeTaken=67, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787701980, Process_Duration=6, Process_End_Time=1452787701986, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:21,990 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787701656_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:21,990 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21,991 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:21,991 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:21,993 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:21,992 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:TASK_FINISHED]: vertexName=FA5EC746EBF84D1494D061EF6FBA33ED, taskId=task_1452787701656_0001_1_00_000000, startTime=1452787701922, finishTime=1452787701991, timeTaken=69, status=SUCCEEDED, successfulAttemptID=attempt_1452787701656_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787701980, Process_Duration=6, Process_End_Time=1452787701986, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:21,994 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787701656_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:21,995 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED] : 1
2016-01-14 16:08:21,995 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,995 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787701980, Process_Duration=6, Process_End_Time=1452787701986, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:21,997 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:21,997 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:22,000 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:22,000 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:VERTEX_FINISHED]: vertexName=FA5EC746EBF84D1494D061EF6FBA33ED, vertexId=vertex_1452787701656_0001_1_00, initRequestedTime=1452787701885, initedTime=1452787701902, startRequestedTime=1452787701904, startedTime=1452787701904, finishTime=1452787701995, timeTaken=91, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787701980, Process_Duration=6, Process_End_Time=1452787701986, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787701922, firstTasksToStart=[ task_1452787701656_0001_1_00_000000 ], lastTaskFinishTime=1452787701989, lastTasksToFinish=[ task_1452787701656_0001_1_00_000000 ], minTaskDuration=67, maxTaskDuration=67, avgTaskDuration=67.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787701656_0001_1_00_000000 ], longestDurationTasks=[ task_1452787701656_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:22,000 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:22,000 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701656_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:22,001 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:22,001 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787701656_0001_00_000001, stoppedTime=1452787702001, exitStatus=0
2016-01-14 16:08:22,001 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701656_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:22,002 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:22,002 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787701656_0001_1
2016-01-14 16:08:22,001 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787701656_0001_00_000001
2016-01-14 16:08:22,002 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787701656_0001_1
2016-01-14 16:08:22,003 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 102790C3E0694CAB8CFD774F8CCBB7B4 for vertex: vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:22,003 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787701656_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:22,005 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787701656_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:22,006 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787701656_0001_00_000001, Exiting
2016-01-14 16:08:22,006 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787701656_0001_00_000001
2016-01-14 16:08:22,006 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787701656_0001_00_000001
2016-01-14 16:08:22,012 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787701656_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:22,012 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787701656_0001_00_000001 completed successfully
2016-01-14 16:08:22,017 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787701656_0001_1, queueSize=0
2016-01-14 16:08:22,017 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:22,017 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787701656_0001_1, startTime=1452787701883, finishTime=1452787702015, timeTaken=132, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787701980, Process_Duration=6, Process_End_Time=1452787701986, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:22,018 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787701656_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:22,018 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787701656_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:22,018 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787701656_0001_00_000001
2016-01-14 16:08:22,018 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701656_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:22 Completed Dag: dag_1452787701656_0001_1
2016-01-14 16:08:22,019 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787701656_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:22,019 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787701656_0001_1_post
2016-01-14 16:08:22,019 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:22,019 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:22,027 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1, applicationId=application_1452787701656_0001
2016-01-14 16:08:22,030 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:22,030 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:22,031 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:22,031 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:22,031 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:22,031 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:22,033 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:22,034 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:22,034 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:22,035 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:22,036 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:22,037 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:22,037 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:22,043 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9/.tez/application_1452787701656_0001
2016-01-14 16:08:22,045 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.414
2016-01-14 16:08:22,151 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:22,186 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:22,186 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:22,237 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.010
2016-01-14 16:08:22,240 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.012
2016-01-14 16:08:22,240 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:22,241 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:22,241 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_UNKNOWN_'field2'
2016-01-14 16:08:22,276 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:22,276 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:22,334 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-01-14 16:08:22,349 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.030
2016-01-14 16:08:22,350 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:22,350 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:22,351 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:22,376 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:22,378 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:22,402 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:22,403 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:22,406 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_'field'"]
2016-01-14 16:08:22,406 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:22,407 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:22,408 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:22,409 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:22,409 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:22,430 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:22,436 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:22,436 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:22,436 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:22,450 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD/.tez/application_1452787702436_0001 doesn't exist and is created
2016-01-14 16:08:22,473 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:22,474 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:22,475 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD/.tez/application_1452787702436_0001
2016-01-14 16:08:22,480 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787702436_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:22,498 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:22,500 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:22,503 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:22,503 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:22,503 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD/.tez/application_1452787702436_0001/localmode-log-dir
2016-01-14 16:08:22,504 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD/.tez/application_1452787702436_0001/localmode-log-dir/history.txt.appattempt_1452787702436_0001_000000, maxErrors=10
2016-01-14 16:08:22,505 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:22,505 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787702436_0001_000000, appSubmitTime=1452787702479, launchTime=1452787702480
2016-01-14 16:08:22,511 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:22,517 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:22,519 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:22,519 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:22,521 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:39067
2016-01-14 16:08:22,523 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:22,528 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787702436_0001_000000, startTime=1452787702528
2016-01-14 16:08:22,528 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:22,528 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:22,574 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:22,574 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:22,574 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_'field', applicationId=application_1452787702436_0001, dagName=[757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD] every.every/(1/1) ...ESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:22,592 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD] every.every/(1/1) ...ESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:22,594 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787702436_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD/.tez/application_1452787702436_0001/localmode-log-dir/dag_1452787702436_0001_1.dot
2016-01-14 16:08:22,595 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD/.tez/application_1452787702436_0001/localmode-log-dir/dag_1452787702436_0001_1-tez-dag.pb.txt
2016-01-14 16:08:22,604 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787702436_0001_1
2016-01-14 16:08:22,604 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:22,605 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD] every.every/(1/1) ...ESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:22 Running Dag: dag_1452787702436_0001_1
2016-01-14 16:08:22,617 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:22,617 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787702436_0001_1, submitTime=1452787702593
2016-01-14 16:08:22,618 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex F9ACF725E9B042AA9240B898B1897189
2016-01-14 16:08:22,618 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:22,618 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:22,619 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787702436_0001_1, initTime=1452787702617
2016-01-14 16:08:22,619 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787702436_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:22,620 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:DAG_STARTED]: dagID=dag_1452787702436_0001_1, startTime=1452787702619
2016-01-14 16:08:22,620 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:22,620 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787702436_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:22,620 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: F9ACF725E9B042AA9240B898B1897189 : {C6279ACEA0424821B1D7BC7029B6E7AB={InputName=C6279ACEA0424821B1D7BC7029B6E7AB}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:22,620 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_'field', applicationId=application_1452787702436_0001, dagName=[757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD] every.every/(1/1) ...ESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:22,620 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:22,620 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: C6279ACEA0424821B1D7BC7029B6E7AB, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:22,621 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,621 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,622 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,622 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]. Starting root input initializers: 1
2016-01-14 16:08:22,623 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:22,624 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: C6279ACEA0424821B1D7BC7029B6E7AB on vertex vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,626 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:22,626 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input C6279ACEA0424821B1D7BC7029B6E7AB asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:22,627 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:22,628 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:22,630 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:22,632 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: C6279ACEA0424821B1D7BC7029B6E7AB on vertex vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,632 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:22,632 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {C6279ACEA0424821B1D7BC7029B6E7AB=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:22,633 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189] parallelism set to 1
2016-01-14 16:08:22,633 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:22,633 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787702436_0001_1_00, eventCount=1
2016-01-14 16:08:22,633 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,634 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=A329068D94A34F488C59974327D932E8, vertexId=vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:22,634 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=A329068D94A34F488C59974327D932E8, vertexId=vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,635 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=A329068D94A34F488C59974327D932E8, vertexName=F9ACF725E9B042AA9240B898B1897189, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:22,636 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=A329068D94A34F488C59974327D932E8, vertexId=vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,637 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F9ACF725E9B042AA9240B898B1897189, vertexId=vertex_1452787702436_0001_1_00, initRequestedTime=1452787702620, initedTime=1452787702637, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:22,637 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:22,637 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189] with distanceFromRoot: 0
2016-01-14 16:08:22,637 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:22,638 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in F9ACF725E9B042AA9240B898B1897189
2016-01-14 16:08:22,638 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,638 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787702436_0001_1_00, startRequestedTime=1452787702637, startedTime=1452787702637
2016-01-14 16:08:22,638 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:22,638 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:22,639 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:22,639 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:TASK_STARTED]: vertexName=F9ACF725E9B042AA9240B898B1897189, taskId=task_1452787702436_0001_1_00_000000, scheduledTime=1452787702639, launchTime=1452787702639
2016-01-14 16:08:22,640 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787702436_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:22,640 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,640 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD] every.every/(1/1) ...ESULTS.-1_UNKNOWN_'field', VertexName: F9ACF725E9B042AA9240B898B1897189, VertexParallelism: 1, TaskAttemptID:attempt_1452787702436_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=C6279ACEA0424821B1D7BC7029B6E7AB, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=A329068D94A34F488C59974327D932E8, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:22,641 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787702436_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:22,641 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:22,642 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:22,642 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:22,643 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:22,644 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787702436_0001_00_000001
2016-01-14 16:08:22,644 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702436_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:22,644 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787702436_0001, with dag id: dag_1452787702436_0001_1
2016-01-14 16:08:22,646 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787702436_0001_00_000001
2016-01-14 16:08:22,646 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:22,647 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787702436_0001_00_000001, launchTime=1452787702647
2016-01-14 16:08:22,647 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:22,648 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702436_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:22,648 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787702436_0001_00_000001
2016-01-14 16:08:22,654 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787702436_0001_1_00_000000_0] to container: [container_1452787702436_0001_00_000001]
2016-01-14 16:08:22,654 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702436_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:22,655 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787702436_0001_1_00_000000_0] started. Is using containerId: [container_1452787702436_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:22,656 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:22,656 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F9ACF725E9B042AA9240B898B1897189, taskAttemptId=attempt_1452787702436_0001_1_00_000000_0, startTime=1452787702655, containerId=container_1452787702436_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787702436_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:22,656 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787702436_0001_00_000001 given task: attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22,657 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787702436_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22,657 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787702436_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:22,657 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787702436_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:22 Starting to run new task attempt: attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22,658 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22,658 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:22,658 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:22,658 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:22,658 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:22,658 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:22,658 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:22,658 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD] every.every/(1/1) ...ESULTS.-1_UNKNOWN_'field', VertexName: F9ACF725E9B042AA9240B898B1897189, VertexParallelism: 1, TaskAttemptID:attempt_1452787702436_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=C6279ACEA0424821B1D7BC7029B6E7AB, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=A329068D94A34F488C59974327D932E8, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:22,658 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:22,659 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22,659 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:22,659 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:22,660 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787702436_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:22,661 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=C6279ACEA0424821B1D7BC7029B6E7AB, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:22,662 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:22,662 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:22,662 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=A329068D94A34F488C59974327D932E8, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:22,662 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: C6279ACEA0424821B1D7BC7029B6E7AB
2016-01-14 16:08:22,662 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: C6279ACEA0424821B1D7BC7029B6E7AB
2016-01-14 16:08:22,663 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:22,663 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: A329068D94A34F488C59974327D932E8
2016-01-14 16:08:22,663 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:22,663 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: A329068D94A34F488C59974327D932E8
2016-01-14 16:08:22,669 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:22,670 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: C6279ACEA0424821B1D7BC7029B6E7AB
2016-01-14 16:08:22,671 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: C6279ACEA0424821B1D7BC7029B6E7AB
2016-01-14 16:08:22,671 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:22,681 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F9ACF725E9B042AA9240B898B1897189, ordinal: 0
2016-01-14 16:08:22,681 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F9ACF725E9B042AA9240B898B1897189, mem on start (mb), free: 249, total: 386, max: 672
2016-01-14 16:08:22,682 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:22,682 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:22,683 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:22,682 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:22,683 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: A329068D94A34F488C59974327D932E8
2016-01-14 16:08:22,683 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:22,684 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:22,684 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:22,684 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:22,684 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:22,685 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:22,685 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:22,685 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:22,685 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, C6279ACEA0424821B1D7BC7029B6E7AB, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:22,686 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, A329068D94A34F488C59974327D932E8, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:22,686 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:22,686 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: C6279ACEA0424821B1D7BC7029B6E7AB being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:22,686 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: C6279ACEA0424821B1D7BC7029B6E7AB
2016-01-14 16:08:22,686 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:22,687 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: C6279ACEA0424821B1D7BC7029B6E7AB
2016-01-14 16:08:22,686 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:22,687 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:22,687 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:22,688 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22,688 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:22,688 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@55f88c89
2016-01-14 16:08:22,690 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@55f88c89
2016-01-14 16:08:22,690 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:22,690 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:22,691 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:22,692 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: C6279ACEA0424821B1D7BC7029B6E7AB
2016-01-14 16:08:22,692 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_'field'"], id: A329068D94A34F488C59974327D932E8
2016-01-14 16:08:22,693 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_'field'"]
2016-01-14 16:08:22,693 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:22,694 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:22,694 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F9ACF725E9B042AA9240B898B1897189, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:22,697 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:22,697 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:22,697 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22,698 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787702436_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:22,698 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22,699 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F9ACF725E9B042AA9240B898B1897189, mem on close (mb), free: 248, total: 386, max: 672
2016-01-14 16:08:22 Completed running task attempt: attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22,699 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787702436_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:22,700 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787702694, Process_Duration=4, Process_End_Time=1452787702698, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:22,700 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:22,701 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:22,701 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787702436_0001_00_000001
2016-01-14 16:08:22,701 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F9ACF725E9B042AA9240B898B1897189, taskAttemptId=attempt_1452787702436_0001_1_00_000000_0, startTime=1452787702655, finishTime=1452787702700, timeTaken=45, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787702694, Process_Duration=4, Process_End_Time=1452787702698, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:22,701 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787702436_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:22,701 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22,701 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:22,703 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:22,703 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:TASK_FINISHED]: vertexName=F9ACF725E9B042AA9240B898B1897189, taskId=task_1452787702436_0001_1_00_000000, startTime=1452787702655, finishTime=1452787702701, timeTaken=46, status=SUCCEEDED, successfulAttemptID=attempt_1452787702436_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787702694, Process_Duration=4, Process_End_Time=1452787702698, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:22,703 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787702436_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:22,704 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:22,704 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189] : 1
2016-01-14 16:08:22,704 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,707 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:VERTEX_FINISHED]: vertexName=F9ACF725E9B042AA9240B898B1897189, vertexId=vertex_1452787702436_0001_1_00, initRequestedTime=1452787702620, initedTime=1452787702637, startRequestedTime=1452787702637, startedTime=1452787702637, finishTime=1452787702704, timeTaken=67, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787702694, Process_Duration=4, Process_End_Time=1452787702698, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787702655, firstTasksToStart=[ task_1452787702436_0001_1_00_000000 ], lastTaskFinishTime=1452787702700, lastTasksToFinish=[ task_1452787702436_0001_1_00_000000 ], minTaskDuration=45, maxTaskDuration=45, avgTaskDuration=45.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787702436_0001_1_00_000000 ], longestDurationTasks=[ task_1452787702436_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:22,707 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:22,707 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702436_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:22,708 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787702436_0001_00_000001, stoppedTime=1452787702707, exitStatus=0
2016-01-14 16:08:22,708 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702436_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:22,708 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:22,708 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787702436_0001_1
2016-01-14 16:08:22,708 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787702436_0001_1
2016-01-14 16:08:22,709 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: A329068D94A34F488C59974327D932E8 for vertex: vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,710 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:22,711 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:22,712 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787702436_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:22,712 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787702436_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:22,713 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787702436_0001_00_000001, Exiting
2016-01-14 16:08:22,713 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787702436_0001_00_000001
2016-01-14 16:08:22,713 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787702436_0001_00_000001
2016-01-14 16:08:22,715 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787702436_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:22,715 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787702436_0001_00_000001 completed successfully
2016-01-14 16:08:22,719 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787702436_0001_1, queueSize=0
2016-01-14 16:08:22,719 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:22,720 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787702436_0001_1, startTime=1452787702619, finishTime=1452787702718, timeTaken=99, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787702694, Process_Duration=4, Process_End_Time=1452787702698, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:22,720 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787702436_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:22,721 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787702436_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:22,721 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787702436_0001_00_000001
2016-01-14 16:08:22,721 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702436_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:22 Completed Dag: dag_1452787702436_0001_1
2016-01-14 16:08:22,722 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787702436_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:22,722 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787702436_0001_1_post
2016-01-14 16:08:22,722 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:22,723 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:22,728 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_'field', applicationId=application_1452787702436_0001
2016-01-14 16:08:22,732 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:22,732 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:22,732 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:22,732 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:22,732 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:22,733 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:22,733 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:22,734 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:22,734 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:22,734 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:22,735 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:22,735 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:22,735 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:22,740 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD/.tez/application_1452787702436_0001
2016-01-14 16:08:22,741 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.339
2016-01-14 16:08:22,819 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:22,851 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:22,851 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:22,891 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.013
2016-01-14 16:08:22,903 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-01-14 16:08:22,904 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:22,904 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:22,904 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:22,920 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:22,920 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:22,934 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:22,934 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:22,935 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_RESULTS"]
2016-01-14 16:08:22,935 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:22,936 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:22,936 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:22,937 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:22,937 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:22,955 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:22,960 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:22,961 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:22,961 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:22,970 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA/.tez/application_1452787702961_0001 doesn't exist and is created
2016-01-14 16:08:22,988 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:22,989 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:22,989 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA/.tez/application_1452787702961_0001
2016-01-14 16:08:22,992 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787702961_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:23,003 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:23,004 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:23,006 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:23,006 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:23,006 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA/.tez/application_1452787702961_0001/localmode-log-dir
2016-01-14 16:08:23,006 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA/.tez/application_1452787702961_0001/localmode-log-dir/history.txt.appattempt_1452787702961_0001_000000, maxErrors=10
2016-01-14 16:08:23,006 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:23,006 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787702961_0001_000000, appSubmitTime=1452787702992, launchTime=1452787702992
2016-01-14 16:08:23,012 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:23,014 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:23,015 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:23,015 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:23,016 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:46559
2016-01-14 16:08:23,018 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:23,021 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787702961_0001_000000, startTime=1452787703021
2016-01-14 16:08:23,021 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:23,021 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:23,089 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:23,089 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:23,089 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_RESULTS, applicationId=application_1452787702961_0001, dagName=[7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA] every.every/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:23,108 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA] every.every/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:23,110 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787702961_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA/.tez/application_1452787702961_0001/localmode-log-dir/dag_1452787702961_0001_1.dot
2016-01-14 16:08:23,111 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA/.tez/application_1452787702961_0001/localmode-log-dir/dag_1452787702961_0001_1-tez-dag.pb.txt
2016-01-14 16:08:23,121 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787702961_0001_1
2016-01-14 16:08:23,121 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:23,121 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA] every.every/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:23 Running Dag: dag_1452787702961_0001_1
2016-01-14 16:08:23,133 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787702961_0001_1, submitTime=1452787703109
2016-01-14 16:08:23,133 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:23,134 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex AD9101F7E6E148E79DDC3A1C5B0E72DD
2016-01-14 16:08:23,134 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:23,134 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787702961_0001_1, initTime=1452787703133
2016-01-14 16:08:23,134 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:23,135 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787702961_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:23,136 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:DAG_STARTED]: dagID=dag_1452787702961_0001_1, startTime=1452787703136
2016-01-14 16:08:23,136 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_RESULTS, applicationId=application_1452787702961_0001, dagName=[7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA] every.every/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:23,136 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:23,136 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:23,137 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787702961_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:23,137 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: AD9101F7E6E148E79DDC3A1C5B0E72DD : {D2B1B60D5C304176A1B742EEF149619C={InputName=D2B1B60D5C304176A1B742EEF149619C}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:23,137 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: D2B1B60D5C304176A1B742EEF149619C, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:23,137 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,137 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,137 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,138 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]. Starting root input initializers: 1
2016-01-14 16:08:23,138 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:23,138 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: D2B1B60D5C304176A1B742EEF149619C on vertex vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,141 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:23,141 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input D2B1B60D5C304176A1B742EEF149619C asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:23,141 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:23,142 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:23,144 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:23,145 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: D2B1B60D5C304176A1B742EEF149619C on vertex vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,145 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:23,146 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {D2B1B60D5C304176A1B742EEF149619C=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:23,146 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD] parallelism set to 1
2016-01-14 16:08:23,146 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:23,146 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787702961_0001_1_00, eventCount=1
2016-01-14 16:08:23,146 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,146 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=23574803263E4708AA94BCD11CCFDB70, vertexId=vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:23,146 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=23574803263E4708AA94BCD11CCFDB70, vertexId=vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,148 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=23574803263E4708AA94BCD11CCFDB70, vertexName=AD9101F7E6E148E79DDC3A1C5B0E72DD, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:23,148 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=23574803263E4708AA94BCD11CCFDB70, vertexId=vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,149 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:23,149 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:VERTEX_INITIALIZED]: vertexName=AD9101F7E6E148E79DDC3A1C5B0E72DD, vertexId=vertex_1452787702961_0001_1_00, initRequestedTime=1452787703137, initedTime=1452787703149, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:23,149 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD] with distanceFromRoot: 0
2016-01-14 16:08:23,150 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:23,150 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in AD9101F7E6E148E79DDC3A1C5B0E72DD
2016-01-14 16:08:23,150 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,150 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:23,151 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787702961_0001_1_00, startRequestedTime=1452787703150, startedTime=1452787703150
2016-01-14 16:08:23,151 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:23,152 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:23,152 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:TASK_STARTED]: vertexName=AD9101F7E6E148E79DDC3A1C5B0E72DD, taskId=task_1452787702961_0001_1_00_000000, scheduledTime=1452787703151, launchTime=1452787703151
2016-01-14 16:08:23,152 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787702961_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:23,152 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,153 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA] every.every/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS, VertexName: AD9101F7E6E148E79DDC3A1C5B0E72DD, VertexParallelism: 1, TaskAttemptID:attempt_1452787702961_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=D2B1B60D5C304176A1B742EEF149619C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=23574803263E4708AA94BCD11CCFDB70, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:23,153 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787702961_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:23,153 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:23,154 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:23,154 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:23,155 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:23,155 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787702961_0001_00_000001
2016-01-14 16:08:23,155 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702961_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:23,157 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787702961_0001_00_000001
2016-01-14 16:08:23,157 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:23,158 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702961_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:23,158 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:23,159 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787702961_0001_00_000001, launchTime=1452787703158
2016-01-14 16:08:23,160 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787702961_0001_00_000001
2016-01-14 16:08:23,160 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787702961_0001_1_00_000000_0] to container: [container_1452787702961_0001_00_000001]
2016-01-14 16:08:23,161 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702961_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:23,161 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787702961_0001_00_000001 given task: attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23,161 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787702961_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23,161 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787702961_0001_1_00_000000_0] started. Is using containerId: [container_1452787702961_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:23,161 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=AD9101F7E6E148E79DDC3A1C5B0E72DD, taskAttemptId=attempt_1452787702961_0001_1_00_000000_0, startTime=1452787703161, containerId=container_1452787702961_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787702961_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:23,162 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787702961_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:23,162 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787702961_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:23,162 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:23 Starting to run new task attempt: attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23,163 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23,163 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:23,163 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:23,163 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:23,163 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:23,163 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:23,164 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:23,164 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA] every.every/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS, VertexName: AD9101F7E6E148E79DDC3A1C5B0E72DD, VertexParallelism: 1, TaskAttemptID:attempt_1452787702961_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=D2B1B60D5C304176A1B742EEF149619C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=23574803263E4708AA94BCD11CCFDB70, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:23,164 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:23,165 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23,165 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:23,165 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:23,166 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=D2B1B60D5C304176A1B742EEF149619C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:23,166 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=23574803263E4708AA94BCD11CCFDB70, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:23,166 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:23,166 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787702961_0001, with dag id: dag_1452787702961_0001_1
2016-01-14 16:08:23,169 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:23,169 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 23574803263E4708AA94BCD11CCFDB70
2016-01-14 16:08:23,170 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:23,170 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 23574803263E4708AA94BCD11CCFDB70
2016-01-14 16:08:23,168 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787702961_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:23,168 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:23,171 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: D2B1B60D5C304176A1B742EEF149619C
2016-01-14 16:08:23,172 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: D2B1B60D5C304176A1B742EEF149619C
2016-01-14 16:08:23,172 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:23,180 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:23,180 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: D2B1B60D5C304176A1B742EEF149619C
2016-01-14 16:08:23,180 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: D2B1B60D5C304176A1B742EEF149619C
2016-01-14 16:08:23,189 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:23,189 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 23574803263E4708AA94BCD11CCFDB70
2016-01-14 16:08:23,191 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: AD9101F7E6E148E79DDC3A1C5B0E72DD, ordinal: 0
2016-01-14 16:08:23,191 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AD9101F7E6E148E79DDC3A1C5B0E72DD, mem on start (mb), free: 170, total: 386, max: 672
2016-01-14 16:08:23,191 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:23,191 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:23,192 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:23,192 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:23,193 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:23,194 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:23,194 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:23,194 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:23,195 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:23,195 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:23,196 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:23,196 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 23574803263E4708AA94BCD11CCFDB70, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:23,197 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, D2B1B60D5C304176A1B742EEF149619C, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:23,197 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:23,198 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: D2B1B60D5C304176A1B742EEF149619C being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:23,198 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: D2B1B60D5C304176A1B742EEF149619C
2016-01-14 16:08:23,198 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:23,198 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: D2B1B60D5C304176A1B742EEF149619C
2016-01-14 16:08:23,198 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:23,199 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:23,199 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:23,199 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23,199 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:23,200 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@1e871ab4
2016-01-14 16:08:23,202 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@1e871ab4
2016-01-14 16:08:23,202 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:23,202 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:23,204 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:23,205 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: D2B1B60D5C304176A1B742EEF149619C
2016-01-14 16:08:23,206 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_RESULTS"], id: 23574803263E4708AA94BCD11CCFDB70
2016-01-14 16:08:23,206 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_RESULTS"]
2016-01-14 16:08:23,207 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:23,207 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:23,208 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: AD9101F7E6E148E79DDC3A1C5B0E72DD, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:23,211 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:23,212 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:23,213 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23,213 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787702961_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:23,215 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23,215 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AD9101F7E6E148E79DDC3A1C5B0E72DD, mem on close (mb), free: 169, total: 386, max: 672
2016-01-14 16:08:23 Completed running task attempt: attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23,217 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787702961_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:23,219 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787703209, Process_Duration=6, Process_End_Time=1452787703215, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:23,219 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:23,220 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:23,220 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=AD9101F7E6E148E79DDC3A1C5B0E72DD, taskAttemptId=attempt_1452787702961_0001_1_00_000000_0, startTime=1452787703161, finishTime=1452787703219, timeTaken=58, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787703209, Process_Duration=6, Process_End_Time=1452787703215, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:23,220 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787702961_0001_00_000001
2016-01-14 16:08:23,220 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787702961_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:23,220 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23,221 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:23,221 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:TASK_FINISHED]: vertexName=AD9101F7E6E148E79DDC3A1C5B0E72DD, taskId=task_1452787702961_0001_1_00_000000, startTime=1452787703161, finishTime=1452787703220, timeTaken=59, status=SUCCEEDED, successfulAttemptID=attempt_1452787702961_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787703209, Process_Duration=6, Process_End_Time=1452787703215, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:23,222 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:23,223 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:23,224 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787702961_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:23,225 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD] : 1
2016-01-14 16:08:23,225 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,227 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:23,228 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:VERTEX_FINISHED]: vertexName=AD9101F7E6E148E79DDC3A1C5B0E72DD, vertexId=vertex_1452787702961_0001_1_00, initRequestedTime=1452787703137, initedTime=1452787703149, startRequestedTime=1452787703150, startedTime=1452787703150, finishTime=1452787703225, timeTaken=75, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787703209, Process_Duration=6, Process_End_Time=1452787703215, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787703161, firstTasksToStart=[ task_1452787702961_0001_1_00_000000 ], lastTaskFinishTime=1452787703219, lastTasksToFinish=[ task_1452787702961_0001_1_00_000000 ], minTaskDuration=58, maxTaskDuration=58, avgTaskDuration=58.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787702961_0001_1_00_000000 ], longestDurationTasks=[ task_1452787702961_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:23,228 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:23,228 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702961_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:23,228 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787702961_0001_00_000001, stoppedTime=1452787703228, exitStatus=0
2016-01-14 16:08:23,228 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:23,228 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702961_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:23,229 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:23,229 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787702961_0001_1
2016-01-14 16:08:23,229 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787702961_0001_1
2016-01-14 16:08:23,229 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 23574803263E4708AA94BCD11CCFDB70 for vertex: vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,232 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787702961_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:23,232 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787702961_0001_00_000001: 12 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:23,232 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787702961_0001_00_000001, Exiting
2016-01-14 16:08:23,232 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787702961_0001_00_000001
2016-01-14 16:08:23,232 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787702961_0001_00_000001
2016-01-14 16:08:23,234 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787702961_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:23,235 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787702961_0001_00_000001 completed successfully
2016-01-14 16:08:23,241 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787702961_0001_1, queueSize=0
2016-01-14 16:08:23,241 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:23,242 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787702961_0001_1, startTime=1452787703136, finishTime=1452787703240, timeTaken=104, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787703209, Process_Duration=6, Process_End_Time=1452787703215, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:23,242 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787702961_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:23,243 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787702961_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:23,243 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787702961_0001_00_000001
2016-01-14 16:08:23,243 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702961_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:23 Completed Dag: dag_1452787702961_0001_1
2016-01-14 16:08:23,243 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787702961_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:23,244 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787702961_0001_1_post
2016-01-14 16:08:23,244 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:23,244 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:23,250 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_RESULTS, applicationId=application_1452787702961_0001
2016-01-14 16:08:23,251 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:23,251 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:23,252 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:23,252 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:23,252 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:23,252 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:23,253 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:23,253 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:23,253 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:23,254 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:23,254 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:23,254 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:23,254 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:23,258 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA/.tez/application_1452787702961_0001
2016-01-14 16:08:23,258 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.324
2016-01-14 16:08:23,342 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:23,374 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:23,375 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:23,438 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 16:08:23,450 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 16:08:23,451 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:23,451 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:23,451 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:23,474 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:23,475 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:23,490 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:23,490 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:23,490 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_ALL"]
2016-01-14 16:08:23,491 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:23,491 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:23,492 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:23,493 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...d'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:23,493 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:23,508 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:23,512 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:23,513 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:23,514 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:23,523 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE/.tez/application_1452787703513_0001 doesn't exist and is created
2016-01-14 16:08:23,540 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:23,540 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:23,541 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE/.tez/application_1452787703513_0001
2016-01-14 16:08:23,544 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787703513_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:23,558 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:23,560 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:23,562 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:23,562 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:23,563 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE/.tez/application_1452787703513_0001/localmode-log-dir
2016-01-14 16:08:23,564 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE/.tez/application_1452787703513_0001/localmode-log-dir/history.txt.appattempt_1452787703513_0001_000000, maxErrors=10
2016-01-14 16:08:23,565 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:23,565 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787703513_0001_000000, appSubmitTime=1452787703543, launchTime=1452787703543
2016-01-14 16:08:23,569 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:23,571 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:23,573 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:57906
2016-01-14 16:08:23,574 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:23,574 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:23,575 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:23,577 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:23,577 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787703513_0001_000000, startTime=1452787703577
2016-01-14 16:08:23,578 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:23,641 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:23,641 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:23,641 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL, applicationId=application_1452787703513_0001, dagName=[BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE] every.every/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:23,658 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE] every.every/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:23,659 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787703513_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE/.tez/application_1452787703513_0001/localmode-log-dir/dag_1452787703513_0001_1.dot
2016-01-14 16:08:23,660 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE/.tez/application_1452787703513_0001/localmode-log-dir/dag_1452787703513_0001_1-tez-dag.pb.txt
2016-01-14 16:08:23,667 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787703513_0001_1
2016-01-14 16:08:23,667 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:23,667 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE] every.every/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:23 Running Dag: dag_1452787703513_0001_1
2016-01-14 16:08:23,679 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:23,679 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787703513_0001_1, submitTime=1452787703658
2016-01-14 16:08:23,679 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex C0B37FB3D5E74F77ABCEC04AC87E6BC5
2016-01-14 16:08:23,680 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:23,680 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:23,680 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787703513_0001_1, initTime=1452787703679
2016-01-14 16:08:23,680 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787703513_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:23,681 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:DAG_STARTED]: dagID=dag_1452787703513_0001_1, startTime=1452787703681
2016-01-14 16:08:23,681 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:23,681 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787703513_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:23,681 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: C0B37FB3D5E74F77ABCEC04AC87E6BC5 : {9961698B067B43959E10E6032AF27F90={InputName=9961698B067B43959E10E6032AF27F90}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:23,682 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 9961698B067B43959E10E6032AF27F90, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:23,682 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,682 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,682 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,681 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:23,682 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]. Starting root input initializers: 1
2016-01-14 16:08:23,683 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:23,683 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 9961698B067B43959E10E6032AF27F90 on vertex vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,683 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL, applicationId=application_1452787703513_0001, dagName=[BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE] every.every/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:23,685 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:23,685 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 9961698B067B43959E10E6032AF27F90 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:23,685 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:23,685 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:23,687 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:23,687 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 9961698B067B43959E10E6032AF27F90 on vertex vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,688 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:23,688 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {9961698B067B43959E10E6032AF27F90=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:23,688 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5] parallelism set to 1
2016-01-14 16:08:23,688 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:23,688 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787703513_0001_1_00, eventCount=1
2016-01-14 16:08:23,689 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,689 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=C893FC346A524C2DA354F6343AAC3ACE, vertexId=vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:23,689 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=C893FC346A524C2DA354F6343AAC3ACE, vertexId=vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,691 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=C893FC346A524C2DA354F6343AAC3ACE, vertexName=C0B37FB3D5E74F77ABCEC04AC87E6BC5, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:23,691 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=C893FC346A524C2DA354F6343AAC3ACE, vertexId=vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,692 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:23,693 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:VERTEX_INITIALIZED]: vertexName=C0B37FB3D5E74F77ABCEC04AC87E6BC5, vertexId=vertex_1452787703513_0001_1_00, initRequestedTime=1452787703681, initedTime=1452787703692, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:23,693 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5] with distanceFromRoot: 0
2016-01-14 16:08:23,693 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:23,693 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in C0B37FB3D5E74F77ABCEC04AC87E6BC5
2016-01-14 16:08:23,693 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,694 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:23,694 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787703513_0001_1_00, startRequestedTime=1452787703693, startedTime=1452787703693
2016-01-14 16:08:23,695 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:23,695 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:23,696 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:TASK_STARTED]: vertexName=C0B37FB3D5E74F77ABCEC04AC87E6BC5, taskId=task_1452787703513_0001_1_00_000000, scheduledTime=1452787703695, launchTime=1452787703695
2016-01-14 16:08:23,696 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787703513_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:23,696 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,696 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE] every.every/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL, VertexName: C0B37FB3D5E74F77ABCEC04AC87E6BC5, VertexParallelism: 1, TaskAttemptID:attempt_1452787703513_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=9961698B067B43959E10E6032AF27F90, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=C893FC346A524C2DA354F6343AAC3ACE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:23,696 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787703513_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:23,697 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:23,697 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:23,698 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:23,698 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:23,698 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787703513_0001_00_000001
2016-01-14 16:08:23,698 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787703513_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:23,700 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787703513_0001_00_000001
2016-01-14 16:08:23,701 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:23,701 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787703513_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:23,701 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:23,702 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787703513_0001_00_000001, launchTime=1452787703701
2016-01-14 16:08:23,702 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787703513_0001_00_000001
2016-01-14 16:08:23,703 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787703513_0001_1_00_000000_0] to container: [container_1452787703513_0001_00_000001]
2016-01-14 16:08:23,704 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787703513_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:23,704 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787703513_0001_1_00_000000_0] started. Is using containerId: [container_1452787703513_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:23,704 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=C0B37FB3D5E74F77ABCEC04AC87E6BC5, taskAttemptId=attempt_1452787703513_0001_1_00_000000_0, startTime=1452787703704, containerId=container_1452787703513_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787703513_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:23,704 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:23,704 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787703513_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:23,705 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787703513_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:23,705 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787703513_0001_00_000001 given task: attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23,705 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787703513_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23 Starting to run new task attempt: attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23,706 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23,706 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:23,707 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:23,707 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:23,707 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:23,707 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:23,708 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:23,709 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787703513_0001, with dag id: dag_1452787703513_0001_1
2016-01-14 16:08:23,709 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE] every.every/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL, VertexName: C0B37FB3D5E74F77ABCEC04AC87E6BC5, VertexParallelism: 1, TaskAttemptID:attempt_1452787703513_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=9961698B067B43959E10E6032AF27F90, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=C893FC346A524C2DA354F6343AAC3ACE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:23,709 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:23,710 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23,710 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:23,710 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:23,711 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:23,711 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=C893FC346A524C2DA354F6343AAC3ACE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:23,713 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:23,714 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=9961698B067B43959E10E6032AF27F90, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:23,714 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: C893FC346A524C2DA354F6343AAC3ACE
2016-01-14 16:08:23,714 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:23,714 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: C893FC346A524C2DA354F6343AAC3ACE
2016-01-14 16:08:23,715 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:23,715 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:23,715 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 9961698B067B43959E10E6032AF27F90
2016-01-14 16:08:23,717 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 9961698B067B43959E10E6032AF27F90
2016-01-14 16:08:23,723 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:23,723 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 9961698B067B43959E10E6032AF27F90
2016-01-14 16:08:23,723 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 9961698B067B43959E10E6032AF27F90
2016-01-14 16:08:23,725 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787703513_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:23,731 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: C0B37FB3D5E74F77ABCEC04AC87E6BC5, ordinal: 0
2016-01-14 16:08:23,732 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C0B37FB3D5E74F77ABCEC04AC87E6BC5, mem on start (mb), free: 304, total: 384, max: 672
2016-01-14 16:08:23,732 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:23,732 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:23,732 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:23,736 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:23,736 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: C893FC346A524C2DA354F6343AAC3ACE
2016-01-14 16:08:23,736 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:23,737 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:23,737 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:23,737 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:23,738 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:23,738 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:23,738 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:23,738 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:23,739 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, C893FC346A524C2DA354F6343AAC3ACE, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:23,739 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 9961698B067B43959E10E6032AF27F90, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:23,739 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:23,739 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 9961698B067B43959E10E6032AF27F90 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:23,739 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 9961698B067B43959E10E6032AF27F90
2016-01-14 16:08:23,740 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:23,740 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 9961698B067B43959E10E6032AF27F90
2016-01-14 16:08:23,741 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:23,741 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:23,741 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:23,742 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23,742 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:23,743 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@19dfe5aa
2016-01-14 16:08:23,743 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@19dfe5aa
2016-01-14 16:08:23,744 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:23,744 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:23,746 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:23,746 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 9961698B067B43959E10E6032AF27F90
2016-01-14 16:08:23,747 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_ALL"], id: C893FC346A524C2DA354F6343AAC3ACE
2016-01-14 16:08:23,747 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_ALL"]
2016-01-14 16:08:23,747 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:23,748 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:23,748 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: C0B37FB3D5E74F77ABCEC04AC87E6BC5, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:23,751 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:23,751 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:23,752 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23,752 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787703513_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:23,753 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23,753 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C0B37FB3D5E74F77ABCEC04AC87E6BC5, mem on close (mb), free: 302, total: 384, max: 672
2016-01-14 16:08:23 Completed running task attempt: attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23,755 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787703513_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:23,756 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787703748, Process_Duration=5, Process_End_Time=1452787703753, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:23,756 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=C0B37FB3D5E74F77ABCEC04AC87E6BC5, taskAttemptId=attempt_1452787703513_0001_1_00_000000_0, startTime=1452787703704, finishTime=1452787703756, timeTaken=52, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787703748, Process_Duration=5, Process_End_Time=1452787703753, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:23,756 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:23,757 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787703513_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:23,757 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:23,760 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:23,760 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23,760 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:23,761 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787703513_0001_00_000001
2016-01-14 16:08:23,761 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:TASK_FINISHED]: vertexName=C0B37FB3D5E74F77ABCEC04AC87E6BC5, taskId=task_1452787703513_0001_1_00_000000, startTime=1452787703704, finishTime=1452787703761, timeTaken=57, status=SUCCEEDED, successfulAttemptID=attempt_1452787703513_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787703748, Process_Duration=5, Process_End_Time=1452787703753, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:23,762 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787703513_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:23,762 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5] : 1
2016-01-14 16:08:23,762 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,762 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:23,763 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:23,764 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:VERTEX_FINISHED]: vertexName=C0B37FB3D5E74F77ABCEC04AC87E6BC5, vertexId=vertex_1452787703513_0001_1_00, initRequestedTime=1452787703681, initedTime=1452787703692, startRequestedTime=1452787703693, startedTime=1452787703693, finishTime=1452787703762, timeTaken=69, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787703748, Process_Duration=5, Process_End_Time=1452787703753, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787703704, firstTasksToStart=[ task_1452787703513_0001_1_00_000000 ], lastTaskFinishTime=1452787703756, lastTasksToFinish=[ task_1452787703513_0001_1_00_000000 ], minTaskDuration=52, maxTaskDuration=52, avgTaskDuration=52.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787703513_0001_1_00_000000 ], longestDurationTasks=[ task_1452787703513_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:23,764 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:23,764 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787703513_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:23,764 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787703513_0001_00_000001, stoppedTime=1452787703764, exitStatus=0
2016-01-14 16:08:23,764 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787703513_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:23,765 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:23,765 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:23,765 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787703513_0001_1
2016-01-14 16:08:23,765 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787703513_0001_1
2016-01-14 16:08:23,765 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: C893FC346A524C2DA354F6343AAC3ACE for vertex: vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,772 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787703513_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:23,772 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787703513_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:23,772 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787703513_0001_00_000001, Exiting
2016-01-14 16:08:23,772 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787703513_0001_00_000001
2016-01-14 16:08:23,772 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787703513_0001_00_000001
2016-01-14 16:08:23,775 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787703513_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:23,775 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787703513_0001_00_000001 completed successfully
2016-01-14 16:08:23,776 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787703513_0001_1, queueSize=0
2016-01-14 16:08:23,776 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:23,776 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787703513_0001_1, startTime=1452787703681, finishTime=1452787703774, timeTaken=93, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787703748, Process_Duration=5, Process_End_Time=1452787703753, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:23,776 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787703513_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:23,777 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787703513_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:23,777 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787703513_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:23,777 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787703513_0001_00_000001
2016-01-14 16:08:23 Completed Dag: dag_1452787703513_0001_1
2016-01-14 16:08:23,778 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787703513_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:23,778 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787703513_0001_1_post
2016-01-14 16:08:23,778 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:23,779 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:23,788 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL, applicationId=application_1452787703513_0001
2016-01-14 16:08:23,790 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:23,791 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:23,791 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:23,791 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:23,791 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:23,791 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:23,792 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:23,792 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:23,793 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:23,793 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:23,793 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:23,794 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:23,794 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:23,799 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE/.tez/application_1452787703513_0001
2016-01-14 16:08:23,800 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.309
2016-01-14 16:08:23,870 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:23,876 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:23,876 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:23,900 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:23,900 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:23,935 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.011
2016-01-14 16:08:23,942 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 16:08:23,942 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:23,943 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:23,943 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:23,956 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:23,957 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:23,967 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:23,967 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:23,968 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_-1"]
2016-01-14 16:08:23,968 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:23,968 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:23,969 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:23,969 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:23,970 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:23,982 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:23,987 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:23,987 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:23,987 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:23,997 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9/.tez/application_1452787703987_0001 doesn't exist and is created
2016-01-14 16:08:24,013 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:24,013 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:24,014 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9/.tez/application_1452787703987_0001
2016-01-14 16:08:24,017 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787703987_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:24,028 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:24,029 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:24,031 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:24,032 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:24,032 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9/.tez/application_1452787703987_0001/localmode-log-dir
2016-01-14 16:08:24,032 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9/.tez/application_1452787703987_0001/localmode-log-dir/history.txt.appattempt_1452787703987_0001_000000, maxErrors=10
2016-01-14 16:08:24,032 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:24,032 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787703987_0001_000000, appSubmitTime=1452787704017, launchTime=1452787704017
2016-01-14 16:08:24,037 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:24,038 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:24,038 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:37634
2016-01-14 16:08:24,043 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:24,043 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:24,043 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:24,046 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787703987_0001_000000, startTime=1452787704046
2016-01-14 16:08:24,046 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:24,046 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:24,114 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:24,114 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:24,114 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...eld'_RESULTS.-1_VALUES_-1, applicationId=application_1452787703987_0001, dagName=[91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9] every.every/(1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:24,131 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9] every.every/(1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:24,133 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787703987_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9/.tez/application_1452787703987_0001/localmode-log-dir/dag_1452787703987_0001_1.dot
2016-01-14 16:08:24,133 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9/.tez/application_1452787703987_0001/localmode-log-dir/dag_1452787703987_0001_1-tez-dag.pb.txt
2016-01-14 16:08:24,138 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787703987_0001_1
2016-01-14 16:08:24,139 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:24,139 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9] every.every/(1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:24 Running Dag: dag_1452787703987_0001_1
2016-01-14 16:08:24,150 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787703987_0001_1, submitTime=1452787704132
2016-01-14 16:08:24,150 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:24,150 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex AE2FE1DCE73F46E482010D121E9D83C5
2016-01-14 16:08:24,150 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:24,151 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787703987_0001_1, initTime=1452787704150
2016-01-14 16:08:24,151 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:24,151 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787703987_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:24,152 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:24,152 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:DAG_STARTED]: dagID=dag_1452787703987_0001_1, startTime=1452787704152
2016-01-14 16:08:24,152 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:24,153 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787703987_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:24,153 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...eld'_RESULTS.-1_VALUES_-1, applicationId=application_1452787703987_0001, dagName=[91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9] every.every/(1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:24,153 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: AE2FE1DCE73F46E482010D121E9D83C5 : {CF866D1324204536882DCDB2B4F43721={InputName=CF866D1324204536882DCDB2B4F43721}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:24,153 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: CF866D1324204536882DCDB2B4F43721, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:24,153 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,153 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,153 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,154 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]. Starting root input initializers: 1
2016-01-14 16:08:24,154 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:24,156 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: CF866D1324204536882DCDB2B4F43721 on vertex vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,158 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:24,158 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input CF866D1324204536882DCDB2B4F43721 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:24,159 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:24,159 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:24,161 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:24,162 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: CF866D1324204536882DCDB2B4F43721 on vertex vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,162 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:24,163 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {CF866D1324204536882DCDB2B4F43721=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:24,163 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] parallelism set to 1
2016-01-14 16:08:24,163 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:24,163 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787703987_0001_1_00, eventCount=1
2016-01-14 16:08:24,163 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,164 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=6756EE6DDA0B4559A32A459AFCF3A41E, vertexId=vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:24,164 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=6756EE6DDA0B4559A32A459AFCF3A41E, vertexId=vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,166 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=6756EE6DDA0B4559A32A459AFCF3A41E, vertexName=AE2FE1DCE73F46E482010D121E9D83C5, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:24,166 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=6756EE6DDA0B4559A32A459AFCF3A41E, vertexId=vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,167 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:24,168 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:VERTEX_INITIALIZED]: vertexName=AE2FE1DCE73F46E482010D121E9D83C5, vertexId=vertex_1452787703987_0001_1_00, initRequestedTime=1452787704153, initedTime=1452787704167, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:24,168 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] with distanceFromRoot: 0
2016-01-14 16:08:24,168 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:24,168 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in AE2FE1DCE73F46E482010D121E9D83C5
2016-01-14 16:08:24,169 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,169 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:24,169 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787703987_0001_1_00, startRequestedTime=1452787704168, startedTime=1452787704168
2016-01-14 16:08:24,170 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:24,170 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:24,171 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:TASK_STARTED]: vertexName=AE2FE1DCE73F46E482010D121E9D83C5, taskId=task_1452787703987_0001_1_00_000000, scheduledTime=1452787704170, launchTime=1452787704170
2016-01-14 16:08:24,171 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787703987_0001, with dag id: dag_1452787703987_0001_1
2016-01-14 16:08:24,171 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787703987_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:24,172 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,172 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9] every.every/(1/1) ...eld'_RESULTS.-1_VALUES_-1, VertexName: AE2FE1DCE73F46E482010D121E9D83C5, VertexParallelism: 1, TaskAttemptID:attempt_1452787703987_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=CF866D1324204536882DCDB2B4F43721, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6756EE6DDA0B4559A32A459AFCF3A41E, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:24,173 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787703987_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:24,173 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:24,174 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:24,175 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:24,176 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:24,176 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787703987_0001_00_000001
2016-01-14 16:08:24,177 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787703987_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:24,178 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787703987_0001_00_000001
2016-01-14 16:08:24,178 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:24,179 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787703987_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:24,179 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787703987_0001_00_000001, launchTime=1452787704179
2016-01-14 16:08:24,179 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:24,180 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787703987_0001_00_000001
2016-01-14 16:08:24,181 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787703987_0001_1_00_000000_0] to container: [container_1452787703987_0001_00_000001]
2016-01-14 16:08:24,181 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787703987_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:24,181 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787703987_0001_00_000001 given task: attempt_1452787703987_0001_1_00_000000_0
2016-01-14 16:08:24,181 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787703987_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787703987_0001_1_00_000000_0
2016-01-14 16:08:24,182 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787703987_0001_1_00_000000_0] started. Is using containerId: [container_1452787703987_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:24 Starting to run new task attempt: attempt_1452787703987_0001_1_00_000000_0
2016-01-14 16:08:24,182 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787703987_0001_1_00_000000_0
2016-01-14 16:08:24,182 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:24,182 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:24,182 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:24,183 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:24,183 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:24,183 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:24,183 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:24,184 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9] every.every/(1/1) ...eld'_RESULTS.-1_VALUES_-1, VertexName: AE2FE1DCE73F46E482010D121E9D83C5, VertexParallelism: 1, TaskAttemptID:attempt_1452787703987_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=CF866D1324204536882DCDB2B4F43721, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6756EE6DDA0B4559A32A459AFCF3A41E, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:24,184 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=AE2FE1DCE73F46E482010D121E9D83C5, taskAttemptId=attempt_1452787703987_0001_1_00_000000_0, startTime=1452787704181, containerId=container_1452787703987_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787703987_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:24,184 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:24,185 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787703987_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:24,185 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787703987_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:24,185 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787703987_0001_1_00_000000_0
2016-01-14 16:08:24,185 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:24,186 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:24,186 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:24,186 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=CF866D1324204536882DCDB2B4F43721, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:24,187 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=6756EE6DDA0B4559A32A459AFCF3A41E, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:24,187 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:24,187 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:24,187 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: CF866D1324204536882DCDB2B4F43721
2016-01-14 16:08:24,188 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 6756EE6DDA0B4559A32A459AFCF3A41E
2016-01-14 16:08:24,188 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:24,188 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 6756EE6DDA0B4559A32A459AFCF3A41E
2016-01-14 16:08:24,188 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: CF866D1324204536882DCDB2B4F43721
2016-01-14 16:08:24,189 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:24,193 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787703987_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:24,193 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:24,194 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: CF866D1324204536882DCDB2B4F43721
2016-01-14 16:08:24,194 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: CF866D1324204536882DCDB2B4F43721
2016-01-14 16:08:24,202 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: AE2FE1DCE73F46E482010D121E9D83C5, ordinal: 0
2016-01-14 16:08:24,202 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AE2FE1DCE73F46E482010D121E9D83C5, mem on start (mb), free: 228, total: 384, max: 672
2016-01-14 16:08:24,202 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:24,202 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:24,203 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:24,202 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:24,203 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 6756EE6DDA0B4559A32A459AFCF3A41E
2016-01-14 16:08:24,203 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:24,204 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:24,204 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:24,204 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:24,205 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:24,205 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:24,206 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:24,207 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:24,207 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 6756EE6DDA0B4559A32A459AFCF3A41E, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:24,207 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, CF866D1324204536882DCDB2B4F43721, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:24,208 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:24,208 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: CF866D1324204536882DCDB2B4F43721
2016-01-14 16:08:24,208 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:24,208 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: CF866D1324204536882DCDB2B4F43721
2016-01-14 16:08:24,208 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: CF866D1324204536882DCDB2B4F43721 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:24,209 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:24,209 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:24,209 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:24,209 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787703987_0001_1_00_000000_0
2016-01-14 16:08:24,210 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:24,211 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@27daa766
2016-01-14 16:08:24,212 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:24,212 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@27daa766
2016-01-14 16:08:24,212 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:24,212 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:24,213 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: CF866D1324204536882DCDB2B4F43721
2016-01-14 16:08:24,213 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_-1"], id: 6756EE6DDA0B4559A32A459AFCF3A41E
2016-01-14 16:08:24,213 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_-1"]
2016-01-14 16:08:24,213 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:24,213 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:24,214 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: AE2FE1DCE73F46E482010D121E9D83C5, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:24,215 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:24,218 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:24,219 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:24,222 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:24,222 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:24,223 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787703987_0001_1_00_000000_0
2016-01-14 16:08:24,224 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787703987_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:24,226 INFO  task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452787703987_0001_1_00_000000_0
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:24,233 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 18 [[File System Counters FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=528, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452787704214, Process_Duration=11, Process_End_Time=1452787704225, Read_Duration=0, Tuples_Read=1][cascading.flow.StepCounters Tuples_Read=1]]
2016-01-14 16:08:24,233 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AE2FE1DCE73F46E482010D121E9D83C5, mem on close (mb), free: 226, total: 384, max: 672
2016-01-14 16:08:24,234 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=AE2FE1DCE73F46E482010D121E9D83C5, index=0
2016-01-14 16:08:24,234 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=AE2FE1DCE73F46E482010D121E9D83C5, sourceVertex=CF866D1324204536882DCDB2B4F43721
2016-01-14 16:08:24,234 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=AE2FE1DCE73F46E482010D121E9D83C5, sourceVertex=6756EE6DDA0B4559A32A459AFCF3A41E
2016-01-14 16:08:24,235 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787703987_0001_00_000001
2016-01-14 16:08:24,235 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787703987_0001_00_000001
2016-01-14 16:08:24,235 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=AE2FE1DCE73F46E482010D121E9D83C5, taskAttemptId=attempt_1452787703987_0001_1_00_000000_0, startTime=1452787704181, finishTime=1452787704233, timeTaken=52, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=528, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452787704214, Process_Duration=11, Process_End_Time=1452787704225, Read_Duration=0, Tuples_Read=1, cascading.flow.StepCounters, Tuples_Read=1
2016-01-14 16:08:24,236 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787703987_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 16:08:24,237 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787703987_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 16:08:24,237 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452787703987_0001_00_000001 completed but with errors
2016-01-14 16:08:24,236 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:24,237 INFO  impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452787703987_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 16:08:24,239 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:TASK_FINISHED]: vertexName=AE2FE1DCE73F46E482010D121E9D83C5, taskId=task_1452787703987_0001_1_00_000000, startTime=1452787704181, finishTime=1452787704239, timeTaken=58, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-01-14 16:08:24,240 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787703987_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 16:08:24,240 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:24,240 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:24,242 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(686)) - Container container_1452787703987_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 16:08:24,242 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:24,245 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787703987_0001_00_000001, stoppedTime=1452787704242, exitStatus=1
2016-01-14 16:08:24,245 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787703987_0001_00_000001 transitioned from RUNNING to COMPLETED via event C_COMPLETED
2016-01-14 16:08:24,245 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] : 1
2016-01-14 16:08:24,245 INFO  impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] because task failed: task_1452787703987_0001_1_00_000000
2016-01-14 16:08:24,246 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] due to trigger: OWN_TASK_FAILURE
2016-01-14 16:08:24,247 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 16:08:24,247 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,248 INFO  impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=6756EE6DDA0B4559A32A459AFCF3A41E, vertexId=vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,253 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:24,254 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:VERTEX_FINISHED]: vertexName=AE2FE1DCE73F46E482010D121E9D83C5, vertexId=vertex_1452787703987_0001_1_00, initRequestedTime=1452787704153, initedTime=1452787704167, startRequestedTime=1452787704168, startedTime=1452787704168, finishTime=1452787704252, timeTaken=84, status=FAILED, diagnostics=Task failed, taskId=task_1452787703987_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452787704181, firstTasksToStart=[ task_1452787703987_0001_1_00_000000 ], lastTaskFinishTime=1452787704233, lastTasksToFinish=[ task_1452787703987_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 16:08:24,254 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 16:08:24,255 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452787703987_0001_1_00_000000_0 failed: true container: container_1452787703987_0001_00_000001 numFailedTAs: 0
2016-01-14 16:08:24,255 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787703987_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 16:08:24,258 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 16:08:24,258 INFO  impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 16:08:24,258 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787703987_0001_1
2016-01-14 16:08:24,258 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: 6756EE6DDA0B4559A32A459AFCF3A41E for vertex: vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,259 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787703987_0001_1, queueSize=0
2016-01-14 16:08:24,259 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:24,260 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787703987_0001_1, startTime=1452787704152, finishTime=1452787704259, timeTaken=107, status=FAILED, diagnostics=Vertex failed, vertexName=AE2FE1DCE73F46E482010D121E9D83C5, vertexId=vertex_1452787703987_0001_1_00, diagnostics=[Task failed, taskId=task_1452787703987_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 16:08:24,260 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787703987_0001_1 finished with state: FAILED
2016-01-14 16:08:24,261 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787703987_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:24 Completed Dag: dag_1452787703987_0001_1
2016-01-14 16:08:24,261 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787703987_0001_1, dagState=FAILED
2016-01-14 16:08:24,262 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787703987_0001_1_post
2016-01-14 16:08:24,262 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:24,262 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:24,268 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...eld'_RESULTS.-1_VALUES_-1, applicationId=application_1452787703987_0001
2016-01-14 16:08:24,272 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:24,272 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:24,273 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:24,273 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:24,273 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:24,274 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:24,274 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:24,276 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:24,276 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:24,277 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:24,277 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:24,277 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:24,278 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:24,282 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9/.tez/application_1452787703987_0001
2016-01-14 16:08:24,282 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping all jobs
2016-01-14 16:08:24,282 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping: (1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:24,283 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopped all jobs
2016-01-14 16:08:24,283 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.316
2016-01-14 16:08:24,284 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:24,313 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:24,314 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:24,349 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.007
2016-01-14 16:08:24,354 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.012
2016-01-14 16:08:24,354 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:24,355 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:24,355 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_VALUES_'field2'
2016-01-14 16:08:24,376 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:24,376 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:24,414 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.011
2016-01-14 16:08:24,421 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 16:08:24,422 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:24,422 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:24,422 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:24,436 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:24,436 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:24,447 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:24,447 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:24,448 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_RESULTS"]
2016-01-14 16:08:24,449 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:24,450 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:24,450 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:24,452 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:24,452 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:24,464 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:24,468 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:24,469 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:24,469 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:24,478 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC/.tez/application_1452787704469_0001 doesn't exist and is created
2016-01-14 16:08:24,494 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:24,494 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:24,495 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC/.tez/application_1452787704469_0001
2016-01-14 16:08:24,498 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787704469_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:24,508 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:24,508 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:24,510 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:24,510 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:24,510 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC/.tez/application_1452787704469_0001/localmode-log-dir
2016-01-14 16:08:24,511 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC/.tez/application_1452787704469_0001/localmode-log-dir/history.txt.appattempt_1452787704469_0001_000000, maxErrors=10
2016-01-14 16:08:24,511 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:24,511 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787704469_0001_000000, appSubmitTime=1452787704497, launchTime=1452787704498
2016-01-14 16:08:24,514 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:24,516 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:24,517 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:24,517 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:24,518 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:51639
2016-01-14 16:08:24,523 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:24,525 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787704469_0001_000000, startTime=1452787704525
2016-01-14 16:08:24,525 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:24,525 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:24,595 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:24,595 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:24,595 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...RESULTS.-1_VALUES_RESULTS, applicationId=application_1452787704469_0001, dagName=[EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC] every.every/(1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:24,612 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC] every.every/(1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:24,614 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787704469_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC/.tez/application_1452787704469_0001/localmode-log-dir/dag_1452787704469_0001_1.dot
2016-01-14 16:08:24,615 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC/.tez/application_1452787704469_0001/localmode-log-dir/dag_1452787704469_0001_1-tez-dag.pb.txt
2016-01-14 16:08:24,620 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787704469_0001_1
2016-01-14 16:08:24,620 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:24,620 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC] every.every/(1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:24 Running Dag: dag_1452787704469_0001_1
2016-01-14 16:08:24,623 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:24,623 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:24,633 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787704469_0001_1, submitTime=1452787704613
2016-01-14 16:08:24,633 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:24,636 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex BC0941F7977B4E14B7568F8D72D55606
2016-01-14 16:08:24,636 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:24,637 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787704469_0001_1, initTime=1452787704636
2016-01-14 16:08:24,637 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:24,638 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787704469_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:24,639 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:DAG_STARTED]: dagID=dag_1452787704469_0001_1, startTime=1452787704638
2016-01-14 16:08:24,639 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:24,639 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787704469_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:24,640 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: BC0941F7977B4E14B7568F8D72D55606 : {4EDC7B783DBE4289B39B9CC41BC4FD3C={InputName=4EDC7B783DBE4289B39B9CC41BC4FD3C}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:24,640 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 4EDC7B783DBE4289B39B9CC41BC4FD3C, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:24,640 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:24,640 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,640 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,640 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,641 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]. Starting root input initializers: 1
2016-01-14 16:08:24,640 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...RESULTS.-1_VALUES_RESULTS, applicationId=application_1452787704469_0001, dagName=[EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC] every.every/(1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:24,643 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:24,644 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 4EDC7B783DBE4289B39B9CC41BC4FD3C on vertex vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,645 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:24,645 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 4EDC7B783DBE4289B39B9CC41BC4FD3C asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:24,646 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:24,646 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:24,648 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:24,649 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 4EDC7B783DBE4289B39B9CC41BC4FD3C on vertex vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,649 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:24,649 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {4EDC7B783DBE4289B39B9CC41BC4FD3C=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:24,650 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] parallelism set to 1
2016-01-14 16:08:24,650 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:24,651 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787704469_0001_1_00, eventCount=1
2016-01-14 16:08:24,651 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,652 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=1931E85EA6F4475DBEB973E7F507C274, vertexId=vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:24,652 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=1931E85EA6F4475DBEB973E7F507C274, vertexId=vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,654 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=1931E85EA6F4475DBEB973E7F507C274, vertexName=BC0941F7977B4E14B7568F8D72D55606, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:24,655 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=1931E85EA6F4475DBEB973E7F507C274, vertexId=vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,657 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:VERTEX_INITIALIZED]: vertexName=BC0941F7977B4E14B7568F8D72D55606, vertexId=vertex_1452787704469_0001_1_00, initRequestedTime=1452787704640, initedTime=1452787704656, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:24,657 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] with distanceFromRoot: 0
2016-01-14 16:08:24,657 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:24,658 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:24,658 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in BC0941F7977B4E14B7568F8D72D55606
2016-01-14 16:08:24,658 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,659 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:24,659 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787704469_0001_1_00, startRequestedTime=1452787704658, startedTime=1452787704658
2016-01-14 16:08:24,660 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:24,660 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:24,661 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:TASK_STARTED]: vertexName=BC0941F7977B4E14B7568F8D72D55606, taskId=task_1452787704469_0001_1_00_000000, scheduledTime=1452787704660, launchTime=1452787704660
2016-01-14 16:08:24,661 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787704469_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:24,661 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,662 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC] every.every/(1/1) ...RESULTS.-1_VALUES_RESULTS, VertexName: BC0941F7977B4E14B7568F8D72D55606, VertexParallelism: 1, TaskAttemptID:attempt_1452787704469_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=4EDC7B783DBE4289B39B9CC41BC4FD3C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=1931E85EA6F4475DBEB973E7F507C274, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:24,662 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787704469_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:24,662 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:24,665 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787704469_0001, with dag id: dag_1452787704469_0001_1
2016-01-14 16:08:24,668 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:24,668 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:24,668 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:24,669 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787704469_0001_00_000001
2016-01-14 16:08:24,669 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704469_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:24,671 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787704469_0001_00_000001
2016-01-14 16:08:24,671 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:24,673 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704469_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:24,673 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787704469_0001_00_000001, launchTime=1452787704673
2016-01-14 16:08:24,673 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:24,674 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787704469_0001_00_000001
2016-01-14 16:08:24,675 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787704469_0001_1_00_000000_0] to container: [container_1452787704469_0001_00_000001]
2016-01-14 16:08:24,675 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704469_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:24,675 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787704469_0001_00_000001 given task: attempt_1452787704469_0001_1_00_000000_0
2016-01-14 16:08:24,675 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787704469_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787704469_0001_1_00_000000_0
2016-01-14 16:08:24,676 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787704469_0001_1_00_000000_0] started. Is using containerId: [container_1452787704469_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:24,676 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:24,676 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=BC0941F7977B4E14B7568F8D72D55606, taskAttemptId=attempt_1452787704469_0001_1_00_000000_0, startTime=1452787704675, containerId=container_1452787704469_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787704469_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:24,677 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787704469_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:24,677 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787704469_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:24 Starting to run new task attempt: attempt_1452787704469_0001_1_00_000000_0
2016-01-14 16:08:24,677 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787704469_0001_1_00_000000_0
2016-01-14 16:08:24,678 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:24,678 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:24,678 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:24,678 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:24,678 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:24,679 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:24,679 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC] every.every/(1/1) ...RESULTS.-1_VALUES_RESULTS, VertexName: BC0941F7977B4E14B7568F8D72D55606, VertexParallelism: 1, TaskAttemptID:attempt_1452787704469_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=4EDC7B783DBE4289B39B9CC41BC4FD3C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=1931E85EA6F4475DBEB973E7F507C274, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:24,679 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:24,680 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787704469_0001_1_00_000000_0
2016-01-14 16:08:24,680 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:24,680 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:24,680 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:24,681 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=4EDC7B783DBE4289B39B9CC41BC4FD3C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:24,681 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=1931E85EA6F4475DBEB973E7F507C274, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:24,681 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:24,682 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 4EDC7B783DBE4289B39B9CC41BC4FD3C
2016-01-14 16:08:24,682 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 4EDC7B783DBE4289B39B9CC41BC4FD3C
2016-01-14 16:08:24,682 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:24,683 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 1931E85EA6F4475DBEB973E7F507C274
2016-01-14 16:08:24,683 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:24,683 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 1931E85EA6F4475DBEB973E7F507C274
2016-01-14 16:08:24,685 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:24,689 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:24,689 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 4EDC7B783DBE4289B39B9CC41BC4FD3C
2016-01-14 16:08:24,689 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 4EDC7B783DBE4289B39B9CC41BC4FD3C
2016-01-14 16:08:24,697 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787704469_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:24,700 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:24,700 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 1931E85EA6F4475DBEB973E7F507C274
2016-01-14 16:08:24,705 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: BC0941F7977B4E14B7568F8D72D55606, ordinal: 0
2016-01-14 16:08:24,705 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BC0941F7977B4E14B7568F8D72D55606, mem on start (mb), free: 151, total: 384, max: 672
2016-01-14 16:08:24,705 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:24,706 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:24,706 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:24,706 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:24,706 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:24,707 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:24,707 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:24,707 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:24,708 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:24,708 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:24,708 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:24,709 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 4EDC7B783DBE4289B39B9CC41BC4FD3C, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:24,709 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 1931E85EA6F4475DBEB973E7F507C274, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:24,709 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:24,709 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 4EDC7B783DBE4289B39B9CC41BC4FD3C being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:24,709 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 4EDC7B783DBE4289B39B9CC41BC4FD3C
2016-01-14 16:08:24,710 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:24,710 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 4EDC7B783DBE4289B39B9CC41BC4FD3C
2016-01-14 16:08:24,710 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:24,711 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:24,711 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:24,711 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787704469_0001_1_00_000000_0
2016-01-14 16:08:24,715 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:24,715 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 4EDC7B783DBE4289B39B9CC41BC4FD3C
2016-01-14 16:08:24,716 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_RESULTS"], id: 1931E85EA6F4475DBEB973E7F507C274
2016-01-14 16:08:24,716 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_RESULTS"]
2016-01-14 16:08:24,716 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:24,716 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:24,717 INFO  input.MRInput (MRInput.java:checkAndAwaitRecordReaderInitialization(597)) - Awaiting RecordReader initialization
2016-01-14 16:08:24,717 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:24,717 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@603603cb
2016-01-14 16:08:24,718 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@603603cb
2016-01-14 16:08:24,719 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:24,719 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:24,719 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: BC0941F7977B4E14B7568F8D72D55606, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:24,720 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:24,721 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:24,722 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:24,723 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:24,723 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:24,724 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787704469_0001_1_00_000000_0
2016-01-14 16:08:24,724 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787704469_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:24,725 INFO  task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452787704469_0001_1_00_000000_0
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:24,729 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:24,729 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=BC0941F7977B4E14B7568F8D72D55606, taskAttemptId=attempt_1452787704469_0001_1_00_000000_0, startTime=1452787704675, finishTime=1452787704729, timeTaken=54, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452787704719, Process_Duration=6, Process_End_Time=1452787704725, Read_Duration=1, Tuples_Read=1, cascading.flow.StepCounters, Tuples_Read=1
2016-01-14 16:08:24,730 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787704469_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 16:08:24,730 INFO  impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452787704469_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 16:08:24,730 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:24,730 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:TASK_FINISHED]: vertexName=BC0941F7977B4E14B7568F8D72D55606, taskId=task_1452787704469_0001_1_00_000000, startTime=1452787704675, finishTime=1452787704730, timeTaken=55, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-01-14 16:08:24,731 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787704469_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 16:08:24,731 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:24,731 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] : 1
2016-01-14 16:08:24,731 INFO  impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] because task failed: task_1452787704469_0001_1_00_000000
2016-01-14 16:08:24,731 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] due to trigger: OWN_TASK_FAILURE
2016-01-14 16:08:24,732 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 16:08:24,732 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,732 INFO  impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=1931E85EA6F4475DBEB973E7F507C274, vertexId=vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,733 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:24,734 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:VERTEX_FINISHED]: vertexName=BC0941F7977B4E14B7568F8D72D55606, vertexId=vertex_1452787704469_0001_1_00, initRequestedTime=1452787704640, initedTime=1452787704656, startRequestedTime=1452787704658, startedTime=1452787704658, finishTime=1452787704733, timeTaken=75, status=FAILED, diagnostics=Task failed, taskId=task_1452787704469_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452787704675, firstTasksToStart=[ task_1452787704469_0001_1_00_000000 ], lastTaskFinishTime=1452787704729, lastTasksToFinish=[ task_1452787704469_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 16:08:24,738 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 16:08:24,738 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 19 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452787704719, Process_Duration=6, Process_End_Time=1452787704725, Read_Duration=1, Tuples_Read=1][cascading.flow.StepCounters Tuples_Read=1]]
2016-01-14 16:08:24,738 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BC0941F7977B4E14B7568F8D72D55606, mem on close (mb), free: 148, total: 384, max: 672
2016-01-14 16:08:24,738 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=BC0941F7977B4E14B7568F8D72D55606, index=0
2016-01-14 16:08:24,739 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=BC0941F7977B4E14B7568F8D72D55606, sourceVertex=4EDC7B783DBE4289B39B9CC41BC4FD3C
2016-01-14 16:08:24,739 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=BC0941F7977B4E14B7568F8D72D55606, sourceVertex=1931E85EA6F4475DBEB973E7F507C274
2016-01-14 16:08:24,739 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787704469_0001_00_000001
2016-01-14 16:08:24,739 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787704469_0001_00_000001
2016-01-14 16:08:24,740 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:24,741 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787704469_0001_00_000001, stoppedTime=1452787704740, exitStatus=0
2016-01-14 16:08:24,741 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704469_0001_00_000001 transitioned from RUNNING to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:24,741 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452787704469_0001_1_00_000000_0 failed: true container: container_1452787704469_0001_00_000001 numFailedTAs: 0
2016-01-14 16:08:24,748 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 16:08:24,749 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787704469_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 16:08:24,749 INFO  impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 16:08:24,749 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787704469_0001_1
2016-01-14 16:08:24,749 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: 1931E85EA6F4475DBEB973E7F507C274 for vertex: vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,750 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787704469_0001_1, queueSize=0
2016-01-14 16:08:24,750 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:24,751 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787704469_0001_1, startTime=1452787704638, finishTime=1452787704749, timeTaken=111, status=FAILED, diagnostics=Vertex failed, vertexName=BC0941F7977B4E14B7568F8D72D55606, vertexId=vertex_1452787704469_0001_1_00, diagnostics=[Task failed, taskId=task_1452787704469_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 16:08:24,751 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787704469_0001_1 finished with state: FAILED
2016-01-14 16:08:24,751 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787704469_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:24,752 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787704469_0001_00_000001
2016-01-14 16:08:24 Completed Dag: dag_1452787704469_0001_1
2016-01-14 16:08:24,752 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787704469_0001_1, dagState=FAILED
2016-01-14 16:08:24,752 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787704469_0001_1_post
2016-01-14 16:08:24,752 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:24,752 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:24,752 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704469_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 16:08:24,749 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452787704469_0001_00_000001 completed but with errors
2016-01-14 16:08:24,754 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(1033)) - Container container_1452787704469_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 16:08:24,755 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704469_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 16:08:24,755 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787704469_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 16:08:24,768 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...RESULTS.-1_VALUES_RESULTS, applicationId=application_1452787704469_0001
2016-01-14 16:08:24,773 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:24,773 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:24,773 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:24,773 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:24,773 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:24,774 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:24,774 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:24,774 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:24,774 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:24,775 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:24,775 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:24,775 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:24,775 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:24,781 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC/.tez/application_1452787704469_0001
2016-01-14 16:08:24,781 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping all jobs
2016-01-14 16:08:24,782 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping: (1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:24,782 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopped all jobs
2016-01-14 16:08:24,783 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.335
2016-01-14 16:08:24,783 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:24,840 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:24,841 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:24,880 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.012
2016-01-14 16:08:24,888 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-01-14 16:08:24,888 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:24,889 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:24,889 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:24,904 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:24,904 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:24,915 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:24,915 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:24,916 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_ALL"]
2016-01-14 16:08:24,916 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:24,916 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:24,916 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:24,918 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:24,918 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:24,930 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:24,934 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:24,935 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:24,935 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:24,944 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370/.tez/application_1452787704934_0001 doesn't exist and is created
2016-01-14 16:08:24,959 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:24,959 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:24,960 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370/.tez/application_1452787704934_0001
2016-01-14 16:08:24,963 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787704934_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:24,973 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:24,974 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:24,976 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:24,976 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:24,976 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370/.tez/application_1452787704934_0001/localmode-log-dir
2016-01-14 16:08:24,977 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370/.tez/application_1452787704934_0001/localmode-log-dir/history.txt.appattempt_1452787704934_0001_000000, maxErrors=10
2016-01-14 16:08:24,977 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:24,977 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787704934_0001_000000, appSubmitTime=1452787704962, launchTime=1452787704963
2016-01-14 16:08:24,984 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:46079
2016-01-14 16:08:24,984 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:24,988 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:24,988 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:24,989 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:24,989 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:24,994 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787704934_0001_000000, startTime=1452787704994
2016-01-14 16:08:24,994 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:24,994 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:25,060 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:25,060 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:25,060 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.-1_VALUES_ALL, applicationId=application_1452787704934_0001, dagName=[D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370] every.every/(1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:25,076 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370] every.every/(1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:25,078 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787704934_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370/.tez/application_1452787704934_0001/localmode-log-dir/dag_1452787704934_0001_1.dot
2016-01-14 16:08:25,078 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370/.tez/application_1452787704934_0001/localmode-log-dir/dag_1452787704934_0001_1-tez-dag.pb.txt
2016-01-14 16:08:25,083 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787704934_0001_1
2016-01-14 16:08:25,083 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:25,084 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370] every.every/(1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:25 Running Dag: dag_1452787704934_0001_1
2016-01-14 16:08:25,097 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787704934_0001_1, submitTime=1452787705077
2016-01-14 16:08:25,097 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:25,098 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex B5D4B984971A42F590F1A00DADD3B035
2016-01-14 16:08:25,098 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:25,098 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787704934_0001_1, initTime=1452787705098
2016-01-14 16:08:25,099 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:25,100 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787704934_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:25,101 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:DAG_STARTED]: dagID=dag_1452787704934_0001_1, startTime=1452787705100
2016-01-14 16:08:25,101 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:25,101 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:25,101 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.-1_VALUES_ALL, applicationId=application_1452787704934_0001, dagName=[D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370] every.every/(1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:25,101 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787704934_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:25,103 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: B5D4B984971A42F590F1A00DADD3B035 : {91A61A8AE3684AEE8C251B1102124310={InputName=91A61A8AE3684AEE8C251B1102124310}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:25,103 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 91A61A8AE3684AEE8C251B1102124310, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:25,103 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,103 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,103 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,104 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]. Starting root input initializers: 1
2016-01-14 16:08:25,104 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:25,105 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 91A61A8AE3684AEE8C251B1102124310 on vertex vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,106 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:25,106 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 91A61A8AE3684AEE8C251B1102124310 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:25,107 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:25,107 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:25,108 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:25,109 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 91A61A8AE3684AEE8C251B1102124310 on vertex vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,110 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:25,110 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {91A61A8AE3684AEE8C251B1102124310=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:25,110 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] parallelism set to 1
2016-01-14 16:08:25,110 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:25,110 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787704934_0001_1_00, eventCount=1
2016-01-14 16:08:25,111 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,111 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=C3AB2F238449423C9068D89C040DFD0F, vertexId=vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:25,111 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=C3AB2F238449423C9068D89C040DFD0F, vertexId=vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,113 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=C3AB2F238449423C9068D89C040DFD0F, vertexName=B5D4B984971A42F590F1A00DADD3B035, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:25,113 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=C3AB2F238449423C9068D89C040DFD0F, vertexId=vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,114 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:25,115 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B5D4B984971A42F590F1A00DADD3B035, vertexId=vertex_1452787704934_0001_1_00, initRequestedTime=1452787705103, initedTime=1452787705114, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:25,115 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] with distanceFromRoot: 0
2016-01-14 16:08:25,115 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:25,116 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in B5D4B984971A42F590F1A00DADD3B035
2016-01-14 16:08:25,116 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,116 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:25,117 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787704934_0001_1_00, startRequestedTime=1452787705116, startedTime=1452787705116
2016-01-14 16:08:25,117 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:25,117 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:25,118 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:TASK_STARTED]: vertexName=B5D4B984971A42F590F1A00DADD3B035, taskId=task_1452787704934_0001_1_00_000000, scheduledTime=1452787705117, launchTime=1452787705117
2016-01-14 16:08:25,118 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787704934_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:25,119 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,119 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370] every.every/(1/1) ...ld'_RESULTS.-1_VALUES_ALL, VertexName: B5D4B984971A42F590F1A00DADD3B035, VertexParallelism: 1, TaskAttemptID:attempt_1452787704934_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=91A61A8AE3684AEE8C251B1102124310, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=C3AB2F238449423C9068D89C040DFD0F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:25,119 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787704934_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:25,120 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787704934_0001, with dag id: dag_1452787704934_0001_1
2016-01-14 16:08:25,120 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:25,121 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:25,121 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:25,122 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:25,122 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787704934_0001_00_000001
2016-01-14 16:08:25,124 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704934_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:25,126 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787704934_0001_00_000001
2016-01-14 16:08:25,126 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:25,127 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:25,127 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704934_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:25,127 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787704934_0001_00_000001, launchTime=1452787705127
2016-01-14 16:08:25,128 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787704934_0001_00_000001
2016-01-14 16:08:25,128 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787704934_0001_1_00_000000_0] to container: [container_1452787704934_0001_00_000001]
2016-01-14 16:08:25,128 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704934_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:25,129 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787704934_0001_00_000001 given task: attempt_1452787704934_0001_1_00_000000_0
2016-01-14 16:08:25,129 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787704934_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787704934_0001_1_00_000000_0
2016-01-14 16:08:25,129 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787704934_0001_1_00_000000_0] started. Is using containerId: [container_1452787704934_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:25 Starting to run new task attempt: attempt_1452787704934_0001_1_00_000000_0
2016-01-14 16:08:25,130 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:25,130 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B5D4B984971A42F590F1A00DADD3B035, taskAttemptId=attempt_1452787704934_0001_1_00_000000_0, startTime=1452787705129, containerId=container_1452787704934_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787704934_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:25,130 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787704934_0001_1_00_000000_0
2016-01-14 16:08:25,130 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:25,130 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787704934_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:25,131 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:25,131 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:25,131 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787704934_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:25,131 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:25,132 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:25,133 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:25,133 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370] every.every/(1/1) ...ld'_RESULTS.-1_VALUES_ALL, VertexName: B5D4B984971A42F590F1A00DADD3B035, VertexParallelism: 1, TaskAttemptID:attempt_1452787704934_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=91A61A8AE3684AEE8C251B1102124310, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=C3AB2F238449423C9068D89C040DFD0F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:25,133 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:25,133 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787704934_0001_1_00_000000_0
2016-01-14 16:08:25,134 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:25,134 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:25,135 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787704934_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:25,135 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:25,135 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=91A61A8AE3684AEE8C251B1102124310, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:25,136 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:25,137 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 91A61A8AE3684AEE8C251B1102124310
2016-01-14 16:08:25,137 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 91A61A8AE3684AEE8C251B1102124310
2016-01-14 16:08:25,138 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:25,140 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=C3AB2F238449423C9068D89C040DFD0F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:25,142 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:25,142 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:25,142 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: C3AB2F238449423C9068D89C040DFD0F
2016-01-14 16:08:25,142 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:25,142 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: C3AB2F238449423C9068D89C040DFD0F
2016-01-14 16:08:25,142 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 91A61A8AE3684AEE8C251B1102124310
2016-01-14 16:08:25,143 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 91A61A8AE3684AEE8C251B1102124310
2016-01-14 16:08:25,150 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B5D4B984971A42F590F1A00DADD3B035, ordinal: 0
2016-01-14 16:08:25,150 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B5D4B984971A42F590F1A00DADD3B035, mem on start (mb), free: 293, total: 385, max: 672
2016-01-14 16:08:25,150 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:25,150 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:25,150 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:25,157 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:25,157 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: C3AB2F238449423C9068D89C040DFD0F
2016-01-14 16:08:25,157 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:25,157 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:25,157 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:25,157 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:25,157 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:25,158 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:25,158 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:25,158 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:25,158 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 91A61A8AE3684AEE8C251B1102124310, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:25,158 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, C3AB2F238449423C9068D89C040DFD0F, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:25,158 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:25,158 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 91A61A8AE3684AEE8C251B1102124310 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:25,159 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:25,159 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:25,159 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 91A61A8AE3684AEE8C251B1102124310
2016-01-14 16:08:25,159 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:25,159 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 91A61A8AE3684AEE8C251B1102124310
2016-01-14 16:08:25,159 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:25,160 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787704934_0001_1_00_000000_0
2016-01-14 16:08:25,163 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:25,164 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:25,164 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@729b0c63
2016-01-14 16:08:25,165 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 91A61A8AE3684AEE8C251B1102124310
2016-01-14 16:08:25,166 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_ALL"], id: C3AB2F238449423C9068D89C040DFD0F
2016-01-14 16:08:25,166 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_ALL"]
2016-01-14 16:08:25,167 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:25,167 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:25,168 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@729b0c63
2016-01-14 16:08:25,168 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:25,168 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:25,169 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B5D4B984971A42F590F1A00DADD3B035, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:25,169 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:25,170 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:25,171 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:25,172 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:25,172 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:25,172 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787704934_0001_1_00_000000_0
2016-01-14 16:08:25,172 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787704934_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:25,173 INFO  task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452787704934_0001_1_00_000000_0
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:25,183 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 18 [[File System Counters FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452787705169, Process_Duration=4, Process_End_Time=1452787705173, Read_Duration=0, Tuples_Read=1][cascading.flow.StepCounters Tuples_Read=1]]
2016-01-14 16:08:25,183 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B5D4B984971A42F590F1A00DADD3B035, mem on close (mb), free: 291, total: 385, max: 672
2016-01-14 16:08:25,183 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B5D4B984971A42F590F1A00DADD3B035, taskAttemptId=attempt_1452787704934_0001_1_00_000000_0, startTime=1452787705129, finishTime=1452787705183, timeTaken=54, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452787705169, Process_Duration=4, Process_End_Time=1452787705173, Read_Duration=0, Tuples_Read=1, cascading.flow.StepCounters, Tuples_Read=1
2016-01-14 16:08:25,183 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:25,184 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787704934_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 16:08:25,183 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=B5D4B984971A42F590F1A00DADD3B035, index=0
2016-01-14 16:08:25,184 INFO  impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452787704934_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 16:08:25,184 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=B5D4B984971A42F590F1A00DADD3B035, sourceVertex=91A61A8AE3684AEE8C251B1102124310
2016-01-14 16:08:25,184 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:25,184 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=B5D4B984971A42F590F1A00DADD3B035, sourceVertex=C3AB2F238449423C9068D89C040DFD0F
2016-01-14 16:08:25,184 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:TASK_FINISHED]: vertexName=B5D4B984971A42F590F1A00DADD3B035, taskId=task_1452787704934_0001_1_00_000000, startTime=1452787705129, finishTime=1452787705184, timeTaken=55, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-01-14 16:08:25,185 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787704934_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 16:08:25,185 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787704934_0001_00_000001
2016-01-14 16:08:25,185 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] : 1
2016-01-14 16:08:25,185 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:25,186 INFO  impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] because task failed: task_1452787704934_0001_1_00_000000
2016-01-14 16:08:25,186 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] due to trigger: OWN_TASK_FAILURE
2016-01-14 16:08:25,185 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787704934_0001_00_000001
2016-01-14 16:08:25,186 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 16:08:25,186 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,186 INFO  impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=C3AB2F238449423C9068D89C040DFD0F, vertexId=vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,195 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787704934_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 16:08:25,195 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452787704934_0001_00_000001 completed but with errors
2016-01-14 16:08:25,195 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:25,196 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:VERTEX_FINISHED]: vertexName=B5D4B984971A42F590F1A00DADD3B035, vertexId=vertex_1452787704934_0001_1_00, initRequestedTime=1452787705103, initedTime=1452787705114, startRequestedTime=1452787705116, startedTime=1452787705116, finishTime=1452787705195, timeTaken=79, status=FAILED, diagnostics=Task failed, taskId=task_1452787704934_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452787705129, firstTasksToStart=[ task_1452787704934_0001_1_00_000000 ], lastTaskFinishTime=1452787705183, lastTasksToFinish=[ task_1452787704934_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 16:08:25,196 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 16:08:25,196 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:25,196 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787704934_0001_00_000001, stoppedTime=1452787705196, exitStatus=0
2016-01-14 16:08:25,197 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704934_0001_00_000001 transitioned from RUNNING to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:25,197 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452787704934_0001_1_00_000000_0 failed: true container: container_1452787704934_0001_00_000001 numFailedTAs: 0
2016-01-14 16:08:25,198 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 16:08:25,198 INFO  impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 16:08:25,198 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787704934_0001_1
2016-01-14 16:08:25,198 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: C3AB2F238449423C9068D89C040DFD0F for vertex: vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,199 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787704934_0001_1, queueSize=0
2016-01-14 16:08:25,199 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:25,200 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787704934_0001_1, startTime=1452787705100, finishTime=1452787705199, timeTaken=99, status=FAILED, diagnostics=Vertex failed, vertexName=B5D4B984971A42F590F1A00DADD3B035, vertexId=vertex_1452787704934_0001_1_00, diagnostics=[Task failed, taskId=task_1452787704934_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 16:08:25,200 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787704934_0001_1 finished with state: FAILED
2016-01-14 16:08:25,200 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787704934_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:25,201 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(1033)) - Container container_1452787704934_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 16:08:25,201 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704934_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:25,201 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787704934_0001_00_000001
2016-01-14 16:08:25 Completed Dag: dag_1452787704934_0001_1
2016-01-14 16:08:25,201 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787704934_0001_1, dagState=FAILED
2016-01-14 16:08:25,201 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787704934_0001_1_post
2016-01-14 16:08:25,201 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:25,202 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:25,202 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787704934_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 16:08:25,213 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ld'_RESULTS.-1_VALUES_ALL, applicationId=application_1452787704934_0001
2016-01-14 16:08:25,215 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:25,215 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:25,215 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:25,215 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:25,215 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:25,216 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:25,216 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:25,216 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:25,217 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:25,217 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:25,217 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:25,218 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:25,218 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:25,221 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370/.tez/application_1452787704934_0001
2016-01-14 16:08:25,222 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping all jobs
2016-01-14 16:08:25,222 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping: (1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:25,222 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopped all jobs
2016-01-14 16:08:25,224 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.308
2016-01-14 16:08:25,224 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:25,246 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:25,247 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:25,264 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:25,264 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:25,280 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.006
2016-01-14 16:08:25,286 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.010
2016-01-14 16:08:25,286 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:25,286 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:25,287 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_ARGS_'field2'
2016-01-14 16:08:25,308 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:25,309 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:25,342 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.009
2016-01-14 16:08:25,360 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.027
2016-01-14 16:08:25,361 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:25,361 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:25,361 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:25,375 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:25,376 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:25,388 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:25,388 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:25,389 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_ARGS_RESULTS"]
2016-01-14 16:08:25,389 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:25,390 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:25,390 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:25,393 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:25,393 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:25,407 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:25,413 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:25,413 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:25,414 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:25,424 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0/.tez/application_1452787705413_0001 doesn't exist and is created
2016-01-14 16:08:25,443 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:25,444 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:25,444 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0/.tez/application_1452787705413_0001
2016-01-14 16:08:25,448 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787705413_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:25,458 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:25,459 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:25,461 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:25,461 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:25,461 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0/.tez/application_1452787705413_0001/localmode-log-dir
2016-01-14 16:08:25,462 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0/.tez/application_1452787705413_0001/localmode-log-dir/history.txt.appattempt_1452787705413_0001_000000, maxErrors=10
2016-01-14 16:08:25,462 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:25,462 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787705413_0001_000000, appSubmitTime=1452787705447, launchTime=1452787705447
2016-01-14 16:08:25,469 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:25,470 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:55161
2016-01-14 16:08:25,474 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:25,475 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:25,475 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:25,481 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:25,483 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787705413_0001_000000, startTime=1452787705483
2016-01-14 16:08:25,483 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:25,483 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:25,545 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:25,545 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:25,545 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...'_RESULTS.-1_ARGS_RESULTS, applicationId=application_1452787705413_0001, dagName=[36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0] every.every/(1/1) ...'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:25,562 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0] every.every/(1/1) ...'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:25,563 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787705413_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0/.tez/application_1452787705413_0001/localmode-log-dir/dag_1452787705413_0001_1.dot
2016-01-14 16:08:25,564 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0/.tez/application_1452787705413_0001/localmode-log-dir/dag_1452787705413_0001_1-tez-dag.pb.txt
2016-01-14 16:08:25,569 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787705413_0001_1
2016-01-14 16:08:25,569 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:25,569 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0] every.every/(1/1) ...'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:25 Running Dag: dag_1452787705413_0001_1
2016-01-14 16:08:25,581 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:25,582 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787705413_0001_1, submitTime=1452787705562
2016-01-14 16:08:25,582 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex CFFBEE5A1C524954846B988643FBC8B6
2016-01-14 16:08:25,583 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:25,583 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:25,584 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787705413_0001_1, initTime=1452787705582
2016-01-14 16:08:25,584 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787705413_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:25,584 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:DAG_STARTED]: dagID=dag_1452787705413_0001_1, startTime=1452787705584
2016-01-14 16:08:25,584 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:25,585 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787705413_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:25,585 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:25,585 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: CFFBEE5A1C524954846B988643FBC8B6 : {0E08DBA5CE864189808FF87D736B2FF9={InputName=0E08DBA5CE864189808FF87D736B2FF9}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:25,585 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 0E08DBA5CE864189808FF87D736B2FF9, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:25,585 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,585 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,585 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,586 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]. Starting root input initializers: 1
2016-01-14 16:08:25,588 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...'_RESULTS.-1_ARGS_RESULTS, applicationId=application_1452787705413_0001, dagName=[36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0] every.every/(1/1) ...'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:25,588 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:25,588 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 0E08DBA5CE864189808FF87D736B2FF9 on vertex vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,590 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:25,590 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 0E08DBA5CE864189808FF87D736B2FF9 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:25,590 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:25,591 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:25,592 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:25,593 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 0E08DBA5CE864189808FF87D736B2FF9 on vertex vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,593 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:25,593 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {0E08DBA5CE864189808FF87D736B2FF9=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:25,594 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6] parallelism set to 1
2016-01-14 16:08:25,594 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:25,594 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787705413_0001_1_00, eventCount=1
2016-01-14 16:08:25,595 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,595 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=61D3681347CF4A909CEE58BAFAC9B907, vertexId=vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:25,595 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=61D3681347CF4A909CEE58BAFAC9B907, vertexId=vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,597 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=61D3681347CF4A909CEE58BAFAC9B907, vertexName=CFFBEE5A1C524954846B988643FBC8B6, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:25,597 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=61D3681347CF4A909CEE58BAFAC9B907, vertexId=vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,599 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:25,599 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:VERTEX_INITIALIZED]: vertexName=CFFBEE5A1C524954846B988643FBC8B6, vertexId=vertex_1452787705413_0001_1_00, initRequestedTime=1452787705585, initedTime=1452787705598, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:25,599 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6] with distanceFromRoot: 0
2016-01-14 16:08:25,599 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:25,599 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in CFFBEE5A1C524954846B988643FBC8B6
2016-01-14 16:08:25,599 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,600 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:25,600 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787705413_0001_1_00, startRequestedTime=1452787705599, startedTime=1452787705599
2016-01-14 16:08:25,600 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:25,601 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:25,601 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:TASK_STARTED]: vertexName=CFFBEE5A1C524954846B988643FBC8B6, taskId=task_1452787705413_0001_1_00_000000, scheduledTime=1452787705601, launchTime=1452787705601
2016-01-14 16:08:25,601 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787705413_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:25,602 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,602 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0] every.every/(1/1) ...'_RESULTS.-1_ARGS_RESULTS, VertexName: CFFBEE5A1C524954846B988643FBC8B6, VertexParallelism: 1, TaskAttemptID:attempt_1452787705413_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0E08DBA5CE864189808FF87D736B2FF9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=61D3681347CF4A909CEE58BAFAC9B907, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:25,603 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787705413_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:25,603 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:25,604 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:25,604 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:25,604 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:25,605 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787705413_0001_00_000001
2016-01-14 16:08:25,605 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705413_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:25,607 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787705413_0001_00_000001
2016-01-14 16:08:25,607 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:25,607 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705413_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:25,608 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:25,608 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787705413_0001_00_000001, launchTime=1452787705608
2016-01-14 16:08:25,609 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787705413_0001_00_000001
2016-01-14 16:08:25,609 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787705413_0001_1_00_000000_0] to container: [container_1452787705413_0001_00_000001]
2016-01-14 16:08:25,610 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705413_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:25,610 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787705413_0001_00_000001 given task: attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25,610 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787705413_0001, with dag id: dag_1452787705413_0001_1
2016-01-14 16:08:25,610 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787705413_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25 Starting to run new task attempt: attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25,610 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787705413_0001_1_00_000000_0] started. Is using containerId: [container_1452787705413_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:25,611 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25,611 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:25,611 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:25,611 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:25,612 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:25,612 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:25,612 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:25,612 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:25,611 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=CFFBEE5A1C524954846B988643FBC8B6, taskAttemptId=attempt_1452787705413_0001_1_00_000000_0, startTime=1452787705610, containerId=container_1452787705413_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787705413_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:25,612 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787705413_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:25,612 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787705413_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:25,613 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0] every.every/(1/1) ...'_RESULTS.-1_ARGS_RESULTS, VertexName: CFFBEE5A1C524954846B988643FBC8B6, VertexParallelism: 1, TaskAttemptID:attempt_1452787705413_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0E08DBA5CE864189808FF87D736B2FF9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=61D3681347CF4A909CEE58BAFAC9B907, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:25,613 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:25,613 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25,613 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:25,613 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:25,616 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=0E08DBA5CE864189808FF87D736B2FF9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:25,616 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:25,616 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=61D3681347CF4A909CEE58BAFAC9B907, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:25,618 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:25,618 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 61D3681347CF4A909CEE58BAFAC9B907
2016-01-14 16:08:25,618 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:25,618 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 61D3681347CF4A909CEE58BAFAC9B907
2016-01-14 16:08:25,618 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787705413_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:25,619 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:25,620 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 0E08DBA5CE864189808FF87D736B2FF9
2016-01-14 16:08:25,620 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 0E08DBA5CE864189808FF87D736B2FF9
2016-01-14 16:08:25,621 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:25,624 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:25,625 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 0E08DBA5CE864189808FF87D736B2FF9
2016-01-14 16:08:25,625 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 0E08DBA5CE864189808FF87D736B2FF9
2016-01-14 16:08:25,630 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: CFFBEE5A1C524954846B988643FBC8B6, ordinal: 0
2016-01-14 16:08:25,632 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: CFFBEE5A1C524954846B988643FBC8B6, mem on start (mb), free: 216, total: 385, max: 672
2016-01-14 16:08:25,632 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:25,632 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:25,632 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:25,633 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:25,633 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 61D3681347CF4A909CEE58BAFAC9B907
2016-01-14 16:08:25,634 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:25,634 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:25,634 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:25,635 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:25,635 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:25,635 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:25,636 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:25,636 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:25,636 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 61D3681347CF4A909CEE58BAFAC9B907, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:25,636 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 0E08DBA5CE864189808FF87D736B2FF9, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:25,637 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:25,637 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 0E08DBA5CE864189808FF87D736B2FF9 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:25,637 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 0E08DBA5CE864189808FF87D736B2FF9
2016-01-14 16:08:25,637 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:25,637 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 0E08DBA5CE864189808FF87D736B2FF9
2016-01-14 16:08:25,637 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:25,638 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:25,638 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:25,639 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25,639 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:25,639 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@2230658c
2016-01-14 16:08:25,640 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@2230658c
2016-01-14 16:08:25,643 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:25,643 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:25,642 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:25,646 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 0E08DBA5CE864189808FF87D736B2FF9
2016-01-14 16:08:25,647 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_ARGS_RESULTS"], id: 61D3681347CF4A909CEE58BAFAC9B907
2016-01-14 16:08:25,647 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_ARGS_RESULTS"]
2016-01-14 16:08:25,647 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:25,648 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:25,648 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: CFFBEE5A1C524954846B988643FBC8B6, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:25,651 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:25,652 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:25,652 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25,653 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787705413_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:25,654 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25,654 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: CFFBEE5A1C524954846B988643FBC8B6, mem on close (mb), free: 215, total: 385, max: 672
2016-01-14 16:08:25 Completed running task attempt: attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25,655 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787705413_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:25,657 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:25,657 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=CFFBEE5A1C524954846B988643FBC8B6, taskAttemptId=attempt_1452787705413_0001_1_00_000000_0, startTime=1452787705610, finishTime=1452787705657, timeTaken=47, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787705648, Process_Duration=6, Process_End_Time=1452787705654, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:25,657 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787705413_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:25,658 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25,658 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:TASK_FINISHED]: vertexName=CFFBEE5A1C524954846B988643FBC8B6, taskId=task_1452787705413_0001_1_00_000000, startTime=1452787705610, finishTime=1452787705658, timeTaken=48, status=SUCCEEDED, successfulAttemptID=attempt_1452787705413_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787705648, Process_Duration=6, Process_End_Time=1452787705654, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:25,659 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787705413_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:25,659 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6] : 1
2016-01-14 16:08:25,659 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,660 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:25,661 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:25,660 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:VERTEX_FINISHED]: vertexName=CFFBEE5A1C524954846B988643FBC8B6, vertexId=vertex_1452787705413_0001_1_00, initRequestedTime=1452787705585, initedTime=1452787705598, startRequestedTime=1452787705599, startedTime=1452787705599, finishTime=1452787705659, timeTaken=60, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787705648, Process_Duration=6, Process_End_Time=1452787705654, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787705610, firstTasksToStart=[ task_1452787705413_0001_1_00_000000 ], lastTaskFinishTime=1452787705657, lastTasksToFinish=[ task_1452787705413_0001_1_00_000000 ], minTaskDuration=47, maxTaskDuration=47, avgTaskDuration=47.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787705413_0001_1_00_000000 ], longestDurationTasks=[ task_1452787705413_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:25,662 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:25,662 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:25,663 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705413_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:25,664 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787705413_0001_00_000001, stoppedTime=1452787705664, exitStatus=0
2016-01-14 16:08:25,664 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705413_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:25,664 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:25,664 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:25,665 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787705648, Process_Duration=6, Process_End_Time=1452787705654, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:25,665 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:25,665 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:25,666 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787705413_0001_00_000001
2016-01-14 16:08:25,665 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787705413_0001_1
2016-01-14 16:08:25,666 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787705413_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:25,666 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787705413_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:25,666 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787705413_0001_1
2016-01-14 16:08:25,667 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787705413_0001_00_000001, Exiting
2016-01-14 16:08:25,667 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787705413_0001_00_000001
2016-01-14 16:08:25,667 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787705413_0001_00_000001
2016-01-14 16:08:25,667 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 61D3681347CF4A909CEE58BAFAC9B907 for vertex: vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,671 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787705413_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:25,671 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787705413_0001_00_000001 completed successfully
2016-01-14 16:08:25,678 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787705413_0001_1, queueSize=0
2016-01-14 16:08:25,679 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:25,679 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787705413_0001_1, startTime=1452787705584, finishTime=1452787705677, timeTaken=93, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787705648, Process_Duration=6, Process_End_Time=1452787705654, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:25,679 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787705413_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:25,679 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787705413_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:25,679 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705413_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:25,680 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787705413_0001_00_000001
2016-01-14 16:08:25 Completed Dag: dag_1452787705413_0001_1
2016-01-14 16:08:25,680 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787705413_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:25,680 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787705413_0001_1_post
2016-01-14 16:08:25,680 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:25,680 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:25,687 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...'_RESULTS.-1_ARGS_RESULTS, applicationId=application_1452787705413_0001
2016-01-14 16:08:25,690 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:25,690 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:25,691 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:25,691 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:25,691 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:25,691 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:25,692 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:25,693 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:25,693 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:25,693 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:25,694 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:25,694 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:25,694 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:25,698 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0/.tez/application_1452787705413_0001
2016-01-14 16:08:25,699 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.311
2016-01-14 16:08:25,764 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:25,786 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:25,786 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:25,817 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.004
2016-01-14 16:08:25,819 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.006
2016-01-14 16:08:25,819 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:25,819 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:25,820 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_ARGS_ALL
2016-01-14 16:08:25,840 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:25,841 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:25,848 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:25,848 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:25,880 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 16:08:25,883 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 16:08:25,883 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:25,884 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:25,884 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:25,898 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:25,898 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_-1
2016-01-14 16:08:25,909 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:25,910 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:25,910 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_-1"]
2016-01-14 16:08:25,910 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:25,910 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:25,910 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:25,912 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ld'_RESULTS.0_'field2'_-1
2016-01-14 16:08:25,912 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:25,925 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:25,929 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:25,930 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:25,930 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:25,940 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520/.tez/application_1452787705930_0001 doesn't exist and is created
2016-01-14 16:08:25,956 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:25,956 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:25,957 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520/.tez/application_1452787705930_0001
2016-01-14 16:08:25,960 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787705930_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:25,970 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:25,971 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:25,973 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:25,973 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:25,973 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520/.tez/application_1452787705930_0001/localmode-log-dir
2016-01-14 16:08:25,974 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520/.tez/application_1452787705930_0001/localmode-log-dir/history.txt.appattempt_1452787705930_0001_000000, maxErrors=10
2016-01-14 16:08:25,974 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:25,974 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787705930_0001_000000, appSubmitTime=1452787705960, launchTime=1452787705960
2016-01-14 16:08:25,980 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:25,984 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:45809
2016-01-14 16:08:25,986 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:25,987 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:25,988 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:25,994 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:25,996 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787705930_0001_000000, startTime=1452787705996
2016-01-14 16:08:25,996 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:25,996 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:26,057 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:26,057 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:26,057 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.0_'field2'_-1, applicationId=application_1452787705930_0001, dagName=[ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520] every.every/(1/1) ...ld'_RESULTS.0_'field2'_-1
2016-01-14 16:08:26,087 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520] every.every/(1/1) ...ld'_RESULTS.0_'field2'_-1
2016-01-14 16:08:26,089 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787705930_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520/.tez/application_1452787705930_0001/localmode-log-dir/dag_1452787705930_0001_1.dot
2016-01-14 16:08:26,089 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520/.tez/application_1452787705930_0001/localmode-log-dir/dag_1452787705930_0001_1-tez-dag.pb.txt
2016-01-14 16:08:26,095 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787705930_0001_1
2016-01-14 16:08:26,095 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:26,095 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520] every.every/(1/1) ...ld'_RESULTS.0_'field2'_-1
2016-01-14 16:08:26 Running Dag: dag_1452787705930_0001_1
2016-01-14 16:08:26,106 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787705930_0001_1, submitTime=1452787706088
2016-01-14 16:08:26,106 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:26,107 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex B98F53A5648C424B983DC3CC7EEFDF1D
2016-01-14 16:08:26,107 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:26,107 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787705930_0001_1, initTime=1452787706106
2016-01-14 16:08:26,107 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:26,108 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787705930_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:26,109 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:DAG_STARTED]: dagID=dag_1452787705930_0001_1, startTime=1452787706108
2016-01-14 16:08:26,109 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:26,109 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:26,109 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.0_'field2'_-1, applicationId=application_1452787705930_0001, dagName=[ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520] every.every/(1/1) ...ld'_RESULTS.0_'field2'_-1
2016-01-14 16:08:26,109 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787705930_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:26,110 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: B98F53A5648C424B983DC3CC7EEFDF1D : {855915D5C2C74D63811526AF96A61CC1={InputName=855915D5C2C74D63811526AF96A61CC1}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:26,110 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 855915D5C2C74D63811526AF96A61CC1, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:26,110 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,110 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,110 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,110 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]. Starting root input initializers: 1
2016-01-14 16:08:26,111 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:26,111 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 855915D5C2C74D63811526AF96A61CC1 on vertex vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,112 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:26,113 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 855915D5C2C74D63811526AF96A61CC1 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:26,113 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:26,113 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:26,114 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:26,117 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 855915D5C2C74D63811526AF96A61CC1 on vertex vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,117 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:26,117 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {855915D5C2C74D63811526AF96A61CC1=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:26,117 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D] parallelism set to 1
2016-01-14 16:08:26,117 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:26,118 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787705930_0001_1_00, eventCount=1
2016-01-14 16:08:26,118 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,118 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=19CA88D057E64CA0A29D921557D73C47, vertexId=vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:26,118 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=19CA88D057E64CA0A29D921557D73C47, vertexId=vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,119 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=19CA88D057E64CA0A29D921557D73C47, vertexName=B98F53A5648C424B983DC3CC7EEFDF1D, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:26,120 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=19CA88D057E64CA0A29D921557D73C47, vertexId=vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,121 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:26,121 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B98F53A5648C424B983DC3CC7EEFDF1D, vertexId=vertex_1452787705930_0001_1_00, initRequestedTime=1452787706110, initedTime=1452787706121, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:26,121 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D] with distanceFromRoot: 0
2016-01-14 16:08:26,121 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:26,122 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in B98F53A5648C424B983DC3CC7EEFDF1D
2016-01-14 16:08:26,122 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,122 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:26,122 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787705930_0001_1_00, startRequestedTime=1452787706122, startedTime=1452787706122
2016-01-14 16:08:26,123 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:26,123 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:26,123 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:TASK_STARTED]: vertexName=B98F53A5648C424B983DC3CC7EEFDF1D, taskId=task_1452787705930_0001_1_00_000000, scheduledTime=1452787706123, launchTime=1452787706123
2016-01-14 16:08:26,124 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787705930_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:26,124 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,124 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520] every.every/(1/1) ...ld'_RESULTS.0_'field2'_-1, VertexName: B98F53A5648C424B983DC3CC7EEFDF1D, VertexParallelism: 1, TaskAttemptID:attempt_1452787705930_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=855915D5C2C74D63811526AF96A61CC1, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=19CA88D057E64CA0A29D921557D73C47, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:26,125 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787705930_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:26,125 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:26,126 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:26,127 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:26,127 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:26,128 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787705930_0001_00_000001
2016-01-14 16:08:26,128 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705930_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:26,130 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787705930_0001_00_000001
2016-01-14 16:08:26,131 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:26,131 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705930_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:26,132 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787705930_0001_00_000001, launchTime=1452787706131
2016-01-14 16:08:26,131 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:26,132 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787705930_0001_00_000001
2016-01-14 16:08:26,134 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787705930_0001_1_00_000000_0] to container: [container_1452787705930_0001_00_000001]
2016-01-14 16:08:26,134 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705930_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:26,135 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787705930_0001_00_000001 given task: attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26,135 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787705930_0001_1_00_000000_0] started. Is using containerId: [container_1452787705930_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:26,135 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787705930_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26,136 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:26,136 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B98F53A5648C424B983DC3CC7EEFDF1D, taskAttemptId=attempt_1452787705930_0001_1_00_000000_0, startTime=1452787706135, containerId=container_1452787705930_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787705930_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:26,136 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787705930_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:26 Starting to run new task attempt: attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26,136 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26,136 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:26,137 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:26,137 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787705930_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:26,137 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:26,137 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:26,137 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:26,137 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:26,138 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520] every.every/(1/1) ...ld'_RESULTS.0_'field2'_-1, VertexName: B98F53A5648C424B983DC3CC7EEFDF1D, VertexParallelism: 1, TaskAttemptID:attempt_1452787705930_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=855915D5C2C74D63811526AF96A61CC1, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=19CA88D057E64CA0A29D921557D73C47, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:26,138 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:26,139 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26,139 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787705930_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:26,139 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:26,140 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787705930_0001, with dag id: dag_1452787705930_0001_1
2016-01-14 16:08:26,140 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:26,142 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=855915D5C2C74D63811526AF96A61CC1, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:26,142 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:26,144 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=19CA88D057E64CA0A29D921557D73C47, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:26,144 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:26,144 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 855915D5C2C74D63811526AF96A61CC1
2016-01-14 16:08:26,145 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 855915D5C2C74D63811526AF96A61CC1
2016-01-14 16:08:26,146 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:26,145 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:26,147 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 19CA88D057E64CA0A29D921557D73C47
2016-01-14 16:08:26,147 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:26,147 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 19CA88D057E64CA0A29D921557D73C47
2016-01-14 16:08:26,150 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:26,150 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 855915D5C2C74D63811526AF96A61CC1
2016-01-14 16:08:26,150 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 855915D5C2C74D63811526AF96A61CC1
2016-01-14 16:08:26,156 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B98F53A5648C424B983DC3CC7EEFDF1D, ordinal: 0
2016-01-14 16:08:26,156 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B98F53A5648C424B983DC3CC7EEFDF1D, mem on start (mb), free: 328, total: 384, max: 672
2016-01-14 16:08:26,156 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:26,157 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:26,157 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:26,163 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:26,163 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 19CA88D057E64CA0A29D921557D73C47
2016-01-14 16:08:26,163 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:26,163 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:26,163 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:26,163 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:26,164 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:26,164 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:26,164 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:26,164 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:26,164 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 855915D5C2C74D63811526AF96A61CC1, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:26,164 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 19CA88D057E64CA0A29D921557D73C47, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:26,164 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:26,164 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 855915D5C2C74D63811526AF96A61CC1 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:26,164 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 855915D5C2C74D63811526AF96A61CC1
2016-01-14 16:08:26,165 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:26,165 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 855915D5C2C74D63811526AF96A61CC1
2016-01-14 16:08:26,164 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:26,166 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:26,166 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:26,166 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26,166 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:26,167 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@36844406
2016-01-14 16:08:26,168 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@36844406
2016-01-14 16:08:26,168 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:26,168 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:26,169 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:26,169 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 855915D5C2C74D63811526AF96A61CC1
2016-01-14 16:08:26,169 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_-1"], id: 19CA88D057E64CA0A29D921557D73C47
2016-01-14 16:08:26,170 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_-1"]
2016-01-14 16:08:26,170 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:26,170 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:26,170 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B98F53A5648C424B983DC3CC7EEFDF1D, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:26,173 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:26,173 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:26,173 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26,174 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787705930_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:26,174 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26,175 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B98F53A5648C424B983DC3CC7EEFDF1D, mem on close (mb), free: 326, total: 384, max: 672
2016-01-14 16:08:26 Completed running task attempt: attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26,176 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787705930_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:26,177 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:26,177 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B98F53A5648C424B983DC3CC7EEFDF1D, taskAttemptId=attempt_1452787705930_0001_1_00_000000_0, startTime=1452787706135, finishTime=1452787706177, timeTaken=42, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787706171, Process_Duration=3, Process_End_Time=1452787706174, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:26,177 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787705930_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:26,177 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26,178 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:26,178 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:TASK_FINISHED]: vertexName=B98F53A5648C424B983DC3CC7EEFDF1D, taskId=task_1452787705930_0001_1_00_000000, startTime=1452787706135, finishTime=1452787706178, timeTaken=43, status=SUCCEEDED, successfulAttemptID=attempt_1452787705930_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787706171, Process_Duration=3, Process_End_Time=1452787706174, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:26,178 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787705930_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:26,179 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D] : 1
2016-01-14 16:08:26,179 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,179 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:26,180 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:VERTEX_FINISHED]: vertexName=B98F53A5648C424B983DC3CC7EEFDF1D, vertexId=vertex_1452787705930_0001_1_00, initRequestedTime=1452787706110, initedTime=1452787706121, startRequestedTime=1452787706122, startedTime=1452787706122, finishTime=1452787706179, timeTaken=57, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787706171, Process_Duration=3, Process_End_Time=1452787706174, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787706135, firstTasksToStart=[ task_1452787705930_0001_1_00_000000 ], lastTaskFinishTime=1452787706177, lastTasksToFinish=[ task_1452787705930_0001_1_00_000000 ], minTaskDuration=42, maxTaskDuration=42, avgTaskDuration=42.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787705930_0001_1_00_000000 ], longestDurationTasks=[ task_1452787705930_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:26,181 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:26,181 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:26,182 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787706171, Process_Duration=3, Process_End_Time=1452787706174, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:26,182 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705930_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:26,182 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:26,182 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787705930_0001_00_000001, stoppedTime=1452787706182, exitStatus=0
2016-01-14 16:08:26,184 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705930_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:26,184 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:26,184 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:26,184 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:26,185 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787705930_0001_1
2016-01-14 16:08:26,185 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787705930_0001_1
2016-01-14 16:08:26,185 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 19CA88D057E64CA0A29D921557D73C47 for vertex: vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,187 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787705930_0001_00_000001
2016-01-14 16:08:26,187 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787705930_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:26,187 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787705930_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:26,188 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787705930_0001_00_000001, Exiting
2016-01-14 16:08:26,188 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787705930_0001_00_000001
2016-01-14 16:08:26,188 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787705930_0001_00_000001
2016-01-14 16:08:26,190 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787705930_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:26,190 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787705930_0001_00_000001 completed successfully
2016-01-14 16:08:26,196 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787705930_0001_1, queueSize=0
2016-01-14 16:08:26,196 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:26,197 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787705930_0001_1, startTime=1452787706108, finishTime=1452787706195, timeTaken=87, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787706171, Process_Duration=3, Process_End_Time=1452787706174, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:26,197 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787705930_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:26,197 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787705930_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:26,197 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705930_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:26,197 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787705930_0001_00_000001
2016-01-14 16:08:26 Completed Dag: dag_1452787705930_0001_1
2016-01-14 16:08:26,197 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787705930_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:26,198 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787705930_0001_1_post
2016-01-14 16:08:26,198 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:26,198 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:26,204 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ld'_RESULTS.0_'field2'_-1, applicationId=application_1452787705930_0001
2016-01-14 16:08:26,206 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:26,206 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:26,206 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:26,206 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:26,206 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:26,207 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:26,207 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:26,208 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:26,208 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:26,208 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:26,208 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:26,209 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:26,209 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:26,214 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520/.tez/application_1452787705930_0001
2016-01-14 16:08:26,214 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.305
2016-01-14 16:08:26,279 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_'field2'_-1
2016-01-14 16:08:26,308 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:26,308 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:26,352 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.008
2016-01-14 16:08:26,358 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 16:08:26,359 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:26,359 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:26,359 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:26,375 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:26,376 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_'field2'
2016-01-14 16:08:26,384 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:26,385 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:26,385 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_'field2'"]
2016-01-14 16:08:26,385 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:26,385 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:26,385 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:26,386 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...SULTS.0_'field2'_'field2'
2016-01-14 16:08:26,386 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:26,389 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:26,389 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:26,398 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:26,402 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:26,403 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:26,403 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:26,412 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684/.tez/application_1452787706403_0001 doesn't exist and is created
2016-01-14 16:08:26,427 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:26,427 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:26,428 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684/.tez/application_1452787706403_0001
2016-01-14 16:08:26,431 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787706403_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:26,441 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:26,442 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:26,443 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:26,444 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:26,444 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684/.tez/application_1452787706403_0001/localmode-log-dir
2016-01-14 16:08:26,444 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684/.tez/application_1452787706403_0001/localmode-log-dir/history.txt.appattempt_1452787706403_0001_000000, maxErrors=10
2016-01-14 16:08:26,444 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:26,445 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787706403_0001_000000, appSubmitTime=1452787706430, launchTime=1452787706430
2016-01-14 16:08:26,451 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:48029
2016-01-14 16:08:26,451 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:26,452 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:26,454 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:26,454 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:26,455 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:26,457 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787706403_0001_000000, startTime=1452787706457
2016-01-14 16:08:26,457 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:26,458 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:26,528 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:26,528 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:26,528 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...SULTS.0_'field2'_'field2', applicationId=application_1452787706403_0001, dagName=[AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684] every.every/(1/1) ...SULTS.0_'field2'_'field2'
2016-01-14 16:08:26,542 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684] every.every/(1/1) ...SULTS.0_'field2'_'field2'
2016-01-14 16:08:26,544 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787706403_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684/.tez/application_1452787706403_0001/localmode-log-dir/dag_1452787706403_0001_1.dot
2016-01-14 16:08:26,544 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684/.tez/application_1452787706403_0001/localmode-log-dir/dag_1452787706403_0001_1-tez-dag.pb.txt
2016-01-14 16:08:26,549 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787706403_0001_1
2016-01-14 16:08:26,549 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:26,550 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684] every.every/(1/1) ...SULTS.0_'field2'_'field2'
2016-01-14 16:08:26 Running Dag: dag_1452787706403_0001_1
2016-01-14 16:08:26,560 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787706403_0001_1, submitTime=1452787706542
2016-01-14 16:08:26,560 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:26,560 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E7E7C875973C43B7B1B536E423AC1944
2016-01-14 16:08:26,561 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:26,561 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787706403_0001_1, initTime=1452787706560
2016-01-14 16:08:26,561 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:26,562 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787706403_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:26,562 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:DAG_STARTED]: dagID=dag_1452787706403_0001_1, startTime=1452787706562
2016-01-14 16:08:26,562 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:26,562 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:26,562 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787706403_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:26,563 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E7E7C875973C43B7B1B536E423AC1944 : {D9B0DBE0FBEE47F1BC62A6721A515C53={InputName=D9B0DBE0FBEE47F1BC62A6721A515C53}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:26,563 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: D9B0DBE0FBEE47F1BC62A6721A515C53, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:26,563 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,563 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...SULTS.0_'field2'_'field2', applicationId=application_1452787706403_0001, dagName=[AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684] every.every/(1/1) ...SULTS.0_'field2'_'field2'
2016-01-14 16:08:26,563 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,563 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,564 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]. Starting root input initializers: 1
2016-01-14 16:08:26,564 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:26,564 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: D9B0DBE0FBEE47F1BC62A6721A515C53 on vertex vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,566 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:26,566 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input D9B0DBE0FBEE47F1BC62A6721A515C53 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:26,567 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:26,567 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:26,568 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:26,568 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: D9B0DBE0FBEE47F1BC62A6721A515C53 on vertex vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,569 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:26,569 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {D9B0DBE0FBEE47F1BC62A6721A515C53=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:26,569 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944] parallelism set to 1
2016-01-14 16:08:26,569 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:26,569 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787706403_0001_1_00, eventCount=1
2016-01-14 16:08:26,570 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,570 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=D797D69B8ACC44F9AB69D10672513B85, vertexId=vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:26,570 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=D797D69B8ACC44F9AB69D10672513B85, vertexId=vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,571 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=D797D69B8ACC44F9AB69D10672513B85, vertexName=E7E7C875973C43B7B1B536E423AC1944, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:26,572 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=D797D69B8ACC44F9AB69D10672513B85, vertexId=vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,572 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:26,573 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E7E7C875973C43B7B1B536E423AC1944, vertexId=vertex_1452787706403_0001_1_00, initRequestedTime=1452787706563, initedTime=1452787706572, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:26,573 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944] with distanceFromRoot: 0
2016-01-14 16:08:26,573 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:26,573 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E7E7C875973C43B7B1B536E423AC1944
2016-01-14 16:08:26,573 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,574 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:26,574 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787706403_0001_1_00, startRequestedTime=1452787706573, startedTime=1452787706573
2016-01-14 16:08:26,574 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:26,575 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:26,575 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:TASK_STARTED]: vertexName=E7E7C875973C43B7B1B536E423AC1944, taskId=task_1452787706403_0001_1_00_000000, scheduledTime=1452787706575, launchTime=1452787706575
2016-01-14 16:08:26,576 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787706403_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:26,576 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,576 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684] every.every/(1/1) ...SULTS.0_'field2'_'field2', VertexName: E7E7C875973C43B7B1B536E423AC1944, VertexParallelism: 1, TaskAttemptID:attempt_1452787706403_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=D9B0DBE0FBEE47F1BC62A6721A515C53, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D797D69B8ACC44F9AB69D10672513B85, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:26,576 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787706403_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:26,577 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:26,577 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:26,578 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:26,578 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:26,578 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787706403_0001_00_000001
2016-01-14 16:08:26,578 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706403_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:26,580 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787706403_0001_00_000001
2016-01-14 16:08:26,580 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:26,581 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706403_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:26,581 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787706403_0001, with dag id: dag_1452787706403_0001_1
2016-01-14 16:08:26,582 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:26,582 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787706403_0001_00_000001, launchTime=1452787706581
2016-01-14 16:08:26,583 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787706403_0001_00_000001
2016-01-14 16:08:26,584 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787706403_0001_1_00_000000_0] to container: [container_1452787706403_0001_00_000001]
2016-01-14 16:08:26,584 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706403_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:26,585 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787706403_0001_00_000001 given task: attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26,585 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787706403_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26,585 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787706403_0001_1_00_000000_0] started. Is using containerId: [container_1452787706403_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:26,585 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E7E7C875973C43B7B1B536E423AC1944, taskAttemptId=attempt_1452787706403_0001_1_00_000000_0, startTime=1452787706585, containerId=container_1452787706403_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787706403_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:26,586 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787706403_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:26 Starting to run new task attempt: attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26,586 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26,586 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:26,586 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:26,586 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787706403_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:26,586 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:26,587 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:26,587 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:26,588 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:26,588 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:26,588 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684] every.every/(1/1) ...SULTS.0_'field2'_'field2', VertexName: E7E7C875973C43B7B1B536E423AC1944, VertexParallelism: 1, TaskAttemptID:attempt_1452787706403_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=D9B0DBE0FBEE47F1BC62A6721A515C53, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D797D69B8ACC44F9AB69D10672513B85, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:26,588 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:26,589 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26,589 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:26,590 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:26,590 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787706403_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:26,591 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:26,591 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=D797D69B8ACC44F9AB69D10672513B85, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:26,591 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=D9B0DBE0FBEE47F1BC62A6721A515C53, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:26,591 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:26,591 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:26,592 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: D797D69B8ACC44F9AB69D10672513B85
2016-01-14 16:08:26,592 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:26,592 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: D797D69B8ACC44F9AB69D10672513B85
2016-01-14 16:08:26,592 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: D9B0DBE0FBEE47F1BC62A6721A515C53
2016-01-14 16:08:26,593 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: D9B0DBE0FBEE47F1BC62A6721A515C53
2016-01-14 16:08:26,594 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:26,597 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:26,598 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: D9B0DBE0FBEE47F1BC62A6721A515C53
2016-01-14 16:08:26,598 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: D9B0DBE0FBEE47F1BC62A6721A515C53
2016-01-14 16:08:26,605 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E7E7C875973C43B7B1B536E423AC1944, ordinal: 0
2016-01-14 16:08:26,605 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E7E7C875973C43B7B1B536E423AC1944, mem on start (mb), free: 252, total: 384, max: 672
2016-01-14 16:08:26,605 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:26,606 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:26,606 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:26,610 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:26,610 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: D797D69B8ACC44F9AB69D10672513B85
2016-01-14 16:08:26,611 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:26,611 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:26,611 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:26,611 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:26,611 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:26,612 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:26,612 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:26,612 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:26,612 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, D797D69B8ACC44F9AB69D10672513B85, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:26,613 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, D9B0DBE0FBEE47F1BC62A6721A515C53, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:26,613 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:26,613 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: D9B0DBE0FBEE47F1BC62A6721A515C53
2016-01-14 16:08:26,614 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:26,614 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: D9B0DBE0FBEE47F1BC62A6721A515C53
2016-01-14 16:08:26,614 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: D9B0DBE0FBEE47F1BC62A6721A515C53 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:26,614 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:26,615 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:26,615 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:26,615 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26,616 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:26,617 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@21b4869f
2016-01-14 16:08:26,618 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@21b4869f
2016-01-14 16:08:26,618 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:26,618 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:26,618 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:26,619 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: D9B0DBE0FBEE47F1BC62A6721A515C53
2016-01-14 16:08:26,619 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_'field2'"], id: D797D69B8ACC44F9AB69D10672513B85
2016-01-14 16:08:26,619 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_'field2'"]
2016-01-14 16:08:26,619 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:26,619 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:26,620 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E7E7C875973C43B7B1B536E423AC1944, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:26,631 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:26,631 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:26,632 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26,632 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787706403_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:26,633 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26,633 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E7E7C875973C43B7B1B536E423AC1944, mem on close (mb), free: 250, total: 384, max: 672
2016-01-14 16:08:26 Completed running task attempt: attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26,634 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787706403_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:26,635 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787706620, Process_Duration=13, Process_End_Time=1452787706633, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=9][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:26,636 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:26,636 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E7E7C875973C43B7B1B536E423AC1944, taskAttemptId=attempt_1452787706403_0001_1_00_000000_0, startTime=1452787706585, finishTime=1452787706635, timeTaken=50, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787706620, Process_Duration=13, Process_End_Time=1452787706633, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=9, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:26,636 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787706403_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:26,636 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:26,636 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26,636 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:26,636 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:26,637 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:TASK_FINISHED]: vertexName=E7E7C875973C43B7B1B536E423AC1944, taskId=task_1452787706403_0001_1_00_000000, startTime=1452787706585, finishTime=1452787706636, timeTaken=51, status=SUCCEEDED, successfulAttemptID=attempt_1452787706403_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787706620, Process_Duration=13, Process_End_Time=1452787706633, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=9, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:26,637 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787706403_0001_00_000001
2016-01-14 16:08:26,637 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787706403_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:26,638 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944] : 1
2016-01-14 16:08:26,638 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,637 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:26,639 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:26,639 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:VERTEX_FINISHED]: vertexName=E7E7C875973C43B7B1B536E423AC1944, vertexId=vertex_1452787706403_0001_1_00, initRequestedTime=1452787706563, initedTime=1452787706572, startRequestedTime=1452787706573, startedTime=1452787706573, finishTime=1452787706638, timeTaken=65, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787706620, Process_Duration=13, Process_End_Time=1452787706633, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=9, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787706585, firstTasksToStart=[ task_1452787706403_0001_1_00_000000 ], lastTaskFinishTime=1452787706635, lastTasksToFinish=[ task_1452787706403_0001_1_00_000000 ], minTaskDuration=50, maxTaskDuration=50, avgTaskDuration=50.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787706403_0001_1_00_000000 ], longestDurationTasks=[ task_1452787706403_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:26,639 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:26,639 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706403_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:26,640 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787706403_0001_00_000001, stoppedTime=1452787706640, exitStatus=0
2016-01-14 16:08:26,640 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706403_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:26,640 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:26,640 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:26,640 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787706403_0001_1
2016-01-14 16:08:26,641 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787706403_0001_1
2016-01-14 16:08:26,641 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: D797D69B8ACC44F9AB69D10672513B85 for vertex: vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,648 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787706403_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:26,648 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787706403_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:26,648 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787706403_0001_00_000001, Exiting
2016-01-14 16:08:26,648 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787706403_0001_00_000001
2016-01-14 16:08:26,648 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787706403_0001_00_000001
2016-01-14 16:08:26,650 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787706403_0001_1, queueSize=0
2016-01-14 16:08:26,650 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787706403_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:26,650 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787706403_0001_1, startTime=1452787706562, finishTime=1452787706647, timeTaken=85, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787706620, Process_Duration=13, Process_End_Time=1452787706633, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=9, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:26,650 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:26,650 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787706403_0001_00_000001 completed successfully
2016-01-14 16:08:26,651 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787706403_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:26,651 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787706403_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:26,652 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706403_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:26,652 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787706403_0001_00_000001
2016-01-14 16:08:26 Completed Dag: dag_1452787706403_0001_1
2016-01-14 16:08:26,653 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787706403_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:26,653 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787706403_0001_1_post
2016-01-14 16:08:26,653 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:26,653 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:26,658 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...SULTS.0_'field2'_'field2', applicationId=application_1452787706403_0001
2016-01-14 16:08:26,660 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:26,660 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:26,660 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:26,661 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:26,661 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:26,661 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:26,662 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:26,662 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:26,662 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:26,663 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:26,663 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:26,663 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:26,664 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:26,667 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684/.tez/application_1452787706403_0001
2016-01-14 16:08:26,668 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.284
2016-01-14 16:08:26,734 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_'field2'_'field2'
2016-01-14 16:08:26,754 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:26,754 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:26,794 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.011
2016-01-14 16:08:26,799 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.016
2016-01-14 16:08:26,800 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:26,800 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:26,800 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:26,813 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:26,813 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_RESULTS
2016-01-14 16:08:26,822 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:26,822 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:26,822 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_RESULTS"]
2016-01-14 16:08:26,822 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:26,822 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:26,823 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:26,823 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ESULTS.0_'field2'_RESULTS
2016-01-14 16:08:26,823 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:26,841 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:26,846 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:26,847 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:26,847 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:26,857 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1/.tez/application_1452787706847_0001 doesn't exist and is created
2016-01-14 16:08:26,872 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:26,872 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:26,873 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1/.tez/application_1452787706847_0001
2016-01-14 16:08:26,876 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787706847_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:26,886 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:26,886 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:26,888 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:26,888 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:26,889 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1/.tez/application_1452787706847_0001/localmode-log-dir
2016-01-14 16:08:26,889 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1/.tez/application_1452787706847_0001/localmode-log-dir/history.txt.appattempt_1452787706847_0001_000000, maxErrors=10
2016-01-14 16:08:26,889 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:26,889 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787706847_0001_000000, appSubmitTime=1452787706875, launchTime=1452787706875
2016-01-14 16:08:26,894 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:26,895 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:26,896 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:26,896 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:26,899 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:45872
2016-01-14 16:08:26,902 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:26,904 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787706847_0001_000000, startTime=1452787706904
2016-01-14 16:08:26,905 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:26,905 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:26,973 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:26,973 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:26,973 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ESULTS.0_'field2'_RESULTS, applicationId=application_1452787706847_0001, dagName=[1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1] every.every/(1/1) ...ESULTS.0_'field2'_RESULTS
2016-01-14 16:08:26,988 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1] every.every/(1/1) ...ESULTS.0_'field2'_RESULTS
2016-01-14 16:08:26,989 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787706847_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1/.tez/application_1452787706847_0001/localmode-log-dir/dag_1452787706847_0001_1.dot
2016-01-14 16:08:26,990 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1/.tez/application_1452787706847_0001/localmode-log-dir/dag_1452787706847_0001_1-tez-dag.pb.txt
2016-01-14 16:08:27,005 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787706847_0001_1
2016-01-14 16:08:27,005 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:27,006 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1] every.every/(1/1) ...ESULTS.0_'field2'_RESULTS
2016-01-14 16:08:27 Running Dag: dag_1452787706847_0001_1
2016-01-14 16:08:27,017 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:27,018 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787706847_0001_1, submitTime=1452787706988
2016-01-14 16:08:27,018 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E0EF08A648904039A94246587893B7BF
2016-01-14 16:08:27,018 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:27,019 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:27,019 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787706847_0001_1, initTime=1452787707018
2016-01-14 16:08:27,020 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787706847_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:27,020 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:27,020 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:DAG_STARTED]: dagID=dag_1452787706847_0001_1, startTime=1452787707020
2016-01-14 16:08:27,020 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:27,020 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787706847_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:27,021 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E0EF08A648904039A94246587893B7BF : {838F4AF9F7EB4F81A0A385CD1876F987={InputName=838F4AF9F7EB4F81A0A385CD1876F987}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:27,021 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 838F4AF9F7EB4F81A0A385CD1876F987, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:27,021 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,021 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,021 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,025 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]. Starting root input initializers: 1
2016-01-14 16:08:27,025 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:27,026 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ESULTS.0_'field2'_RESULTS, applicationId=application_1452787706847_0001, dagName=[1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1] every.every/(1/1) ...ESULTS.0_'field2'_RESULTS
2016-01-14 16:08:27,026 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 838F4AF9F7EB4F81A0A385CD1876F987 on vertex vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,028 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:27,028 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 838F4AF9F7EB4F81A0A385CD1876F987 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:27,028 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:27,029 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:27,030 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:27,031 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 838F4AF9F7EB4F81A0A385CD1876F987 on vertex vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,031 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:27,031 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {838F4AF9F7EB4F81A0A385CD1876F987=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:27,031 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF] parallelism set to 1
2016-01-14 16:08:27,031 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:27,032 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787706847_0001_1_00, eventCount=1
2016-01-14 16:08:27,032 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:27,032 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,032 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=932D487A2FD44C69B5752B3B1451901E, vertexId=vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:27,032 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:27,034 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=932D487A2FD44C69B5752B3B1451901E, vertexId=vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,036 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=932D487A2FD44C69B5752B3B1451901E, vertexName=E0EF08A648904039A94246587893B7BF, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:27,036 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=932D487A2FD44C69B5752B3B1451901E, vertexId=vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,037 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:27,038 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E0EF08A648904039A94246587893B7BF, vertexId=vertex_1452787706847_0001_1_00, initRequestedTime=1452787707021, initedTime=1452787707037, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:27,038 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF] with distanceFromRoot: 0
2016-01-14 16:08:27,038 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:27,038 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E0EF08A648904039A94246587893B7BF
2016-01-14 16:08:27,038 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,038 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:27,039 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787706847_0001_1_00, startRequestedTime=1452787707038, startedTime=1452787707038
2016-01-14 16:08:27,039 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:27,039 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:27,040 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:TASK_STARTED]: vertexName=E0EF08A648904039A94246587893B7BF, taskId=task_1452787706847_0001_1_00_000000, scheduledTime=1452787707039, launchTime=1452787707039
2016-01-14 16:08:27,040 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787706847_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:27,040 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,040 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1] every.every/(1/1) ...ESULTS.0_'field2'_RESULTS, VertexName: E0EF08A648904039A94246587893B7BF, VertexParallelism: 1, TaskAttemptID:attempt_1452787706847_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=838F4AF9F7EB4F81A0A385CD1876F987, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=932D487A2FD44C69B5752B3B1451901E, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:27,041 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787706847_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:27,041 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:27,041 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787706847_0001, with dag id: dag_1452787706847_0001_1
2016-01-14 16:08:27,043 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:27,043 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:27,043 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:27,044 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787706847_0001_00_000001
2016-01-14 16:08:27,044 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706847_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:27,046 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787706847_0001_00_000001
2016-01-14 16:08:27,046 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:27,046 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706847_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:27,047 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787706847_0001_00_000001, launchTime=1452787707046
2016-01-14 16:08:27,046 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:27,047 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787706847_0001_00_000001
2016-01-14 16:08:27,048 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787706847_0001_1_00_000000_0] to container: [container_1452787706847_0001_00_000001]
2016-01-14 16:08:27,049 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706847_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:27,049 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787706847_0001_00_000001 given task: attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27,049 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787706847_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27 Starting to run new task attempt: attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27,050 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787706847_0001_1_00_000000_0] started. Is using containerId: [container_1452787706847_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:27,050 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27,050 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:27,050 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:27,051 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:27,050 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E0EF08A648904039A94246587893B7BF, taskAttemptId=attempt_1452787706847_0001_1_00_000000_0, startTime=1452787707050, containerId=container_1452787706847_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787706847_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:27,050 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:27,051 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787706847_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:27,051 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:27,051 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787706847_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:27,051 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:27,051 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:27,052 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1] every.every/(1/1) ...ESULTS.0_'field2'_RESULTS, VertexName: E0EF08A648904039A94246587893B7BF, VertexParallelism: 1, TaskAttemptID:attempt_1452787706847_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=838F4AF9F7EB4F81A0A385CD1876F987, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=932D487A2FD44C69B5752B3B1451901E, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:27,052 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:27,052 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27,052 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:27,052 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:27,054 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=838F4AF9F7EB4F81A0A385CD1876F987, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:27,054 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:27,054 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:27,054 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 838F4AF9F7EB4F81A0A385CD1876F987
2016-01-14 16:08:27,059 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 838F4AF9F7EB4F81A0A385CD1876F987
2016-01-14 16:08:27,058 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787706847_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:27,057 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=932D487A2FD44C69B5752B3B1451901E, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:27,060 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:27,060 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 932D487A2FD44C69B5752B3B1451901E
2016-01-14 16:08:27,060 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:27,061 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 932D487A2FD44C69B5752B3B1451901E
2016-01-14 16:08:27,061 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:27,062 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:27,062 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 838F4AF9F7EB4F81A0A385CD1876F987
2016-01-14 16:08:27,063 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 838F4AF9F7EB4F81A0A385CD1876F987
2016-01-14 16:08:27,072 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:27,072 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 932D487A2FD44C69B5752B3B1451901E
2016-01-14 16:08:27,076 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E0EF08A648904039A94246587893B7BF, ordinal: 0
2016-01-14 16:08:27,076 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E0EF08A648904039A94246587893B7BF, mem on start (mb), free: 175, total: 384, max: 672
2016-01-14 16:08:27,076 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:27,076 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:27,076 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:27,076 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:27,077 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:27,077 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:27,077 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:27,078 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:27,078 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:27,078 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:27,078 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:27,078 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 838F4AF9F7EB4F81A0A385CD1876F987, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:27,078 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 932D487A2FD44C69B5752B3B1451901E, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:27,079 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:27,079 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 838F4AF9F7EB4F81A0A385CD1876F987 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:27,079 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 838F4AF9F7EB4F81A0A385CD1876F987
2016-01-14 16:08:27,079 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:27,079 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 838F4AF9F7EB4F81A0A385CD1876F987
2016-01-14 16:08:27,079 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:27,080 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:27,080 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:27,080 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27,080 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:27,083 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@1494a702
2016-01-14 16:08:27,083 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:27,084 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@1494a702
2016-01-14 16:08:27,084 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:27,084 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:27,085 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 838F4AF9F7EB4F81A0A385CD1876F987
2016-01-14 16:08:27,085 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_RESULTS"], id: 932D487A2FD44C69B5752B3B1451901E
2016-01-14 16:08:27,085 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_RESULTS"]
2016-01-14 16:08:27,085 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:27,085 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:27,086 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E0EF08A648904039A94246587893B7BF, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:27,089 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:27,089 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:27,089 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27,090 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787706847_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:27,090 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27,090 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E0EF08A648904039A94246587893B7BF, mem on close (mb), free: 174, total: 384, max: 672
2016-01-14 16:08:27 Completed running task attempt: attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27,092 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787706847_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:27,093 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E0EF08A648904039A94246587893B7BF, taskAttemptId=attempt_1452787706847_0001_1_00_000000_0, startTime=1452787707050, finishTime=1452787707093, timeTaken=43, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787707086, Process_Duration=4, Process_End_Time=1452787707090, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:27,093 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787706847_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:27,093 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27,094 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:27,094 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:TASK_FINISHED]: vertexName=E0EF08A648904039A94246587893B7BF, taskId=task_1452787706847_0001_1_00_000000, startTime=1452787707050, finishTime=1452787707094, timeTaken=44, status=SUCCEEDED, successfulAttemptID=attempt_1452787706847_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787707086, Process_Duration=4, Process_End_Time=1452787707090, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:27,094 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:27,095 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787706847_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:27,095 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF] : 1
2016-01-14 16:08:27,095 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,095 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:27,096 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:VERTEX_FINISHED]: vertexName=E0EF08A648904039A94246587893B7BF, vertexId=vertex_1452787706847_0001_1_00, initRequestedTime=1452787707021, initedTime=1452787707037, startRequestedTime=1452787707038, startedTime=1452787707038, finishTime=1452787707095, timeTaken=57, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787707086, Process_Duration=4, Process_End_Time=1452787707090, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787707050, firstTasksToStart=[ task_1452787706847_0001_1_00_000000 ], lastTaskFinishTime=1452787707093, lastTasksToFinish=[ task_1452787706847_0001_1_00_000000 ], minTaskDuration=43, maxTaskDuration=43, avgTaskDuration=43.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787706847_0001_1_00_000000 ], longestDurationTasks=[ task_1452787706847_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:27,096 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:27,097 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706847_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:27,097 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787706847_0001_00_000001, stoppedTime=1452787707097, exitStatus=0
2016-01-14 16:08:27,097 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706847_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:27,097 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:27,097 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787706847_0001_1
2016-01-14 16:08:27,098 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787706847_0001_1
2016-01-14 16:08:27,098 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 932D487A2FD44C69B5752B3B1451901E for vertex: vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,100 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:27,097 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787707086, Process_Duration=4, Process_End_Time=1452787707090, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:27,101 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:27,101 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:27,101 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787706847_0001_00_000001
2016-01-14 16:08:27,101 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787706847_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:27,101 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787706847_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:27,101 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:27,101 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787706847_0001_00_000001, Exiting
2016-01-14 16:08:27,101 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787706847_0001_00_000001
2016-01-14 16:08:27,102 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787706847_0001_00_000001
2016-01-14 16:08:27,104 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787706847_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:27,104 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787706847_0001_00_000001 completed successfully
2016-01-14 16:08:27,110 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787706847_0001_1, queueSize=0
2016-01-14 16:08:27,110 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:27,110 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787706847_0001_1, startTime=1452787707020, finishTime=1452787707109, timeTaken=89, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787707086, Process_Duration=4, Process_End_Time=1452787707090, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:27,110 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787706847_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:27,110 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787706847_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:27,111 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787706847_0001_00_000001
2016-01-14 16:08:27,111 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706847_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:27 Completed Dag: dag_1452787706847_0001_1
2016-01-14 16:08:27,112 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787706847_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:27,112 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787706847_0001_1_post
2016-01-14 16:08:27,113 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:27,113 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:27,117 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ESULTS.0_'field2'_RESULTS, applicationId=application_1452787706847_0001
2016-01-14 16:08:27,119 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:27,119 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:27,119 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:27,119 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:27,119 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:27,120 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:27,120 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:27,121 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:27,121 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:27,121 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:27,122 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:27,122 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:27,122 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:27,127 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1/.tez/application_1452787706847_0001
2016-01-14 16:08:27,128 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.305
2016-01-14 16:08:27,197 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_'field2'_RESULTS
2016-01-14 16:08:27,217 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:27,217 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:27,248 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.009
2016-01-14 16:08:27,258 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 16:08:27,259 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:27,259 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:27,259 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:27,288 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:27,289 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:27,299 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:27,299 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:27,300 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_ALL"]
2016-01-14 16:08:27,300 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:27,300 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:27,300 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:27,300 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...d'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:27,302 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:27,314 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:27,318 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:27,319 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:27,319 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:27,328 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F/.tez/application_1452787707319_0001 doesn't exist and is created
2016-01-14 16:08:27,343 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:27,343 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:27,344 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F/.tez/application_1452787707319_0001
2016-01-14 16:08:27,347 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787707319_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:27,356 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:27,357 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:27,359 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:27,359 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:27,359 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F/.tez/application_1452787707319_0001/localmode-log-dir
2016-01-14 16:08:27,360 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F/.tez/application_1452787707319_0001/localmode-log-dir/history.txt.appattempt_1452787707319_0001_000000, maxErrors=10
2016-01-14 16:08:27,360 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:27,360 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787707319_0001_000000, appSubmitTime=1452787707346, launchTime=1452787707346
2016-01-14 16:08:27,364 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:27,366 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:27,367 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:27,367 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:27,370 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:44189
2016-01-14 16:08:27,371 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:27,374 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787707319_0001_000000, startTime=1452787707374
2016-01-14 16:08:27,375 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:27,375 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:27,443 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:27,443 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:27,444 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...d'_RESULTS.0_'field2'_ALL, applicationId=application_1452787707319_0001, dagName=[776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F] every.every/(1/1) ...d'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:27,458 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F] every.every/(1/1) ...d'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:27,460 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787707319_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F/.tez/application_1452787707319_0001/localmode-log-dir/dag_1452787707319_0001_1.dot
2016-01-14 16:08:27,460 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F/.tez/application_1452787707319_0001/localmode-log-dir/dag_1452787707319_0001_1-tez-dag.pb.txt
2016-01-14 16:08:27,465 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787707319_0001_1
2016-01-14 16:08:27,465 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:27,466 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F] every.every/(1/1) ...d'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:27 Running Dag: dag_1452787707319_0001_1
2016-01-14 16:08:27,477 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787707319_0001_1, submitTime=1452787707459
2016-01-14 16:08:27,477 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:27,478 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex D9B991A2FC1844E086101E9AD6927E58
2016-01-14 16:08:27,478 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:27,479 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:27,479 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787707319_0001_1, initTime=1452787707477
2016-01-14 16:08:27,480 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787707319_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:27,480 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:DAG_STARTED]: dagID=dag_1452787707319_0001_1, startTime=1452787707480
2016-01-14 16:08:27,480 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:27,480 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:27,480 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787707319_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:27,480 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: D9B991A2FC1844E086101E9AD6927E58 : {07B4E09DF18042AEB0FCD9A70A2C7FEE={InputName=07B4E09DF18042AEB0FCD9A70A2C7FEE}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:27,481 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 07B4E09DF18042AEB0FCD9A70A2C7FEE, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:27,481 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,481 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,481 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,481 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]. Starting root input initializers: 1
2016-01-14 16:08:27,481 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:27,482 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 07B4E09DF18042AEB0FCD9A70A2C7FEE on vertex vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,482 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...d'_RESULTS.0_'field2'_ALL, applicationId=application_1452787707319_0001, dagName=[776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F] every.every/(1/1) ...d'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:27,485 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:27,485 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 07B4E09DF18042AEB0FCD9A70A2C7FEE asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:27,485 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:27,486 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:27,487 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:27,487 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 07B4E09DF18042AEB0FCD9A70A2C7FEE on vertex vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,488 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:27,488 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {07B4E09DF18042AEB0FCD9A70A2C7FEE=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:27,488 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58] parallelism set to 1
2016-01-14 16:08:27,488 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:27,488 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787707319_0001_1_00, eventCount=1
2016-01-14 16:08:27,489 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,489 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=371FE588973A4C3C8FEC7BEBCCF40810, vertexId=vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:27,489 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=371FE588973A4C3C8FEC7BEBCCF40810, vertexId=vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,491 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=371FE588973A4C3C8FEC7BEBCCF40810, vertexName=D9B991A2FC1844E086101E9AD6927E58, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:27,491 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=371FE588973A4C3C8FEC7BEBCCF40810, vertexId=vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,492 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:VERTEX_INITIALIZED]: vertexName=D9B991A2FC1844E086101E9AD6927E58, vertexId=vertex_1452787707319_0001_1_00, initRequestedTime=1452787707480, initedTime=1452787707492, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:27,492 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58] with distanceFromRoot: 0
2016-01-14 16:08:27,492 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:27,493 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:27,493 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in D9B991A2FC1844E086101E9AD6927E58
2016-01-14 16:08:27,493 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,494 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:27,494 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787707319_0001_1_00, startRequestedTime=1452787707493, startedTime=1452787707493
2016-01-14 16:08:27,494 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:27,495 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:27,495 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:TASK_STARTED]: vertexName=D9B991A2FC1844E086101E9AD6927E58, taskId=task_1452787707319_0001_1_00_000000, scheduledTime=1452787707494, launchTime=1452787707494
2016-01-14 16:08:27,495 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787707319_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:27,496 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,496 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F] every.every/(1/1) ...d'_RESULTS.0_'field2'_ALL, VertexName: D9B991A2FC1844E086101E9AD6927E58, VertexParallelism: 1, TaskAttemptID:attempt_1452787707319_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=07B4E09DF18042AEB0FCD9A70A2C7FEE, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=371FE588973A4C3C8FEC7BEBCCF40810, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:27,496 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787707319_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:27,497 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:27,497 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:27,498 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:27,498 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:27,499 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787707319_0001_00_000001
2016-01-14 16:08:27,499 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787707319_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:27,500 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787707319_0001, with dag id: dag_1452787707319_0001_1
2016-01-14 16:08:27,501 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787707319_0001_00_000001
2016-01-14 16:08:27,501 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:27,502 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787707319_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:27,502 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:27,503 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787707319_0001_00_000001, launchTime=1452787707502
2016-01-14 16:08:27,504 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787707319_0001_00_000001
2016-01-14 16:08:27,505 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787707319_0001_1_00_000000_0] to container: [container_1452787707319_0001_00_000001]
2016-01-14 16:08:27,505 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787707319_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:27,505 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787707319_0001_00_000001 given task: attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27,505 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787707319_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27,505 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787707319_0001_1_00_000000_0] started. Is using containerId: [container_1452787707319_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:27,506 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=D9B991A2FC1844E086101E9AD6927E58, taskAttemptId=attempt_1452787707319_0001_1_00_000000_0, startTime=1452787707505, containerId=container_1452787707319_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787707319_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:27 Starting to run new task attempt: attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27,506 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787707319_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:27,506 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:27,506 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27,506 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:27,506 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:27,506 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:27,507 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:27,507 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:27,507 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:27,507 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F] every.every/(1/1) ...d'_RESULTS.0_'field2'_ALL, VertexName: D9B991A2FC1844E086101E9AD6927E58, VertexParallelism: 1, TaskAttemptID:attempt_1452787707319_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=07B4E09DF18042AEB0FCD9A70A2C7FEE, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=371FE588973A4C3C8FEC7BEBCCF40810, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:27,507 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:27,506 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787707319_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:27,508 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27,508 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:27,509 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:27,509 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787707319_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:27,510 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=07B4E09DF18042AEB0FCD9A70A2C7FEE, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:27,510 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:27,510 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=371FE588973A4C3C8FEC7BEBCCF40810, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:27,510 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:27,511 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:27,511 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 371FE588973A4C3C8FEC7BEBCCF40810
2016-01-14 16:08:27,511 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:27,511 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 371FE588973A4C3C8FEC7BEBCCF40810
2016-01-14 16:08:27,510 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 07B4E09DF18042AEB0FCD9A70A2C7FEE
2016-01-14 16:08:27,512 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 07B4E09DF18042AEB0FCD9A70A2C7FEE
2016-01-14 16:08:27,516 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:27,518 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:27,518 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 07B4E09DF18042AEB0FCD9A70A2C7FEE
2016-01-14 16:08:27,519 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 07B4E09DF18042AEB0FCD9A70A2C7FEE
2016-01-14 16:08:27,524 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: D9B991A2FC1844E086101E9AD6927E58, ordinal: 0
2016-01-14 16:08:27,524 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D9B991A2FC1844E086101E9AD6927E58, mem on start (mb), free: 306, total: 384, max: 672
2016-01-14 16:08:27,524 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:27,524 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:27,524 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:27,526 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:27,526 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 371FE588973A4C3C8FEC7BEBCCF40810
2016-01-14 16:08:27,527 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:27,527 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:27,527 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:27,527 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:27,528 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:27,528 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:27,528 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:27,528 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:27,529 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 371FE588973A4C3C8FEC7BEBCCF40810, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:27,529 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 07B4E09DF18042AEB0FCD9A70A2C7FEE, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:27,529 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:27,529 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 07B4E09DF18042AEB0FCD9A70A2C7FEE being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:27,529 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 07B4E09DF18042AEB0FCD9A70A2C7FEE
2016-01-14 16:08:27,530 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:27,530 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 07B4E09DF18042AEB0FCD9A70A2C7FEE
2016-01-14 16:08:27,530 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:27,530 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:27,531 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:27,531 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27,531 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:27,532 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@3a278a78
2016-01-14 16:08:27,533 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@3a278a78
2016-01-14 16:08:27,533 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:27,533 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:27,535 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:27,536 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 07B4E09DF18042AEB0FCD9A70A2C7FEE
2016-01-14 16:08:27,536 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_ALL"], id: 371FE588973A4C3C8FEC7BEBCCF40810
2016-01-14 16:08:27,536 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_ALL"]
2016-01-14 16:08:27,536 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:27,536 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:27,537 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: D9B991A2FC1844E086101E9AD6927E58, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:27,539 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:27,539 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:27,539 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27,539 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787707319_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:27,540 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27,540 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D9B991A2FC1844E086101E9AD6927E58, mem on close (mb), free: 304, total: 384, max: 672
2016-01-14 16:08:27 Completed running task attempt: attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27,541 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787707319_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:27,542 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787707537, Process_Duration=3, Process_End_Time=1452787707540, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:27,542 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=D9B991A2FC1844E086101E9AD6927E58, taskAttemptId=attempt_1452787707319_0001_1_00_000000_0, startTime=1452787707505, finishTime=1452787707542, timeTaken=37, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787707537, Process_Duration=3, Process_End_Time=1452787707540, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:27,542 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:27,542 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787707319_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:27,543 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27,542 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:27,543 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:TASK_FINISHED]: vertexName=D9B991A2FC1844E086101E9AD6927E58, taskId=task_1452787707319_0001_1_00_000000, startTime=1452787707505, finishTime=1452787707543, timeTaken=38, status=SUCCEEDED, successfulAttemptID=attempt_1452787707319_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787707537, Process_Duration=3, Process_End_Time=1452787707540, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:27,543 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787707319_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:27,543 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:27,542 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:27,543 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58] : 1
2016-01-14 16:08:27,545 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,543 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:27,546 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:27,546 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:VERTEX_FINISHED]: vertexName=D9B991A2FC1844E086101E9AD6927E58, vertexId=vertex_1452787707319_0001_1_00, initRequestedTime=1452787707480, initedTime=1452787707492, startRequestedTime=1452787707493, startedTime=1452787707493, finishTime=1452787707545, timeTaken=52, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787707537, Process_Duration=3, Process_End_Time=1452787707540, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787707505, firstTasksToStart=[ task_1452787707319_0001_1_00_000000 ], lastTaskFinishTime=1452787707542, lastTasksToFinish=[ task_1452787707319_0001_1_00_000000 ], minTaskDuration=37, maxTaskDuration=37, avgTaskDuration=37.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787707319_0001_1_00_000000 ], longestDurationTasks=[ task_1452787707319_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:27,547 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:27,547 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787707319_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:27,548 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787707319_0001_00_000001, stoppedTime=1452787707547, exitStatus=0
2016-01-14 16:08:27,549 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787707319_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:27,549 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:27,549 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787707319_0001_1
2016-01-14 16:08:27,549 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787707319_0001_1
2016-01-14 16:08:27,550 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 371FE588973A4C3C8FEC7BEBCCF40810 for vertex: vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,545 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787707319_0001_00_000001
2016-01-14 16:08:27,548 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:27,550 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787707319_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:27,550 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787707319_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:27,550 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787707319_0001_00_000001, Exiting
2016-01-14 16:08:27,550 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787707319_0001_00_000001
2016-01-14 16:08:27,550 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787707319_0001_00_000001
2016-01-14 16:08:27,551 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787707319_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:27,551 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787707319_0001_00_000001 completed successfully
2016-01-14 16:08:27,558 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787707319_0001_1, queueSize=0
2016-01-14 16:08:27,558 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:27,559 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787707319_0001_1, startTime=1452787707480, finishTime=1452787707557, timeTaken=77, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787707537, Process_Duration=3, Process_End_Time=1452787707540, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:27,559 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787707319_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:27,559 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787707319_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:27,560 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787707319_0001_00_000001
2016-01-14 16:08:27,560 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787707319_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:27 Completed Dag: dag_1452787707319_0001_1
2016-01-14 16:08:27,561 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787707319_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:27,561 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787707319_0001_1_post
2016-01-14 16:08:27,561 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:27,561 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:27,566 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...d'_RESULTS.0_'field2'_ALL, applicationId=application_1452787707319_0001
2016-01-14 16:08:27,568 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:27,568 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:27,568 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:27,569 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:27,569 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:27,569 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:27,570 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:27,570 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:27,570 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:27,570 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:27,571 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:27,571 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:27,571 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:27,575 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F/.tez/application_1452787707319_0001
2016-01-14 16:08:27,576 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.276
2016-01-14 16:08:27,645 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:27,665 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:27,666 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:27,696 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.007
2016-01-14 16:08:27,703 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 16:08:27,703 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:27,703 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:27,704 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:27,717 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:27,718 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_-1
2016-01-14 16:08:27,727 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:27,727 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:27,727 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_-1"]
2016-01-14 16:08:27,727 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:27,728 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:27,728 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:27,728 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...eld'_RESULTS.0_UNKNOWN_-1
2016-01-14 16:08:27,729 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:27,733 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:27,733 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:27,740 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:27,744 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:27,745 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:27,745 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:27,754 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E/.tez/application_1452787707745_0001 doesn't exist and is created
2016-01-14 16:08:27,778 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:27,778 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:27,779 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E/.tez/application_1452787707745_0001
2016-01-14 16:08:27,782 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787707745_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:27,795 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:27,796 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:27,798 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:27,798 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:27,799 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E/.tez/application_1452787707745_0001/localmode-log-dir
2016-01-14 16:08:27,799 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E/.tez/application_1452787707745_0001/localmode-log-dir/history.txt.appattempt_1452787707745_0001_000000, maxErrors=10
2016-01-14 16:08:27,800 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:27,800 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787707745_0001_000000, appSubmitTime=1452787707781, launchTime=1452787707782
2016-01-14 16:08:27,810 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:27,813 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:52399
2016-01-14 16:08:27,814 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:27,815 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:27,816 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:27,816 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:27,818 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787707745_0001_000000, startTime=1452787707818
2016-01-14 16:08:27,818 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:27,818 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:27,879 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:27,879 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:27,879 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...eld'_RESULTS.0_UNKNOWN_-1, applicationId=application_1452787707745_0001, dagName=[73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E] every.every/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1
2016-01-14 16:08:27,895 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E] every.every/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1
2016-01-14 16:08:27,897 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787707745_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E/.tez/application_1452787707745_0001/localmode-log-dir/dag_1452787707745_0001_1.dot
2016-01-14 16:08:27,897 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E/.tez/application_1452787707745_0001/localmode-log-dir/dag_1452787707745_0001_1-tez-dag.pb.txt
2016-01-14 16:08:27,903 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787707745_0001_1
2016-01-14 16:08:27,903 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:27,903 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E] every.every/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1
2016-01-14 16:08:27 Running Dag: dag_1452787707745_0001_1
2016-01-14 16:08:27,916 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787707745_0001_1, submitTime=1452787707895
2016-01-14 16:08:27,916 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:27,916 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex B2DD8C693F5948C0923D5AC165B7A96A
2016-01-14 16:08:27,917 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:27,917 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:27,917 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787707745_0001_1, initTime=1452787707916
2016-01-14 16:08:27,917 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787707745_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:27,918 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:DAG_STARTED]: dagID=dag_1452787707745_0001_1, startTime=1452787707918
2016-01-14 16:08:27,919 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:27,919 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787707745_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:27,919 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...eld'_RESULTS.0_UNKNOWN_-1, applicationId=application_1452787707745_0001, dagName=[73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E] every.every/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1
2016-01-14 16:08:27,918 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:27,919 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: B2DD8C693F5948C0923D5AC165B7A96A : {8962D5CE20624558BAAAEA8DB400C008={InputName=8962D5CE20624558BAAAEA8DB400C008}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:27,920 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 8962D5CE20624558BAAAEA8DB400C008, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:27,920 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:27,920 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:27,920 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:27,920 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]. Starting root input initializers: 1
2016-01-14 16:08:27,921 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:27,922 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 8962D5CE20624558BAAAEA8DB400C008 on vertex vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:27,924 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:27,924 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 8962D5CE20624558BAAAEA8DB400C008 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:27,925 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:27,925 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:27,927 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:27,928 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 8962D5CE20624558BAAAEA8DB400C008 on vertex vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:27,928 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:27,928 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {8962D5CE20624558BAAAEA8DB400C008=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:27,929 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A] parallelism set to 1
2016-01-14 16:08:27,929 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:27,929 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787707745_0001_1_00, eventCount=1
2016-01-14 16:08:27,929 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:27,929 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=3978968D15C0477D89B38B2BA3F5F296, vertexId=vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:27,930 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=3978968D15C0477D89B38B2BA3F5F296, vertexId=vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:27,931 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=3978968D15C0477D89B38B2BA3F5F296, vertexName=B2DD8C693F5948C0923D5AC165B7A96A, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:27,932 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=3978968D15C0477D89B38B2BA3F5F296, vertexId=vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:27,933 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B2DD8C693F5948C0923D5AC165B7A96A, vertexId=vertex_1452787707745_0001_1_00, initRequestedTime=1452787707919, initedTime=1452787707933, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:27,933 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A] with distanceFromRoot: 0
2016-01-14 16:08:27,933 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:27,934 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:27,935 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in B2DD8C693F5948C0923D5AC165B7A96A
2016-01-14 16:08:27,935 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:27,936 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:27,936 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787707745_0001_1_00, startRequestedTime=1452787707935, startedTime=1452787707935
2016-01-14 16:08:27,937 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:27,937 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:27,937 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787707745_0001, with dag id: dag_1452787707745_0001_1
2016-01-14 16:08:27,938 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:TASK_STARTED]: vertexName=B2DD8C693F5948C0923D5AC165B7A96A, taskId=task_1452787707745_0001_1_00_000000, scheduledTime=1452787707937, launchTime=1452787707937
2016-01-14 16:08:27,938 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787707745_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:27,940 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:27,940 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E] every.every/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1, VertexName: B2DD8C693F5948C0923D5AC165B7A96A, VertexParallelism: 1, TaskAttemptID:attempt_1452787707745_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8962D5CE20624558BAAAEA8DB400C008, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=3978968D15C0477D89B38B2BA3F5F296, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:27,941 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787707745_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:27,941 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:27,942 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:27,942 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:27,943 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:27,943 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787707745_0001_00_000001
2016-01-14 16:08:27,943 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787707745_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:27,945 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787707745_0001_00_000001
2016-01-14 16:08:27,945 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:27,947 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787707745_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:27,947 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:27,948 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787707745_0001_00_000001, launchTime=1452787707947
2016-01-14 16:08:27,949 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787707745_0001_00_000001
2016-01-14 16:08:27,949 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787707745_0001_1_00_000000_0] to container: [container_1452787707745_0001_00_000001]
2016-01-14 16:08:27,950 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787707745_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:27,951 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787707745_0001_00_000001 given task: attempt_1452787707745_0001_1_00_000000_0
2016-01-14 16:08:27,951 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787707745_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787707745_0001_1_00_000000_0
2016-01-14 16:08:27,951 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787707745_0001_1_00_000000_0] started. Is using containerId: [container_1452787707745_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:27,951 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:27,951 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B2DD8C693F5948C0923D5AC165B7A96A, taskAttemptId=attempt_1452787707745_0001_1_00_000000_0, startTime=1452787707951, containerId=container_1452787707745_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787707745_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:27,952 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787707745_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:27,952 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787707745_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:27 Starting to run new task attempt: attempt_1452787707745_0001_1_00_000000_0
2016-01-14 16:08:27,954 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787707745_0001_1_00_000000_0
2016-01-14 16:08:27,955 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:27,955 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:27,955 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:27,956 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:27,956 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:27,956 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:27,957 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E] every.every/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1, VertexName: B2DD8C693F5948C0923D5AC165B7A96A, VertexParallelism: 1, TaskAttemptID:attempt_1452787707745_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8962D5CE20624558BAAAEA8DB400C008, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=3978968D15C0477D89B38B2BA3F5F296, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:27,957 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:27,959 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787707745_0001_1_00_000000_0
2016-01-14 16:08:27,960 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:27,960 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:27,959 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787707745_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:27,962 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=8962D5CE20624558BAAAEA8DB400C008, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:27,962 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:27,962 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=3978968D15C0477D89B38B2BA3F5F296, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:27,963 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:27,964 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 3978968D15C0477D89B38B2BA3F5F296
2016-01-14 16:08:27,964 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:27,964 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 3978968D15C0477D89B38B2BA3F5F296
2016-01-14 16:08:27,965 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:27,967 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:27,974 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 8962D5CE20624558BAAAEA8DB400C008
2016-01-14 16:08:27,974 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 8962D5CE20624558BAAAEA8DB400C008
2016-01-14 16:08:27,977 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:27,977 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 8962D5CE20624558BAAAEA8DB400C008
2016-01-14 16:08:27,978 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 8962D5CE20624558BAAAEA8DB400C008
2016-01-14 16:08:27,979 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B2DD8C693F5948C0923D5AC165B7A96A, ordinal: 0
2016-01-14 16:08:27,979 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B2DD8C693F5948C0923D5AC165B7A96A, mem on start (mb), free: 224, total: 384, max: 672
2016-01-14 16:08:27,980 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:27,980 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:27,980 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:27,981 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:27,982 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 3978968D15C0477D89B38B2BA3F5F296
2016-01-14 16:08:27,982 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:27,982 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:27,982 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:27,983 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:27,984 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:27,984 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:27,984 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:27,985 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:27,985 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 3978968D15C0477D89B38B2BA3F5F296, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:27,986 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 8962D5CE20624558BAAAEA8DB400C008, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:27,986 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:27,986 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 8962D5CE20624558BAAAEA8DB400C008
2016-01-14 16:08:27,987 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:27,987 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 8962D5CE20624558BAAAEA8DB400C008
2016-01-14 16:08:27,988 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 8962D5CE20624558BAAAEA8DB400C008 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:27,988 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:27,989 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:27,989 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:27,989 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787707745_0001_1_00_000000_0
2016-01-14 16:08:27,990 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:27,991 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@7716a60f
2016-01-14 16:08:27,993 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@7716a60f
2016-01-14 16:08:27,993 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:27,993 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:27,994 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:27,995 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 8962D5CE20624558BAAAEA8DB400C008
2016-01-14 16:08:27,995 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_-1"], id: 3978968D15C0477D89B38B2BA3F5F296
2016-01-14 16:08:27,996 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_-1"]
2016-01-14 16:08:27,996 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:27,997 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:27,997 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B2DD8C693F5948C0923D5AC165B7A96A, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:28,000 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:28,001 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:28,002 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787707745_0001_1_00_000000_0
2016-01-14 16:08:28,002 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787707745_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:28,003 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787707745_0001_1_00_000000_0
2016-01-14 16:08:28,004 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B2DD8C693F5948C0923D5AC165B7A96A, mem on close (mb), free: 222, total: 384, max: 672
2016-01-14 16:08:28 Completed running task attempt: attempt_1452787707745_0001_1_00_000000_0
2016-01-14 16:08:28,006 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787707745_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:28,009 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B2DD8C693F5948C0923D5AC165B7A96A, taskAttemptId=attempt_1452787707745_0001_1_00_000000_0, startTime=1452787707951, finishTime=1452787708008, timeTaken=57, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787707997, Process_Duration=6, Process_End_Time=1452787708003, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:28,009 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787707745_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:28,009 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:28,009 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787707745_0001_1_00_000000_0
2016-01-14 16:08:28,010 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:28,011 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:TASK_FINISHED]: vertexName=B2DD8C693F5948C0923D5AC165B7A96A, taskId=task_1452787707745_0001_1_00_000000, startTime=1452787707951, finishTime=1452787708010, timeTaken=59, status=SUCCEEDED, successfulAttemptID=attempt_1452787707745_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787707997, Process_Duration=6, Process_End_Time=1452787708003, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:28,011 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:28,011 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787707745_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:28,011 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A] : 1
2016-01-14 16:08:28,011 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:28,014 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:28,014 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:VERTEX_FINISHED]: vertexName=B2DD8C693F5948C0923D5AC165B7A96A, vertexId=vertex_1452787707745_0001_1_00, initRequestedTime=1452787707919, initedTime=1452787707933, startRequestedTime=1452787707935, startedTime=1452787707935, finishTime=1452787708012, timeTaken=77, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787707997, Process_Duration=6, Process_End_Time=1452787708003, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787707951, firstTasksToStart=[ task_1452787707745_0001_1_00_000000 ], lastTaskFinishTime=1452787708008, lastTasksToFinish=[ task_1452787707745_0001_1_00_000000 ], minTaskDuration=57, maxTaskDuration=57, avgTaskDuration=57.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787707745_0001_1_00_000000 ], longestDurationTasks=[ task_1452787707745_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:28,014 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:28,016 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787707745_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:28,016 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787707997, Process_Duration=6, Process_End_Time=1452787708003, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:28,016 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787707745_0001_00_000001, stoppedTime=1452787708016, exitStatus=0
2016-01-14 16:08:28,016 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:28,016 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787707745_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:28,016 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:28,017 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:28,017 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787707745_0001_1
2016-01-14 16:08:28,017 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:28,017 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787707745_0001_1
2016-01-14 16:08:28,017 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 3978968D15C0477D89B38B2BA3F5F296 for vertex: vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:28,020 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787707745_0001_00_000001
2016-01-14 16:08:28,020 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787707745_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:28,020 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787707745_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:28,021 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787707745_0001_00_000001, Exiting
2016-01-14 16:08:28,021 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787707745_0001_00_000001
2016-01-14 16:08:28,021 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787707745_0001_00_000001
2016-01-14 16:08:28,027 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787707745_0001_1, queueSize=0
2016-01-14 16:08:28,028 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:28,028 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787707745_0001_1, startTime=1452787707918, finishTime=1452787708026, timeTaken=108, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787707997, Process_Duration=6, Process_End_Time=1452787708003, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:28,028 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787707745_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:28,028 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787707745_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:28 Completed Dag: dag_1452787707745_0001_1
2016-01-14 16:08:28,029 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787707745_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:28,029 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787707745_0001_1_post
2016-01-14 16:08:28,029 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:28,029 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787707745_0001_00_000001
2016-01-14 16:08:28,029 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:28,029 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787707745_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 16:08:28,030 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787707745_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:28,030 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787707745_0001_00_000001 completed successfully
2016-01-14 16:08:28,030 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787707745_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 16:08:28,035 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...eld'_RESULTS.0_UNKNOWN_-1, applicationId=application_1452787707745_0001
2016-01-14 16:08:28,037 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:28,038 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:28,038 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:28,038 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:28,038 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:28,041 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:28,042 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:28,043 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:28,043 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:28,043 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:28,045 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:28,045 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:28,045 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:28,052 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E/.tez/application_1452787707745_0001
2016-01-14 16:08:28,053 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.325
2016-01-14 16:08:28,132 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_UNKNOWN_-1
2016-01-14 16:08:28,153 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:28,153 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:28,181 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.005
2016-01-14 16:08:28,182 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.006
2016-01-14 16:08:28,182 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:28,182 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:28,182 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_UNKNOWN_'field2'
2016-01-14 16:08:28,203 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:28,204 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:28,233 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.007
2016-01-14 16:08:28,240 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 16:08:28,240 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:28,241 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:28,241 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:28,254 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:28,254 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:28,254 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:28,254 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_RESULTS
2016-01-14 16:08:28,263 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:28,263 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:28,263 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_RESULTS"]
2016-01-14 16:08:28,264 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:28,264 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:28,264 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:28,264 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...RESULTS.0_UNKNOWN_RESULTS
2016-01-14 16:08:28,264 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:28,278 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:28,282 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:28,283 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:28,283 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:28,291 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4CFDE559F4FE433CA7A086BD2B6EF34C/E9DD453A62B840CA87A87E7C581C0CDF/.tez/application_1452787708282_0001 doesn't exist and is created
2016-01-14 16:08:28,306 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:28,306 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:28,307 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4CFDE559F4FE433CA7A086BD2B6EF34C/E9DD453A62B840CA87A87E7C581C0CDF/.tez/application_1452787708282_0001
2016-01-14 16:08:28,309 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787708282_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:28,319 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:28,319 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:28,321 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:28,321 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:28,321 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4CFDE559F4FE433CA7A086BD2B6EF34C/E9DD453A62B840CA87A87E7C581C0CDF/.tez/application_1452787708282_0001/localmode-log-dir
2016-01-14 16:08:28,322 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4CFDE559F4FE433CA7A086BD2B6EF34C/E9DD453A62B840CA87A87E7C581C0CDF/.tez/application_1452787708282_0001/localmode-log-dir/history.txt.appattempt_1452787708282_0001_000000, maxErrors=10
2016-01-14 16:08:28,322 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:28,322 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787708282_0001_000000, appSubmitTime=1452787708309, launchTime=1452787708309
2016-01-14 16:08:28,327 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:28,331 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:28,331 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:47345
2016-01-14 16:08:28,333 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:28,333 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:28,334 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:28,336 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787708282_0001_000000, startTime=1452787708336
2016-01-14 16:08:28,336 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:28,336 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:28,406 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:28,407 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:28,407 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...RESULTS.0_UNKNOWN_RESULTS, applicationId=application_1452787708282_0001, dagName=[4CFDE559F4FE433CA7A086BD2B6EF34C/E9DD453A62B840CA87A87E7C581C0CDF] every.every/(1/1) ...RESULTS.0_UNKNOWN_RESULTS
2016-01-14 16:08:28,423 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [4CFDE559F4FE433CA7A086BD2B6EF34C/E9DD453A62B840CA87A87E7C581C0CDF] every.every/(1/1) ...RESULTS.0_UNKNOWN_RESULTS
2016-01-14 16:08:28,424 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787708282_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4CFDE559F4FE433CA7A086BD2B6EF34C/E9DD453A62B840CA87A87E7C581C0CDF/.tez/application_1452787708282_0001/localmode-log-dir/dag_1452787708282_0001_1.dot
2016-01-14 16:08:28,425 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4CFDE559F4FE433CA7A086BD2B6EF34C/E9DD453A62B840CA87A87E7C581C0CDF/.tez/application_1452787708282_0001/localmode-log-dir/dag_1452787708282_0001_1-tez-dag.pb.txt
2016-01-14 16:08:28,428 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787708282_0001_1
2016-01-14 16:08:28,428 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:28,428 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [4CFDE559F4FE433CA7A086BD2B6EF34C/E9DD453A62B840CA87A87E7C581C0CDF] every.every/(1/1) ...RESULTS.0_UNKNOWN_RESULTS
2016-01-14 16:08:28 Running Dag: dag_1452787708282_0001_1
2016-01-14 16:08:28,439 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708282_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787708282_0001_1, submitTime=1452787708423
2016-01-14 16:08:28,439 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:28,439 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex DC5303FCDE15427C8818A3921FDE0496
2016-01-14 16:08:28,440 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:28,440 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708282_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787708282_0001_1, initTime=1452787708439
2016-01-14 16:08:28,440 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:28,440 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787708282_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:28,441 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708282_0001_1][Event:DAG_STARTED]: dagID=dag_1452787708282_0001_1, startTime=1452787708441
2016-01-14 16:08:28,441 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:28,442 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787708282_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:28,442 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: DC5303FCDE15427C8818A3921FDE0496 : {C716258BD88548B396BDC106399EA51E={InputName=C716258BD88548B396BDC106399EA51E}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:28,442 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: C716258BD88548B396BDC106399EA51E, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:28,442 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496]
2016-01-14 16:08:28,443 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496]
2016-01-14 16:08:28,443 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496]
2016-01-14 16:08:28,443 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496]. Starting root input initializers: 1
2016-01-14 16:08:28,441 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:28,442 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...RESULTS.0_UNKNOWN_RESULTS, applicationId=application_1452787708282_0001, dagName=[4CFDE559F4FE433CA7A086BD2B6EF34C/E9DD453A62B840CA87A87E7C581C0CDF] every.every/(1/1) ...RESULTS.0_UNKNOWN_RESULTS
2016-01-14 16:08:28,444 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:28,445 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: C716258BD88548B396BDC106399EA51E on vertex vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496]
2016-01-14 16:08:28,446 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:28,447 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input C716258BD88548B396BDC106399EA51E asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:28,447 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:28,448 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:28,449 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:28,449 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: C716258BD88548B396BDC106399EA51E on vertex vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496]
2016-01-14 16:08:28,450 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:28,450 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {C716258BD88548B396BDC106399EA51E=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:28,450 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496] parallelism set to 1
2016-01-14 16:08:28,450 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:28,450 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708282_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787708282_0001_1_00, eventCount=1
2016-01-14 16:08:28,450 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496]
2016-01-14 16:08:28,451 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=C1B22DECFA154E51B2221B4E35241114, vertexId=vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:28,451 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=C1B22DECFA154E51B2221B4E35241114, vertexId=vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496]
2016-01-14 16:08:28,453 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=C1B22DECFA154E51B2221B4E35241114, vertexName=DC5303FCDE15427C8818A3921FDE0496, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:28,453 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=C1B22DECFA154E51B2221B4E35241114, vertexId=vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496]
2016-01-14 16:08:28,454 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:28,454 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708282_0001_1][Event:VERTEX_INITIALIZED]: vertexName=DC5303FCDE15427C8818A3921FDE0496, vertexId=vertex_1452787708282_0001_1_00, initRequestedTime=1452787708442, initedTime=1452787708454, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:28,454 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496] with distanceFromRoot: 0
2016-01-14 16:08:28,454 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:28,455 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in DC5303FCDE15427C8818A3921FDE0496
2016-01-14 16:08:28,455 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496]
2016-01-14 16:08:28,455 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:28,455 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708282_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787708282_0001_1_00, startRequestedTime=1452787708455, startedTime=1452787708455
2016-01-14 16:08:28,455 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:28,457 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:28,458 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708282_0001_1][Event:TASK_STARTED]: vertexName=DC5303FCDE15427C8818A3921FDE0496, taskId=task_1452787708282_0001_1_00_000000, scheduledTime=1452787708457, launchTime=1452787708457
2016-01-14 16:08:28,458 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787708282_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:28,458 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496]
2016-01-14 16:08:28,459 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [4CFDE559F4FE433CA7A086BD2B6EF34C/E9DD453A62B840CA87A87E7C581C0CDF] every.every/(1/1) ...RESULTS.0_UNKNOWN_RESULTS, VertexName: DC5303FCDE15427C8818A3921FDE0496, VertexParallelism: 1, TaskAttemptID:attempt_1452787708282_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=C716258BD88548B396BDC106399EA51E, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=C1B22DECFA154E51B2221B4E35241114, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:28,459 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787708282_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:28,459 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:28,459 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787708282_0001, with dag id: dag_1452787708282_0001_1
2016-01-14 16:08:28,460 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:28,461 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:28,461 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:28,462 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787708282_0001_00_000001
2016-01-14 16:08:28,462 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787708282_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:28,474 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787708282_0001_00_000001
2016-01-14 16:08:28,474 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:28,476 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787708282_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:28,476 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:28,476 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708282_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787708282_0001_00_000001, launchTime=1452787708476
2016-01-14 16:08:28,477 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787708282_0001_00_000001
2016-01-14 16:08:28,478 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787708282_0001_1_00_000000_0] to container: [container_1452787708282_0001_00_000001]
2016-01-14 16:08:28,478 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787708282_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:28,479 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787708282_0001_1_00_000000_0] started. Is using containerId: [container_1452787708282_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:28,479 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708282_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=DC5303FCDE15427C8818A3921FDE0496, taskAttemptId=attempt_1452787708282_0001_1_00_000000_0, startTime=1452787708479, containerId=container_1452787708282_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787708282_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:28,479 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:28,479 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787708282_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:28,479 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787708282_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:28,480 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787708282_0001_00_000001 given task: attempt_1452787708282_0001_1_00_000000_0
2016-01-14 16:08:28,480 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787708282_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787708282_0001_1_00_000000_0
2016-01-14 16:08:28 Starting to run new task attempt: attempt_1452787708282_0001_1_00_000000_0
2016-01-14 16:08:28,480 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787708282_0001_1_00_000000_0
2016-01-14 16:08:28,480 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:28,480 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:28,480 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:28,481 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:28,481 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:28,481 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:28,481 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [4CFDE559F4FE433CA7A086BD2B6EF34C/E9DD453A62B840CA87A87E7C581C0CDF] every.every/(1/1) ...RESULTS.0_UNKNOWN_RESULTS, VertexName: DC5303FCDE15427C8818A3921FDE0496, VertexParallelism: 1, TaskAttemptID:attempt_1452787708282_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=C716258BD88548B396BDC106399EA51E, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=C1B22DECFA154E51B2221B4E35241114, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:28,481 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:28,482 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787708282_0001_1_00_000000_0
2016-01-14 16:08:28,482 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:28,482 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:28,483 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787708282_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:28,483 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:28,485 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=C1B22DECFA154E51B2221B4E35241114, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:28,485 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:28,485 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: C1B22DECFA154E51B2221B4E35241114
2016-01-14 16:08:28,485 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:28,486 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: C1B22DECFA154E51B2221B4E35241114
2016-01-14 16:08:28,485 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=C716258BD88548B396BDC106399EA51E, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:28,486 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:28,488 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:28,489 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: C716258BD88548B396BDC106399EA51E
2016-01-14 16:08:28,490 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: C716258BD88548B396BDC106399EA51E
2016-01-14 16:08:28,492 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:28,493 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: C716258BD88548B396BDC106399EA51E
2016-01-14 16:08:28,493 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: C716258BD88548B396BDC106399EA51E
2016-01-14 16:08:28,495 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: DC5303FCDE15427C8818A3921FDE0496, ordinal: 0
2016-01-14 16:08:28,495 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DC5303FCDE15427C8818A3921FDE0496, mem on start (mb), free: 336, total: 384, max: 672
2016-01-14 16:08:28,496 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:28,496 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:28,496 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:28,497 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:28,497 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: C1B22DECFA154E51B2221B4E35241114
2016-01-14 16:08:28,497 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:28,497 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:28,497 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:28,498 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:28,498 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:28,498 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:28,498 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:28,498 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:28,498 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, C1B22DECFA154E51B2221B4E35241114, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:28,498 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, C716258BD88548B396BDC106399EA51E, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:28,498 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:28,498 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: C716258BD88548B396BDC106399EA51E
2016-01-14 16:08:28,498 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:28,498 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: C716258BD88548B396BDC106399EA51E
2016-01-14 16:08:28,498 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: C716258BD88548B396BDC106399EA51E being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:28,499 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:28,499 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:28,499 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:28,499 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787708282_0001_1_00_000000_0
2016-01-14 16:08:28,499 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:28,500 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@3f5591c4
2016-01-14 16:08:28,500 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@3f5591c4
2016-01-14 16:08:28,501 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:28,501 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:28,503 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:28,504 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: C716258BD88548B396BDC106399EA51E
2016-01-14 16:08:28,504 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_RESULTS"], id: C1B22DECFA154E51B2221B4E35241114
2016-01-14 16:08:28,505 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_RESULTS"]
2016-01-14 16:08:28,505 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:28,505 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:28,505 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: DC5303FCDE15427C8818A3921FDE0496, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:28,507 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:28,508 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:28,508 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787708282_0001_1_00_000000_0
2016-01-14 16:08:28,508 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787708282_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:28,509 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787708282_0001_1_00_000000_0
2016-01-14 16:08:28,509 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DC5303FCDE15427C8818A3921FDE0496, mem on close (mb), free: 334, total: 384, max: 672
2016-01-14 16:08:28 Completed running task attempt: attempt_1452787708282_0001_1_00_000000_0
2016-01-14 16:08:28,510 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787708282_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:28,511 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787708506, Process_Duration=3, Process_End_Time=1452787708509, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:28,511 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708282_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=DC5303FCDE15427C8818A3921FDE0496, taskAttemptId=attempt_1452787708282_0001_1_00_000000_0, startTime=1452787708479, finishTime=1452787708511, timeTaken=32, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787708506, Process_Duration=3, Process_End_Time=1452787708509, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:28,511 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:28,512 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787708282_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:28,512 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:28,512 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787708282_0001_1_00_000000_0
2016-01-14 16:08:28,512 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:28,512 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:28,513 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:28,513 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708282_0001_1][Event:TASK_FINISHED]: vertexName=DC5303FCDE15427C8818A3921FDE0496, taskId=task_1452787708282_0001_1_00_000000, startTime=1452787708479, finishTime=1452787708512, timeTaken=33, status=SUCCEEDED, successfulAttemptID=attempt_1452787708282_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787708506, Process_Duration=3, Process_End_Time=1452787708509, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:28,513 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787708282_0001_00_000001
2016-01-14 16:08:28,513 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787708282_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:28,514 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496] : 1
2016-01-14 16:08:28,514 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496]
2016-01-14 16:08:28,515 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:28,515 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708282_0001_1][Event:VERTEX_FINISHED]: vertexName=DC5303FCDE15427C8818A3921FDE0496, vertexId=vertex_1452787708282_0001_1_00, initRequestedTime=1452787708442, initedTime=1452787708454, startRequestedTime=1452787708455, startedTime=1452787708455, finishTime=1452787708514, timeTaken=59, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787708506, Process_Duration=3, Process_End_Time=1452787708509, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787708479, firstTasksToStart=[ task_1452787708282_0001_1_00_000000 ], lastTaskFinishTime=1452787708511, lastTasksToFinish=[ task_1452787708282_0001_1_00_000000 ], minTaskDuration=32, maxTaskDuration=32, avgTaskDuration=32.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787708282_0001_1_00_000000 ], longestDurationTasks=[ task_1452787708282_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:28,515 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:28,515 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787708282_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:28,516 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708282_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787708282_0001_00_000001, stoppedTime=1452787708516, exitStatus=0
2016-01-14 16:08:28,516 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:28,516 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787708282_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:28,516 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:28,516 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787708282_0001_1
2016-01-14 16:08:28,516 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708282_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787708282_0001_1
2016-01-14 16:08:28,517 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: C1B22DECFA154E51B2221B4E35241114 for vertex: vertex_1452787708282_0001_1_00 [DC5303FCDE15427C8818A3921FDE0496]
2016-01-14 16:08:28,525 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787708282_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:28,525 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787708282_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:28,525 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787708282_0001_00_000001, Exiting
2016-01-14 16:08:28,525 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787708282_0001_00_000001
2016-01-14 16:08:28,525 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787708282_0001_00_000001
2016-01-14 16:08:28,526 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787708282_0001_1, queueSize=0
2016-01-14 16:08:28,526 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787708282_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:28,526 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787708282_0001_00_000001 completed successfully
2016-01-14 16:08:28,527 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:28,527 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708282_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787708282_0001_1, startTime=1452787708441, finishTime=1452787708524, timeTaken=83, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787708506, Process_Duration=3, Process_End_Time=1452787708509, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:28,527 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787708282_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:28,528 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787708282_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:28,528 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787708282_0001_00_000001
2016-01-14 16:08:28,528 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787708282_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:28 Completed Dag: dag_1452787708282_0001_1
2016-01-14 16:08:28,528 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787708282_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:28,528 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787708282_0001_1_post
2016-01-14 16:08:28,529 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:28,529 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:28,535 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...RESULTS.0_UNKNOWN_RESULTS, applicationId=application_1452787708282_0001
2016-01-14 16:08:28,536 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:28,536 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:28,536 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:28,537 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:28,537 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:28,537 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:28,537 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:28,538 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:28,538 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:28,539 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:28,539 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:28,540 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:28,540 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:28,543 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4CFDE559F4FE433CA7A086BD2B6EF34C/E9DD453A62B840CA87A87E7C581C0CDF/.tez/application_1452787708282_0001
2016-01-14 16:08:28,544 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.281
2016-01-14 16:08:28,611 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_UNKNOWN_RESULTS
2016-01-14 16:08:28,631 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:28,632 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:28,667 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.009
2016-01-14 16:08:28,675 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 16:08:28,676 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:28,676 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:28,677 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:28,690 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:28,690 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_ALL
2016-01-14 16:08:28,699 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:28,699 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:28,699 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_ALL"]
2016-01-14 16:08:28,699 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:28,699 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:28,700 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:28,701 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ld'_RESULTS.0_UNKNOWN_ALL
2016-01-14 16:08:28,701 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:28,713 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:28,718 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:28,718 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:28,719 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:28,728 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/772397F5963B4F7A8B72EFB8B958936A/B9513FDBCE9647E89BE35164BBA990D4/.tez/application_1452787708718_0001 doesn't exist and is created
2016-01-14 16:08:28,744 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:28,744 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:28,744 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/772397F5963B4F7A8B72EFB8B958936A/B9513FDBCE9647E89BE35164BBA990D4/.tez/application_1452787708718_0001
2016-01-14 16:08:28,747 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787708718_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:28,757 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:28,758 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:28,759 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:28,760 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:28,760 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/772397F5963B4F7A8B72EFB8B958936A/B9513FDBCE9647E89BE35164BBA990D4/.tez/application_1452787708718_0001/localmode-log-dir
2016-01-14 16:08:28,760 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/772397F5963B4F7A8B72EFB8B958936A/B9513FDBCE9647E89BE35164BBA990D4/.tez/application_1452787708718_0001/localmode-log-dir/history.txt.appattempt_1452787708718_0001_000000, maxErrors=10
2016-01-14 16:08:28,760 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:28,760 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787708718_0001_000000, appSubmitTime=1452787708747, launchTime=1452787708747
2016-01-14 16:08:28,765 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:28,765 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:28,766 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:28,766 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:28,770 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:38625
2016-01-14 16:08:28,771 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:28,773 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787708718_0001_000000, startTime=1452787708773
2016-01-14 16:08:28,774 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:28,774 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:28,792 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:28,792 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:28,844 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:28,844 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:28,844 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.0_UNKNOWN_ALL, applicationId=application_1452787708718_0001, dagName=[772397F5963B4F7A8B72EFB8B958936A/B9513FDBCE9647E89BE35164BBA990D4] every.every/(1/1) ...ld'_RESULTS.0_UNKNOWN_ALL
2016-01-14 16:08:28,859 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [772397F5963B4F7A8B72EFB8B958936A/B9513FDBCE9647E89BE35164BBA990D4] every.every/(1/1) ...ld'_RESULTS.0_UNKNOWN_ALL
2016-01-14 16:08:28,860 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787708718_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/772397F5963B4F7A8B72EFB8B958936A/B9513FDBCE9647E89BE35164BBA990D4/.tez/application_1452787708718_0001/localmode-log-dir/dag_1452787708718_0001_1.dot
2016-01-14 16:08:28,861 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/772397F5963B4F7A8B72EFB8B958936A/B9513FDBCE9647E89BE35164BBA990D4/.tez/application_1452787708718_0001/localmode-log-dir/dag_1452787708718_0001_1-tez-dag.pb.txt
2016-01-14 16:08:28,865 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787708718_0001_1
2016-01-14 16:08:28,865 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:28,865 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [772397F5963B4F7A8B72EFB8B958936A/B9513FDBCE9647E89BE35164BBA990D4] every.every/(1/1) ...ld'_RESULTS.0_UNKNOWN_ALL
2016-01-14 16:08:28 Running Dag: dag_1452787708718_0001_1
2016-01-14 16:08:28,875 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708718_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787708718_0001_1, submitTime=1452787708859
2016-01-14 16:08:28,875 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:28,875 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex A6D8CFF247E84AA8A2C39FE202215798
2016-01-14 16:08:28,875 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:28,876 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708718_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787708718_0001_1, initTime=1452787708875
2016-01-14 16:08:28,876 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:28,876 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787708718_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:28,877 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708718_0001_1][Event:DAG_STARTED]: dagID=dag_1452787708718_0001_1, startTime=1452787708877
2016-01-14 16:08:28,877 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:28,877 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:28,877 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787708718_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:28,877 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: A6D8CFF247E84AA8A2C39FE202215798 : {346314244B614CFD9D6278348D42B320={InputName=346314244B614CFD9D6278348D42B320}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:28,878 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 346314244B614CFD9D6278348D42B320, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:28,878 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798]
2016-01-14 16:08:28,879 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798]
2016-01-14 16:08:28,879 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798]
2016-01-14 16:08:28,879 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798]. Starting root input initializers: 1
2016-01-14 16:08:28,880 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:28,880 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.0_UNKNOWN_ALL, applicationId=application_1452787708718_0001, dagName=[772397F5963B4F7A8B72EFB8B958936A/B9513FDBCE9647E89BE35164BBA990D4] every.every/(1/1) ...ld'_RESULTS.0_UNKNOWN_ALL
2016-01-14 16:08:28,880 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 346314244B614CFD9D6278348D42B320 on vertex vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798]
2016-01-14 16:08:28,881 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:28,881 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 346314244B614CFD9D6278348D42B320 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:28,882 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:28,882 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:28,883 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:28,883 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 346314244B614CFD9D6278348D42B320 on vertex vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798]
2016-01-14 16:08:28,883 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:28,883 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {346314244B614CFD9D6278348D42B320=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:28,884 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798] parallelism set to 1
2016-01-14 16:08:28,884 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:28,884 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708718_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787708718_0001_1_00, eventCount=1
2016-01-14 16:08:28,884 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798]
2016-01-14 16:08:28,884 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=0CAF7E7EEC4647349F94B20BE0508A51, vertexId=vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:28,885 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=0CAF7E7EEC4647349F94B20BE0508A51, vertexId=vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798]
2016-01-14 16:08:28,887 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=0CAF7E7EEC4647349F94B20BE0508A51, vertexName=A6D8CFF247E84AA8A2C39FE202215798, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:28,887 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=0CAF7E7EEC4647349F94B20BE0508A51, vertexId=vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798]
2016-01-14 16:08:28,888 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708718_0001_1][Event:VERTEX_INITIALIZED]: vertexName=A6D8CFF247E84AA8A2C39FE202215798, vertexId=vertex_1452787708718_0001_1_00, initRequestedTime=1452787708877, initedTime=1452787708888, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:28,889 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798] with distanceFromRoot: 0
2016-01-14 16:08:28,889 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:28,889 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:28,889 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in A6D8CFF247E84AA8A2C39FE202215798
2016-01-14 16:08:28,889 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798]
2016-01-14 16:08:28,890 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708718_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787708718_0001_1_00, startRequestedTime=1452787708889, startedTime=1452787708889
2016-01-14 16:08:28,890 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:28,890 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:28,891 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708718_0001_1][Event:TASK_STARTED]: vertexName=A6D8CFF247E84AA8A2C39FE202215798, taskId=task_1452787708718_0001_1_00_000000, scheduledTime=1452787708891, launchTime=1452787708891
2016-01-14 16:08:28,891 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787708718_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:28,891 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:28,891 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798]
2016-01-14 16:08:28,892 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [772397F5963B4F7A8B72EFB8B958936A/B9513FDBCE9647E89BE35164BBA990D4] every.every/(1/1) ...ld'_RESULTS.0_UNKNOWN_ALL, VertexName: A6D8CFF247E84AA8A2C39FE202215798, VertexParallelism: 1, TaskAttemptID:attempt_1452787708718_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=346314244B614CFD9D6278348D42B320, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=0CAF7E7EEC4647349F94B20BE0508A51, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:28,892 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787708718_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:28,892 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:28,893 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:28,893 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:28,893 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:28,894 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787708718_0001_00_000001
2016-01-14 16:08:28,894 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787708718_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:28,896 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787708718_0001_00_000001
2016-01-14 16:08:28,896 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:28,897 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787708718_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:28,897 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708718_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787708718_0001_00_000001, launchTime=1452787708897
2016-01-14 16:08:28,897 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:28,898 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787708718_0001_00_000001
2016-01-14 16:08:28,901 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787708718_0001_1_00_000000_0] to container: [container_1452787708718_0001_00_000001]
2016-01-14 16:08:28,901 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787708718_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:28,902 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787708718_0001_1_00_000000_0] started. Is using containerId: [container_1452787708718_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:28,902 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:28,902 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708718_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=A6D8CFF247E84AA8A2C39FE202215798, taskAttemptId=attempt_1452787708718_0001_1_00_000000_0, startTime=1452787708902, containerId=container_1452787708718_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787708718_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:28,903 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787708718_0001_00_000001 given task: attempt_1452787708718_0001_1_00_000000_0
2016-01-14 16:08:28,903 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787708718_0001, with dag id: dag_1452787708718_0001_1
2016-01-14 16:08:28,903 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787708718_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:28,904 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787708718_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:28,903 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787708718_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787708718_0001_1_00_000000_0
2016-01-14 16:08:28 Starting to run new task attempt: attempt_1452787708718_0001_1_00_000000_0
2016-01-14 16:08:28,906 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787708718_0001_1_00_000000_0
2016-01-14 16:08:28,906 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:28,906 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:28,907 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:28,907 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:28,907 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:28,907 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:28,907 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [772397F5963B4F7A8B72EFB8B958936A/B9513FDBCE9647E89BE35164BBA990D4] every.every/(1/1) ...ld'_RESULTS.0_UNKNOWN_ALL, VertexName: A6D8CFF247E84AA8A2C39FE202215798, VertexParallelism: 1, TaskAttemptID:attempt_1452787708718_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=346314244B614CFD9D6278348D42B320, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=0CAF7E7EEC4647349F94B20BE0508A51, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:28,907 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:28,909 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787708718_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:28,910 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787708718_0001_1_00_000000_0
2016-01-14 16:08:28,911 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:28,911 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:28,911 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=346314244B614CFD9D6278348D42B320, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:28,912 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:28,912 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 346314244B614CFD9D6278348D42B320
2016-01-14 16:08:28,912 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 346314244B614CFD9D6278348D42B320
2016-01-14 16:08:28,912 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:28,913 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=0CAF7E7EEC4647349F94B20BE0508A51, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:28,913 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:28,913 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 0CAF7E7EEC4647349F94B20BE0508A51
2016-01-14 16:08:28,913 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:28,913 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 0CAF7E7EEC4647349F94B20BE0508A51
2016-01-14 16:08:28,915 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:28,924 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: A6D8CFF247E84AA8A2C39FE202215798, ordinal: 0
2016-01-14 16:08:28,925 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A6D8CFF247E84AA8A2C39FE202215798, mem on start (mb), free: 261, total: 384, max: 672
2016-01-14 16:08:28,925 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:28,925 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:28,928 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:28,928 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 346314244B614CFD9D6278348D42B320
2016-01-14 16:08:28,928 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 346314244B614CFD9D6278348D42B320
2016-01-14 16:08:28,928 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:28,928 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:28,929 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 0CAF7E7EEC4647349F94B20BE0508A51
2016-01-14 16:08:28,930 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:28,930 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:28,930 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:28,930 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:28,931 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:28,931 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:28,931 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:28,931 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:28,931 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 0CAF7E7EEC4647349F94B20BE0508A51, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:28,932 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 346314244B614CFD9D6278348D42B320, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:28,932 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:28,932 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 346314244B614CFD9D6278348D42B320 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:28,932 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 346314244B614CFD9D6278348D42B320
2016-01-14 16:08:28,932 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:28,932 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 346314244B614CFD9D6278348D42B320
2016-01-14 16:08:28,932 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:28,932 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:28,934 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:28,934 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787708718_0001_1_00_000000_0
2016-01-14 16:08:28,936 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:28,937 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@5156eb32
2016-01-14 16:08:28,938 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:28,938 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@5156eb32
2016-01-14 16:08:28,938 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:28,938 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 346314244B614CFD9D6278348D42B320
2016-01-14 16:08:28,939 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_ALL"], id: 0CAF7E7EEC4647349F94B20BE0508A51
2016-01-14 16:08:28,939 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_ALL"]
2016-01-14 16:08:28,939 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:28,939 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:28,938 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:28,940 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: A6D8CFF247E84AA8A2C39FE202215798, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:28,943 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:28,943 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:28,943 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787708718_0001_1_00_000000_0
2016-01-14 16:08:28,944 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787708718_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:28,944 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787708718_0001_1_00_000000_0
2016-01-14 16:08:28,944 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A6D8CFF247E84AA8A2C39FE202215798, mem on close (mb), free: 259, total: 384, max: 672
2016-01-14 16:08:28 Completed running task attempt: attempt_1452787708718_0001_1_00_000000_0
2016-01-14 16:08:28,945 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787708718_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:28,947 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787708940, Process_Duration=4, Process_End_Time=1452787708944, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:28,947 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:28,947 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708718_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=A6D8CFF247E84AA8A2C39FE202215798, taskAttemptId=attempt_1452787708718_0001_1_00_000000_0, startTime=1452787708902, finishTime=1452787708947, timeTaken=45, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787708940, Process_Duration=4, Process_End_Time=1452787708944, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:28,947 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787708718_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:28,948 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787708718_0001_1_00_000000_0
2016-01-14 16:08:28,948 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:28,948 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708718_0001_1][Event:TASK_FINISHED]: vertexName=A6D8CFF247E84AA8A2C39FE202215798, taskId=task_1452787708718_0001_1_00_000000, startTime=1452787708902, finishTime=1452787708948, timeTaken=46, status=SUCCEEDED, successfulAttemptID=attempt_1452787708718_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787708940, Process_Duration=4, Process_End_Time=1452787708944, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:28,949 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:28,949 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:28,949 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787708718_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:28,949 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798] : 1
2016-01-14 16:08:28,949 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798]
2016-01-14 16:08:28,950 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:28,951 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:28,951 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708718_0001_1][Event:VERTEX_FINISHED]: vertexName=A6D8CFF247E84AA8A2C39FE202215798, vertexId=vertex_1452787708718_0001_1_00, initRequestedTime=1452787708877, initedTime=1452787708888, startRequestedTime=1452787708889, startedTime=1452787708889, finishTime=1452787708950, timeTaken=61, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787708940, Process_Duration=4, Process_End_Time=1452787708944, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787708902, firstTasksToStart=[ task_1452787708718_0001_1_00_000000 ], lastTaskFinishTime=1452787708947, lastTasksToFinish=[ task_1452787708718_0001_1_00_000000 ], minTaskDuration=45, maxTaskDuration=45, avgTaskDuration=45.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787708718_0001_1_00_000000 ], longestDurationTasks=[ task_1452787708718_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:28,951 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:28,951 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787708718_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:28,951 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708718_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787708718_0001_00_000001, stoppedTime=1452787708951, exitStatus=0
2016-01-14 16:08:28,951 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787708718_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:28,951 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:28,951 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787708718_0001_1
2016-01-14 16:08:28,951 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:28,952 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708718_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787708718_0001_1
2016-01-14 16:08:28,952 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 0CAF7E7EEC4647349F94B20BE0508A51 for vertex: vertex_1452787708718_0001_1_00 [A6D8CFF247E84AA8A2C39FE202215798]
2016-01-14 16:08:28,953 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787708718_0001_00_000001
2016-01-14 16:08:28,953 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787708718_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:28,954 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787708718_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:28,954 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787708718_0001_00_000001, Exiting
2016-01-14 16:08:28,954 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787708718_0001_00_000001
2016-01-14 16:08:28,954 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787708718_0001_00_000001
2016-01-14 16:08:28,955 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787708718_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:28,956 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787708718_0001_00_000001 completed successfully
2016-01-14 16:08:28,960 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787708718_0001_1, queueSize=0
2016-01-14 16:08:28,960 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:28,960 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787708718_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787708718_0001_1, startTime=1452787708877, finishTime=1452787708959, timeTaken=82, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787708940, Process_Duration=4, Process_End_Time=1452787708944, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:28,960 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787708718_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:28,960 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787708718_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:28,961 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787708718_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:28 Completed Dag: dag_1452787708718_0001_1
2016-01-14 16:08:28,961 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787708718_0001_00_000001
2016-01-14 16:08:28,961 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787708718_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:28,961 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787708718_0001_1_post
2016-01-14 16:08:28,961 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:28,961 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:28,968 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ld'_RESULTS.0_UNKNOWN_ALL, applicationId=application_1452787708718_0001
2016-01-14 16:08:28,970 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:28,970 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:28,970 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:28,970 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:28,970 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:28,971 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:28,971 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:28,971 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:28,971 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:28,972 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:28,972 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:28,972 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:28,973 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:28,976 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/772397F5963B4F7A8B72EFB8B958936A/B9513FDBCE9647E89BE35164BBA990D4/.tez/application_1452787708718_0001
2016-01-14 16:08:28,977 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.277
2016-01-14 16:08:29,050 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_UNKNOWN_ALL
2016-01-14 16:08:29,070 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:29,071 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:29,105 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.011
2016-01-14 16:08:29,111 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 16:08:29,111 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:29,111 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:29,111 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:29,124 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:29,124 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_-1
2016-01-14 16:08:29,133 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:29,133 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:29,134 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_-1"]
2016-01-14 16:08:29,134 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:29,134 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:29,134 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:29,135 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ield'_RESULTS.0_VALUES_-1
2016-01-14 16:08:29,135 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:29,145 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:29,150 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:29,150 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:29,150 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:29,159 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D8DAEB1D865941E997CEB2286D043434/C38326128DFC4BA4BCDACFDF8DA882AC/.tez/application_1452787709150_0001 doesn't exist and is created
2016-01-14 16:08:29,175 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:29,175 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:29,176 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D8DAEB1D865941E997CEB2286D043434/C38326128DFC4BA4BCDACFDF8DA882AC/.tez/application_1452787709150_0001
2016-01-14 16:08:29,178 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787709150_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:29,188 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:29,188 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:29,190 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:29,190 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:29,190 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D8DAEB1D865941E997CEB2286D043434/C38326128DFC4BA4BCDACFDF8DA882AC/.tez/application_1452787709150_0001/localmode-log-dir
2016-01-14 16:08:29,191 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D8DAEB1D865941E997CEB2286D043434/C38326128DFC4BA4BCDACFDF8DA882AC/.tez/application_1452787709150_0001/localmode-log-dir/history.txt.appattempt_1452787709150_0001_000000, maxErrors=10
2016-01-14 16:08:29,191 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:29,191 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787709150_0001_000000, appSubmitTime=1452787709178, launchTime=1452787709178
2016-01-14 16:08:29,196 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:34325
2016-01-14 16:08:29,197 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:29,200 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:29,204 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:29,204 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:29,205 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:29,206 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787709150_0001_000000, startTime=1452787709206
2016-01-14 16:08:29,207 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:29,206 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:29,276 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:29,276 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:29,276 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ield'_RESULTS.0_VALUES_-1, applicationId=application_1452787709150_0001, dagName=[D8DAEB1D865941E997CEB2286D043434/C38326128DFC4BA4BCDACFDF8DA882AC] every.every/(1/1) ...ield'_RESULTS.0_VALUES_-1
2016-01-14 16:08:29,277 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:29,277 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:29,290 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [D8DAEB1D865941E997CEB2286D043434/C38326128DFC4BA4BCDACFDF8DA882AC] every.every/(1/1) ...ield'_RESULTS.0_VALUES_-1
2016-01-14 16:08:29,292 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787709150_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D8DAEB1D865941E997CEB2286D043434/C38326128DFC4BA4BCDACFDF8DA882AC/.tez/application_1452787709150_0001/localmode-log-dir/dag_1452787709150_0001_1.dot
2016-01-14 16:08:29,292 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D8DAEB1D865941E997CEB2286D043434/C38326128DFC4BA4BCDACFDF8DA882AC/.tez/application_1452787709150_0001/localmode-log-dir/dag_1452787709150_0001_1-tez-dag.pb.txt
2016-01-14 16:08:29,296 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787709150_0001_1
2016-01-14 16:08:29,296 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:29,296 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [D8DAEB1D865941E997CEB2286D043434/C38326128DFC4BA4BCDACFDF8DA882AC] every.every/(1/1) ...ield'_RESULTS.0_VALUES_-1
2016-01-14 16:08:29 Running Dag: dag_1452787709150_0001_1
2016-01-14 16:08:29,307 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709150_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787709150_0001_1, submitTime=1452787709291
2016-01-14 16:08:29,307 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:29,307 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex FBBD186666A9470183D6A9207A2FCB88
2016-01-14 16:08:29,307 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:29,308 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709150_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787709150_0001_1, initTime=1452787709307
2016-01-14 16:08:29,308 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:29,308 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787709150_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:29,308 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709150_0001_1][Event:DAG_STARTED]: dagID=dag_1452787709150_0001_1, startTime=1452787709308
2016-01-14 16:08:29,308 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:29,308 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:29,309 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787709150_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:29,310 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: FBBD186666A9470183D6A9207A2FCB88 : {A3C243EF2DFE40178ACBBEF4D395B7D9={InputName=A3C243EF2DFE40178ACBBEF4D395B7D9}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:29,310 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: A3C243EF2DFE40178ACBBEF4D395B7D9, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:29,310 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88]
2016-01-14 16:08:29,310 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ield'_RESULTS.0_VALUES_-1, applicationId=application_1452787709150_0001, dagName=[D8DAEB1D865941E997CEB2286D043434/C38326128DFC4BA4BCDACFDF8DA882AC] every.every/(1/1) ...ield'_RESULTS.0_VALUES_-1
2016-01-14 16:08:29,310 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88]
2016-01-14 16:08:29,310 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88]
2016-01-14 16:08:29,310 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88]. Starting root input initializers: 1
2016-01-14 16:08:29,311 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:29,311 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: A3C243EF2DFE40178ACBBEF4D395B7D9 on vertex vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88]
2016-01-14 16:08:29,313 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:29,313 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input A3C243EF2DFE40178ACBBEF4D395B7D9 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:29,313 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:29,314 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:29,315 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:29,315 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: A3C243EF2DFE40178ACBBEF4D395B7D9 on vertex vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88]
2016-01-14 16:08:29,315 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:29,315 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {A3C243EF2DFE40178ACBBEF4D395B7D9=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:29,316 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88] parallelism set to 1
2016-01-14 16:08:29,316 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:29,316 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709150_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787709150_0001_1_00, eventCount=1
2016-01-14 16:08:29,316 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88]
2016-01-14 16:08:29,316 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=D0CC41B975E144399608057E5E13706F, vertexId=vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:29,317 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=D0CC41B975E144399608057E5E13706F, vertexId=vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88]
2016-01-14 16:08:29,318 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=D0CC41B975E144399608057E5E13706F, vertexName=FBBD186666A9470183D6A9207A2FCB88, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:29,318 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=D0CC41B975E144399608057E5E13706F, vertexId=vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88]
2016-01-14 16:08:29,319 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709150_0001_1][Event:VERTEX_INITIALIZED]: vertexName=FBBD186666A9470183D6A9207A2FCB88, vertexId=vertex_1452787709150_0001_1_00, initRequestedTime=1452787709310, initedTime=1452787709319, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:29,319 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:29,319 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88] with distanceFromRoot: 0
2016-01-14 16:08:29,320 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:29,320 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in FBBD186666A9470183D6A9207A2FCB88
2016-01-14 16:08:29,320 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88]
2016-01-14 16:08:29,321 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:29,321 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709150_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787709150_0001_1_00, startRequestedTime=1452787709320, startedTime=1452787709320
2016-01-14 16:08:29,321 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:29,322 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:29,322 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709150_0001_1][Event:TASK_STARTED]: vertexName=FBBD186666A9470183D6A9207A2FCB88, taskId=task_1452787709150_0001_1_00_000000, scheduledTime=1452787709321, launchTime=1452787709321
2016-01-14 16:08:29,322 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787709150_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:29,322 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88]
2016-01-14 16:08:29,323 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [D8DAEB1D865941E997CEB2286D043434/C38326128DFC4BA4BCDACFDF8DA882AC] every.every/(1/1) ...ield'_RESULTS.0_VALUES_-1, VertexName: FBBD186666A9470183D6A9207A2FCB88, VertexParallelism: 1, TaskAttemptID:attempt_1452787709150_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=A3C243EF2DFE40178ACBBEF4D395B7D9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D0CC41B975E144399608057E5E13706F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:29,323 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787709150_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:29,323 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:29,324 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:29,324 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:29,324 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:29,325 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787709150_0001_00_000001
2016-01-14 16:08:29,325 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787709150_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:29,326 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787709150_0001, with dag id: dag_1452787709150_0001_1
2016-01-14 16:08:29,327 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787709150_0001_00_000001
2016-01-14 16:08:29,327 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:29,328 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787709150_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:29,328 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:29,328 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709150_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787709150_0001_00_000001, launchTime=1452787709328
2016-01-14 16:08:29,329 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787709150_0001_00_000001
2016-01-14 16:08:29,330 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787709150_0001_1_00_000000_0] to container: [container_1452787709150_0001_00_000001]
2016-01-14 16:08:29,330 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787709150_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:29,330 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787709150_0001_1_00_000000_0] started. Is using containerId: [container_1452787709150_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:29,331 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709150_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=FBBD186666A9470183D6A9207A2FCB88, taskAttemptId=attempt_1452787709150_0001_1_00_000000_0, startTime=1452787709330, containerId=container_1452787709150_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787709150_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:29,331 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787709150_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:29,331 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:29,331 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787709150_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:29,331 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787709150_0001_00_000001 given task: attempt_1452787709150_0001_1_00_000000_0
2016-01-14 16:08:29,331 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787709150_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787709150_0001_1_00_000000_0
2016-01-14 16:08:29 Starting to run new task attempt: attempt_1452787709150_0001_1_00_000000_0
2016-01-14 16:08:29,332 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787709150_0001_1_00_000000_0
2016-01-14 16:08:29,332 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:29,332 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:29,332 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:29,332 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:29,332 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:29,333 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:29,333 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [D8DAEB1D865941E997CEB2286D043434/C38326128DFC4BA4BCDACFDF8DA882AC] every.every/(1/1) ...ield'_RESULTS.0_VALUES_-1, VertexName: FBBD186666A9470183D6A9207A2FCB88, VertexParallelism: 1, TaskAttemptID:attempt_1452787709150_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=A3C243EF2DFE40178ACBBEF4D395B7D9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D0CC41B975E144399608057E5E13706F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:29,333 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:29,334 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787709150_0001_1_00_000000_0
2016-01-14 16:08:29,334 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:29,334 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:29,335 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=A3C243EF2DFE40178ACBBEF4D395B7D9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:29,336 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787709150_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:29,336 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:29,336 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: A3C243EF2DFE40178ACBBEF4D395B7D9
2016-01-14 16:08:29,336 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: A3C243EF2DFE40178ACBBEF4D395B7D9
2016-01-14 16:08:29,335 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:29,336 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=D0CC41B975E144399608057E5E13706F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:29,337 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:29,337 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: D0CC41B975E144399608057E5E13706F
2016-01-14 16:08:29,337 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:29,337 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: D0CC41B975E144399608057E5E13706F
2016-01-14 16:08:29,340 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:29,341 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:29,342 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: A3C243EF2DFE40178ACBBEF4D395B7D9
2016-01-14 16:08:29,342 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: A3C243EF2DFE40178ACBBEF4D395B7D9
2016-01-14 16:08:29,348 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: FBBD186666A9470183D6A9207A2FCB88, ordinal: 0
2016-01-14 16:08:29,348 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FBBD186666A9470183D6A9207A2FCB88, mem on start (mb), free: 188, total: 384, max: 672
2016-01-14 16:08:29,348 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:29,348 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:29,349 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:29,349 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: D0CC41B975E144399608057E5E13706F
2016-01-14 16:08:29,349 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:29,349 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:29,349 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:29,350 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:29,350 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:29,350 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:29,350 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:29,352 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:29,352 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:29,352 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, A3C243EF2DFE40178ACBBEF4D395B7D9, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:29,352 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, D0CC41B975E144399608057E5E13706F, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:29,352 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:29,352 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: A3C243EF2DFE40178ACBBEF4D395B7D9
2016-01-14 16:08:29,352 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:29,352 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: A3C243EF2DFE40178ACBBEF4D395B7D9
2016-01-14 16:08:29,352 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: A3C243EF2DFE40178ACBBEF4D395B7D9 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:29,353 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:29,353 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:29,354 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:29,355 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787709150_0001_1_00_000000_0
2016-01-14 16:08:29,357 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:29,357 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:29,357 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@59890985
2016-01-14 16:08:29,358 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: A3C243EF2DFE40178ACBBEF4D395B7D9
2016-01-14 16:08:29,358 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@59890985
2016-01-14 16:08:29,358 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:29,359 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:29,358 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_-1"], id: D0CC41B975E144399608057E5E13706F
2016-01-14 16:08:29,359 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_-1"]
2016-01-14 16:08:29,359 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:29,359 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:29,360 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: FBBD186666A9470183D6A9207A2FCB88, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:29,361 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:29,363 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:29,364 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:29,366 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:29,367 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:29,367 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787709150_0001_1_00_000000_0
2016-01-14 16:08:29,367 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787709150_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:29,368 INFO  task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452787709150_0001_1_00_000000_0
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:29,372 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 18 [[File System Counters FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452787709360, Process_Duration=8, Process_End_Time=1452787709368, Read_Duration=1, Tuples_Read=1][cascading.flow.StepCounters Tuples_Read=1]]
2016-01-14 16:08:29,373 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FBBD186666A9470183D6A9207A2FCB88, mem on close (mb), free: 186, total: 384, max: 672
2016-01-14 16:08:29,373 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=FBBD186666A9470183D6A9207A2FCB88, index=0
2016-01-14 16:08:29,373 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709150_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=FBBD186666A9470183D6A9207A2FCB88, taskAttemptId=attempt_1452787709150_0001_1_00_000000_0, startTime=1452787709330, finishTime=1452787709373, timeTaken=43, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452787709360, Process_Duration=8, Process_End_Time=1452787709368, Read_Duration=1, Tuples_Read=1, cascading.flow.StepCounters, Tuples_Read=1
2016-01-14 16:08:29,373 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:29,373 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=FBBD186666A9470183D6A9207A2FCB88, sourceVertex=A3C243EF2DFE40178ACBBEF4D395B7D9
2016-01-14 16:08:29,373 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787709150_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 16:08:29,375 INFO  impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452787709150_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 16:08:29,376 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:29,376 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=FBBD186666A9470183D6A9207A2FCB88, sourceVertex=D0CC41B975E144399608057E5E13706F
2016-01-14 16:08:29,376 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709150_0001_1][Event:TASK_FINISHED]: vertexName=FBBD186666A9470183D6A9207A2FCB88, taskId=task_1452787709150_0001_1_00_000000, startTime=1452787709330, finishTime=1452787709376, timeTaken=46, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-01-14 16:08:29,376 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787709150_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 16:08:29,376 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:29,376 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88] : 1
2016-01-14 16:08:29,376 INFO  impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88] because task failed: task_1452787709150_0001_1_00_000000
2016-01-14 16:08:29,378 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88] due to trigger: OWN_TASK_FAILURE
2016-01-14 16:08:29,378 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 16:08:29,379 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88]
2016-01-14 16:08:29,379 INFO  impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=D0CC41B975E144399608057E5E13706F, vertexId=vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88]
2016-01-14 16:08:29,380 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:29,380 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709150_0001_1][Event:VERTEX_FINISHED]: vertexName=FBBD186666A9470183D6A9207A2FCB88, vertexId=vertex_1452787709150_0001_1_00, initRequestedTime=1452787709310, initedTime=1452787709319, startRequestedTime=1452787709320, startedTime=1452787709320, finishTime=1452787709380, timeTaken=60, status=FAILED, diagnostics=Task failed, taskId=task_1452787709150_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452787709330, firstTasksToStart=[ task_1452787709150_0001_1_00_000000 ], lastTaskFinishTime=1452787709373, lastTasksToFinish=[ task_1452787709150_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 16:08:29,380 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 16:08:29,381 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709150_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787709150_0001_00_000001, stoppedTime=1452787709381, exitStatus=0
2016-01-14 16:08:29,381 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:29,381 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787709150_0001_00_000001
2016-01-14 16:08:29,381 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787709150_0001_00_000001 transitioned from RUNNING to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:29,381 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787709150_0001_00_000001
2016-01-14 16:08:29,382 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787709150_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 16:08:29,382 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452787709150_0001_00_000001 completed but with errors
2016-01-14 16:08:29,382 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452787709150_0001_1_00_000000_0 failed: true container: container_1452787709150_0001_00_000001 numFailedTAs: 0
2016-01-14 16:08:29,383 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 16:08:29,383 INFO  impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 16:08:29,383 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787709150_0001_1
2016-01-14 16:08:29,383 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: D0CC41B975E144399608057E5E13706F for vertex: vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88]
2016-01-14 16:08:29,385 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787709150_0001_1, queueSize=0
2016-01-14 16:08:29,386 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:29,386 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709150_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787709150_0001_1, startTime=1452787709308, finishTime=1452787709384, timeTaken=76, status=FAILED, diagnostics=Vertex failed, vertexName=FBBD186666A9470183D6A9207A2FCB88, vertexId=vertex_1452787709150_0001_1_00, diagnostics=[Task failed, taskId=task_1452787709150_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452787709150_0001_1_00 [FBBD186666A9470183D6A9207A2FCB88] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 16:08:29,386 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787709150_0001_1 finished with state: FAILED
2016-01-14 16:08:29,386 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787709150_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:29,387 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787709150_0001_00_000001
2016-01-14 16:08:29,387 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(1033)) - Container container_1452787709150_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 16:08:29,391 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787709150_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:29 Completed Dag: dag_1452787709150_0001_1
2016-01-14 16:08:29,392 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787709150_0001_1, dagState=FAILED
2016-01-14 16:08:29,392 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787709150_0001_1_post
2016-01-14 16:08:29,392 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:29,392 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:29,392 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787709150_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 16:08:29,394 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ield'_RESULTS.0_VALUES_-1, applicationId=application_1452787709150_0001
2016-01-14 16:08:29,397 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:29,397 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:29,397 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:29,397 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:29,397 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:29,398 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:29,399 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:29,399 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:29,399 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:29,399 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:29,399 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:29,399 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:29,400 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:29,407 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D8DAEB1D865941E997CEB2286D043434/C38326128DFC4BA4BCDACFDF8DA882AC/.tez/application_1452787709150_0001
2016-01-14 16:08:29,407 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping all jobs
2016-01-14 16:08:29,407 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping: (1/1) ...ield'_RESULTS.0_VALUES_-1
2016-01-14 16:08:29,408 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopped all jobs
2016-01-14 16:08:29,409 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.275
2016-01-14 16:08:29,409 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_VALUES_-1
2016-01-14 16:08:29,440 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:29,441 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:29,479 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.004
2016-01-14 16:08:29,481 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.006
2016-01-14 16:08:29,482 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:29,482 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:29,482 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_VALUES_'field2'
2016-01-14 16:08:29,504 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:29,504 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:29,539 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.009
2016-01-14 16:08:29,547 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 16:08:29,547 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:29,548 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:29,548 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:29,562 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:29,563 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_RESULTS
2016-01-14 16:08:29,571 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:29,572 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:29,572 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_RESULTS"]
2016-01-14 16:08:29,573 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:29,574 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:29,574 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:29,575 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ..._RESULTS.0_VALUES_RESULTS
2016-01-14 16:08:29,575 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:29,588 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:29,593 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:29,593 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:29,594 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:29,604 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/28F1CB0BDFA4454AB127BA3418B7E5DF/DAA353DCBA744905B4DC109715B6460F/.tez/application_1452787709593_0001 doesn't exist and is created
2016-01-14 16:08:29,619 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:29,620 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:29,620 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/28F1CB0BDFA4454AB127BA3418B7E5DF/DAA353DCBA744905B4DC109715B6460F/.tez/application_1452787709593_0001
2016-01-14 16:08:29,623 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787709593_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:29,634 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:29,635 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:29,637 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:29,637 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:29,637 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/28F1CB0BDFA4454AB127BA3418B7E5DF/DAA353DCBA744905B4DC109715B6460F/.tez/application_1452787709593_0001/localmode-log-dir
2016-01-14 16:08:29,637 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/28F1CB0BDFA4454AB127BA3418B7E5DF/DAA353DCBA744905B4DC109715B6460F/.tez/application_1452787709593_0001/localmode-log-dir/history.txt.appattempt_1452787709593_0001_000000, maxErrors=10
2016-01-14 16:08:29,637 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:29,638 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787709593_0001_000000, appSubmitTime=1452787709623, launchTime=1452787709623
2016-01-14 16:08:29,642 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:29,644 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:29,645 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:29,645 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:29,651 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:47264
2016-01-14 16:08:29,652 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:29,654 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787709593_0001_000000, startTime=1452787709654
2016-01-14 16:08:29,654 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:29,654 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:29,720 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:29,720 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:29,720 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ..._RESULTS.0_VALUES_RESULTS, applicationId=application_1452787709593_0001, dagName=[28F1CB0BDFA4454AB127BA3418B7E5DF/DAA353DCBA744905B4DC109715B6460F] every.every/(1/1) ..._RESULTS.0_VALUES_RESULTS
2016-01-14 16:08:29,757 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [28F1CB0BDFA4454AB127BA3418B7E5DF/DAA353DCBA744905B4DC109715B6460F] every.every/(1/1) ..._RESULTS.0_VALUES_RESULTS
2016-01-14 16:08:29,759 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787709593_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/28F1CB0BDFA4454AB127BA3418B7E5DF/DAA353DCBA744905B4DC109715B6460F/.tez/application_1452787709593_0001/localmode-log-dir/dag_1452787709593_0001_1.dot
2016-01-14 16:08:29,760 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/28F1CB0BDFA4454AB127BA3418B7E5DF/DAA353DCBA744905B4DC109715B6460F/.tez/application_1452787709593_0001/localmode-log-dir/dag_1452787709593_0001_1-tez-dag.pb.txt
2016-01-14 16:08:29,765 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787709593_0001_1
2016-01-14 16:08:29,765 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:29,765 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [28F1CB0BDFA4454AB127BA3418B7E5DF/DAA353DCBA744905B4DC109715B6460F] every.every/(1/1) ..._RESULTS.0_VALUES_RESULTS
2016-01-14 16:08:29 Running Dag: dag_1452787709593_0001_1
2016-01-14 16:08:29,774 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:29,774 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:29,779 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709593_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787709593_0001_1, submitTime=1452787709758
2016-01-14 16:08:29,779 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:29,779 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex C269897E046542C5ACDC08175C91C156
2016-01-14 16:08:29,779 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:29,779 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709593_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787709593_0001_1, initTime=1452787709779
2016-01-14 16:08:29,780 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787709593_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:29,780 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709593_0001_1][Event:DAG_STARTED]: dagID=dag_1452787709593_0001_1, startTime=1452787709780
2016-01-14 16:08:29,780 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:29,780 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787709593_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:29,780 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: C269897E046542C5ACDC08175C91C156 : {1FC9BDEDBA354D138F6F04285B424AB4={InputName=1FC9BDEDBA354D138F6F04285B424AB4}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:29,780 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 1FC9BDEDBA354D138F6F04285B424AB4, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:29,780 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156]
2016-01-14 16:08:29,781 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156]
2016-01-14 16:08:29,781 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156]
2016-01-14 16:08:29,781 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156]. Starting root input initializers: 1
2016-01-14 16:08:29,781 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ..._RESULTS.0_VALUES_RESULTS, applicationId=application_1452787709593_0001, dagName=[28F1CB0BDFA4454AB127BA3418B7E5DF/DAA353DCBA744905B4DC109715B6460F] every.every/(1/1) ..._RESULTS.0_VALUES_RESULTS
2016-01-14 16:08:29,782 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:29,782 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:29,789 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:29,789 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 1FC9BDEDBA354D138F6F04285B424AB4 on vertex vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156]
2016-01-14 16:08:29,791 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:29,791 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 1FC9BDEDBA354D138F6F04285B424AB4 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:29,792 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:29,792 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:29,794 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:29,794 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 1FC9BDEDBA354D138F6F04285B424AB4 on vertex vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156]
2016-01-14 16:08:29,794 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:29,794 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {1FC9BDEDBA354D138F6F04285B424AB4=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:29,795 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156] parallelism set to 1
2016-01-14 16:08:29,795 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:29,795 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709593_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787709593_0001_1_00, eventCount=1
2016-01-14 16:08:29,795 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156]
2016-01-14 16:08:29,795 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=DC4DCD1AF31C45DAB13BC5C6D066406B, vertexId=vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:29,796 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=DC4DCD1AF31C45DAB13BC5C6D066406B, vertexId=vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156]
2016-01-14 16:08:29,797 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=DC4DCD1AF31C45DAB13BC5C6D066406B, vertexName=C269897E046542C5ACDC08175C91C156, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:29,798 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=DC4DCD1AF31C45DAB13BC5C6D066406B, vertexId=vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156]
2016-01-14 16:08:29,799 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:29,800 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709593_0001_1][Event:VERTEX_INITIALIZED]: vertexName=C269897E046542C5ACDC08175C91C156, vertexId=vertex_1452787709593_0001_1_00, initRequestedTime=1452787709780, initedTime=1452787709799, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:29,800 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156] with distanceFromRoot: 0
2016-01-14 16:08:29,800 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:29,800 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787709593_0001, with dag id: dag_1452787709593_0001_1
2016-01-14 16:08:29,801 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in C269897E046542C5ACDC08175C91C156
2016-01-14 16:08:29,802 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156]
2016-01-14 16:08:29,802 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:29,802 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709593_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787709593_0001_1_00, startRequestedTime=1452787709801, startedTime=1452787709801
2016-01-14 16:08:29,803 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:29,803 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:29,803 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709593_0001_1][Event:TASK_STARTED]: vertexName=C269897E046542C5ACDC08175C91C156, taskId=task_1452787709593_0001_1_00_000000, scheduledTime=1452787709803, launchTime=1452787709803
2016-01-14 16:08:29,804 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787709593_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:29,805 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156]
2016-01-14 16:08:29,806 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [28F1CB0BDFA4454AB127BA3418B7E5DF/DAA353DCBA744905B4DC109715B6460F] every.every/(1/1) ..._RESULTS.0_VALUES_RESULTS, VertexName: C269897E046542C5ACDC08175C91C156, VertexParallelism: 1, TaskAttemptID:attempt_1452787709593_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=1FC9BDEDBA354D138F6F04285B424AB4, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=DC4DCD1AF31C45DAB13BC5C6D066406B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:29,806 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787709593_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:29,806 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:29,807 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:29,808 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:29,809 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:29,809 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787709593_0001_00_000001
2016-01-14 16:08:29,810 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787709593_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:29,812 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787709593_0001_00_000001
2016-01-14 16:08:29,812 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:29,813 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:29,813 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709593_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787709593_0001_00_000001, launchTime=1452787709813
2016-01-14 16:08:29,813 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787709593_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:29,813 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787709593_0001_00_000001
2016-01-14 16:08:29,814 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787709593_0001_1_00_000000_0] to container: [container_1452787709593_0001_00_000001]
2016-01-14 16:08:29,814 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787709593_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:29,815 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787709593_0001_00_000001 given task: attempt_1452787709593_0001_1_00_000000_0
2016-01-14 16:08:29,815 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787709593_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787709593_0001_1_00_000000_0
2016-01-14 16:08:29,815 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787709593_0001_1_00_000000_0] started. Is using containerId: [container_1452787709593_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:29,816 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:29,816 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709593_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=C269897E046542C5ACDC08175C91C156, taskAttemptId=attempt_1452787709593_0001_1_00_000000_0, startTime=1452787709815, containerId=container_1452787709593_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787709593_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:29 Starting to run new task attempt: attempt_1452787709593_0001_1_00_000000_0
2016-01-14 16:08:29,816 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787709593_0001_1_00_000000_0
2016-01-14 16:08:29,817 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:29,817 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:29,817 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:29,817 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:29,817 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:29,817 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:29,818 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [28F1CB0BDFA4454AB127BA3418B7E5DF/DAA353DCBA744905B4DC109715B6460F] every.every/(1/1) ..._RESULTS.0_VALUES_RESULTS, VertexName: C269897E046542C5ACDC08175C91C156, VertexParallelism: 1, TaskAttemptID:attempt_1452787709593_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=1FC9BDEDBA354D138F6F04285B424AB4, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=DC4DCD1AF31C45DAB13BC5C6D066406B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:29,818 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:29,818 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787709593_0001_1_00_000000_0
2016-01-14 16:08:29,819 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:29,819 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:29,818 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787709593_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:29,820 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787709593_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:29,820 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:29,822 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=DC4DCD1AF31C45DAB13BC5C6D066406B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:29,824 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:29,824 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: DC4DCD1AF31C45DAB13BC5C6D066406B
2016-01-14 16:08:29,824 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:29,824 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: DC4DCD1AF31C45DAB13BC5C6D066406B
2016-01-14 16:08:29,822 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787709593_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:29,826 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:29,828 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=1FC9BDEDBA354D138F6F04285B424AB4, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:29,828 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:29,829 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 1FC9BDEDBA354D138F6F04285B424AB4
2016-01-14 16:08:29,829 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 1FC9BDEDBA354D138F6F04285B424AB4
2016-01-14 16:08:29,834 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:29,834 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 1FC9BDEDBA354D138F6F04285B424AB4
2016-01-14 16:08:29,835 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 1FC9BDEDBA354D138F6F04285B424AB4
2016-01-14 16:08:29,835 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: C269897E046542C5ACDC08175C91C156, ordinal: 0
2016-01-14 16:08:29,835 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C269897E046542C5ACDC08175C91C156, mem on start (mb), free: 319, total: 385, max: 672
2016-01-14 16:08:29,835 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:29,835 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:29,835 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:29,842 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:29,842 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: DC4DCD1AF31C45DAB13BC5C6D066406B
2016-01-14 16:08:29,842 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:29,842 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:29,842 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:29,842 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:29,842 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:29,843 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:29,843 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:29,843 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:29,843 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, DC4DCD1AF31C45DAB13BC5C6D066406B, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:29,843 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 1FC9BDEDBA354D138F6F04285B424AB4, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:29,843 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:29,843 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 1FC9BDEDBA354D138F6F04285B424AB4 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:29,844 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:29,844 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:29,843 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 1FC9BDEDBA354D138F6F04285B424AB4
2016-01-14 16:08:29,844 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:29,844 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 1FC9BDEDBA354D138F6F04285B424AB4
2016-01-14 16:08:29,845 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:29,845 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787709593_0001_1_00_000000_0
2016-01-14 16:08:29,845 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:29,845 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@27027e30
2016-01-14 16:08:29,847 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@27027e30
2016-01-14 16:08:29,847 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:29,847 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:29,849 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:29,850 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 1FC9BDEDBA354D138F6F04285B424AB4
2016-01-14 16:08:29,850 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_RESULTS"], id: DC4DCD1AF31C45DAB13BC5C6D066406B
2016-01-14 16:08:29,850 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_RESULTS"]
2016-01-14 16:08:29,850 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:29,851 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:29,851 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: C269897E046542C5ACDC08175C91C156, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:29,852 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:29,855 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:29,859 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:29,862 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:29,863 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:29,863 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787709593_0001_1_00_000000_0
2016-01-14 16:08:29,864 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787709593_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:29,864 INFO  task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452787709593_0001_1_00_000000_0
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:29,869 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 18 [[File System Counters FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452787709851, Process_Duration=13, Process_End_Time=1452787709864, Read_Duration=1, Tuples_Read=1][cascading.flow.StepCounters Tuples_Read=1]]
2016-01-14 16:08:29,869 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709593_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=C269897E046542C5ACDC08175C91C156, taskAttemptId=attempt_1452787709593_0001_1_00_000000_0, startTime=1452787709815, finishTime=1452787709869, timeTaken=54, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452787709851, Process_Duration=13, Process_End_Time=1452787709864, Read_Duration=1, Tuples_Read=1, cascading.flow.StepCounters, Tuples_Read=1
2016-01-14 16:08:29,870 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787709593_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 16:08:29,870 INFO  impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452787709593_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 16:08:29,870 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709593_0001_1][Event:TASK_FINISHED]: vertexName=C269897E046542C5ACDC08175C91C156, taskId=task_1452787709593_0001_1_00_000000, startTime=1452787709815, finishTime=1452787709870, timeTaken=55, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-01-14 16:08:29,870 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787709593_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 16:08:29,870 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156] : 1
2016-01-14 16:08:29,870 INFO  impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156] because task failed: task_1452787709593_0001_1_00_000000
2016-01-14 16:08:29,870 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156] due to trigger: OWN_TASK_FAILURE
2016-01-14 16:08:29,870 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 16:08:29,871 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156]
2016-01-14 16:08:29,871 INFO  impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=DC4DCD1AF31C45DAB13BC5C6D066406B, vertexId=vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156]
2016-01-14 16:08:29,872 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709593_0001_1][Event:VERTEX_FINISHED]: vertexName=C269897E046542C5ACDC08175C91C156, vertexId=vertex_1452787709593_0001_1_00, initRequestedTime=1452787709780, initedTime=1452787709799, startRequestedTime=1452787709801, startedTime=1452787709801, finishTime=1452787709871, timeTaken=70, status=FAILED, diagnostics=Task failed, taskId=task_1452787709593_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452787709815, firstTasksToStart=[ task_1452787709593_0001_1_00_000000 ], lastTaskFinishTime=1452787709869, lastTasksToFinish=[ task_1452787709593_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 16:08:29,872 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:29,870 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:29,872 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 16:08:29,872 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C269897E046542C5ACDC08175C91C156, mem on close (mb), free: 317, total: 385, max: 672
2016-01-14 16:08:29,875 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 16:08:29,875 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:29,877 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=C269897E046542C5ACDC08175C91C156, index=0
2016-01-14 16:08:29,877 INFO  impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 16:08:29,878 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:29,878 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=C269897E046542C5ACDC08175C91C156, sourceVertex=1FC9BDEDBA354D138F6F04285B424AB4
2016-01-14 16:08:29,878 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787709593_0001_1
2016-01-14 16:08:29,878 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: DC4DCD1AF31C45DAB13BC5C6D066406B for vertex: vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156]
2016-01-14 16:08:29,879 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787709593_0001_1, queueSize=0
2016-01-14 16:08:29,879 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:29,879 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709593_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787709593_0001_1, startTime=1452787709780, finishTime=1452787709878, timeTaken=98, status=FAILED, diagnostics=Vertex failed, vertexName=C269897E046542C5ACDC08175C91C156, vertexId=vertex_1452787709593_0001_1_00, diagnostics=[Task failed, taskId=task_1452787709593_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452787709593_0001_1_00 [C269897E046542C5ACDC08175C91C156] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 16:08:29,879 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=C269897E046542C5ACDC08175C91C156, sourceVertex=DC4DCD1AF31C45DAB13BC5C6D066406B
2016-01-14 16:08:29,879 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787709593_0001_1 finished with state: FAILED
2016-01-14 16:08:29,879 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787709593_0001_00_000001
2016-01-14 16:08:29,880 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787709593_0001_00_000001
2016-01-14 16:08:29,879 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787709593_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:29,880 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787709593_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787709593_0001_00_000001, stoppedTime=1452787709880, exitStatus=0
2016-01-14 16:08:29,880 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:29,880 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787709593_0001_00_000001 transitioned from RUNNING to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:29,880 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452787709593_0001_1_00_000000_0 failed: true container: container_1452787709593_0001_00_000001 numFailedTAs: 0
2016-01-14 16:08:29 Completed Dag: dag_1452787709593_0001_1
2016-01-14 16:08:29,881 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787709593_0001_1, dagState=FAILED
2016-01-14 16:08:29,881 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787709593_0001_1_post
2016-01-14 16:08:29,881 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:29,881 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:29,881 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1452787709593_0001_00_000001. Relying on regular task shutdown for it to end
2016-01-14 16:08:29,882 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787709593_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 16:08:29,882 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787709593_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 16:08:29,882 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452787709593_0001_00_000001 completed but with errors
2016-01-14 16:08:29,882 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(1033)) - Container container_1452787709593_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 16:08:29,883 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787709593_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 16:08:29,883 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787709593_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 16:08:29,885 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ..._RESULTS.0_VALUES_RESULTS, applicationId=application_1452787709593_0001
2016-01-14 16:08:29,888 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:29,888 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:29,888 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:29,888 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:29,888 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:29,889 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:29,889 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:29,889 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:29,889 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:29,890 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:29,890 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:29,890 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:29,890 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:29,895 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/28F1CB0BDFA4454AB127BA3418B7E5DF/DAA353DCBA744905B4DC109715B6460F/.tez/application_1452787709593_0001
2016-01-14 16:08:29,895 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping all jobs
2016-01-14 16:08:29,896 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping: (1/1) ..._RESULTS.0_VALUES_RESULTS
2016-01-14 16:08:29,896 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopped all jobs
2016-01-14 16:08:29,896 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.325
2016-01-14 16:08:29,896 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_VALUES_RESULTS
2016-01-14 16:08:29,923 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:29,923 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:29,955 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.010
2016-01-14 16:08:29,959 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 16:08:29,959 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:29,959 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:29,960 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:29,972 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:29,972 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_ALL
2016-01-14 16:08:29,981 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:29,981 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:29,981 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_ALL"]
2016-01-14 16:08:29,981 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:29,981 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:29,982 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:29,982 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...eld'_RESULTS.0_VALUES_ALL
2016-01-14 16:08:29,984 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:29,995 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:30,000 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:30,000 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:30,000 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:30,010 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/F83AE21D3CFA401681309FB13B0298DF/E00C8223DF2E4D9FB286D31E2636B07D/.tez/application_1452787710000_0001 doesn't exist and is created
2016-01-14 16:08:30,025 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:30,026 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:30,027 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/F83AE21D3CFA401681309FB13B0298DF/E00C8223DF2E4D9FB286D31E2636B07D/.tez/application_1452787710000_0001
2016-01-14 16:08:30,031 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787710000_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:30,042 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:30,043 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:30,044 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:30,044 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:30,044 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/F83AE21D3CFA401681309FB13B0298DF/E00C8223DF2E4D9FB286D31E2636B07D/.tez/application_1452787710000_0001/localmode-log-dir
2016-01-14 16:08:30,044 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/F83AE21D3CFA401681309FB13B0298DF/E00C8223DF2E4D9FB286D31E2636B07D/.tez/application_1452787710000_0001/localmode-log-dir/history.txt.appattempt_1452787710000_0001_000000, maxErrors=10
2016-01-14 16:08:30,045 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:30,045 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787710000_0001_000000, appSubmitTime=1452787710030, launchTime=1452787710030
2016-01-14 16:08:30,047 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:30,048 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:30,049 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:30,049 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:30,052 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:33583
2016-01-14 16:08:30,054 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:30,055 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787710000_0001_000000, startTime=1452787710055
2016-01-14 16:08:30,055 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:30,055 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:30,126 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:30,126 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:30,126 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...eld'_RESULTS.0_VALUES_ALL, applicationId=application_1452787710000_0001, dagName=[F83AE21D3CFA401681309FB13B0298DF/E00C8223DF2E4D9FB286D31E2636B07D] every.every/(1/1) ...eld'_RESULTS.0_VALUES_ALL
2016-01-14 16:08:30,140 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [F83AE21D3CFA401681309FB13B0298DF/E00C8223DF2E4D9FB286D31E2636B07D] every.every/(1/1) ...eld'_RESULTS.0_VALUES_ALL
2016-01-14 16:08:30,142 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787710000_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/F83AE21D3CFA401681309FB13B0298DF/E00C8223DF2E4D9FB286D31E2636B07D/.tez/application_1452787710000_0001/localmode-log-dir/dag_1452787710000_0001_1.dot
2016-01-14 16:08:30,142 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/F83AE21D3CFA401681309FB13B0298DF/E00C8223DF2E4D9FB286D31E2636B07D/.tez/application_1452787710000_0001/localmode-log-dir/dag_1452787710000_0001_1-tez-dag.pb.txt
2016-01-14 16:08:30,146 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787710000_0001_1
2016-01-14 16:08:30,146 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:30,147 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [F83AE21D3CFA401681309FB13B0298DF/E00C8223DF2E4D9FB286D31E2636B07D] every.every/(1/1) ...eld'_RESULTS.0_VALUES_ALL
2016-01-14 16:08:30 Running Dag: dag_1452787710000_0001_1
2016-01-14 16:08:30,158 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710000_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787710000_0001_1, submitTime=1452787710141
2016-01-14 16:08:30,158 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:30,159 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex C02BFEB83B1A41C79D7E54DD2DFA0365
2016-01-14 16:08:30,159 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:30,159 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710000_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787710000_0001_1, initTime=1452787710158
2016-01-14 16:08:30,159 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:30,160 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787710000_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:30,160 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710000_0001_1][Event:DAG_STARTED]: dagID=dag_1452787710000_0001_1, startTime=1452787710160
2016-01-14 16:08:30,160 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:30,160 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:30,161 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787710000_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:30,161 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...eld'_RESULTS.0_VALUES_ALL, applicationId=application_1452787710000_0001, dagName=[F83AE21D3CFA401681309FB13B0298DF/E00C8223DF2E4D9FB286D31E2636B07D] every.every/(1/1) ...eld'_RESULTS.0_VALUES_ALL
2016-01-14 16:08:30,161 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: C02BFEB83B1A41C79D7E54DD2DFA0365 : {78AAFFC377A741C2AEDA10EF0FC0D5B9={InputName=78AAFFC377A741C2AEDA10EF0FC0D5B9}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:30,161 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 78AAFFC377A741C2AEDA10EF0FC0D5B9, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:30,161 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365]
2016-01-14 16:08:30,162 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365]
2016-01-14 16:08:30,162 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365]
2016-01-14 16:08:30,162 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365]. Starting root input initializers: 1
2016-01-14 16:08:30,163 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:30,163 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 78AAFFC377A741C2AEDA10EF0FC0D5B9 on vertex vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365]
2016-01-14 16:08:30,165 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:30,166 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 78AAFFC377A741C2AEDA10EF0FC0D5B9 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:30,166 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:30,166 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:30,168 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:30,168 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 78AAFFC377A741C2AEDA10EF0FC0D5B9 on vertex vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365]
2016-01-14 16:08:30,168 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:30,169 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {78AAFFC377A741C2AEDA10EF0FC0D5B9=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:30,169 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365] parallelism set to 1
2016-01-14 16:08:30,169 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:30,169 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710000_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787710000_0001_1_00, eventCount=1
2016-01-14 16:08:30,169 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365]
2016-01-14 16:08:30,170 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=4A85F41B91A94BE58D3F57D7E035F552, vertexId=vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:30,170 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=4A85F41B91A94BE58D3F57D7E035F552, vertexId=vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365]
2016-01-14 16:08:30,172 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=4A85F41B91A94BE58D3F57D7E035F552, vertexName=C02BFEB83B1A41C79D7E54DD2DFA0365, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:30,172 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=4A85F41B91A94BE58D3F57D7E035F552, vertexId=vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365]
2016-01-14 16:08:30,173 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:30,173 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710000_0001_1][Event:VERTEX_INITIALIZED]: vertexName=C02BFEB83B1A41C79D7E54DD2DFA0365, vertexId=vertex_1452787710000_0001_1_00, initRequestedTime=1452787710161, initedTime=1452787710173, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:30,173 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365] with distanceFromRoot: 0
2016-01-14 16:08:30,173 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:30,174 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in C02BFEB83B1A41C79D7E54DD2DFA0365
2016-01-14 16:08:30,174 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365]
2016-01-14 16:08:30,174 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:30,174 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710000_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787710000_0001_1_00, startRequestedTime=1452787710173, startedTime=1452787710173
2016-01-14 16:08:30,174 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:30,175 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:30,175 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710000_0001_1][Event:TASK_STARTED]: vertexName=C02BFEB83B1A41C79D7E54DD2DFA0365, taskId=task_1452787710000_0001_1_00_000000, scheduledTime=1452787710175, launchTime=1452787710175
2016-01-14 16:08:30,175 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787710000_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:30,175 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365]
2016-01-14 16:08:30,176 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [F83AE21D3CFA401681309FB13B0298DF/E00C8223DF2E4D9FB286D31E2636B07D] every.every/(1/1) ...eld'_RESULTS.0_VALUES_ALL, VertexName: C02BFEB83B1A41C79D7E54DD2DFA0365, VertexParallelism: 1, TaskAttemptID:attempt_1452787710000_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=78AAFFC377A741C2AEDA10EF0FC0D5B9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=4A85F41B91A94BE58D3F57D7E035F552, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:30,176 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787710000_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:30,176 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:30,177 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:30,177 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:30,177 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:30,178 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787710000_0001_00_000001
2016-01-14 16:08:30,178 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787710000_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:30,179 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787710000_0001_00_000001
2016-01-14 16:08:30,180 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:30,180 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787710000_0001, with dag id: dag_1452787710000_0001_1
2016-01-14 16:08:30,181 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787710000_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:30,183 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710000_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787710000_0001_00_000001, launchTime=1452787710181
2016-01-14 16:08:30,184 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:30,184 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787710000_0001_00_000001
2016-01-14 16:08:30,185 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787710000_0001_1_00_000000_0] to container: [container_1452787710000_0001_00_000001]
2016-01-14 16:08:30,186 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787710000_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:30,187 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787710000_0001_00_000001 given task: attempt_1452787710000_0001_1_00_000000_0
2016-01-14 16:08:30,187 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787710000_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787710000_0001_1_00_000000_0
2016-01-14 16:08:30,187 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787710000_0001_1_00_000000_0] started. Is using containerId: [container_1452787710000_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:30,187 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710000_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=C02BFEB83B1A41C79D7E54DD2DFA0365, taskAttemptId=attempt_1452787710000_0001_1_00_000000_0, startTime=1452787710187, containerId=container_1452787710000_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787710000_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:30,187 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787710000_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:30 Starting to run new task attempt: attempt_1452787710000_0001_1_00_000000_0
2016-01-14 16:08:30,187 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787710000_0001_1_00_000000_0
2016-01-14 16:08:30,187 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787710000_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:30,187 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:30,189 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:30,189 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:30,189 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:30,189 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:30,189 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:30,189 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:30,190 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [F83AE21D3CFA401681309FB13B0298DF/E00C8223DF2E4D9FB286D31E2636B07D] every.every/(1/1) ...eld'_RESULTS.0_VALUES_ALL, VertexName: C02BFEB83B1A41C79D7E54DD2DFA0365, VertexParallelism: 1, TaskAttemptID:attempt_1452787710000_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=78AAFFC377A741C2AEDA10EF0FC0D5B9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=4A85F41B91A94BE58D3F57D7E035F552, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:30,190 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:30,191 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787710000_0001_1_00_000000_0
2016-01-14 16:08:30,192 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787710000_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:30,192 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:30,193 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:30,193 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=78AAFFC377A741C2AEDA10EF0FC0D5B9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:30,194 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:30,194 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 78AAFFC377A741C2AEDA10EF0FC0D5B9
2016-01-14 16:08:30,194 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 78AAFFC377A741C2AEDA10EF0FC0D5B9
2016-01-14 16:08:30,194 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=4A85F41B91A94BE58D3F57D7E035F552, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:30,193 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:30,196 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:30,197 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 78AAFFC377A741C2AEDA10EF0FC0D5B9
2016-01-14 16:08:30,197 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 78AAFFC377A741C2AEDA10EF0FC0D5B9
2016-01-14 16:08:30,198 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:30,199 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:30,199 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 4A85F41B91A94BE58D3F57D7E035F552
2016-01-14 16:08:30,199 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:30,200 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 4A85F41B91A94BE58D3F57D7E035F552
2016-01-14 16:08:30,208 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: C02BFEB83B1A41C79D7E54DD2DFA0365, ordinal: 0
2016-01-14 16:08:30,208 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C02BFEB83B1A41C79D7E54DD2DFA0365, mem on start (mb), free: 259, total: 385, max: 672
2016-01-14 16:08:30,209 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:30,209 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:30,209 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:30,211 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:30,211 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 4A85F41B91A94BE58D3F57D7E035F552
2016-01-14 16:08:30,211 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:30,211 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:30,212 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:30,212 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:30,212 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:30,212 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:30,212 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:30,213 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:30,213 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 78AAFFC377A741C2AEDA10EF0FC0D5B9, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:30,213 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 4A85F41B91A94BE58D3F57D7E035F552, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:30,213 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:30,214 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 78AAFFC377A741C2AEDA10EF0FC0D5B9
2016-01-14 16:08:30,214 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:30,214 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 78AAFFC377A741C2AEDA10EF0FC0D5B9
2016-01-14 16:08:30,214 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 78AAFFC377A741C2AEDA10EF0FC0D5B9 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:30,214 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:30,215 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:30,215 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:30,215 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787710000_0001_1_00_000000_0
2016-01-14 16:08:30,216 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:30,217 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@3561add9
2016-01-14 16:08:30,218 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@3561add9
2016-01-14 16:08:30,219 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:30,219 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:30,219 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:30,219 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:30,218 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:30,220 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 78AAFFC377A741C2AEDA10EF0FC0D5B9
2016-01-14 16:08:30,220 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_ALL"], id: 4A85F41B91A94BE58D3F57D7E035F552
2016-01-14 16:08:30,221 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_ALL"]
2016-01-14 16:08:30,221 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:30,221 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:30,222 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: C02BFEB83B1A41C79D7E54DD2DFA0365, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:30,222 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:30,225 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:30,228 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:30,231 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:30,231 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:30,231 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787710000_0001_1_00_000000_0
2016-01-14 16:08:30,231 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787710000_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:30,232 INFO  task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452787710000_0001_1_00_000000_0
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:30,236 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 18 [[File System Counters FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452787710222, Process_Duration=10, Process_End_Time=1452787710232, Read_Duration=0, Tuples_Read=1][cascading.flow.StepCounters Tuples_Read=1]]
2016-01-14 16:08:30,236 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C02BFEB83B1A41C79D7E54DD2DFA0365, mem on close (mb), free: 257, total: 385, max: 672
2016-01-14 16:08:30,236 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:30,236 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710000_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=C02BFEB83B1A41C79D7E54DD2DFA0365, taskAttemptId=attempt_1452787710000_0001_1_00_000000_0, startTime=1452787710187, finishTime=1452787710236, timeTaken=49, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452787710222, Process_Duration=10, Process_End_Time=1452787710232, Read_Duration=0, Tuples_Read=1, cascading.flow.StepCounters, Tuples_Read=1
2016-01-14 16:08:30,237 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787710000_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 16:08:30,238 INFO  impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452787710000_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 16:08:30,238 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710000_0001_1][Event:TASK_FINISHED]: vertexName=C02BFEB83B1A41C79D7E54DD2DFA0365, taskId=task_1452787710000_0001_1_00_000000, startTime=1452787710187, finishTime=1452787710238, timeTaken=51, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-01-14 16:08:30,238 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787710000_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 16:08:30,238 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:30,236 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=C02BFEB83B1A41C79D7E54DD2DFA0365, index=0
2016-01-14 16:08:30,239 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:30,238 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365] : 1
2016-01-14 16:08:30,239 INFO  impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365] because task failed: task_1452787710000_0001_1_00_000000
2016-01-14 16:08:30,239 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365] due to trigger: OWN_TASK_FAILURE
2016-01-14 16:08:30,240 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 16:08:30,240 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365]
2016-01-14 16:08:30,240 INFO  impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=4A85F41B91A94BE58D3F57D7E035F552, vertexId=vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365]
2016-01-14 16:08:30,239 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=C02BFEB83B1A41C79D7E54DD2DFA0365, sourceVertex=78AAFFC377A741C2AEDA10EF0FC0D5B9
2016-01-14 16:08:30,240 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=C02BFEB83B1A41C79D7E54DD2DFA0365, sourceVertex=4A85F41B91A94BE58D3F57D7E035F552
2016-01-14 16:08:30,240 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787710000_0001_00_000001
2016-01-14 16:08:30,241 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787710000_0001_00_000001
2016-01-14 16:08:30,242 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710000_0001_1][Event:VERTEX_FINISHED]: vertexName=C02BFEB83B1A41C79D7E54DD2DFA0365, vertexId=vertex_1452787710000_0001_1_00, initRequestedTime=1452787710161, initedTime=1452787710173, startRequestedTime=1452787710173, startedTime=1452787710173, finishTime=1452787710241, timeTaken=68, status=FAILED, diagnostics=Task failed, taskId=task_1452787710000_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452787710187, firstTasksToStart=[ task_1452787710000_0001_1_00_000000 ], lastTaskFinishTime=1452787710236, lastTasksToFinish=[ task_1452787710000_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 16:08:30,242 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 16:08:30,242 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710000_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787710000_0001_00_000001, stoppedTime=1452787710242, exitStatus=0
2016-01-14 16:08:30,242 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787710000_0001_00_000001 transitioned from RUNNING to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:30,242 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452787710000_0001_1_00_000000_0 failed: true container: container_1452787710000_0001_00_000001 numFailedTAs: 0
2016-01-14 16:08:30,242 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 16:08:30,243 INFO  impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 16:08:30,243 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787710000_0001_1
2016-01-14 16:08:30,243 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: 4A85F41B91A94BE58D3F57D7E035F552 for vertex: vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365]
2016-01-14 16:08:30,243 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:30,244 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:30,244 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787710000_0001_1, queueSize=0
2016-01-14 16:08:30,244 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:30,245 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710000_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787710000_0001_1, startTime=1452787710160, finishTime=1452787710243, timeTaken=83, status=FAILED, diagnostics=Vertex failed, vertexName=C02BFEB83B1A41C79D7E54DD2DFA0365, vertexId=vertex_1452787710000_0001_1_00, diagnostics=[Task failed, taskId=task_1452787710000_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452787710000_0001_1_00 [C02BFEB83B1A41C79D7E54DD2DFA0365] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 16:08:30,245 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787710000_0001_1 finished with state: FAILED
2016-01-14 16:08:30,245 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787710000_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:30,246 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1452787710000_0001_00_000001. Relying on regular task shutdown for it to end
2016-01-14 16:08:30 Completed Dag: dag_1452787710000_0001_1
2016-01-14 16:08:30,246 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787710000_0001_1, dagState=FAILED
2016-01-14 16:08:30,246 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787710000_0001_1_post
2016-01-14 16:08:30,246 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:30,246 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:30,246 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787710000_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 16:08:30,246 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787710000_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 16:08:30,246 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452787710000_0001_00_000001 completed but with errors
2016-01-14 16:08:30,247 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(1033)) - Container container_1452787710000_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 16:08:30,247 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787710000_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 16:08:30,247 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787710000_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 16:08:30,254 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...eld'_RESULTS.0_VALUES_ALL, applicationId=application_1452787710000_0001
2016-01-14 16:08:30,255 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:30,256 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:30,256 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:30,256 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:30,256 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:30,256 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:30,257 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:30,257 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:30,257 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:30,257 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:30,258 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:30,258 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:30,258 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:30,261 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/F83AE21D3CFA401681309FB13B0298DF/E00C8223DF2E4D9FB286D31E2636B07D/.tez/application_1452787710000_0001
2016-01-14 16:08:30,261 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping all jobs
2016-01-14 16:08:30,262 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping: (1/1) ...eld'_RESULTS.0_VALUES_ALL
2016-01-14 16:08:30,262 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopped all jobs
2016-01-14 16:08:30,263 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.281
2016-01-14 16:08:30,263 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_VALUES_ALL
2016-01-14 16:08:30,282 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:30,282 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:30,316 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.008
2016-01-14 16:08:30,320 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.012
2016-01-14 16:08:30,320 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:30,320 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:30,321 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:30,333 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:30,333 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_ARGS_-1
2016-01-14 16:08:30,341 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:30,342 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:30,342 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_ARGS_-1"]
2016-01-14 16:08:30,342 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:30,342 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:30,343 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:30,344 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...'field'_RESULTS.0_ARGS_-1
2016-01-14 16:08:30,344 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:30,354 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:30,359 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:30,359 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:30,359 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:30,368 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/8F4214A4D5B84EA09CCC9AC2034C8338/D312BDE6C1314CE38BBFD0C43DA27CA7/.tez/application_1452787710359_0001 doesn't exist and is created
2016-01-14 16:08:30,383 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:30,383 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:30,384 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/8F4214A4D5B84EA09CCC9AC2034C8338/D312BDE6C1314CE38BBFD0C43DA27CA7/.tez/application_1452787710359_0001
2016-01-14 16:08:30,387 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787710359_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:30,397 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:30,397 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:30,399 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:30,399 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:30,399 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/8F4214A4D5B84EA09CCC9AC2034C8338/D312BDE6C1314CE38BBFD0C43DA27CA7/.tez/application_1452787710359_0001/localmode-log-dir
2016-01-14 16:08:30,400 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/8F4214A4D5B84EA09CCC9AC2034C8338/D312BDE6C1314CE38BBFD0C43DA27CA7/.tez/application_1452787710359_0001/localmode-log-dir/history.txt.appattempt_1452787710359_0001_000000, maxErrors=10
2016-01-14 16:08:30,400 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:30,400 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787710359_0001_000000, appSubmitTime=1452787710386, launchTime=1452787710386
2016-01-14 16:08:30,404 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:30,405 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:52498
2016-01-14 16:08:30,406 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:30,407 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:30,407 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:30,411 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:30,413 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787710359_0001_000000, startTime=1452787710413
2016-01-14 16:08:30,413 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:30,413 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:30,484 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:30,484 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:30,484 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...'field'_RESULTS.0_ARGS_-1, applicationId=application_1452787710359_0001, dagName=[8F4214A4D5B84EA09CCC9AC2034C8338/D312BDE6C1314CE38BBFD0C43DA27CA7] every.every/(1/1) ...'field'_RESULTS.0_ARGS_-1
2016-01-14 16:08:30,498 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [8F4214A4D5B84EA09CCC9AC2034C8338/D312BDE6C1314CE38BBFD0C43DA27CA7] every.every/(1/1) ...'field'_RESULTS.0_ARGS_-1
2016-01-14 16:08:30,499 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787710359_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/8F4214A4D5B84EA09CCC9AC2034C8338/D312BDE6C1314CE38BBFD0C43DA27CA7/.tez/application_1452787710359_0001/localmode-log-dir/dag_1452787710359_0001_1.dot
2016-01-14 16:08:30,500 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/8F4214A4D5B84EA09CCC9AC2034C8338/D312BDE6C1314CE38BBFD0C43DA27CA7/.tez/application_1452787710359_0001/localmode-log-dir/dag_1452787710359_0001_1-tez-dag.pb.txt
2016-01-14 16:08:30,503 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787710359_0001_1
2016-01-14 16:08:30,503 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:30,504 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [8F4214A4D5B84EA09CCC9AC2034C8338/D312BDE6C1314CE38BBFD0C43DA27CA7] every.every/(1/1) ...'field'_RESULTS.0_ARGS_-1
2016-01-14 16:08:30 Running Dag: dag_1452787710359_0001_1
2016-01-14 16:08:30,515 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710359_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787710359_0001_1, submitTime=1452787710498
2016-01-14 16:08:30,515 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:30,515 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex AC2856B4C3E24BC5A421F2631CD01668
2016-01-14 16:08:30,516 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:30,516 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710359_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787710359_0001_1, initTime=1452787710515
2016-01-14 16:08:30,516 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:30,516 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787710359_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:30,517 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710359_0001_1][Event:DAG_STARTED]: dagID=dag_1452787710359_0001_1, startTime=1452787710517
2016-01-14 16:08:30,517 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:30,517 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:30,517 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787710359_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:30,517 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: AC2856B4C3E24BC5A421F2631CD01668 : {BB121A8C766B4C3B97F1F79D75A7263E={InputName=BB121A8C766B4C3B97F1F79D75A7263E}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:30,517 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: BB121A8C766B4C3B97F1F79D75A7263E, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:30,518 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668]
2016-01-14 16:08:30,518 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668]
2016-01-14 16:08:30,518 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668]
2016-01-14 16:08:30,518 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668]. Starting root input initializers: 1
2016-01-14 16:08:30,518 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...'field'_RESULTS.0_ARGS_-1, applicationId=application_1452787710359_0001, dagName=[8F4214A4D5B84EA09CCC9AC2034C8338/D312BDE6C1314CE38BBFD0C43DA27CA7] every.every/(1/1) ...'field'_RESULTS.0_ARGS_-1
2016-01-14 16:08:30,518 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:30,520 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: BB121A8C766B4C3B97F1F79D75A7263E on vertex vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668]
2016-01-14 16:08:30,522 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:30,522 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input BB121A8C766B4C3B97F1F79D75A7263E asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:30,523 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:30,523 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:30,524 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:30,524 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: BB121A8C766B4C3B97F1F79D75A7263E on vertex vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668]
2016-01-14 16:08:30,525 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:30,525 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {BB121A8C766B4C3B97F1F79D75A7263E=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:30,525 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668] parallelism set to 1
2016-01-14 16:08:30,525 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:30,525 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710359_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787710359_0001_1_00, eventCount=1
2016-01-14 16:08:30,525 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668]
2016-01-14 16:08:30,526 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=6AC8719964E7486993B3001B790FA987, vertexId=vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:30,526 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=6AC8719964E7486993B3001B790FA987, vertexId=vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668]
2016-01-14 16:08:30,527 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=6AC8719964E7486993B3001B790FA987, vertexName=AC2856B4C3E24BC5A421F2631CD01668, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:30,527 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=6AC8719964E7486993B3001B790FA987, vertexId=vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668]
2016-01-14 16:08:30,528 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:30,529 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710359_0001_1][Event:VERTEX_INITIALIZED]: vertexName=AC2856B4C3E24BC5A421F2631CD01668, vertexId=vertex_1452787710359_0001_1_00, initRequestedTime=1452787710517, initedTime=1452787710528, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:30,529 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668] with distanceFromRoot: 0
2016-01-14 16:08:30,529 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:30,529 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in AC2856B4C3E24BC5A421F2631CD01668
2016-01-14 16:08:30,529 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668]
2016-01-14 16:08:30,529 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:30,530 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710359_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787710359_0001_1_00, startRequestedTime=1452787710529, startedTime=1452787710529
2016-01-14 16:08:30,530 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:30,530 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:30,530 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710359_0001_1][Event:TASK_STARTED]: vertexName=AC2856B4C3E24BC5A421F2631CD01668, taskId=task_1452787710359_0001_1_00_000000, scheduledTime=1452787710530, launchTime=1452787710530
2016-01-14 16:08:30,530 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787710359_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:30,530 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668]
2016-01-14 16:08:30,531 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [8F4214A4D5B84EA09CCC9AC2034C8338/D312BDE6C1314CE38BBFD0C43DA27CA7] every.every/(1/1) ...'field'_RESULTS.0_ARGS_-1, VertexName: AC2856B4C3E24BC5A421F2631CD01668, VertexParallelism: 1, TaskAttemptID:attempt_1452787710359_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=BB121A8C766B4C3B97F1F79D75A7263E, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6AC8719964E7486993B3001B790FA987, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:30,531 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787710359_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:30,531 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:30,532 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:30,532 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:30,532 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:30,533 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787710359_0001_00_000001
2016-01-14 16:08:30,533 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787710359_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:30,535 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787710359_0001_00_000001
2016-01-14 16:08:30,535 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:30,535 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787710359_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:30,535 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787710359_0001, with dag id: dag_1452787710359_0001_1
2016-01-14 16:08:30,536 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:30,536 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710359_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787710359_0001_00_000001, launchTime=1452787710535
2016-01-14 16:08:30,537 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787710359_0001_00_000001
2016-01-14 16:08:30,538 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787710359_0001_1_00_000000_0] to container: [container_1452787710359_0001_00_000001]
2016-01-14 16:08:30,538 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787710359_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:30,538 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787710359_0001_1_00_000000_0] started. Is using containerId: [container_1452787710359_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:30,539 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710359_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=AC2856B4C3E24BC5A421F2631CD01668, taskAttemptId=attempt_1452787710359_0001_1_00_000000_0, startTime=1452787710538, containerId=container_1452787710359_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787710359_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:30,539 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787710359_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:30,539 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787710359_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:30,539 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:30,539 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787710359_0001_00_000001 given task: attempt_1452787710359_0001_1_00_000000_0
2016-01-14 16:08:30,540 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787710359_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787710359_0001_1_00_000000_0
2016-01-14 16:08:30 Starting to run new task attempt: attempt_1452787710359_0001_1_00_000000_0
2016-01-14 16:08:30,540 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787710359_0001_1_00_000000_0
2016-01-14 16:08:30,540 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:30,540 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:30,541 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:30,541 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:30,541 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:30,541 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:30,541 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [8F4214A4D5B84EA09CCC9AC2034C8338/D312BDE6C1314CE38BBFD0C43DA27CA7] every.every/(1/1) ...'field'_RESULTS.0_ARGS_-1, VertexName: AC2856B4C3E24BC5A421F2631CD01668, VertexParallelism: 1, TaskAttemptID:attempt_1452787710359_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=BB121A8C766B4C3B97F1F79D75A7263E, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6AC8719964E7486993B3001B790FA987, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:30,541 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:30,542 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787710359_0001_1_00_000000_0
2016-01-14 16:08:30,543 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:30,543 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:30,543 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787710359_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:30,544 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=BB121A8C766B4C3B97F1F79D75A7263E, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:30,544 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=6AC8719964E7486993B3001B790FA987, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:30,544 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:30,545 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:30,544 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:30,545 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: BB121A8C766B4C3B97F1F79D75A7263E
2016-01-14 16:08:30,546 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 6AC8719964E7486993B3001B790FA987
2016-01-14 16:08:30,546 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:30,546 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: BB121A8C766B4C3B97F1F79D75A7263E
2016-01-14 16:08:30,548 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:30,548 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 6AC8719964E7486993B3001B790FA987
2016-01-14 16:08:30,550 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:30,550 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: BB121A8C766B4C3B97F1F79D75A7263E
2016-01-14 16:08:30,550 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: BB121A8C766B4C3B97F1F79D75A7263E
2016-01-14 16:08:30,557 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: AC2856B4C3E24BC5A421F2631CD01668, ordinal: 0
2016-01-14 16:08:30,557 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AC2856B4C3E24BC5A421F2631CD01668, mem on start (mb), free: 200, total: 385, max: 672
2016-01-14 16:08:30,557 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:30,557 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:30,557 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:30,559 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:30,559 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 6AC8719964E7486993B3001B790FA987
2016-01-14 16:08:30,560 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:30,560 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:30,560 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:30,560 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:30,560 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:30,560 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:30,560 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:30,560 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:30,560 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, BB121A8C766B4C3B97F1F79D75A7263E, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:30,561 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 6AC8719964E7486993B3001B790FA987, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:30,561 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:30,561 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: BB121A8C766B4C3B97F1F79D75A7263E being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:30,561 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: BB121A8C766B4C3B97F1F79D75A7263E
2016-01-14 16:08:30,561 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:30,561 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: BB121A8C766B4C3B97F1F79D75A7263E
2016-01-14 16:08:30,561 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:30,561 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:30,561 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:30,562 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787710359_0001_1_00_000000_0
2016-01-14 16:08:30,563 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:30,563 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@2e6aea22
2016-01-14 16:08:30,564 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@2e6aea22
2016-01-14 16:08:30,564 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:30,564 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:30,565 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:30,566 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: BB121A8C766B4C3B97F1F79D75A7263E
2016-01-14 16:08:30,566 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_ARGS_-1"], id: 6AC8719964E7486993B3001B790FA987
2016-01-14 16:08:30,566 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_ARGS_-1"]
2016-01-14 16:08:30,567 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:30,567 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:30,567 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: AC2856B4C3E24BC5A421F2631CD01668, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:30,570 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:30,570 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:30,570 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787710359_0001_1_00_000000_0
2016-01-14 16:08:30,571 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787710359_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:30,571 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787710359_0001_1_00_000000_0
2016-01-14 16:08:30,571 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AC2856B4C3E24BC5A421F2631CD01668, mem on close (mb), free: 199, total: 385, max: 672
2016-01-14 16:08:30 Completed running task attempt: attempt_1452787710359_0001_1_00_000000_0
2016-01-14 16:08:30,573 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787710359_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:30,574 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:30,574 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710359_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=AC2856B4C3E24BC5A421F2631CD01668, taskAttemptId=attempt_1452787710359_0001_1_00_000000_0, startTime=1452787710538, finishTime=1452787710574, timeTaken=36, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787710568, Process_Duration=3, Process_End_Time=1452787710571, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:30,574 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787710359_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:30,574 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787710359_0001_1_00_000000_0
2016-01-14 16:08:30,574 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:30,574 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710359_0001_1][Event:TASK_FINISHED]: vertexName=AC2856B4C3E24BC5A421F2631CD01668, taskId=task_1452787710359_0001_1_00_000000, startTime=1452787710538, finishTime=1452787710574, timeTaken=36, status=SUCCEEDED, successfulAttemptID=attempt_1452787710359_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787710568, Process_Duration=3, Process_End_Time=1452787710571, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:30,575 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:30,575 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787710359_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:30,575 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668] : 1
2016-01-14 16:08:30,575 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668]
2016-01-14 16:08:30,576 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:30,576 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710359_0001_1][Event:VERTEX_FINISHED]: vertexName=AC2856B4C3E24BC5A421F2631CD01668, vertexId=vertex_1452787710359_0001_1_00, initRequestedTime=1452787710517, initedTime=1452787710528, startRequestedTime=1452787710529, startedTime=1452787710529, finishTime=1452787710575, timeTaken=46, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787710568, Process_Duration=3, Process_End_Time=1452787710571, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787710538, firstTasksToStart=[ task_1452787710359_0001_1_00_000000 ], lastTaskFinishTime=1452787710574, lastTasksToFinish=[ task_1452787710359_0001_1_00_000000 ], minTaskDuration=36, maxTaskDuration=36, avgTaskDuration=36.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787710359_0001_1_00_000000 ], longestDurationTasks=[ task_1452787710359_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:30,576 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:30,576 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787710359_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:30,576 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710359_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787710359_0001_00_000001, stoppedTime=1452787710576, exitStatus=0
2016-01-14 16:08:30,576 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787710359_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:30,576 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:30,577 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787710359_0001_1
2016-01-14 16:08:30,577 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710359_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787710359_0001_1
2016-01-14 16:08:30,577 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 6AC8719964E7486993B3001B790FA987 for vertex: vertex_1452787710359_0001_1_00 [AC2856B4C3E24BC5A421F2631CD01668]
2016-01-14 16:08:30,577 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:30,578 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787710568, Process_Duration=3, Process_End_Time=1452787710571, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:30,578 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:30,578 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:30,579 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787710359_0001_00_000001
2016-01-14 16:08:30,579 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787710359_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:30,579 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787710359_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:30,579 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787710359_0001_00_000001, Exiting
2016-01-14 16:08:30,579 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787710359_0001_00_000001
2016-01-14 16:08:30,579 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787710359_0001_00_000001
2016-01-14 16:08:30,580 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787710359_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:30,580 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787710359_0001_00_000001 completed successfully
2016-01-14 16:08:30,587 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787710359_0001_1, queueSize=0
2016-01-14 16:08:30,587 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:30,588 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710359_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787710359_0001_1, startTime=1452787710517, finishTime=1452787710586, timeTaken=69, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787710568, Process_Duration=3, Process_End_Time=1452787710571, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:30,588 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787710359_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:30,589 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787710359_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:30,589 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787710359_0001_00_000001
2016-01-14 16:08:30,590 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787710359_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:30 Completed Dag: dag_1452787710359_0001_1
2016-01-14 16:08:30,593 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787710359_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:30,593 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787710359_0001_1_post
2016-01-14 16:08:30,594 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:30,594 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:30,596 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...'field'_RESULTS.0_ARGS_-1, applicationId=application_1452787710359_0001
2016-01-14 16:08:30,597 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:30,597 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:30,598 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:30,598 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:30,598 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:30,599 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:30,599 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:30,600 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:30,600 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:30,600 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:30,600 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:30,600 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:30,600 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:30,604 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/8F4214A4D5B84EA09CCC9AC2034C8338/D312BDE6C1314CE38BBFD0C43DA27CA7/.tez/application_1452787710359_0001
2016-01-14 16:08:30,605 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.263
2016-01-14 16:08:30,667 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_ARGS_-1
2016-01-14 16:08:30,687 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:30,687 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:30,691 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:30,692 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:30,714 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.002
2016-01-14 16:08:30,716 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.004
2016-01-14 16:08:30,716 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:30,717 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:30,717 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_ARGS_'field2'
2016-01-14 16:08:30,737 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:30,738 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:30,770 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.010
2016-01-14 16:08:30,776 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.016
2016-01-14 16:08:30,777 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:30,778 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:30,778 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:30,799 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:30,800 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_ARGS_RESULTS
2016-01-14 16:08:30,814 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:30,815 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:30,815 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_ARGS_RESULTS"]
2016-01-14 16:08:30,815 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:30,815 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:30,815 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:30,816 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...d'_RESULTS.0_ARGS_RESULTS
2016-01-14 16:08:30,816 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:30,828 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:30,833 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:30,834 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:30,834 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:30,844 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ACEA1DC6E6304F02810D2F77DF50F078/D67BB7947D4E4758A5434085B23B8882/.tez/application_1452787710834_0001 doesn't exist and is created
2016-01-14 16:08:30,862 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:30,862 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:30,863 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ACEA1DC6E6304F02810D2F77DF50F078/D67BB7947D4E4758A5434085B23B8882/.tez/application_1452787710834_0001
2016-01-14 16:08:30,865 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787710834_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:30,875 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:30,876 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:30,877 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:30,878 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:30,878 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ACEA1DC6E6304F02810D2F77DF50F078/D67BB7947D4E4758A5434085B23B8882/.tez/application_1452787710834_0001/localmode-log-dir
2016-01-14 16:08:30,878 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ACEA1DC6E6304F02810D2F77DF50F078/D67BB7947D4E4758A5434085B23B8882/.tez/application_1452787710834_0001/localmode-log-dir/history.txt.appattempt_1452787710834_0001_000000, maxErrors=10
2016-01-14 16:08:30,879 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:30,879 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787710834_0001_000000, appSubmitTime=1452787710865, launchTime=1452787710865
2016-01-14 16:08:30,882 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:30,883 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:30,884 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:30,884 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:30,891 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:33176
2016-01-14 16:08:30,892 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:30,894 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787710834_0001_000000, startTime=1452787710894
2016-01-14 16:08:30,894 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:30,894 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:30,963 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:30,963 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:30,963 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...d'_RESULTS.0_ARGS_RESULTS, applicationId=application_1452787710834_0001, dagName=[ACEA1DC6E6304F02810D2F77DF50F078/D67BB7947D4E4758A5434085B23B8882] every.every/(1/1) ...d'_RESULTS.0_ARGS_RESULTS
2016-01-14 16:08:30,993 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [ACEA1DC6E6304F02810D2F77DF50F078/D67BB7947D4E4758A5434085B23B8882] every.every/(1/1) ...d'_RESULTS.0_ARGS_RESULTS
2016-01-14 16:08:30,994 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787710834_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ACEA1DC6E6304F02810D2F77DF50F078/D67BB7947D4E4758A5434085B23B8882/.tez/application_1452787710834_0001/localmode-log-dir/dag_1452787710834_0001_1.dot
2016-01-14 16:08:30,994 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ACEA1DC6E6304F02810D2F77DF50F078/D67BB7947D4E4758A5434085B23B8882/.tez/application_1452787710834_0001/localmode-log-dir/dag_1452787710834_0001_1-tez-dag.pb.txt
2016-01-14 16:08:30,998 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787710834_0001_1
2016-01-14 16:08:30,998 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:30,998 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [ACEA1DC6E6304F02810D2F77DF50F078/D67BB7947D4E4758A5434085B23B8882] every.every/(1/1) ...d'_RESULTS.0_ARGS_RESULTS
2016-01-14 16:08:30 Running Dag: dag_1452787710834_0001_1
2016-01-14 16:08:31,011 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:31,011 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710834_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787710834_0001_1, submitTime=1452787710993
2016-01-14 16:08:31,012 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex EA4660DCC31E4BA5B1345FA33E79A49C
2016-01-14 16:08:31,012 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:31,012 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:31,012 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710834_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787710834_0001_1, initTime=1452787711011
2016-01-14 16:08:31,013 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787710834_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:31,013 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710834_0001_1][Event:DAG_STARTED]: dagID=dag_1452787710834_0001_1, startTime=1452787711013
2016-01-14 16:08:31,013 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:31,013 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787710834_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:31,013 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: EA4660DCC31E4BA5B1345FA33E79A49C : {0C85BF4B8CE44EF1A1EB7248A2261EAA={InputName=0C85BF4B8CE44EF1A1EB7248A2261EAA}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:31,013 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 0C85BF4B8CE44EF1A1EB7248A2261EAA, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:31,014 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C]
2016-01-14 16:08:31,014 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C]
2016-01-14 16:08:31,014 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C]
2016-01-14 16:08:31,014 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:31,014 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C]. Starting root input initializers: 1
2016-01-14 16:08:31,014 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:31,015 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 0C85BF4B8CE44EF1A1EB7248A2261EAA on vertex vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C]
2016-01-14 16:08:31,015 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...d'_RESULTS.0_ARGS_RESULTS, applicationId=application_1452787710834_0001, dagName=[ACEA1DC6E6304F02810D2F77DF50F078/D67BB7947D4E4758A5434085B23B8882] every.every/(1/1) ...d'_RESULTS.0_ARGS_RESULTS
2016-01-14 16:08:31,017 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:31,018 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 0C85BF4B8CE44EF1A1EB7248A2261EAA asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:31,018 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:31,019 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:31,020 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:31,021 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 0C85BF4B8CE44EF1A1EB7248A2261EAA on vertex vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C]
2016-01-14 16:08:31,021 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:31,021 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {0C85BF4B8CE44EF1A1EB7248A2261EAA=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:31,021 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C] parallelism set to 1
2016-01-14 16:08:31,021 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:31,022 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710834_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787710834_0001_1_00, eventCount=1
2016-01-14 16:08:31,022 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C]
2016-01-14 16:08:31,022 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=33037C1820DB421990E6FF48E403DE79, vertexId=vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:31,022 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=33037C1820DB421990E6FF48E403DE79, vertexId=vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C]
2016-01-14 16:08:31,024 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=33037C1820DB421990E6FF48E403DE79, vertexName=EA4660DCC31E4BA5B1345FA33E79A49C, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:31,024 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=33037C1820DB421990E6FF48E403DE79, vertexId=vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C]
2016-01-14 16:08:31,025 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:31,026 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710834_0001_1][Event:VERTEX_INITIALIZED]: vertexName=EA4660DCC31E4BA5B1345FA33E79A49C, vertexId=vertex_1452787710834_0001_1_00, initRequestedTime=1452787711013, initedTime=1452787711025, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:31,026 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C] with distanceFromRoot: 0
2016-01-14 16:08:31,026 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:31,026 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in EA4660DCC31E4BA5B1345FA33E79A49C
2016-01-14 16:08:31,026 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C]
2016-01-14 16:08:31,027 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:31,027 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710834_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787710834_0001_1_00, startRequestedTime=1452787711026, startedTime=1452787711026
2016-01-14 16:08:31,027 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:31,028 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:31,028 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710834_0001_1][Event:TASK_STARTED]: vertexName=EA4660DCC31E4BA5B1345FA33E79A49C, taskId=task_1452787710834_0001_1_00_000000, scheduledTime=1452787711028, launchTime=1452787711028
2016-01-14 16:08:31,028 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787710834_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:31,029 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C]
2016-01-14 16:08:31,029 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [ACEA1DC6E6304F02810D2F77DF50F078/D67BB7947D4E4758A5434085B23B8882] every.every/(1/1) ...d'_RESULTS.0_ARGS_RESULTS, VertexName: EA4660DCC31E4BA5B1345FA33E79A49C, VertexParallelism: 1, TaskAttemptID:attempt_1452787710834_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0C85BF4B8CE44EF1A1EB7248A2261EAA, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=33037C1820DB421990E6FF48E403DE79, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:31,029 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787710834_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:31,030 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:31,030 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:31,031 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:31,031 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:31,031 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787710834_0001_00_000001
2016-01-14 16:08:31,031 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787710834_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:31,033 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787710834_0001_00_000001
2016-01-14 16:08:31,033 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:31,034 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787710834_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:31,034 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710834_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787710834_0001_00_000001, launchTime=1452787711034
2016-01-14 16:08:31,034 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:31,035 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787710834_0001_00_000001
2016-01-14 16:08:31,035 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787710834_0001_1_00_000000_0] to container: [container_1452787710834_0001_00_000001]
2016-01-14 16:08:31,035 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787710834_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:31,036 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787710834_0001_1_00_000000_0] started. Is using containerId: [container_1452787710834_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:31,036 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710834_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=EA4660DCC31E4BA5B1345FA33E79A49C, taskAttemptId=attempt_1452787710834_0001_1_00_000000_0, startTime=1452787711036, containerId=container_1452787710834_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787710834_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:31,036 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787710834_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:31,036 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:31,036 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787710834_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:31,037 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787710834_0001_00_000001 given task: attempt_1452787710834_0001_1_00_000000_0
2016-01-14 16:08:31,037 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787710834_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787710834_0001_1_00_000000_0
2016-01-14 16:08:31 Starting to run new task attempt: attempt_1452787710834_0001_1_00_000000_0
2016-01-14 16:08:31,038 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787710834_0001_1_00_000000_0
2016-01-14 16:08:31,038 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:31,038 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:31,038 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:31,038 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:31,038 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:31,038 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:31,038 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [ACEA1DC6E6304F02810D2F77DF50F078/D67BB7947D4E4758A5434085B23B8882] every.every/(1/1) ...d'_RESULTS.0_ARGS_RESULTS, VertexName: EA4660DCC31E4BA5B1345FA33E79A49C, VertexParallelism: 1, TaskAttemptID:attempt_1452787710834_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0C85BF4B8CE44EF1A1EB7248A2261EAA, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=33037C1820DB421990E6FF48E403DE79, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:31,039 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:31,040 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787710834_0001_1_00_000000_0
2016-01-14 16:08:31,040 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:31,040 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:31,043 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787710834_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:31,043 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=0C85BF4B8CE44EF1A1EB7248A2261EAA, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:31,043 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:31,044 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:31,044 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=33037C1820DB421990E6FF48E403DE79, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:31,044 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:31,044 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 33037C1820DB421990E6FF48E403DE79
2016-01-14 16:08:31,044 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:31,044 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 33037C1820DB421990E6FF48E403DE79
2016-01-14 16:08:31,044 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 0C85BF4B8CE44EF1A1EB7248A2261EAA
2016-01-14 16:08:31,046 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 0C85BF4B8CE44EF1A1EB7248A2261EAA
2016-01-14 16:08:31,046 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:31,049 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:31,049 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 0C85BF4B8CE44EF1A1EB7248A2261EAA
2016-01-14 16:08:31,049 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 0C85BF4B8CE44EF1A1EB7248A2261EAA
2016-01-14 16:08:31,053 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787710834_0001, with dag id: dag_1452787710834_0001_1
2016-01-14 16:08:31,058 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: EA4660DCC31E4BA5B1345FA33E79A49C, ordinal: 0
2016-01-14 16:08:31,059 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: EA4660DCC31E4BA5B1345FA33E79A49C, mem on start (mb), free: 318, total: 385, max: 672
2016-01-14 16:08:31,059 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:31,060 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:31,060 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:31,062 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:31,062 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 33037C1820DB421990E6FF48E403DE79
2016-01-14 16:08:31,062 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:31,063 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:31,063 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:31,063 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:31,063 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:31,063 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:31,064 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:31,064 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:31,064 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 33037C1820DB421990E6FF48E403DE79, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:31,064 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 0C85BF4B8CE44EF1A1EB7248A2261EAA, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:31,065 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:31,065 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 0C85BF4B8CE44EF1A1EB7248A2261EAA being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:31,065 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 0C85BF4B8CE44EF1A1EB7248A2261EAA
2016-01-14 16:08:31,065 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:31,066 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 0C85BF4B8CE44EF1A1EB7248A2261EAA
2016-01-14 16:08:31,065 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:31,066 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:31,066 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:31,067 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787710834_0001_1_00_000000_0
2016-01-14 16:08:31,068 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:31,069 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@110f873b
2016-01-14 16:08:31,070 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:31,070 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 0C85BF4B8CE44EF1A1EB7248A2261EAA
2016-01-14 16:08:31,070 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_ARGS_RESULTS"], id: 33037C1820DB421990E6FF48E403DE79
2016-01-14 16:08:31,071 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_ARGS_RESULTS"]
2016-01-14 16:08:31,071 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:31,071 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:31,071 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@110f873b
2016-01-14 16:08:31,072 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:31,072 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:31,072 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: EA4660DCC31E4BA5B1345FA33E79A49C, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:31,075 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:31,075 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:31,076 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787710834_0001_1_00_000000_0
2016-01-14 16:08:31,076 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787710834_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:31,077 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787710834_0001_1_00_000000_0
2016-01-14 16:08:31,077 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: EA4660DCC31E4BA5B1345FA33E79A49C, mem on close (mb), free: 316, total: 385, max: 672
2016-01-14 16:08:31 Completed running task attempt: attempt_1452787710834_0001_1_00_000000_0
2016-01-14 16:08:31,079 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787710834_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:31,080 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787711072, Process_Duration=5, Process_End_Time=1452787711077, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:31,080 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710834_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=EA4660DCC31E4BA5B1345FA33E79A49C, taskAttemptId=attempt_1452787710834_0001_1_00_000000_0, startTime=1452787711036, finishTime=1452787711080, timeTaken=44, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787711072, Process_Duration=5, Process_End_Time=1452787711077, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:31,081 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:31,081 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787710834_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:31,081 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:31,081 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:31,082 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:31,081 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787710834_0001_1_00_000000_0
2016-01-14 16:08:31,082 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787710834_0001_00_000001
2016-01-14 16:08:31,082 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:31,082 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710834_0001_1][Event:TASK_FINISHED]: vertexName=EA4660DCC31E4BA5B1345FA33E79A49C, taskId=task_1452787710834_0001_1_00_000000, startTime=1452787711036, finishTime=1452787711082, timeTaken=46, status=SUCCEEDED, successfulAttemptID=attempt_1452787710834_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787711072, Process_Duration=5, Process_End_Time=1452787711077, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:31,083 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787710834_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:31,083 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C] : 1
2016-01-14 16:08:31,083 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C]
2016-01-14 16:08:31,084 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:31,084 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710834_0001_1][Event:VERTEX_FINISHED]: vertexName=EA4660DCC31E4BA5B1345FA33E79A49C, vertexId=vertex_1452787710834_0001_1_00, initRequestedTime=1452787711013, initedTime=1452787711025, startRequestedTime=1452787711026, startedTime=1452787711026, finishTime=1452787711083, timeTaken=57, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787711072, Process_Duration=5, Process_End_Time=1452787711077, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787711036, firstTasksToStart=[ task_1452787710834_0001_1_00_000000 ], lastTaskFinishTime=1452787711080, lastTasksToFinish=[ task_1452787710834_0001_1_00_000000 ], minTaskDuration=44, maxTaskDuration=44, avgTaskDuration=44.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787710834_0001_1_00_000000 ], longestDurationTasks=[ task_1452787710834_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:31,084 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:31,084 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787710834_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:31,084 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710834_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787710834_0001_00_000001, stoppedTime=1452787711084, exitStatus=0
2016-01-14 16:08:31,084 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787710834_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:31,084 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:31,084 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:31,084 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787710834_0001_1
2016-01-14 16:08:31,086 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710834_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787710834_0001_1
2016-01-14 16:08:31,086 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 33037C1820DB421990E6FF48E403DE79 for vertex: vertex_1452787710834_0001_1_00 [EA4660DCC31E4BA5B1345FA33E79A49C]
2016-01-14 16:08:31,093 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787710834_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:31,093 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787710834_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:31,093 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787710834_0001_1, queueSize=0
2016-01-14 16:08:31,094 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:31,094 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787710834_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787710834_0001_1, startTime=1452787711013, finishTime=1452787711092, timeTaken=79, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787711072, Process_Duration=5, Process_End_Time=1452787711077, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:31,095 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787710834_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:31,095 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787710834_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:31,095 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1452787710834_0001_00_000001. Relying on regular task shutdown for it to end
2016-01-14 16:08:31 Completed Dag: dag_1452787710834_0001_1
2016-01-14 16:08:31,096 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787710834_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:31,096 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787710834_0001_1_post
2016-01-14 16:08:31,096 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:31,096 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:31,097 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787710834_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 16:08:31,097 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787710834_0001_00_000001, Exiting
2016-01-14 16:08:31,097 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787710834_0001_00_000001
2016-01-14 16:08:31,097 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787710834_0001_00_000001
2016-01-14 16:08:31,100 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787710834_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:31,100 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787710834_0001_00_000001 completed successfully
2016-01-14 16:08:31,100 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787710834_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 16:08:31,103 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...d'_RESULTS.0_ARGS_RESULTS, applicationId=application_1452787710834_0001
2016-01-14 16:08:31,105 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:31,105 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:31,105 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:31,105 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:31,106 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:31,106 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:31,106 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:31,106 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:31,107 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:31,107 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:31,107 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:31,107 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:31,107 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:31,112 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ACEA1DC6E6304F02810D2F77DF50F078/D67BB7947D4E4758A5434085B23B8882/.tez/application_1452787710834_0001
2016-01-14 16:08:31,112 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.298
2016-01-14 16:08:31,179 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_ARGS_RESULTS
2016-01-14 16:08:31,198 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:31,198 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:31,208 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:31,208 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:31,223 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.004
2016-01-14 16:08:31,226 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.007
2016-01-14 16:08:31,226 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:31,227 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:31,227 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_ARGS_ALL
2016-01-14 16:08:31,252 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:31,253 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:31,281 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.006
2016-01-14 16:08:31,286 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.012
2016-01-14 16:08:31,286 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:31,286 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:31,286 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:31,299 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:31,299 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_-1
2016-01-14 16:08:31,307 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:31,308 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:31,308 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_-1"]
2016-01-14 16:08:31,308 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:31,308 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:31,308 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:31,309 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...'_RESULTS.ALL_'field2'_-1
2016-01-14 16:08:31,309 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:31,319 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:31,324 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:31,324 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:31,324 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:31,333 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BF493EB3DA584EACAEA24208889D1C51/F16596D96DFE4F219160E90D58C7E7B8/.tez/application_1452787711324_0001 doesn't exist and is created
2016-01-14 16:08:31,348 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:31,348 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:31,348 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BF493EB3DA584EACAEA24208889D1C51/F16596D96DFE4F219160E90D58C7E7B8/.tez/application_1452787711324_0001
2016-01-14 16:08:31,351 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787711324_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:31,360 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:31,361 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:31,362 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:31,362 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:31,362 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BF493EB3DA584EACAEA24208889D1C51/F16596D96DFE4F219160E90D58C7E7B8/.tez/application_1452787711324_0001/localmode-log-dir
2016-01-14 16:08:31,363 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BF493EB3DA584EACAEA24208889D1C51/F16596D96DFE4F219160E90D58C7E7B8/.tez/application_1452787711324_0001/localmode-log-dir/history.txt.appattempt_1452787711324_0001_000000, maxErrors=10
2016-01-14 16:08:31,363 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:31,363 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787711324_0001_000000, appSubmitTime=1452787711350, launchTime=1452787711350
2016-01-14 16:08:31,366 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:31,370 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:31,371 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:31,371 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:31,371 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:38440
2016-01-14 16:08:31,374 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:31,376 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787711324_0001_000000, startTime=1452787711376
2016-01-14 16:08:31,376 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:31,376 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:31,448 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:31,448 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:31,448 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...'_RESULTS.ALL_'field2'_-1, applicationId=application_1452787711324_0001, dagName=[BF493EB3DA584EACAEA24208889D1C51/F16596D96DFE4F219160E90D58C7E7B8] every.every/(1/1) ...'_RESULTS.ALL_'field2'_-1
2016-01-14 16:08:31,463 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [BF493EB3DA584EACAEA24208889D1C51/F16596D96DFE4F219160E90D58C7E7B8] every.every/(1/1) ...'_RESULTS.ALL_'field2'_-1
2016-01-14 16:08:31,464 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787711324_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BF493EB3DA584EACAEA24208889D1C51/F16596D96DFE4F219160E90D58C7E7B8/.tez/application_1452787711324_0001/localmode-log-dir/dag_1452787711324_0001_1.dot
2016-01-14 16:08:31,465 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BF493EB3DA584EACAEA24208889D1C51/F16596D96DFE4F219160E90D58C7E7B8/.tez/application_1452787711324_0001/localmode-log-dir/dag_1452787711324_0001_1-tez-dag.pb.txt
2016-01-14 16:08:31,469 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787711324_0001_1
2016-01-14 16:08:31,469 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:31,469 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [BF493EB3DA584EACAEA24208889D1C51/F16596D96DFE4F219160E90D58C7E7B8] every.every/(1/1) ...'_RESULTS.ALL_'field2'_-1
2016-01-14 16:08:31 Running Dag: dag_1452787711324_0001_1
2016-01-14 16:08:31,480 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711324_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787711324_0001_1, submitTime=1452787711463
2016-01-14 16:08:31,480 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:31,480 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex EA1DCDF3327B43328E550AB68DB04F95
2016-01-14 16:08:31,480 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:31,481 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711324_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787711324_0001_1, initTime=1452787711480
2016-01-14 16:08:31,481 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:31,481 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787711324_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:31,481 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711324_0001_1][Event:DAG_STARTED]: dagID=dag_1452787711324_0001_1, startTime=1452787711481
2016-01-14 16:08:31,481 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:31,481 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787711324_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:31,481 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: EA1DCDF3327B43328E550AB68DB04F95 : {05D938E472DC4151B02FCF82FD0D7C7A={InputName=05D938E472DC4151B02FCF82FD0D7C7A}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:31,482 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 05D938E472DC4151B02FCF82FD0D7C7A, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:31,482 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:31,481 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...'_RESULTS.ALL_'field2'_-1, applicationId=application_1452787711324_0001, dagName=[BF493EB3DA584EACAEA24208889D1C51/F16596D96DFE4F219160E90D58C7E7B8] every.every/(1/1) ...'_RESULTS.ALL_'field2'_-1
2016-01-14 16:08:31,482 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95]
2016-01-14 16:08:31,482 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95]
2016-01-14 16:08:31,482 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95]
2016-01-14 16:08:31,482 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95]. Starting root input initializers: 1
2016-01-14 16:08:31,483 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:31,483 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 05D938E472DC4151B02FCF82FD0D7C7A on vertex vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95]
2016-01-14 16:08:31,485 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:31,485 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 05D938E472DC4151B02FCF82FD0D7C7A asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:31,485 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:31,486 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:31,487 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:31,487 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 05D938E472DC4151B02FCF82FD0D7C7A on vertex vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95]
2016-01-14 16:08:31,487 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:31,487 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {05D938E472DC4151B02FCF82FD0D7C7A=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:31,488 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95] parallelism set to 1
2016-01-14 16:08:31,488 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:31,488 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711324_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787711324_0001_1_00, eventCount=1
2016-01-14 16:08:31,488 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95]
2016-01-14 16:08:31,488 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=87508F69736E485CB1F876E466309F4B, vertexId=vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:31,488 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=87508F69736E485CB1F876E466309F4B, vertexId=vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95]
2016-01-14 16:08:31,490 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=87508F69736E485CB1F876E466309F4B, vertexName=EA1DCDF3327B43328E550AB68DB04F95, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:31,490 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=87508F69736E485CB1F876E466309F4B, vertexId=vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95]
2016-01-14 16:08:31,490 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711324_0001_1][Event:VERTEX_INITIALIZED]: vertexName=EA1DCDF3327B43328E550AB68DB04F95, vertexId=vertex_1452787711324_0001_1_00, initRequestedTime=1452787711481, initedTime=1452787711490, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:31,491 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95] with distanceFromRoot: 0
2016-01-14 16:08:31,490 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:31,491 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:31,491 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in EA1DCDF3327B43328E550AB68DB04F95
2016-01-14 16:08:31,491 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95]
2016-01-14 16:08:31,492 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:31,492 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711324_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787711324_0001_1_00, startRequestedTime=1452787711491, startedTime=1452787711491
2016-01-14 16:08:31,492 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:31,492 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:31,492 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711324_0001_1][Event:TASK_STARTED]: vertexName=EA1DCDF3327B43328E550AB68DB04F95, taskId=task_1452787711324_0001_1_00_000000, scheduledTime=1452787711492, launchTime=1452787711492
2016-01-14 16:08:31,493 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787711324_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:31,493 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95]
2016-01-14 16:08:31,493 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [BF493EB3DA584EACAEA24208889D1C51/F16596D96DFE4F219160E90D58C7E7B8] every.every/(1/1) ...'_RESULTS.ALL_'field2'_-1, VertexName: EA1DCDF3327B43328E550AB68DB04F95, VertexParallelism: 1, TaskAttemptID:attempt_1452787711324_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=05D938E472DC4151B02FCF82FD0D7C7A, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=87508F69736E485CB1F876E466309F4B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:31,493 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787711324_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:31,494 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:31,494 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:31,495 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:31,495 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:31,495 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787711324_0001_00_000001
2016-01-14 16:08:31,495 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787711324_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:31,496 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787711324_0001_00_000001
2016-01-14 16:08:31,497 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:31,497 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787711324_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:31,497 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:31,498 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711324_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787711324_0001_00_000001, launchTime=1452787711497
2016-01-14 16:08:31,498 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787711324_0001_00_000001
2016-01-14 16:08:31,499 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787711324_0001_1_00_000000_0] to container: [container_1452787711324_0001_00_000001]
2016-01-14 16:08:31,499 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787711324_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:31,500 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787711324_0001_1_00_000000_0] started. Is using containerId: [container_1452787711324_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:31,500 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711324_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=EA1DCDF3327B43328E550AB68DB04F95, taskAttemptId=attempt_1452787711324_0001_1_00_000000_0, startTime=1452787711499, containerId=container_1452787711324_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787711324_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:31,500 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787711324_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:31,500 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787711324_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:31,500 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:31,500 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787711324_0001, with dag id: dag_1452787711324_0001_1
2016-01-14 16:08:31,501 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787711324_0001_00_000001 given task: attempt_1452787711324_0001_1_00_000000_0
2016-01-14 16:08:31,501 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787711324_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787711324_0001_1_00_000000_0
2016-01-14 16:08:31 Starting to run new task attempt: attempt_1452787711324_0001_1_00_000000_0
2016-01-14 16:08:31,502 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787711324_0001_1_00_000000_0
2016-01-14 16:08:31,502 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:31,502 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:31,502 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:31,502 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:31,502 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:31,502 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:31,502 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [BF493EB3DA584EACAEA24208889D1C51/F16596D96DFE4F219160E90D58C7E7B8] every.every/(1/1) ...'_RESULTS.ALL_'field2'_-1, VertexName: EA1DCDF3327B43328E550AB68DB04F95, VertexParallelism: 1, TaskAttemptID:attempt_1452787711324_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=05D938E472DC4151B02FCF82FD0D7C7A, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=87508F69736E485CB1F876E466309F4B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:31,502 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:31,503 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787711324_0001_1_00_000000_0
2016-01-14 16:08:31,503 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:31,503 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:31,504 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=05D938E472DC4151B02FCF82FD0D7C7A, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:31,505 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:31,505 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:31,505 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 05D938E472DC4151B02FCF82FD0D7C7A
2016-01-14 16:08:31,505 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 05D938E472DC4151B02FCF82FD0D7C7A
2016-01-14 16:08:31,507 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:31,507 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 05D938E472DC4151B02FCF82FD0D7C7A
2016-01-14 16:08:31,507 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:31,509 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 05D938E472DC4151B02FCF82FD0D7C7A
2016-01-14 16:08:31,509 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=87508F69736E485CB1F876E466309F4B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:31,510 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:31,510 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 87508F69736E485CB1F876E466309F4B
2016-01-14 16:08:31,510 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:31,510 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 87508F69736E485CB1F876E466309F4B
2016-01-14 16:08:31,509 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787711324_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:31,520 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: EA1DCDF3327B43328E550AB68DB04F95, ordinal: 0
2016-01-14 16:08:31,520 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: EA1DCDF3327B43328E550AB68DB04F95, mem on start (mb), free: 226, total: 385, max: 672
2016-01-14 16:08:31,520 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:31,521 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:31,521 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:31,522 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 87508F69736E485CB1F876E466309F4B
2016-01-14 16:08:31,521 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:31,522 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:31,522 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:31,522 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:31,524 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:31,524 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:31,524 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:31,524 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:31,525 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:31,526 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 05D938E472DC4151B02FCF82FD0D7C7A, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:31,526 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 87508F69736E485CB1F876E466309F4B, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:31,526 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:31,526 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 05D938E472DC4151B02FCF82FD0D7C7A being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:31,526 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:31,527 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:31,527 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 05D938E472DC4151B02FCF82FD0D7C7A
2016-01-14 16:08:31,527 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:31,527 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 05D938E472DC4151B02FCF82FD0D7C7A
2016-01-14 16:08:31,527 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:31,528 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787711324_0001_1_00_000000_0
2016-01-14 16:08:31,530 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:31,531 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:31,532 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@74eb350
2016-01-14 16:08:31,532 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 05D938E472DC4151B02FCF82FD0D7C7A
2016-01-14 16:08:31,532 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_-1"], id: 87508F69736E485CB1F876E466309F4B
2016-01-14 16:08:31,532 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_-1"]
2016-01-14 16:08:31,533 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:31,533 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:31,534 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@74eb350
2016-01-14 16:08:31,534 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:31,534 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:31,535 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: EA1DCDF3327B43328E550AB68DB04F95, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:31,538 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:31,538 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:31,538 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787711324_0001_1_00_000000_0
2016-01-14 16:08:31,539 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787711324_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:31,539 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787711324_0001_1_00_000000_0
2016-01-14 16:08:31,539 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: EA1DCDF3327B43328E550AB68DB04F95, mem on close (mb), free: 224, total: 385, max: 672
2016-01-14 16:08:31 Completed running task attempt: attempt_1452787711324_0001_1_00_000000_0
2016-01-14 16:08:31,540 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787711324_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:31,541 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787711535, Process_Duration=4, Process_End_Time=1452787711539, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:31,542 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:31,542 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:31,542 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:31,542 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787711324_0001_00_000001
2016-01-14 16:08:31,542 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711324_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=EA1DCDF3327B43328E550AB68DB04F95, taskAttemptId=attempt_1452787711324_0001_1_00_000000_0, startTime=1452787711499, finishTime=1452787711541, timeTaken=42, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787711535, Process_Duration=4, Process_End_Time=1452787711539, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:31,543 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787711324_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:31,543 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787711324_0001_1_00_000000_0
2016-01-14 16:08:31,544 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711324_0001_1][Event:TASK_FINISHED]: vertexName=EA1DCDF3327B43328E550AB68DB04F95, taskId=task_1452787711324_0001_1_00_000000, startTime=1452787711499, finishTime=1452787711543, timeTaken=44, status=SUCCEEDED, successfulAttemptID=attempt_1452787711324_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787711535, Process_Duration=4, Process_End_Time=1452787711539, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:31,544 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787711324_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:31,544 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95] : 1
2016-01-14 16:08:31,544 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95]
2016-01-14 16:08:31,545 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711324_0001_1][Event:VERTEX_FINISHED]: vertexName=EA1DCDF3327B43328E550AB68DB04F95, vertexId=vertex_1452787711324_0001_1_00, initRequestedTime=1452787711481, initedTime=1452787711490, startRequestedTime=1452787711491, startedTime=1452787711491, finishTime=1452787711544, timeTaken=53, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787711535, Process_Duration=4, Process_End_Time=1452787711539, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787711499, firstTasksToStart=[ task_1452787711324_0001_1_00_000000 ], lastTaskFinishTime=1452787711541, lastTasksToFinish=[ task_1452787711324_0001_1_00_000000 ], minTaskDuration=42, maxTaskDuration=42, avgTaskDuration=42.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787711324_0001_1_00_000000 ], longestDurationTasks=[ task_1452787711324_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:31,545 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:31,545 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:31,545 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787711324_0001_1
2016-01-14 16:08:31,546 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:31,546 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711324_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787711324_0001_1
2016-01-14 16:08:31,546 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 87508F69736E485CB1F876E466309F4B for vertex: vertex_1452787711324_0001_1_00 [EA1DCDF3327B43328E550AB68DB04F95]
2016-01-14 16:08:31,548 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:31,549 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:31,555 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787711324_0001_1, queueSize=0
2016-01-14 16:08:31,556 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:31,556 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711324_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787711324_0001_1, startTime=1452787711481, finishTime=1452787711555, timeTaken=74, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787711535, Process_Duration=4, Process_End_Time=1452787711539, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:31,556 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787711324_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:31,556 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787711324_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:31,556 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787711324_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:31,557 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711324_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787711324_0001_00_000001, stoppedTime=1452787711557, exitStatus=0
2016-01-14 16:08:31,557 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787711324_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:31,557 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:31 Completed Dag: dag_1452787711324_0001_1
2016-01-14 16:08:31,559 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787711324_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:31,560 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787711324_0001_1_post
2016-01-14 16:08:31,560 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:31,561 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:31,562 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1452787711324_0001_00_000001. Relying on regular task shutdown for it to end
2016-01-14 16:08:31,562 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787711324_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 16:08:31,563 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...'_RESULTS.ALL_'field2'_-1, applicationId=application_1452787711324_0001
2016-01-14 16:08:31,566 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:31,566 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:31,566 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:31,566 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:31,566 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:31,566 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:31,567 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:31,568 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:31,568 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:31,568 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:31,568 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:31,569 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:31,569 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:31,569 INFO  task.TezChild (TezChild.java:run(198)) - Interrupted while waiting for new work for container container_1452787711324_0001_00_000001
2016-01-14 16:08:31,569 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787711324_0001_00_000001
2016-01-14 16:08:31,569 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787711324_0001_00_000001
2016-01-14 16:08:31,575 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BF493EB3DA584EACAEA24208889D1C51/F16596D96DFE4F219160E90D58C7E7B8/.tez/application_1452787711324_0001
2016-01-14 16:08:31,575 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.268
2016-01-14 16:08:31,636 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.ALL_'field2'_-1
2016-01-14 16:08:31,657 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:31,657 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:31,662 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:31,662 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:31,688 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.009
2016-01-14 16:08:31,693 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 16:08:31,694 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:31,694 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:31,694 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:31,706 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:31,707 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_'field2'
2016-01-14 16:08:31,719 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:31,719 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:31,720 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_'field2'"]
2016-01-14 16:08:31,720 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:31,720 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:31,720 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:31,721 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...LTS.ALL_'field2'_'field2'
2016-01-14 16:08:31,721 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:31,732 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:31,736 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:31,737 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:31,737 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:31,746 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/20291828A12D476F80A5AC1D619DE6AC/F56EA602376A4D98A6247529D69DDFCF/.tez/application_1452787711736_0001 doesn't exist and is created
2016-01-14 16:08:31,763 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:31,763 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:31,764 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/20291828A12D476F80A5AC1D619DE6AC/F56EA602376A4D98A6247529D69DDFCF/.tez/application_1452787711736_0001
2016-01-14 16:08:31,766 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787711736_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:31,776 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:31,777 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:31,778 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:31,779 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:31,779 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/20291828A12D476F80A5AC1D619DE6AC/F56EA602376A4D98A6247529D69DDFCF/.tez/application_1452787711736_0001/localmode-log-dir
2016-01-14 16:08:31,779 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/20291828A12D476F80A5AC1D619DE6AC/F56EA602376A4D98A6247529D69DDFCF/.tez/application_1452787711736_0001/localmode-log-dir/history.txt.appattempt_1452787711736_0001_000000, maxErrors=10
2016-01-14 16:08:31,779 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:31,780 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787711736_0001_000000, appSubmitTime=1452787711766, launchTime=1452787711766
2016-01-14 16:08:31,785 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:31,786 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:31,787 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:31,787 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:31,787 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:37383
2016-01-14 16:08:31,790 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:31,792 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787711736_0001_000000, startTime=1452787711792
2016-01-14 16:08:31,792 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:31,792 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:31,864 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:31,864 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:31,864 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...LTS.ALL_'field2'_'field2', applicationId=application_1452787711736_0001, dagName=[20291828A12D476F80A5AC1D619DE6AC/F56EA602376A4D98A6247529D69DDFCF] every.every/(1/1) ...LTS.ALL_'field2'_'field2'
2016-01-14 16:08:31,878 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [20291828A12D476F80A5AC1D619DE6AC/F56EA602376A4D98A6247529D69DDFCF] every.every/(1/1) ...LTS.ALL_'field2'_'field2'
2016-01-14 16:08:31,879 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787711736_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/20291828A12D476F80A5AC1D619DE6AC/F56EA602376A4D98A6247529D69DDFCF/.tez/application_1452787711736_0001/localmode-log-dir/dag_1452787711736_0001_1.dot
2016-01-14 16:08:31,880 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/20291828A12D476F80A5AC1D619DE6AC/F56EA602376A4D98A6247529D69DDFCF/.tez/application_1452787711736_0001/localmode-log-dir/dag_1452787711736_0001_1-tez-dag.pb.txt
2016-01-14 16:08:31,883 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787711736_0001_1
2016-01-14 16:08:31,883 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:31,883 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [20291828A12D476F80A5AC1D619DE6AC/F56EA602376A4D98A6247529D69DDFCF] every.every/(1/1) ...LTS.ALL_'field2'_'field2'
2016-01-14 16:08:31 Running Dag: dag_1452787711736_0001_1
2016-01-14 16:08:31,894 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711736_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787711736_0001_1, submitTime=1452787711878
2016-01-14 16:08:31,894 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:31,894 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex C6585B4C7404484EBDEDC6566E2CC253
2016-01-14 16:08:31,894 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:31,895 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711736_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787711736_0001_1, initTime=1452787711894
2016-01-14 16:08:31,895 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:31,896 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787711736_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:31,896 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711736_0001_1][Event:DAG_STARTED]: dagID=dag_1452787711736_0001_1, startTime=1452787711896
2016-01-14 16:08:31,897 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:31,897 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:31,897 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...LTS.ALL_'field2'_'field2', applicationId=application_1452787711736_0001, dagName=[20291828A12D476F80A5AC1D619DE6AC/F56EA602376A4D98A6247529D69DDFCF] every.every/(1/1) ...LTS.ALL_'field2'_'field2'
2016-01-14 16:08:31,897 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787711736_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:31,897 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: C6585B4C7404484EBDEDC6566E2CC253 : {DDD76B4E8BFE4C0BAE9ADBEA7416489B={InputName=DDD76B4E8BFE4C0BAE9ADBEA7416489B}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:31,897 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: DDD76B4E8BFE4C0BAE9ADBEA7416489B, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:31,897 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253]
2016-01-14 16:08:31,897 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253]
2016-01-14 16:08:31,898 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253]
2016-01-14 16:08:31,898 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253]. Starting root input initializers: 1
2016-01-14 16:08:31,898 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:31,899 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: DDD76B4E8BFE4C0BAE9ADBEA7416489B on vertex vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253]
2016-01-14 16:08:31,900 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:31,900 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input DDD76B4E8BFE4C0BAE9ADBEA7416489B asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:31,900 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:31,901 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:31,902 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:31,902 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: DDD76B4E8BFE4C0BAE9ADBEA7416489B on vertex vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253]
2016-01-14 16:08:31,902 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:31,902 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {DDD76B4E8BFE4C0BAE9ADBEA7416489B=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:31,902 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253] parallelism set to 1
2016-01-14 16:08:31,902 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:31,903 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711736_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787711736_0001_1_00, eventCount=1
2016-01-14 16:08:31,903 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253]
2016-01-14 16:08:31,903 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=2E2C7BF193604F5387F2BE7FAA25A903, vertexId=vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:31,903 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=2E2C7BF193604F5387F2BE7FAA25A903, vertexId=vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253]
2016-01-14 16:08:31,905 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=2E2C7BF193604F5387F2BE7FAA25A903, vertexName=C6585B4C7404484EBDEDC6566E2CC253, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:31,905 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=2E2C7BF193604F5387F2BE7FAA25A903, vertexId=vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253]
2016-01-14 16:08:31,906 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:31,906 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711736_0001_1][Event:VERTEX_INITIALIZED]: vertexName=C6585B4C7404484EBDEDC6566E2CC253, vertexId=vertex_1452787711736_0001_1_00, initRequestedTime=1452787711897, initedTime=1452787711906, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:31,906 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253] with distanceFromRoot: 0
2016-01-14 16:08:31,906 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:31,906 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in C6585B4C7404484EBDEDC6566E2CC253
2016-01-14 16:08:31,906 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253]
2016-01-14 16:08:31,907 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:31,907 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711736_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787711736_0001_1_00, startRequestedTime=1452787711906, startedTime=1452787711906
2016-01-14 16:08:31,907 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:31,908 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:31,908 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711736_0001_1][Event:TASK_STARTED]: vertexName=C6585B4C7404484EBDEDC6566E2CC253, taskId=task_1452787711736_0001_1_00_000000, scheduledTime=1452787711907, launchTime=1452787711907
2016-01-14 16:08:31,908 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787711736_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:31,908 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253]
2016-01-14 16:08:31,908 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [20291828A12D476F80A5AC1D619DE6AC/F56EA602376A4D98A6247529D69DDFCF] every.every/(1/1) ...LTS.ALL_'field2'_'field2', VertexName: C6585B4C7404484EBDEDC6566E2CC253, VertexParallelism: 1, TaskAttemptID:attempt_1452787711736_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=DDD76B4E8BFE4C0BAE9ADBEA7416489B, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=2E2C7BF193604F5387F2BE7FAA25A903, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:31,908 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787711736_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:31,909 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:31,909 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:31,910 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:31,910 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:31,910 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787711736_0001_00_000001
2016-01-14 16:08:31,910 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787711736_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:31,912 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787711736_0001_00_000001
2016-01-14 16:08:31,912 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:31,912 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787711736_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:31,913 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:31,913 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711736_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787711736_0001_00_000001, launchTime=1452787711913
2016-01-14 16:08:31,914 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787711736_0001, with dag id: dag_1452787711736_0001_1
2016-01-14 16:08:31,914 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787711736_0001_00_000001
2016-01-14 16:08:31,915 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787711736_0001_1_00_000000_0] to container: [container_1452787711736_0001_00_000001]
2016-01-14 16:08:31,915 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787711736_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:31,915 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787711736_0001_00_000001 given task: attempt_1452787711736_0001_1_00_000000_0
2016-01-14 16:08:31,915 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787711736_0001_1_00_000000_0] started. Is using containerId: [container_1452787711736_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:31,916 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711736_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=C6585B4C7404484EBDEDC6566E2CC253, taskAttemptId=attempt_1452787711736_0001_1_00_000000_0, startTime=1452787711915, containerId=container_1452787711736_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787711736_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:31,916 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787711736_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:31,916 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:31,916 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787711736_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787711736_0001_1_00_000000_0
2016-01-14 16:08:31,916 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787711736_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:31 Starting to run new task attempt: attempt_1452787711736_0001_1_00_000000_0
2016-01-14 16:08:31,917 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787711736_0001_1_00_000000_0
2016-01-14 16:08:31,917 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:31,917 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:31,918 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:31,918 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:31,918 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:31,918 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:31,918 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [20291828A12D476F80A5AC1D619DE6AC/F56EA602376A4D98A6247529D69DDFCF] every.every/(1/1) ...LTS.ALL_'field2'_'field2', VertexName: C6585B4C7404484EBDEDC6566E2CC253, VertexParallelism: 1, TaskAttemptID:attempt_1452787711736_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=DDD76B4E8BFE4C0BAE9ADBEA7416489B, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=2E2C7BF193604F5387F2BE7FAA25A903, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:31,919 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:31,919 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787711736_0001_1_00_000000_0
2016-01-14 16:08:31,919 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:31,919 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:31,920 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:31,921 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=2E2C7BF193604F5387F2BE7FAA25A903, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:31,921 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787711736_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:31,921 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:31,922 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 2E2C7BF193604F5387F2BE7FAA25A903
2016-01-14 16:08:31,922 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:31,922 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 2E2C7BF193604F5387F2BE7FAA25A903
2016-01-14 16:08:31,923 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=DDD76B4E8BFE4C0BAE9ADBEA7416489B, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:31,923 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:31,923 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: DDD76B4E8BFE4C0BAE9ADBEA7416489B
2016-01-14 16:08:31,923 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:31,924 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: DDD76B4E8BFE4C0BAE9ADBEA7416489B
2016-01-14 16:08:31,926 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:31,926 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: DDD76B4E8BFE4C0BAE9ADBEA7416489B
2016-01-14 16:08:31,927 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: DDD76B4E8BFE4C0BAE9ADBEA7416489B
2016-01-14 16:08:31,930 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: C6585B4C7404484EBDEDC6566E2CC253, ordinal: 0
2016-01-14 16:08:31,931 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C6585B4C7404484EBDEDC6566E2CC253, mem on start (mb), free: 151, total: 385, max: 672
2016-01-14 16:08:31,931 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:31,931 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:31,931 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:31,932 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:31,932 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 2E2C7BF193604F5387F2BE7FAA25A903
2016-01-14 16:08:31,933 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:31,933 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:31,933 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:31,933 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:31,934 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:31,934 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:31,934 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:31,934 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:31,934 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 2E2C7BF193604F5387F2BE7FAA25A903, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:31,935 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, DDD76B4E8BFE4C0BAE9ADBEA7416489B, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:31,935 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:31,935 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: DDD76B4E8BFE4C0BAE9ADBEA7416489B
2016-01-14 16:08:31,935 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:31,935 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: DDD76B4E8BFE4C0BAE9ADBEA7416489B
2016-01-14 16:08:31,935 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: DDD76B4E8BFE4C0BAE9ADBEA7416489B being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:31,936 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:31,936 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:31,936 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:31,937 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787711736_0001_1_00_000000_0
2016-01-14 16:08:31,937 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:31,937 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@4bee04f5
2016-01-14 16:08:31,938 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@4bee04f5
2016-01-14 16:08:31,938 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:31,938 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:31,939 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:31,940 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: DDD76B4E8BFE4C0BAE9ADBEA7416489B
2016-01-14 16:08:31,940 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_'field2'"], id: 2E2C7BF193604F5387F2BE7FAA25A903
2016-01-14 16:08:31,940 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_'field2'"]
2016-01-14 16:08:31,941 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:31,941 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:31,941 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: C6585B4C7404484EBDEDC6566E2CC253, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:31,944 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:31,944 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:31,944 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787711736_0001_1_00_000000_0
2016-01-14 16:08:31,945 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787711736_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:31,945 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787711736_0001_1_00_000000_0
2016-01-14 16:08:31,945 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C6585B4C7404484EBDEDC6566E2CC253, mem on close (mb), free: 150, total: 385, max: 672
2016-01-14 16:08:31 Completed running task attempt: attempt_1452787711736_0001_1_00_000000_0
2016-01-14 16:08:31,947 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787711736_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:31,948 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787711941, Process_Duration=4, Process_End_Time=1452787711945, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:31,948 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:31,948 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:31,948 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711736_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=C6585B4C7404484EBDEDC6566E2CC253, taskAttemptId=attempt_1452787711736_0001_1_00_000000_0, startTime=1452787711915, finishTime=1452787711948, timeTaken=33, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787711941, Process_Duration=4, Process_End_Time=1452787711945, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:31,949 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787711736_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:31,949 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:31,949 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787711736_0001_00_000001
2016-01-14 16:08:31,949 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787711736_0001_1_00_000000_0
2016-01-14 16:08:31,949 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:31,951 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711736_0001_1][Event:TASK_FINISHED]: vertexName=C6585B4C7404484EBDEDC6566E2CC253, taskId=task_1452787711736_0001_1_00_000000, startTime=1452787711915, finishTime=1452787711950, timeTaken=35, status=SUCCEEDED, successfulAttemptID=attempt_1452787711736_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787711941, Process_Duration=4, Process_End_Time=1452787711945, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:31,951 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787711736_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:31,951 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253] : 1
2016-01-14 16:08:31,951 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253]
2016-01-14 16:08:31,951 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:31,952 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:31,952 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711736_0001_1][Event:VERTEX_FINISHED]: vertexName=C6585B4C7404484EBDEDC6566E2CC253, vertexId=vertex_1452787711736_0001_1_00, initRequestedTime=1452787711897, initedTime=1452787711906, startRequestedTime=1452787711906, startedTime=1452787711906, finishTime=1452787711951, timeTaken=45, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787711941, Process_Duration=4, Process_End_Time=1452787711945, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787711915, firstTasksToStart=[ task_1452787711736_0001_1_00_000000 ], lastTaskFinishTime=1452787711948, lastTasksToFinish=[ task_1452787711736_0001_1_00_000000 ], minTaskDuration=33, maxTaskDuration=33, avgTaskDuration=33.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787711736_0001_1_00_000000 ], longestDurationTasks=[ task_1452787711736_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:31,952 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:31,953 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787711736_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:31,953 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711736_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787711736_0001_00_000001, stoppedTime=1452787711953, exitStatus=0
2016-01-14 16:08:31,953 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:31,953 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787711736_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:31,954 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:31,954 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787711736_0001_1
2016-01-14 16:08:31,954 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711736_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787711736_0001_1
2016-01-14 16:08:31,954 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 2E2C7BF193604F5387F2BE7FAA25A903 for vertex: vertex_1452787711736_0001_1_00 [C6585B4C7404484EBDEDC6566E2CC253]
2016-01-14 16:08:31,961 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787711736_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:31,961 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787711736_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:31,961 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787711736_0001_00_000001, Exiting
2016-01-14 16:08:31,961 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787711736_0001_00_000001
2016-01-14 16:08:31,961 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787711736_0001_00_000001
2016-01-14 16:08:31,962 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787711736_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:31,962 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787711736_0001_00_000001 completed successfully
2016-01-14 16:08:31,963 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787711736_0001_1, queueSize=0
2016-01-14 16:08:31,963 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:31,964 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787711736_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787711736_0001_1, startTime=1452787711896, finishTime=1452787711961, timeTaken=65, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787711941, Process_Duration=4, Process_End_Time=1452787711945, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:31,964 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787711736_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:31,964 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787711736_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:31,964 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787711736_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:31,964 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787711736_0001_00_000001
2016-01-14 16:08:31 Completed Dag: dag_1452787711736_0001_1
2016-01-14 16:08:31,965 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787711736_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:31,965 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787711736_0001_1_post
2016-01-14 16:08:31,965 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:31,965 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:31,970 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...LTS.ALL_'field2'_'field2', applicationId=application_1452787711736_0001
2016-01-14 16:08:31,971 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:31,971 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:31,971 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:31,971 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:31,972 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:31,972 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:31,972 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:31,973 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:31,973 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:31,973 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:31,973 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:31,973 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:31,973 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:31,977 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/20291828A12D476F80A5AC1D619DE6AC/F56EA602376A4D98A6247529D69DDFCF/.tez/application_1452787711736_0001
2016-01-14 16:08:31,978 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.259
2016-01-14 16:08:32,038 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.ALL_'field2'_'field2'
2016-01-14 16:08:32,058 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:32,058 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:32,098 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.006
2016-01-14 16:08:32,106 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 16:08:32,106 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:32,107 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:32,107 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:32,120 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:32,121 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:32,121 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:32,121 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_'field'
2016-01-14 16:08:32,129 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:32,129 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:32,130 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_'field'"]
2016-01-14 16:08:32,130 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:32,130 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:32,130 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:32,130 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ULTS.ALL_'field2'_'field'
2016-01-14 16:08:32,131 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:32,141 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:32,146 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:32,146 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:32,147 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:32,155 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/80B2A1847DF34FF7BD55EE104288E191/B58094069673401F9D2F5445977507C1/.tez/application_1452787712146_0001 doesn't exist and is created
2016-01-14 16:08:32,170 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:32,170 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:32,170 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/80B2A1847DF34FF7BD55EE104288E191/B58094069673401F9D2F5445977507C1/.tez/application_1452787712146_0001
2016-01-14 16:08:32,172 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787712146_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:32,182 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:32,183 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:32,184 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:32,184 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:32,184 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/80B2A1847DF34FF7BD55EE104288E191/B58094069673401F9D2F5445977507C1/.tez/application_1452787712146_0001/localmode-log-dir
2016-01-14 16:08:32,185 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/80B2A1847DF34FF7BD55EE104288E191/B58094069673401F9D2F5445977507C1/.tez/application_1452787712146_0001/localmode-log-dir/history.txt.appattempt_1452787712146_0001_000000, maxErrors=10
2016-01-14 16:08:32,185 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:32,185 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787712146_0001_000000, appSubmitTime=1452787712172, launchTime=1452787712172
2016-01-14 16:08:32,188 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:32,189 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:32,191 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:32,191 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:32,191 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:47378
2016-01-14 16:08:32,193 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:32,195 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787712146_0001_000000, startTime=1452787712195
2016-01-14 16:08:32,195 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:32,195 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:32,270 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:32,270 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:32,270 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ULTS.ALL_'field2'_'field', applicationId=application_1452787712146_0001, dagName=[80B2A1847DF34FF7BD55EE104288E191/B58094069673401F9D2F5445977507C1] every.every/(1/1) ...ULTS.ALL_'field2'_'field'
2016-01-14 16:08:32,284 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [80B2A1847DF34FF7BD55EE104288E191/B58094069673401F9D2F5445977507C1] every.every/(1/1) ...ULTS.ALL_'field2'_'field'
2016-01-14 16:08:32,285 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787712146_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/80B2A1847DF34FF7BD55EE104288E191/B58094069673401F9D2F5445977507C1/.tez/application_1452787712146_0001/localmode-log-dir/dag_1452787712146_0001_1.dot
2016-01-14 16:08:32,286 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/80B2A1847DF34FF7BD55EE104288E191/B58094069673401F9D2F5445977507C1/.tez/application_1452787712146_0001/localmode-log-dir/dag_1452787712146_0001_1-tez-dag.pb.txt
2016-01-14 16:08:32,289 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787712146_0001_1
2016-01-14 16:08:32,289 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:32,290 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [80B2A1847DF34FF7BD55EE104288E191/B58094069673401F9D2F5445977507C1] every.every/(1/1) ...ULTS.ALL_'field2'_'field'
2016-01-14 16:08:32 Running Dag: dag_1452787712146_0001_1
2016-01-14 16:08:32,300 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:32,300 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712146_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787712146_0001_1, submitTime=1452787712284
2016-01-14 16:08:32,301 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex C90E89E8F980496FB143D443BC809353
2016-01-14 16:08:32,302 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:32,302 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:32,302 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712146_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787712146_0001_1, initTime=1452787712301
2016-01-14 16:08:32,303 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787712146_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:32,304 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:32,304 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712146_0001_1][Event:DAG_STARTED]: dagID=dag_1452787712146_0001_1, startTime=1452787712304
2016-01-14 16:08:32,304 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:32,304 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787712146_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:32,304 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: C90E89E8F980496FB143D443BC809353 : {B9985739457444919AE283F078B58835={InputName=B9985739457444919AE283F078B58835}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:32,304 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ULTS.ALL_'field2'_'field', applicationId=application_1452787712146_0001, dagName=[80B2A1847DF34FF7BD55EE104288E191/B58094069673401F9D2F5445977507C1] every.every/(1/1) ...ULTS.ALL_'field2'_'field'
2016-01-14 16:08:32,304 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: B9985739457444919AE283F078B58835, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:32,305 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353]
2016-01-14 16:08:32,305 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353]
2016-01-14 16:08:32,305 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353]
2016-01-14 16:08:32,305 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353]. Starting root input initializers: 1
2016-01-14 16:08:32,306 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:32,306 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: B9985739457444919AE283F078B58835 on vertex vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353]
2016-01-14 16:08:32,307 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:32,308 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input B9985739457444919AE283F078B58835 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:32,308 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:32,308 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:32,309 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:32,310 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: B9985739457444919AE283F078B58835 on vertex vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353]
2016-01-14 16:08:32,310 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:32,310 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {B9985739457444919AE283F078B58835=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:32,310 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353] parallelism set to 1
2016-01-14 16:08:32,310 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:32,310 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712146_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787712146_0001_1_00, eventCount=1
2016-01-14 16:08:32,310 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353]
2016-01-14 16:08:32,310 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=018CB6C826F8494E8663BEDF31F7898A, vertexId=vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:32,311 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=018CB6C826F8494E8663BEDF31F7898A, vertexId=vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353]
2016-01-14 16:08:32,312 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=018CB6C826F8494E8663BEDF31F7898A, vertexName=C90E89E8F980496FB143D443BC809353, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:32,312 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=018CB6C826F8494E8663BEDF31F7898A, vertexId=vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353]
2016-01-14 16:08:32,313 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712146_0001_1][Event:VERTEX_INITIALIZED]: vertexName=C90E89E8F980496FB143D443BC809353, vertexId=vertex_1452787712146_0001_1_00, initRequestedTime=1452787712304, initedTime=1452787712313, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:32,313 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353] with distanceFromRoot: 0
2016-01-14 16:08:32,313 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:32,313 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:32,317 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in C90E89E8F980496FB143D443BC809353
2016-01-14 16:08:32,317 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353]
2016-01-14 16:08:32,317 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712146_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787712146_0001_1_00, startRequestedTime=1452787712317, startedTime=1452787712317
2016-01-14 16:08:32,317 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:32,318 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:32,318 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:32,318 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712146_0001_1][Event:TASK_STARTED]: vertexName=C90E89E8F980496FB143D443BC809353, taskId=task_1452787712146_0001_1_00_000000, scheduledTime=1452787712318, launchTime=1452787712318
2016-01-14 16:08:32,319 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787712146_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:32,319 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353]
2016-01-14 16:08:32,319 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [80B2A1847DF34FF7BD55EE104288E191/B58094069673401F9D2F5445977507C1] every.every/(1/1) ...ULTS.ALL_'field2'_'field', VertexName: C90E89E8F980496FB143D443BC809353, VertexParallelism: 1, TaskAttemptID:attempt_1452787712146_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=B9985739457444919AE283F078B58835, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=018CB6C826F8494E8663BEDF31F7898A, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:32,319 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787712146_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:32,320 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:32,320 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787712146_0001, with dag id: dag_1452787712146_0001_1
2016-01-14 16:08:32,321 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:32,321 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:32,322 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:32,322 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787712146_0001_00_000001
2016-01-14 16:08:32,322 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787712146_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:32,324 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787712146_0001_00_000001
2016-01-14 16:08:32,324 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:32,325 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787712146_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:32,326 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:32,326 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712146_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787712146_0001_00_000001, launchTime=1452787712325
2016-01-14 16:08:32,326 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787712146_0001_00_000001
2016-01-14 16:08:32,327 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787712146_0001_1_00_000000_0] to container: [container_1452787712146_0001_00_000001]
2016-01-14 16:08:32,327 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787712146_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:32,327 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787712146_0001_00_000001 given task: attempt_1452787712146_0001_1_00_000000_0
2016-01-14 16:08:32,327 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787712146_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787712146_0001_1_00_000000_0
2016-01-14 16:08:32,327 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787712146_0001_1_00_000000_0] started. Is using containerId: [container_1452787712146_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:32,328 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712146_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=C90E89E8F980496FB143D443BC809353, taskAttemptId=attempt_1452787712146_0001_1_00_000000_0, startTime=1452787712327, containerId=container_1452787712146_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787712146_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:32,328 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787712146_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:32,328 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:32,328 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787712146_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:32 Starting to run new task attempt: attempt_1452787712146_0001_1_00_000000_0
2016-01-14 16:08:32,328 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787712146_0001_1_00_000000_0
2016-01-14 16:08:32,329 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:32,329 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:32,329 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:32,329 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:32,329 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:32,329 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:32,330 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [80B2A1847DF34FF7BD55EE104288E191/B58094069673401F9D2F5445977507C1] every.every/(1/1) ...ULTS.ALL_'field2'_'field', VertexName: C90E89E8F980496FB143D443BC809353, VertexParallelism: 1, TaskAttemptID:attempt_1452787712146_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=B9985739457444919AE283F078B58835, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=018CB6C826F8494E8663BEDF31F7898A, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:32,330 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:32,332 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787712146_0001_1_00_000000_0
2016-01-14 16:08:32,333 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:32,333 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:32,333 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=B9985739457444919AE283F078B58835, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:32,334 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:32,334 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: B9985739457444919AE283F078B58835
2016-01-14 16:08:32,334 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: B9985739457444919AE283F078B58835
2016-01-14 16:08:32,334 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787712146_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:32,337 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:32,337 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=018CB6C826F8494E8663BEDF31F7898A, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:32,338 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:32,338 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 018CB6C826F8494E8663BEDF31F7898A
2016-01-14 16:08:32,338 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:32,338 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 018CB6C826F8494E8663BEDF31F7898A
2016-01-14 16:08:32,340 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:32,343 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:32,343 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: B9985739457444919AE283F078B58835
2016-01-14 16:08:32,344 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: B9985739457444919AE283F078B58835
2016-01-14 16:08:32,346 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:32,347 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 018CB6C826F8494E8663BEDF31F7898A
2016-01-14 16:08:32,347 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: C90E89E8F980496FB143D443BC809353, ordinal: 0
2016-01-14 16:08:32,347 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C90E89E8F980496FB143D443BC809353, mem on start (mb), free: 285, total: 386, max: 672
2016-01-14 16:08:32,347 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:32,348 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:32,348 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:32,348 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:32,348 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:32,348 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:32,348 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:32,349 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:32,349 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:32,349 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:32,349 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:32,350 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, B9985739457444919AE283F078B58835, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:32,350 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 018CB6C826F8494E8663BEDF31F7898A, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:32,350 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:32,350 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: B9985739457444919AE283F078B58835
2016-01-14 16:08:32,351 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:32,351 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: B9985739457444919AE283F078B58835
2016-01-14 16:08:32,351 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: B9985739457444919AE283F078B58835 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:32,351 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:32,352 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:32,352 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:32,352 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787712146_0001_1_00_000000_0
2016-01-14 16:08:32,352 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:32,353 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@8c896ca
2016-01-14 16:08:32,354 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@8c896ca
2016-01-14 16:08:32,354 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:32,354 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:32,356 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:32,357 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: B9985739457444919AE283F078B58835
2016-01-14 16:08:32,357 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_'field'"], id: 018CB6C826F8494E8663BEDF31F7898A
2016-01-14 16:08:32,357 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_'field'"]
2016-01-14 16:08:32,358 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:32,358 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:32,358 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: C90E89E8F980496FB143D443BC809353, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:32,361 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:32,361 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:32,362 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787712146_0001_1_00_000000_0
2016-01-14 16:08:32,362 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787712146_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:32,363 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787712146_0001_1_00_000000_0
2016-01-14 16:08:32,363 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C90E89E8F980496FB143D443BC809353, mem on close (mb), free: 283, total: 386, max: 672
2016-01-14 16:08:32 Completed running task attempt: attempt_1452787712146_0001_1_00_000000_0
2016-01-14 16:08:32,364 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787712146_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:32,365 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787712358, Process_Duration=5, Process_End_Time=1452787712363, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:32,365 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:32,365 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712146_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=C90E89E8F980496FB143D443BC809353, taskAttemptId=attempt_1452787712146_0001_1_00_000000_0, startTime=1452787712327, finishTime=1452787712365, timeTaken=38, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787712358, Process_Duration=5, Process_End_Time=1452787712363, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:32,366 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787712146_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:32,366 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:32,366 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:32,366 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787712146_0001_00_000001
2016-01-14 16:08:32,366 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787712146_0001_1_00_000000_0
2016-01-14 16:08:32,366 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:32,368 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712146_0001_1][Event:TASK_FINISHED]: vertexName=C90E89E8F980496FB143D443BC809353, taskId=task_1452787712146_0001_1_00_000000, startTime=1452787712327, finishTime=1452787712368, timeTaken=41, status=SUCCEEDED, successfulAttemptID=attempt_1452787712146_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787712358, Process_Duration=5, Process_End_Time=1452787712363, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:32,369 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:32,369 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787712146_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:32,369 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353] : 1
2016-01-14 16:08:32,369 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353]
2016-01-14 16:08:32,370 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712146_0001_1][Event:VERTEX_FINISHED]: vertexName=C90E89E8F980496FB143D443BC809353, vertexId=vertex_1452787712146_0001_1_00, initRequestedTime=1452787712304, initedTime=1452787712313, startRequestedTime=1452787712317, startedTime=1452787712317, finishTime=1452787712369, timeTaken=52, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787712358, Process_Duration=5, Process_End_Time=1452787712363, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787712327, firstTasksToStart=[ task_1452787712146_0001_1_00_000000 ], lastTaskFinishTime=1452787712365, lastTasksToFinish=[ task_1452787712146_0001_1_00_000000 ], minTaskDuration=38, maxTaskDuration=38, avgTaskDuration=38.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787712146_0001_1_00_000000 ], longestDurationTasks=[ task_1452787712146_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:32,370 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:32,370 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787712146_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:32,370 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:32,370 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712146_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787712146_0001_00_000001, stoppedTime=1452787712370, exitStatus=0
2016-01-14 16:08:32,371 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787712146_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:32,371 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:32,371 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787712146_0001_1
2016-01-14 16:08:32,371 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712146_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787712146_0001_1
2016-01-14 16:08:32,371 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:32,371 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 018CB6C826F8494E8663BEDF31F7898A for vertex: vertex_1452787712146_0001_1_00 [C90E89E8F980496FB143D443BC809353]
2016-01-14 16:08:32,377 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787712146_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:32,377 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787712146_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:32,377 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787712146_0001_00_000001, Exiting
2016-01-14 16:08:32,377 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787712146_0001_00_000001
2016-01-14 16:08:32,377 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787712146_0001_00_000001
2016-01-14 16:08:32,378 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787712146_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:32,379 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787712146_0001_00_000001 completed successfully
2016-01-14 16:08:32,380 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787712146_0001_1, queueSize=0
2016-01-14 16:08:32,380 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:32,381 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712146_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787712146_0001_1, startTime=1452787712304, finishTime=1452787712379, timeTaken=75, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787712358, Process_Duration=5, Process_End_Time=1452787712363, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:32,381 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787712146_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:32,381 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787712146_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:32,382 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787712146_0001_00_000001
2016-01-14 16:08:32,382 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787712146_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:32 Completed Dag: dag_1452787712146_0001_1
2016-01-14 16:08:32,383 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787712146_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:32,383 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787712146_0001_1_post
2016-01-14 16:08:32,383 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:32,384 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:32,387 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ULTS.ALL_'field2'_'field', applicationId=application_1452787712146_0001
2016-01-14 16:08:32,389 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:32,389 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:32,389 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:32,389 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:32,389 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:32,390 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:32,390 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:32,390 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:32,390 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:32,391 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:32,391 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:32,391 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:32,392 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:32,395 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/80B2A1847DF34FF7BD55EE104288E191/B58094069673401F9D2F5445977507C1/.tez/application_1452787712146_0001
2016-01-14 16:08:32,396 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.266
2016-01-14 16:08:32,458 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.ALL_'field2'_'field'
2016-01-14 16:08:32,477 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:32,478 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:32,508 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.009
2016-01-14 16:08:32,514 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.015
2016-01-14 16:08:32,515 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:32,515 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:32,515 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:32,529 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:32,530 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_RESULTS
2016-01-14 16:08:32,542 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:32,542 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:32,542 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_RESULTS"]
2016-01-14 16:08:32,543 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:32,543 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:32,543 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:32,544 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ULTS.ALL_'field2'_RESULTS
2016-01-14 16:08:32,544 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:32,558 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:32,562 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:32,562 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:32,563 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:32,570 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:32,570 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:32,571 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4EF5BF8C67D14EF08E0D5943AA6DEAE4/E2C69495C8624F208105A703BC17B87D/.tez/application_1452787712562_0001 doesn't exist and is created
2016-01-14 16:08:32,587 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:32,587 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:32,587 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4EF5BF8C67D14EF08E0D5943AA6DEAE4/E2C69495C8624F208105A703BC17B87D/.tez/application_1452787712562_0001
2016-01-14 16:08:32,590 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787712562_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:32,599 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:32,600 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:32,601 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:32,601 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:32,601 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4EF5BF8C67D14EF08E0D5943AA6DEAE4/E2C69495C8624F208105A703BC17B87D/.tez/application_1452787712562_0001/localmode-log-dir
2016-01-14 16:08:32,601 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4EF5BF8C67D14EF08E0D5943AA6DEAE4/E2C69495C8624F208105A703BC17B87D/.tez/application_1452787712562_0001/localmode-log-dir/history.txt.appattempt_1452787712562_0001_000000, maxErrors=10
2016-01-14 16:08:32,601 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:32,602 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787712562_0001_000000, appSubmitTime=1452787712589, launchTime=1452787712589
2016-01-14 16:08:32,605 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:32,606 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:32,606 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:32,609 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:51354
2016-01-14 16:08:32,609 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:32,610 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:32,612 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787712562_0001_000000, startTime=1452787712612
2016-01-14 16:08:32,612 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:32,612 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:32,687 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:32,687 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:32,687 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ULTS.ALL_'field2'_RESULTS, applicationId=application_1452787712562_0001, dagName=[4EF5BF8C67D14EF08E0D5943AA6DEAE4/E2C69495C8624F208105A703BC17B87D] every.every/(1/1) ...ULTS.ALL_'field2'_RESULTS
2016-01-14 16:08:32,701 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [4EF5BF8C67D14EF08E0D5943AA6DEAE4/E2C69495C8624F208105A703BC17B87D] every.every/(1/1) ...ULTS.ALL_'field2'_RESULTS
2016-01-14 16:08:32,703 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787712562_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4EF5BF8C67D14EF08E0D5943AA6DEAE4/E2C69495C8624F208105A703BC17B87D/.tez/application_1452787712562_0001/localmode-log-dir/dag_1452787712562_0001_1.dot
2016-01-14 16:08:32,703 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4EF5BF8C67D14EF08E0D5943AA6DEAE4/E2C69495C8624F208105A703BC17B87D/.tez/application_1452787712562_0001/localmode-log-dir/dag_1452787712562_0001_1-tez-dag.pb.txt
2016-01-14 16:08:32,707 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787712562_0001_1
2016-01-14 16:08:32,707 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:32,707 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [4EF5BF8C67D14EF08E0D5943AA6DEAE4/E2C69495C8624F208105A703BC17B87D] every.every/(1/1) ...ULTS.ALL_'field2'_RESULTS
2016-01-14 16:08:32 Running Dag: dag_1452787712562_0001_1
2016-01-14 16:08:32,718 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712562_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787712562_0001_1, submitTime=1452787712701
2016-01-14 16:08:32,718 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:32,719 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex B8DB6D74EEE1488DA4486759BEC083A6
2016-01-14 16:08:32,719 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:32,720 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712562_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787712562_0001_1, initTime=1452787712719
2016-01-14 16:08:32,720 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787712562_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:32,720 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712562_0001_1][Event:DAG_STARTED]: dagID=dag_1452787712562_0001_1, startTime=1452787712720
2016-01-14 16:08:32,720 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:32,720 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ULTS.ALL_'field2'_RESULTS, applicationId=application_1452787712562_0001, dagName=[4EF5BF8C67D14EF08E0D5943AA6DEAE4/E2C69495C8624F208105A703BC17B87D] every.every/(1/1) ...ULTS.ALL_'field2'_RESULTS
2016-01-14 16:08:32,720 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787712562_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:32,721 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: B8DB6D74EEE1488DA4486759BEC083A6 : {5142FD3C5AD840A7A728BAB7671F70FC={InputName=5142FD3C5AD840A7A728BAB7671F70FC}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:32,721 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 5142FD3C5AD840A7A728BAB7671F70FC, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:32,721 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6]
2016-01-14 16:08:32,721 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6]
2016-01-14 16:08:32,721 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6]
2016-01-14 16:08:32,720 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:32,721 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6]. Starting root input initializers: 1
2016-01-14 16:08:32,722 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:32,721 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:32,723 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 5142FD3C5AD840A7A728BAB7671F70FC on vertex vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6]
2016-01-14 16:08:32,724 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:32,725 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 5142FD3C5AD840A7A728BAB7671F70FC asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:32,725 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:32,725 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:32,727 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:32,727 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 5142FD3C5AD840A7A728BAB7671F70FC on vertex vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6]
2016-01-14 16:08:32,727 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:32,727 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {5142FD3C5AD840A7A728BAB7671F70FC=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:32,728 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6] parallelism set to 1
2016-01-14 16:08:32,728 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:32,728 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712562_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787712562_0001_1_00, eventCount=1
2016-01-14 16:08:32,728 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6]
2016-01-14 16:08:32,728 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=AC1BFCFF9B094EBC99550C9201B48B30, vertexId=vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:32,728 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=AC1BFCFF9B094EBC99550C9201B48B30, vertexId=vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6]
2016-01-14 16:08:32,730 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=AC1BFCFF9B094EBC99550C9201B48B30, vertexName=B8DB6D74EEE1488DA4486759BEC083A6, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:32,730 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=AC1BFCFF9B094EBC99550C9201B48B30, vertexId=vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6]
2016-01-14 16:08:32,731 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712562_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B8DB6D74EEE1488DA4486759BEC083A6, vertexId=vertex_1452787712562_0001_1_00, initRequestedTime=1452787712721, initedTime=1452787712731, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:32,731 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:32,732 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6] with distanceFromRoot: 0
2016-01-14 16:08:32,732 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:32,732 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in B8DB6D74EEE1488DA4486759BEC083A6
2016-01-14 16:08:32,732 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6]
2016-01-14 16:08:32,733 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:32,733 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712562_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787712562_0001_1_00, startRequestedTime=1452787712732, startedTime=1452787712732
2016-01-14 16:08:32,733 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:32,734 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:32,734 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712562_0001_1][Event:TASK_STARTED]: vertexName=B8DB6D74EEE1488DA4486759BEC083A6, taskId=task_1452787712562_0001_1_00_000000, scheduledTime=1452787712733, launchTime=1452787712733
2016-01-14 16:08:32,734 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787712562_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:32,734 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6]
2016-01-14 16:08:32,735 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [4EF5BF8C67D14EF08E0D5943AA6DEAE4/E2C69495C8624F208105A703BC17B87D] every.every/(1/1) ...ULTS.ALL_'field2'_RESULTS, VertexName: B8DB6D74EEE1488DA4486759BEC083A6, VertexParallelism: 1, TaskAttemptID:attempt_1452787712562_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=5142FD3C5AD840A7A728BAB7671F70FC, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=AC1BFCFF9B094EBC99550C9201B48B30, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:32,735 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787712562_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:32,735 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:32,736 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:32,736 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:32,736 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:32,737 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787712562_0001_00_000001
2016-01-14 16:08:32,737 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787712562_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:32,738 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787712562_0001_00_000001
2016-01-14 16:08:32,738 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787712562_0001, with dag id: dag_1452787712562_0001_1
2016-01-14 16:08:32,738 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:32,739 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787712562_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:32,739 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:32,740 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712562_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787712562_0001_00_000001, launchTime=1452787712739
2016-01-14 16:08:32,740 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787712562_0001_00_000001
2016-01-14 16:08:32,741 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787712562_0001_1_00_000000_0] to container: [container_1452787712562_0001_00_000001]
2016-01-14 16:08:32,741 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787712562_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:32,741 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787712562_0001_00_000001 given task: attempt_1452787712562_0001_1_00_000000_0
2016-01-14 16:08:32,741 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787712562_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787712562_0001_1_00_000000_0
2016-01-14 16:08:32,741 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787712562_0001_1_00_000000_0] started. Is using containerId: [container_1452787712562_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:32,742 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712562_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B8DB6D74EEE1488DA4486759BEC083A6, taskAttemptId=attempt_1452787712562_0001_1_00_000000_0, startTime=1452787712741, containerId=container_1452787712562_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787712562_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:32 Starting to run new task attempt: attempt_1452787712562_0001_1_00_000000_0
2016-01-14 16:08:32,742 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787712562_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:32,742 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787712562_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:32,742 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787712562_0001_1_00_000000_0
2016-01-14 16:08:32,742 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:32,742 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:32,742 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:32,742 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:32,743 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:32,743 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:32,743 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:32,743 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [4EF5BF8C67D14EF08E0D5943AA6DEAE4/E2C69495C8624F208105A703BC17B87D] every.every/(1/1) ...ULTS.ALL_'field2'_RESULTS, VertexName: B8DB6D74EEE1488DA4486759BEC083A6, VertexParallelism: 1, TaskAttemptID:attempt_1452787712562_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=5142FD3C5AD840A7A728BAB7671F70FC, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=AC1BFCFF9B094EBC99550C9201B48B30, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:32,743 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:32,744 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787712562_0001_1_00_000000_0
2016-01-14 16:08:32,744 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:32,744 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:32,745 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=5142FD3C5AD840A7A728BAB7671F70FC, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:32,745 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:32,746 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787712562_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:32,746 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=AC1BFCFF9B094EBC99550C9201B48B30, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:32,746 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:32,747 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: AC1BFCFF9B094EBC99550C9201B48B30
2016-01-14 16:08:32,747 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:32,747 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: AC1BFCFF9B094EBC99550C9201B48B30
2016-01-14 16:08:32,747 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:32,748 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 5142FD3C5AD840A7A728BAB7671F70FC
2016-01-14 16:08:32,748 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 5142FD3C5AD840A7A728BAB7671F70FC
2016-01-14 16:08:32,748 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:32,754 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:32,754 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 5142FD3C5AD840A7A728BAB7671F70FC
2016-01-14 16:08:32,754 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 5142FD3C5AD840A7A728BAB7671F70FC
2016-01-14 16:08:32,757 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B8DB6D74EEE1488DA4486759BEC083A6, ordinal: 0
2016-01-14 16:08:32,757 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B8DB6D74EEE1488DA4486759BEC083A6, mem on start (mb), free: 209, total: 386, max: 672
2016-01-14 16:08:32,757 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:32,757 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:32,757 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:32,759 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:32,759 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: AC1BFCFF9B094EBC99550C9201B48B30
2016-01-14 16:08:32,759 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:32,759 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:32,760 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:32,760 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:32,760 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:32,760 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:32,760 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:32,761 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:32,761 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, AC1BFCFF9B094EBC99550C9201B48B30, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:32,761 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 5142FD3C5AD840A7A728BAB7671F70FC, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:32,761 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:32,762 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 5142FD3C5AD840A7A728BAB7671F70FC being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:32,762 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 5142FD3C5AD840A7A728BAB7671F70FC
2016-01-14 16:08:32,762 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:32,762 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 5142FD3C5AD840A7A728BAB7671F70FC
2016-01-14 16:08:32,762 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:32,762 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:32,763 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:32,763 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787712562_0001_1_00_000000_0
2016-01-14 16:08:32,763 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:32,764 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@2b52ec6
2016-01-14 16:08:32,764 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@2b52ec6
2016-01-14 16:08:32,764 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:32,764 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:32,767 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:32,767 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 5142FD3C5AD840A7A728BAB7671F70FC
2016-01-14 16:08:32,767 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_RESULTS"], id: AC1BFCFF9B094EBC99550C9201B48B30
2016-01-14 16:08:32,768 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_RESULTS"]
2016-01-14 16:08:32,768 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:32,768 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:32,769 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B8DB6D74EEE1488DA4486759BEC083A6, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:32,772 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:32,772 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:32,772 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787712562_0001_1_00_000000_0
2016-01-14 16:08:32,773 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787712562_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:32,773 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787712562_0001_1_00_000000_0
2016-01-14 16:08:32,774 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B8DB6D74EEE1488DA4486759BEC083A6, mem on close (mb), free: 208, total: 386, max: 672
2016-01-14 16:08:32 Completed running task attempt: attempt_1452787712562_0001_1_00_000000_0
2016-01-14 16:08:32,774 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787712562_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:32,776 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787712769, Process_Duration=4, Process_End_Time=1452787712773, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:32,776 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712562_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B8DB6D74EEE1488DA4486759BEC083A6, taskAttemptId=attempt_1452787712562_0001_1_00_000000_0, startTime=1452787712741, finishTime=1452787712776, timeTaken=35, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787712769, Process_Duration=4, Process_End_Time=1452787712773, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:32,776 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:32,776 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787712562_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:32,776 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:32,777 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:32,776 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:32,776 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787712562_0001_1_00_000000_0
2016-01-14 16:08:32,777 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712562_0001_1][Event:TASK_FINISHED]: vertexName=B8DB6D74EEE1488DA4486759BEC083A6, taskId=task_1452787712562_0001_1_00_000000, startTime=1452787712741, finishTime=1452787712777, timeTaken=36, status=SUCCEEDED, successfulAttemptID=attempt_1452787712562_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787712769, Process_Duration=4, Process_End_Time=1452787712773, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:32,777 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:32,777 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787712562_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:32,777 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6] : 1
2016-01-14 16:08:32,777 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6]
2016-01-14 16:08:32,778 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787712562_0001_00_000001
2016-01-14 16:08:32,778 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:32,778 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712562_0001_1][Event:VERTEX_FINISHED]: vertexName=B8DB6D74EEE1488DA4486759BEC083A6, vertexId=vertex_1452787712562_0001_1_00, initRequestedTime=1452787712721, initedTime=1452787712731, startRequestedTime=1452787712732, startedTime=1452787712732, finishTime=1452787712777, timeTaken=45, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787712769, Process_Duration=4, Process_End_Time=1452787712773, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787712741, firstTasksToStart=[ task_1452787712562_0001_1_00_000000 ], lastTaskFinishTime=1452787712776, lastTasksToFinish=[ task_1452787712562_0001_1_00_000000 ], minTaskDuration=35, maxTaskDuration=35, avgTaskDuration=35.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787712562_0001_1_00_000000 ], longestDurationTasks=[ task_1452787712562_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:32,778 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:32,778 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787712562_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:32,779 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712562_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787712562_0001_00_000001, stoppedTime=1452787712779, exitStatus=0
2016-01-14 16:08:32,779 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787712562_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:32,779 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:32,779 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787712562_0001_1
2016-01-14 16:08:32,779 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712562_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787712562_0001_1
2016-01-14 16:08:32,779 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: AC1BFCFF9B094EBC99550C9201B48B30 for vertex: vertex_1452787712562_0001_1_00 [B8DB6D74EEE1488DA4486759BEC083A6]
2016-01-14 16:08:32,779 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:32,786 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787712562_0001_1, queueSize=0
2016-01-14 16:08:32,786 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:32,787 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712562_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787712562_0001_1, startTime=1452787712720, finishTime=1452787712785, timeTaken=65, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787712769, Process_Duration=4, Process_End_Time=1452787712773, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:32,787 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787712562_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:32,787 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787712562_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:32,787 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1452787712562_0001_00_000001. Relying on regular task shutdown for it to end
2016-01-14 16:08:32 Completed Dag: dag_1452787712562_0001_1
2016-01-14 16:08:32,789 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787712562_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:32,791 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787712562_0001_00_000001: 13 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:32,789 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787712562_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:32,791 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787712562_0001_00_000001, Exiting
2016-01-14 16:08:32,791 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787712562_0001_00_000001
2016-01-14 16:08:32,791 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787712562_0001_00_000001
2016-01-14 16:08:32,791 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787712562_0001_1_post
2016-01-14 16:08:32,792 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:32,792 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:32,792 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787712562_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 16:08:32,793 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787712562_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:32,793 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787712562_0001_00_000001 completed successfully
2016-01-14 16:08:32,794 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787712562_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 16:08:32,795 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ULTS.ALL_'field2'_RESULTS, applicationId=application_1452787712562_0001
2016-01-14 16:08:32,796 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:32,796 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:32,796 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:32,796 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:32,797 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:32,797 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:32,797 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:32,797 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:32,798 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:32,798 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:32,798 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:32,798 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:32,799 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:32,803 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4EF5BF8C67D14EF08E0D5943AA6DEAE4/E2C69495C8624F208105A703BC17B87D/.tez/application_1452787712562_0001
2016-01-14 16:08:32,804 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.262
2016-01-14 16:08:32,869 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.ALL_'field2'_RESULTS
2016-01-14 16:08:32,888 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:32,888 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:32,918 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.008
2016-01-14 16:08:32,923 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.013
2016-01-14 16:08:32,924 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:32,924 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:32,925 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:32,938 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:32,939 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_ALL
2016-01-14 16:08:32,946 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:32,946 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:32,947 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_ALL"]
2016-01-14 16:08:32,947 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:32,947 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:32,948 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:32,948 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ..._RESULTS.ALL_'field2'_ALL
2016-01-14 16:08:32,949 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:32,960 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:32,964 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:32,964 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:32,964 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:32,973 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/495495A4D05848EFB47C4007D4DAFC82/D01469BD313A445E8669AA1ACE02A53E/.tez/application_1452787712964_0001 doesn't exist and is created
2016-01-14 16:08:32,987 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:32,987 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:32,988 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/495495A4D05848EFB47C4007D4DAFC82/D01469BD313A445E8669AA1ACE02A53E/.tez/application_1452787712964_0001
2016-01-14 16:08:32,990 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787712964_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:33,000 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:33,001 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:33,003 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:33,003 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:33,003 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/495495A4D05848EFB47C4007D4DAFC82/D01469BD313A445E8669AA1ACE02A53E/.tez/application_1452787712964_0001/localmode-log-dir
2016-01-14 16:08:33,004 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/495495A4D05848EFB47C4007D4DAFC82/D01469BD313A445E8669AA1ACE02A53E/.tez/application_1452787712964_0001/localmode-log-dir/history.txt.appattempt_1452787712964_0001_000000, maxErrors=10
2016-01-14 16:08:33,004 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:33,005 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787712964_0001_000000, appSubmitTime=1452787712990, launchTime=1452787712990
2016-01-14 16:08:33,009 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:33,013 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:33,014 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:33,014 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:33,014 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:33620
2016-01-14 16:08:33,017 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:33,019 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787712964_0001_000000, startTime=1452787713019
2016-01-14 16:08:33,019 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:33,019 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:33,042 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:33,042 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:33,088 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:33,088 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:33,088 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ..._RESULTS.ALL_'field2'_ALL, applicationId=application_1452787712964_0001, dagName=[495495A4D05848EFB47C4007D4DAFC82/D01469BD313A445E8669AA1ACE02A53E] every.every/(1/1) ..._RESULTS.ALL_'field2'_ALL
2016-01-14 16:08:33,102 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [495495A4D05848EFB47C4007D4DAFC82/D01469BD313A445E8669AA1ACE02A53E] every.every/(1/1) ..._RESULTS.ALL_'field2'_ALL
2016-01-14 16:08:33,103 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787712964_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/495495A4D05848EFB47C4007D4DAFC82/D01469BD313A445E8669AA1ACE02A53E/.tez/application_1452787712964_0001/localmode-log-dir/dag_1452787712964_0001_1.dot
2016-01-14 16:08:33,104 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/495495A4D05848EFB47C4007D4DAFC82/D01469BD313A445E8669AA1ACE02A53E/.tez/application_1452787712964_0001/localmode-log-dir/dag_1452787712964_0001_1-tez-dag.pb.txt
2016-01-14 16:08:33,107 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787712964_0001_1
2016-01-14 16:08:33,107 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:33,107 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [495495A4D05848EFB47C4007D4DAFC82/D01469BD313A445E8669AA1ACE02A53E] every.every/(1/1) ..._RESULTS.ALL_'field2'_ALL
2016-01-14 16:08:33 Running Dag: dag_1452787712964_0001_1
2016-01-14 16:08:33,117 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712964_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787712964_0001_1, submitTime=1452787713102
2016-01-14 16:08:33,117 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:33,118 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex F1CB4560549E4574AEB93C951A42969D
2016-01-14 16:08:33,119 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:33,119 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712964_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787712964_0001_1, initTime=1452787713117
2016-01-14 16:08:33,119 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:33,120 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787712964_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:33,121 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712964_0001_1][Event:DAG_STARTED]: dagID=dag_1452787712964_0001_1, startTime=1452787713121
2016-01-14 16:08:33,121 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:33,121 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787712964_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:33,121 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:33,121 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: F1CB4560549E4574AEB93C951A42969D : {7D61AE9849F1478B96BB418DC0644851={InputName=7D61AE9849F1478B96BB418DC0644851}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:33,121 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 7D61AE9849F1478B96BB418DC0644851, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:33,121 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D]
2016-01-14 16:08:33,121 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ..._RESULTS.ALL_'field2'_ALL, applicationId=application_1452787712964_0001, dagName=[495495A4D05848EFB47C4007D4DAFC82/D01469BD313A445E8669AA1ACE02A53E] every.every/(1/1) ..._RESULTS.ALL_'field2'_ALL
2016-01-14 16:08:33,122 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D]
2016-01-14 16:08:33,122 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D]
2016-01-14 16:08:33,122 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D]. Starting root input initializers: 1
2016-01-14 16:08:33,122 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:33,122 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 7D61AE9849F1478B96BB418DC0644851 on vertex vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D]
2016-01-14 16:08:33,124 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:33,124 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 7D61AE9849F1478B96BB418DC0644851 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:33,125 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:33,125 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:33,126 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:33,126 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 7D61AE9849F1478B96BB418DC0644851 on vertex vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D]
2016-01-14 16:08:33,127 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:33,127 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {7D61AE9849F1478B96BB418DC0644851=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:33,127 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D] parallelism set to 1
2016-01-14 16:08:33,127 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:33,127 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712964_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787712964_0001_1_00, eventCount=1
2016-01-14 16:08:33,128 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D]
2016-01-14 16:08:33,128 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=8A36C1B94A5C46C29BF6B256363EE5C2, vertexId=vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:33,128 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=8A36C1B94A5C46C29BF6B256363EE5C2, vertexId=vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D]
2016-01-14 16:08:33,130 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=8A36C1B94A5C46C29BF6B256363EE5C2, vertexName=F1CB4560549E4574AEB93C951A42969D, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:33,130 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=8A36C1B94A5C46C29BF6B256363EE5C2, vertexId=vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D]
2016-01-14 16:08:33,131 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712964_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F1CB4560549E4574AEB93C951A42969D, vertexId=vertex_1452787712964_0001_1_00, initRequestedTime=1452787713121, initedTime=1452787713131, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:33,131 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:33,131 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D] with distanceFromRoot: 0
2016-01-14 16:08:33,132 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:33,132 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in F1CB4560549E4574AEB93C951A42969D
2016-01-14 16:08:33,132 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D]
2016-01-14 16:08:33,133 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:33,133 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712964_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787712964_0001_1_00, startRequestedTime=1452787713132, startedTime=1452787713132
2016-01-14 16:08:33,133 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:33,133 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:33,134 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712964_0001_1][Event:TASK_STARTED]: vertexName=F1CB4560549E4574AEB93C951A42969D, taskId=task_1452787712964_0001_1_00_000000, scheduledTime=1452787713133, launchTime=1452787713133
2016-01-14 16:08:33,134 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787712964_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:33,134 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D]
2016-01-14 16:08:33,135 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [495495A4D05848EFB47C4007D4DAFC82/D01469BD313A445E8669AA1ACE02A53E] every.every/(1/1) ..._RESULTS.ALL_'field2'_ALL, VertexName: F1CB4560549E4574AEB93C951A42969D, VertexParallelism: 1, TaskAttemptID:attempt_1452787712964_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=7D61AE9849F1478B96BB418DC0644851, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=8A36C1B94A5C46C29BF6B256363EE5C2, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:33,135 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787712964_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:33,135 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:33,136 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:33,136 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:33,137 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:33,137 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787712964_0001_00_000001
2016-01-14 16:08:33,137 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787712964_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:33,139 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787712964_0001_00_000001
2016-01-14 16:08:33,139 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:33,140 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787712964_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:33,140 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:33,140 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712964_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787712964_0001_00_000001, launchTime=1452787713140
2016-01-14 16:08:33,141 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787712964_0001_00_000001
2016-01-14 16:08:33,141 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787712964_0001_1_00_000000_0] to container: [container_1452787712964_0001_00_000001]
2016-01-14 16:08:33,142 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787712964_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:33,142 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787712964_0001_1_00_000000_0] started. Is using containerId: [container_1452787712964_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:33,142 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712964_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F1CB4560549E4574AEB93C951A42969D, taskAttemptId=attempt_1452787712964_0001_1_00_000000_0, startTime=1452787713142, containerId=container_1452787712964_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787712964_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:33,142 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787712964_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:33,142 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787712964_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:33,143 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:33,143 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787712964_0001_00_000001 given task: attempt_1452787712964_0001_1_00_000000_0
2016-01-14 16:08:33,143 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787712964_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787712964_0001_1_00_000000_0
2016-01-14 16:08:33 Starting to run new task attempt: attempt_1452787712964_0001_1_00_000000_0
2016-01-14 16:08:33,143 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787712964_0001_1_00_000000_0
2016-01-14 16:08:33,143 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:33,144 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:33,144 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:33,144 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:33,144 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:33,144 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:33,144 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [495495A4D05848EFB47C4007D4DAFC82/D01469BD313A445E8669AA1ACE02A53E] every.every/(1/1) ..._RESULTS.ALL_'field2'_ALL, VertexName: F1CB4560549E4574AEB93C951A42969D, VertexParallelism: 1, TaskAttemptID:attempt_1452787712964_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=7D61AE9849F1478B96BB418DC0644851, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=8A36C1B94A5C46C29BF6B256363EE5C2, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:33,144 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:33,146 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787712964_0001_1_00_000000_0
2016-01-14 16:08:33,146 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787712964_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:33,146 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:33,146 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:33,147 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:33,147 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=7D61AE9849F1478B96BB418DC0644851, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:33,147 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:33,147 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 7D61AE9849F1478B96BB418DC0644851
2016-01-14 16:08:33,147 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 7D61AE9849F1478B96BB418DC0644851
2016-01-14 16:08:33,149 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:33,149 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 7D61AE9849F1478B96BB418DC0644851
2016-01-14 16:08:33,149 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 7D61AE9849F1478B96BB418DC0644851
2016-01-14 16:08:33,149 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:33,153 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787712964_0001, with dag id: dag_1452787712964_0001_1
2016-01-14 16:08:33,153 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=8A36C1B94A5C46C29BF6B256363EE5C2, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:33,154 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:33,154 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 8A36C1B94A5C46C29BF6B256363EE5C2
2016-01-14 16:08:33,154 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:33,154 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 8A36C1B94A5C46C29BF6B256363EE5C2
2016-01-14 16:08:33,158 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F1CB4560549E4574AEB93C951A42969D, ordinal: 0
2016-01-14 16:08:33,158 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F1CB4560549E4574AEB93C951A42969D, mem on start (mb), free: 135, total: 386, max: 672
2016-01-14 16:08:33,158 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:33,158 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:33,158 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:33,165 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:33,165 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 8A36C1B94A5C46C29BF6B256363EE5C2
2016-01-14 16:08:33,165 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:33,165 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:33,165 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:33,165 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:33,166 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:33,166 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:33,166 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:33,166 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:33,166 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 7D61AE9849F1478B96BB418DC0644851, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:33,166 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 8A36C1B94A5C46C29BF6B256363EE5C2, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:33,166 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:33,166 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 7D61AE9849F1478B96BB418DC0644851 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:33,166 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:33,167 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:33,167 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 7D61AE9849F1478B96BB418DC0644851
2016-01-14 16:08:33,167 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:33,167 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 7D61AE9849F1478B96BB418DC0644851
2016-01-14 16:08:33,167 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:33,167 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787712964_0001_1_00_000000_0
2016-01-14 16:08:33,169 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:33,169 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:33,170 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 7D61AE9849F1478B96BB418DC0644851
2016-01-14 16:08:33,170 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_ALL"], id: 8A36C1B94A5C46C29BF6B256363EE5C2
2016-01-14 16:08:33,170 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_ALL"]
2016-01-14 16:08:33,170 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:33,171 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:33,171 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@55cf5684
2016-01-14 16:08:33,172 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@55cf5684
2016-01-14 16:08:33,172 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:33,172 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:33,173 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F1CB4560549E4574AEB93C951A42969D, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:33,176 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:33,176 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:33,177 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787712964_0001_1_00_000000_0
2016-01-14 16:08:33,177 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787712964_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:33,177 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787712964_0001_1_00_000000_0
2016-01-14 16:08:33,177 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F1CB4560549E4574AEB93C951A42969D, mem on close (mb), free: 132, total: 386, max: 672
2016-01-14 16:08:33 Completed running task attempt: attempt_1452787712964_0001_1_00_000000_0
2016-01-14 16:08:33,178 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787712964_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:33,179 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787713173, Process_Duration=4, Process_End_Time=1452787713177, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:33,179 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:33,179 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:33,179 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712964_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F1CB4560549E4574AEB93C951A42969D, taskAttemptId=attempt_1452787712964_0001_1_00_000000_0, startTime=1452787713142, finishTime=1452787713179, timeTaken=37, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787713173, Process_Duration=4, Process_End_Time=1452787713177, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:33,180 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787712964_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:33,180 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:33,180 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:33,180 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787712964_0001_1_00_000000_0
2016-01-14 16:08:33,181 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787712964_0001_00_000001
2016-01-14 16:08:33,181 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712964_0001_1][Event:TASK_FINISHED]: vertexName=F1CB4560549E4574AEB93C951A42969D, taskId=task_1452787712964_0001_1_00_000000, startTime=1452787713142, finishTime=1452787713181, timeTaken=39, status=SUCCEEDED, successfulAttemptID=attempt_1452787712964_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787713173, Process_Duration=4, Process_End_Time=1452787713177, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:33,181 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:33,182 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787712964_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:33,182 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D] : 1
2016-01-14 16:08:33,182 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D]
2016-01-14 16:08:33,183 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:33,183 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712964_0001_1][Event:VERTEX_FINISHED]: vertexName=F1CB4560549E4574AEB93C951A42969D, vertexId=vertex_1452787712964_0001_1_00, initRequestedTime=1452787713121, initedTime=1452787713131, startRequestedTime=1452787713132, startedTime=1452787713132, finishTime=1452787713182, timeTaken=50, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787713173, Process_Duration=4, Process_End_Time=1452787713177, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787713142, firstTasksToStart=[ task_1452787712964_0001_1_00_000000 ], lastTaskFinishTime=1452787713179, lastTasksToFinish=[ task_1452787712964_0001_1_00_000000 ], minTaskDuration=37, maxTaskDuration=37, avgTaskDuration=37.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787712964_0001_1_00_000000 ], longestDurationTasks=[ task_1452787712964_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:33,183 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:33,183 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787712964_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:33,183 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712964_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787712964_0001_00_000001, stoppedTime=1452787713183, exitStatus=0
2016-01-14 16:08:33,183 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787712964_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:33,183 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:33,183 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787712964_0001_1
2016-01-14 16:08:33,183 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712964_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787712964_0001_1
2016-01-14 16:08:33,183 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:33,184 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 8A36C1B94A5C46C29BF6B256363EE5C2 for vertex: vertex_1452787712964_0001_1_00 [F1CB4560549E4574AEB93C951A42969D]
2016-01-14 16:08:33,192 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787712964_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:33,192 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787712964_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:33,192 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787712964_0001_00_000001, Exiting
2016-01-14 16:08:33,193 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787712964_0001_00_000001
2016-01-14 16:08:33,193 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787712964_0001_00_000001
2016-01-14 16:08:33,194 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787712964_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:33,194 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787712964_0001_00_000001 completed successfully
2016-01-14 16:08:33,194 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787712964_0001_1, queueSize=0
2016-01-14 16:08:33,194 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:33,195 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787712964_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787712964_0001_1, startTime=1452787713121, finishTime=1452787713193, timeTaken=72, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787713173, Process_Duration=4, Process_End_Time=1452787713177, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:33,195 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787712964_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:33,196 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787712964_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:33,196 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787712964_0001_00_000001
2016-01-14 16:08:33,196 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787712964_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:33 Completed Dag: dag_1452787712964_0001_1
2016-01-14 16:08:33,197 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787712964_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:33,197 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787712964_0001_1_post
2016-01-14 16:08:33,197 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:33,198 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:33,202 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ..._RESULTS.ALL_'field2'_ALL, applicationId=application_1452787712964_0001
2016-01-14 16:08:33,203 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:33,204 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:33,204 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:33,204 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:33,204 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:33,204 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:33,205 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:33,205 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:33,205 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:33,205 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:33,205 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:33,206 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:33,206 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:33,209 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/495495A4D05848EFB47C4007D4DAFC82/D01469BD313A445E8669AA1ACE02A53E/.tez/application_1452787712964_0001
2016-01-14 16:08:33,210 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.263
2016-01-14 16:08:33,285 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.ALL_'field2'_ALL
2016-01-14 16:08:33,305 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:33,305 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:33,340 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.012
2016-01-14 16:08:33,340 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.013
2016-01-14 16:08:33,341 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:33,341 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:33,341 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:33,354 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:33,355 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_UNKNOWN_-1
2016-01-14 16:08:33,363 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:33,363 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:33,363 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_UNKNOWN_-1"]
2016-01-14 16:08:33,363 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:33,363 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:33,363 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:33,365 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...d'_RESULTS.ALL_UNKNOWN_-1
2016-01-14 16:08:33,365 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:33,376 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:33,380 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:33,381 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:33,381 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:33,390 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/69BC7F3020BD4C27984BA672DE4CE212/A41DD67B243E47A1A1AD5F87236AB8F0/.tez/application_1452787713380_0001 doesn't exist and is created
2016-01-14 16:08:33,404 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:33,404 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:33,404 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/69BC7F3020BD4C27984BA672DE4CE212/A41DD67B243E47A1A1AD5F87236AB8F0/.tez/application_1452787713380_0001
2016-01-14 16:08:33,406 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787713380_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:33,417 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:33,417 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:33,419 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:33,419 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:33,419 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/69BC7F3020BD4C27984BA672DE4CE212/A41DD67B243E47A1A1AD5F87236AB8F0/.tez/application_1452787713380_0001/localmode-log-dir
2016-01-14 16:08:33,419 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/69BC7F3020BD4C27984BA672DE4CE212/A41DD67B243E47A1A1AD5F87236AB8F0/.tez/application_1452787713380_0001/localmode-log-dir/history.txt.appattempt_1452787713380_0001_000000, maxErrors=10
2016-01-14 16:08:33,420 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:33,420 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787713380_0001_000000, appSubmitTime=1452787713406, launchTime=1452787713406
2016-01-14 16:08:33,423 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:33,423 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:33,425 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:33,425 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:33,426 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:34999
2016-01-14 16:08:33,429 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:33,431 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787713380_0001_000000, startTime=1452787713431
2016-01-14 16:08:33,431 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:33,431 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:33,504 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:33,504 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:33,504 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...d'_RESULTS.ALL_UNKNOWN_-1, applicationId=application_1452787713380_0001, dagName=[69BC7F3020BD4C27984BA672DE4CE212/A41DD67B243E47A1A1AD5F87236AB8F0] every.every/(1/1) ...d'_RESULTS.ALL_UNKNOWN_-1
2016-01-14 16:08:33,521 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [69BC7F3020BD4C27984BA672DE4CE212/A41DD67B243E47A1A1AD5F87236AB8F0] every.every/(1/1) ...d'_RESULTS.ALL_UNKNOWN_-1
2016-01-14 16:08:33,522 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787713380_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/69BC7F3020BD4C27984BA672DE4CE212/A41DD67B243E47A1A1AD5F87236AB8F0/.tez/application_1452787713380_0001/localmode-log-dir/dag_1452787713380_0001_1.dot
2016-01-14 16:08:33,522 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/69BC7F3020BD4C27984BA672DE4CE212/A41DD67B243E47A1A1AD5F87236AB8F0/.tez/application_1452787713380_0001/localmode-log-dir/dag_1452787713380_0001_1-tez-dag.pb.txt
2016-01-14 16:08:33,526 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787713380_0001_1
2016-01-14 16:08:33,526 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:33,526 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [69BC7F3020BD4C27984BA672DE4CE212/A41DD67B243E47A1A1AD5F87236AB8F0] every.every/(1/1) ...d'_RESULTS.ALL_UNKNOWN_-1
2016-01-14 16:08:33 Running Dag: dag_1452787713380_0001_1
2016-01-14 16:08:33,537 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787713380_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787713380_0001_1, submitTime=1452787713521
2016-01-14 16:08:33,537 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:33,537 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:33,538 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:33,538 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex A8332B646C6F43D893C53CC3E1A049C9
2016-01-14 16:08:33,538 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:33,539 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787713380_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787713380_0001_1, initTime=1452787713538
2016-01-14 16:08:33,539 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787713380_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:33,539 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:33,539 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787713380_0001_1][Event:DAG_STARTED]: dagID=dag_1452787713380_0001_1, startTime=1452787713539
2016-01-14 16:08:33,539 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:33,539 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787713380_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:33,540 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: A8332B646C6F43D893C53CC3E1A049C9 : {58745D0EC2E74559852B841F97295A1D={InputName=58745D0EC2E74559852B841F97295A1D}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:33,540 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 58745D0EC2E74559852B841F97295A1D, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:33,539 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:33,540 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9]
2016-01-14 16:08:33,540 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9]
2016-01-14 16:08:33,540 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9]
2016-01-14 16:08:33,540 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9]. Starting root input initializers: 1
2016-01-14 16:08:33,541 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:33,541 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 58745D0EC2E74559852B841F97295A1D on vertex vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9]
2016-01-14 16:08:33,541 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...d'_RESULTS.ALL_UNKNOWN_-1, applicationId=application_1452787713380_0001, dagName=[69BC7F3020BD4C27984BA672DE4CE212/A41DD67B243E47A1A1AD5F87236AB8F0] every.every/(1/1) ...d'_RESULTS.ALL_UNKNOWN_-1
2016-01-14 16:08:33,542 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:33,543 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 58745D0EC2E74559852B841F97295A1D asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:33,543 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:33,543 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:33,544 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:33,545 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 58745D0EC2E74559852B841F97295A1D on vertex vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9]
2016-01-14 16:08:33,545 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:33,545 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {58745D0EC2E74559852B841F97295A1D=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:33,545 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9] parallelism set to 1
2016-01-14 16:08:33,545 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:33,546 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787713380_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787713380_0001_1_00, eventCount=1
2016-01-14 16:08:33,546 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9]
2016-01-14 16:08:33,546 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=787473C635464E3EB8A4D0F4B7FC98F5, vertexId=vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:33,546 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=787473C635464E3EB8A4D0F4B7FC98F5, vertexId=vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9]
2016-01-14 16:08:33,548 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=787473C635464E3EB8A4D0F4B7FC98F5, vertexName=A8332B646C6F43D893C53CC3E1A049C9, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:33,548 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=787473C635464E3EB8A4D0F4B7FC98F5, vertexId=vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9]
2016-01-14 16:08:33,549 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787713380_0001_1][Event:VERTEX_INITIALIZED]: vertexName=A8332B646C6F43D893C53CC3E1A049C9, vertexId=vertex_1452787713380_0001_1_00, initRequestedTime=1452787713540, initedTime=1452787713549, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:33,549 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9] with distanceFromRoot: 0
2016-01-14 16:08:33,549 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:33,549 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:33,550 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in A8332B646C6F43D893C53CC3E1A049C9
2016-01-14 16:08:33,550 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9]
2016-01-14 16:08:33,550 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787713380_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787713380_0001_1_00, startRequestedTime=1452787713550, startedTime=1452787713550
2016-01-14 16:08:33,550 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:33,551 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:33,551 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787713380_0001_1][Event:TASK_STARTED]: vertexName=A8332B646C6F43D893C53CC3E1A049C9, taskId=task_1452787713380_0001_1_00_000000, scheduledTime=1452787713551, launchTime=1452787713551
2016-01-14 16:08:33,551 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:33,551 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787713380_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:33,552 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9]
2016-01-14 16:08:33,552 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [69BC7F3020BD4C27984BA672DE4CE212/A41DD67B243E47A1A1AD5F87236AB8F0] every.every/(1/1) ...d'_RESULTS.ALL_UNKNOWN_-1, VertexName: A8332B646C6F43D893C53CC3E1A049C9, VertexParallelism: 1, TaskAttemptID:attempt_1452787713380_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=58745D0EC2E74559852B841F97295A1D, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=787473C635464E3EB8A4D0F4B7FC98F5, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:33,552 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787713380_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:33,553 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:33,553 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:33,554 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:33,554 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:33,554 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787713380_0001_00_000001
2016-01-14 16:08:33,554 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787713380_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:33,555 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787713380_0001_00_000001
2016-01-14 16:08:33,556 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:33,556 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787713380_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:33,556 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787713380_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787713380_0001_00_000001, launchTime=1452787713556
2016-01-14 16:08:33,556 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:33,557 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787713380_0001_00_000001
2016-01-14 16:08:33,558 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787713380_0001_1_00_000000_0] to container: [container_1452787713380_0001_00_000001]
2016-01-14 16:08:33,558 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787713380_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:33,558 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787713380_0001_00_000001 given task: attempt_1452787713380_0001_1_00_000000_0
2016-01-14 16:08:33,558 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787713380_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787713380_0001_1_00_000000_0
2016-01-14 16:08:33,558 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787713380_0001_1_00_000000_0] started. Is using containerId: [container_1452787713380_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:33,559 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787713380_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=A8332B646C6F43D893C53CC3E1A049C9, taskAttemptId=attempt_1452787713380_0001_1_00_000000_0, startTime=1452787713558, containerId=container_1452787713380_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787713380_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:33 Starting to run new task attempt: attempt_1452787713380_0001_1_00_000000_0
2016-01-14 16:08:33,559 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787713380_0001_1_00_000000_0
2016-01-14 16:08:33,559 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787713380_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:33,559 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:33,559 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787713380_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:33,559 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:33,559 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:33,559 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:33,560 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:33,560 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:33,560 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:33,560 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [69BC7F3020BD4C27984BA672DE4CE212/A41DD67B243E47A1A1AD5F87236AB8F0] every.every/(1/1) ...d'_RESULTS.ALL_UNKNOWN_-1, VertexName: A8332B646C6F43D893C53CC3E1A049C9, VertexParallelism: 1, TaskAttemptID:attempt_1452787713380_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=58745D0EC2E74559852B841F97295A1D, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=787473C635464E3EB8A4D0F4B7FC98F5, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:33,560 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:33,561 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787713380_0001_1_00_000000_0
2016-01-14 16:08:33,561 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:33,561 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:33,565 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787713380_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:33,565 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=58745D0EC2E74559852B841F97295A1D, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:33,565 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:33,566 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:33,566 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=787473C635464E3EB8A4D0F4B7FC98F5, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:33,566 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 58745D0EC2E74559852B841F97295A1D
2016-01-14 16:08:33,566 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 58745D0EC2E74559852B841F97295A1D
2016-01-14 16:08:33,566 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:33,568 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 787473C635464E3EB8A4D0F4B7FC98F5
2016-01-14 16:08:33,568 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:33,569 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 787473C635464E3EB8A4D0F4B7FC98F5
2016-01-14 16:08:33,569 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:33,570 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787713380_0001, with dag id: dag_1452787713380_0001_1
2016-01-14 16:08:33,568 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:33,573 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 58745D0EC2E74559852B841F97295A1D
2016-01-14 16:08:33,573 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 58745D0EC2E74559852B841F97295A1D
2016-01-14 16:08:33,578 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: A8332B646C6F43D893C53CC3E1A049C9, ordinal: 0
2016-01-14 16:08:33,578 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A8332B646C6F43D893C53CC3E1A049C9, mem on start (mb), free: 248, total: 368, max: 672
2016-01-14 16:08:33,578 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:33,578 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:33,578 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:33,582 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:33,582 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 787473C635464E3EB8A4D0F4B7FC98F5
2016-01-14 16:08:33,583 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:33,583 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:33,583 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:33,584 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:33,584 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:33,584 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:33,584 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:33,584 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:33,585 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 58745D0EC2E74559852B841F97295A1D, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:33,586 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 787473C635464E3EB8A4D0F4B7FC98F5, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:33,586 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:33,586 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 58745D0EC2E74559852B841F97295A1D being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:33,587 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:33,587 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:33,587 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 58745D0EC2E74559852B841F97295A1D
2016-01-14 16:08:33,588 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:33,588 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 58745D0EC2E74559852B841F97295A1D
2016-01-14 16:08:33,589 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:33,589 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787713380_0001_1_00_000000_0
2016-01-14 16:08:33,592 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:33,592 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 58745D0EC2E74559852B841F97295A1D
2016-01-14 16:08:33,593 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_UNKNOWN_-1"], id: 787473C635464E3EB8A4D0F4B7FC98F5
2016-01-14 16:08:33,593 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_UNKNOWN_-1"]
2016-01-14 16:08:33,593 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:33,593 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:33,593 INFO  input.MRInput (MRInput.java:checkAndAwaitRecordReaderInitialization(597)) - Awaiting RecordReader initialization
2016-01-14 16:08:33,594 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:33,594 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@6aa22fca
2016-01-14 16:08:33,595 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@6aa22fca
2016-01-14 16:08:33,595 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:33,596 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:33,596 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: A8332B646C6F43D893C53CC3E1A049C9, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:33,599 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:33,599 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:33,600 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787713380_0001_1_00_000000_0
2016-01-14 16:08:33,600 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787713380_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:33,601 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787713380_0001_1_00_000000_0
2016-01-14 16:08:33,601 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A8332B646C6F43D893C53CC3E1A049C9, mem on close (mb), free: 246, total: 368, max: 672
2016-01-14 16:08:33 Completed running task attempt: attempt_1452787713380_0001_1_00_000000_0
2016-01-14 16:08:33,602 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787713380_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:33,603 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=385875968, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787713596, Process_Duration=5, Process_End_Time=1452787713601, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:33,603 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787713380_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=A8332B646C6F43D893C53CC3E1A049C9, taskAttemptId=attempt_1452787713380_0001_1_00_000000_0, startTime=1452787713558, finishTime=1452787713603, timeTaken=45, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=385875968, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787713596, Process_Duration=5, Process_End_Time=1452787713601, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:33,604 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:33,604 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:33,604 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787713380_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:33,604 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:33,604 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:33,604 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787713380_0001_1_00_000000_0
2016-01-14 16:08:33,608 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787713380_0001_1][Event:TASK_FINISHED]: vertexName=A8332B646C6F43D893C53CC3E1A049C9, taskId=task_1452787713380_0001_1_00_000000, startTime=1452787713558, finishTime=1452787713608, timeTaken=50, status=SUCCEEDED, successfulAttemptID=attempt_1452787713380_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=385875968, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787713596, Process_Duration=5, Process_End_Time=1452787713601, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:33,608 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787713380_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:33,608 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9] : 1
2016-01-14 16:08:33,608 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9]
2016-01-14 16:08:33,609 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787713380_0001_00_000001
2016-01-14 16:08:33,608 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:33,609 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787713380_0001_1][Event:VERTEX_FINISHED]: vertexName=A8332B646C6F43D893C53CC3E1A049C9, vertexId=vertex_1452787713380_0001_1_00, initRequestedTime=1452787713540, initedTime=1452787713549, startRequestedTime=1452787713550, startedTime=1452787713550, finishTime=1452787713609, timeTaken=59, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=385875968, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787713596, Process_Duration=5, Process_End_Time=1452787713601, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787713558, firstTasksToStart=[ task_1452787713380_0001_1_00_000000 ], lastTaskFinishTime=1452787713603, lastTasksToFinish=[ task_1452787713380_0001_1_00_000000 ], minTaskDuration=45, maxTaskDuration=45, avgTaskDuration=45.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787713380_0001_1_00_000000 ], longestDurationTasks=[ task_1452787713380_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:33,610 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:33,610 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:33,610 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787713380_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:33,610 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787713380_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787713380_0001_00_000001, stoppedTime=1452787713610, exitStatus=0
2016-01-14 16:08:33,610 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787713380_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:33,610 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:33,611 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:33,611 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787713380_0001_1
2016-01-14 16:08:33,612 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787713380_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787713380_0001_1
2016-01-14 16:08:33,612 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 787473C635464E3EB8A4D0F4B7FC98F5 for vertex: vertex_1452787713380_0001_1_00 [A8332B646C6F43D893C53CC3E1A049C9]
2016-01-14 16:08:33,619 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787713380_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:33,619 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787713380_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:33,620 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787713380_0001_00_000001, Exiting
2016-01-14 16:08:33,620 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787713380_0001_00_000001
2016-01-14 16:08:33,620 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787713380_0001_00_000001
2016-01-14 16:08:33,621 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787713380_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:33,621 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787713380_0001_00_000001 completed successfully
2016-01-14 16:08:33,622 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787713380_0001_1, queueSize=0
2016-01-14 16:08:33,623 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:33,623 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787713380_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787713380_0001_1, startTime=1452787713539, finishTime=1452787713620, timeTaken=81, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=385875968, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787713596, Process_Duration=5, Process_End_Time=1452787713601, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:33,624 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787713380_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:33,624 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787713380_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:33,625 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787713380_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:33,625 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787713380_0001_00_000001
2016-01-14 16:08:33 Completed Dag: dag_1452787713380_0001_1
2016-01-14 16:08:33,628 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787713380_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:33,628 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787713380_0001_1_post
2016-01-14 16:08:33,628 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:33,628 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:33,631 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...d'_RESULTS.ALL_UNKNOWN_-1, applicationId=application_1452787713380_0001
2016-01-14 16:08:33,633 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:33,633 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:33,633 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:33,633 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:33,634 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:33,634 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:33,634 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:33,635 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:33,635 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:33,635 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:33,635 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:33,636 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:33,636 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:33,642 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/69BC7F3020BD4C27984BA672DE4CE212/A41DD67B243E47A1A1AD5F87236AB8F0/.tez/application_1452787713380_0001
2016-01-14 16:08:33,643 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.279
2016-01-14 16:08:33,706 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.ALL_UNKNOWN_-1
2016-01-14 16:08:33,726 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:33,726 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:33,749 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.002
2016-01-14 16:08:33,750 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.003
2016-01-14 16:08:33,751 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:33,751 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:33,751 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.ALL_UNKNOWN_'field2'

Standard error

2016-01-14 16:08:18 Running Dag: dag_1452787697237_0001_1
2016-01-14 16:08:18 Starting to run new task attempt: attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18 Completed running task attempt: attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18 Completed Dag: dag_1452787697237_0001_1
2016-01-14 16:08:19 Running Dag: dag_1452787699237_0001_1
2016-01-14 16:08:19 Starting to run new task attempt: attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19 Completed running task attempt: attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19 Completed Dag: dag_1452787699237_0001_1
2016-01-14 16:08:20 Running Dag: dag_1452787699917_0001_1
2016-01-14 16:08:20 Starting to run new task attempt: attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20 Completed running task attempt: attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20 Completed Dag: dag_1452787699917_0001_1
2016-01-14 16:08:20 Running Dag: dag_1452787700536_0001_1
2016-01-14 16:08:20 Starting to run new task attempt: attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20 Completed running task attempt: attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20 Completed Dag: dag_1452787700536_0001_1
2016-01-14 16:08:21 Running Dag: dag_1452787701083_0001_1
2016-01-14 16:08:21 Starting to run new task attempt: attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21 Completed running task attempt: attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21 Completed Dag: dag_1452787701083_0001_1
2016-01-14 16:08:21 Running Dag: dag_1452787701656_0001_1
2016-01-14 16:08:21 Starting to run new task attempt: attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21 Completed running task attempt: attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:22 Completed Dag: dag_1452787701656_0001_1
2016-01-14 16:08:22 Running Dag: dag_1452787702436_0001_1
2016-01-14 16:08:22 Starting to run new task attempt: attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22 Completed running task attempt: attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22 Completed Dag: dag_1452787702436_0001_1
2016-01-14 16:08:23 Running Dag: dag_1452787702961_0001_1
2016-01-14 16:08:23 Starting to run new task attempt: attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23 Completed running task attempt: attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23 Completed Dag: dag_1452787702961_0001_1
2016-01-14 16:08:23 Running Dag: dag_1452787703513_0001_1
2016-01-14 16:08:23 Starting to run new task attempt: attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23 Completed running task attempt: attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23 Completed Dag: dag_1452787703513_0001_1
2016-01-14 16:08:24 Running Dag: dag_1452787703987_0001_1
2016-01-14 16:08:24 Starting to run new task attempt: attempt_1452787703987_0001_1_00_000000_0
2016-01-14 16:08:24 Completed Dag: dag_1452787703987_0001_1
2016-01-14 16:08:24 Running Dag: dag_1452787704469_0001_1
2016-01-14 16:08:24 Starting to run new task attempt: attempt_1452787704469_0001_1_00_000000_0
2016-01-14 16:08:24 Completed Dag: dag_1452787704469_0001_1
2016-01-14 16:08:25 Running Dag: dag_1452787704934_0001_1
2016-01-14 16:08:25 Starting to run new task attempt: attempt_1452787704934_0001_1_00_000000_0
2016-01-14 16:08:25 Completed Dag: dag_1452787704934_0001_1
2016-01-14 16:08:25 Running Dag: dag_1452787705413_0001_1
2016-01-14 16:08:25 Starting to run new task attempt: attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25 Completed running task attempt: attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25 Completed Dag: dag_1452787705413_0001_1
2016-01-14 16:08:26 Running Dag: dag_1452787705930_0001_1
2016-01-14 16:08:26 Starting to run new task attempt: attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26 Completed running task attempt: attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26 Completed Dag: dag_1452787705930_0001_1
2016-01-14 16:08:26 Running Dag: dag_1452787706403_0001_1
2016-01-14 16:08:26 Starting to run new task attempt: attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26 Completed running task attempt: attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26 Completed Dag: dag_1452787706403_0001_1
2016-01-14 16:08:27 Running Dag: dag_1452787706847_0001_1
2016-01-14 16:08:27 Starting to run new task attempt: attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27 Completed running task attempt: attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27 Completed Dag: dag_1452787706847_0001_1
2016-01-14 16:08:27 Running Dag: dag_1452787707319_0001_1
2016-01-14 16:08:27 Starting to run new task attempt: attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27 Completed running task attempt: attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27 Completed Dag: dag_1452787707319_0001_1
2016-01-14 16:08:27 Running Dag: dag_1452787707745_0001_1
2016-01-14 16:08:27 Starting to run new task attempt: attempt_1452787707745_0001_1_00_000000_0
2016-01-14 16:08:28 Completed running task attempt: attempt_1452787707745_0001_1_00_000000_0
2016-01-14 16:08:28 Completed Dag: dag_1452787707745_0001_1
2016-01-14 16:08:28 Running Dag: dag_1452787708282_0001_1
2016-01-14 16:08:28 Starting to run new task attempt: attempt_1452787708282_0001_1_00_000000_0
2016-01-14 16:08:28 Completed running task attempt: attempt_1452787708282_0001_1_00_000000_0
2016-01-14 16:08:28 Completed Dag: dag_1452787708282_0001_1
2016-01-14 16:08:28 Running Dag: dag_1452787708718_0001_1
2016-01-14 16:08:28 Starting to run new task attempt: attempt_1452787708718_0001_1_00_000000_0
2016-01-14 16:08:28 Completed running task attempt: attempt_1452787708718_0001_1_00_000000_0
2016-01-14 16:08:28 Completed Dag: dag_1452787708718_0001_1
2016-01-14 16:08:29 Running Dag: dag_1452787709150_0001_1
2016-01-14 16:08:29 Starting to run new task attempt: attempt_1452787709150_0001_1_00_000000_0
2016-01-14 16:08:29 Completed Dag: dag_1452787709150_0001_1
2016-01-14 16:08:29 Running Dag: dag_1452787709593_0001_1
2016-01-14 16:08:29 Starting to run new task attempt: attempt_1452787709593_0001_1_00_000000_0
2016-01-14 16:08:29 Completed Dag: dag_1452787709593_0001_1
2016-01-14 16:08:30 Running Dag: dag_1452787710000_0001_1
2016-01-14 16:08:30 Starting to run new task attempt: attempt_1452787710000_0001_1_00_000000_0
2016-01-14 16:08:30 Completed Dag: dag_1452787710000_0001_1
2016-01-14 16:08:30 Running Dag: dag_1452787710359_0001_1
2016-01-14 16:08:30 Starting to run new task attempt: attempt_1452787710359_0001_1_00_000000_0
2016-01-14 16:08:30 Completed running task attempt: attempt_1452787710359_0001_1_00_000000_0
2016-01-14 16:08:30 Completed Dag: dag_1452787710359_0001_1
2016-01-14 16:08:30 Running Dag: dag_1452787710834_0001_1
2016-01-14 16:08:31 Starting to run new task attempt: attempt_1452787710834_0001_1_00_000000_0
2016-01-14 16:08:31 Completed running task attempt: attempt_1452787710834_0001_1_00_000000_0
2016-01-14 16:08:31 Completed Dag: dag_1452787710834_0001_1
2016-01-14 16:08:31 Running Dag: dag_1452787711324_0001_1
2016-01-14 16:08:31 Starting to run new task attempt: attempt_1452787711324_0001_1_00_000000_0
2016-01-14 16:08:31 Completed running task attempt: attempt_1452787711324_0001_1_00_000000_0
2016-01-14 16:08:31 Completed Dag: dag_1452787711324_0001_1
Jan 14, 2016 4:08:31 PM com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair execute
SEVERE: RuntimeException while executing runnable com.google.common.util.concurrent.Futures$6@2ae3a84e with executor java.util.concurrent.ThreadPoolExecutor@483eaee1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]
java.util.concurrent.RejectedExecutionException: Task com.google.common.util.concurrent.Futures$6@2ae3a84e rejected from java.util.concurrent.ThreadPoolExecutor@483eaee1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]
	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
	at com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:149)
	at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:134)
	at com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:86)
	at java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:380)
	at java.util.concurrent.FutureTask.set(FutureTask.java:229)
	at java.util.concurrent.FutureTask.run(FutureTask.java:270)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)

2016-01-14 16:08:31 Running Dag: dag_1452787711736_0001_1
2016-01-14 16:08:31 Starting to run new task attempt: attempt_1452787711736_0001_1_00_000000_0
2016-01-14 16:08:31 Completed running task attempt: attempt_1452787711736_0001_1_00_000000_0
2016-01-14 16:08:31 Completed Dag: dag_1452787711736_0001_1
2016-01-14 16:08:32 Running Dag: dag_1452787712146_0001_1
2016-01-14 16:08:32 Starting to run new task attempt: attempt_1452787712146_0001_1_00_000000_0
2016-01-14 16:08:32 Completed running task attempt: attempt_1452787712146_0001_1_00_000000_0
2016-01-14 16:08:32 Completed Dag: dag_1452787712146_0001_1
2016-01-14 16:08:32 Running Dag: dag_1452787712562_0001_1
2016-01-14 16:08:32 Starting to run new task attempt: attempt_1452787712562_0001_1_00_000000_0
2016-01-14 16:08:32 Completed running task attempt: attempt_1452787712562_0001_1_00_000000_0
2016-01-14 16:08:32 Completed Dag: dag_1452787712562_0001_1
2016-01-14 16:08:33 Running Dag: dag_1452787712964_0001_1
2016-01-14 16:08:33 Starting to run new task attempt: attempt_1452787712964_0001_1_00_000000_0
2016-01-14 16:08:33 Completed running task attempt: attempt_1452787712964_0001_1_00_000000_0
2016-01-14 16:08:33 Completed Dag: dag_1452787712964_0001_1
2016-01-14 16:08:33 Running Dag: dag_1452787713380_0001_1
2016-01-14 16:08:33 Starting to run new task attempt: attempt_1452787713380_0001_1_00_000000_0
2016-01-14 16:08:33 Completed running task attempt: attempt_1452787713380_0001_1_00_000000_0
2016-01-14 16:08:33 Completed Dag: dag_1452787713380_0001_1