Class cascading.detail.EachEachPipeAssemblyPlatformTest

40

tests

0

failures

0

ignored

18.209s

duration

100%

successful

Tests

Test Duration Result
-1_'field'_RESULTS.-1_'field2'_'field'[hadoop2-tez] 0.654s passed
-1_'field'_RESULTS.-1_'field2'_'field2'[hadoop2-tez] 0.719s passed
-1_'field'_RESULTS.-1_'field2'_-1[hadoop2-tez] 3.486s passed
-1_'field'_RESULTS.-1_'field2'_ALL[hadoop2-tez] 0.567s passed
-1_'field'_RESULTS.-1_'field2'_RESULTS[hadoop2-tez] 0.558s passed
-1_'field'_RESULTS.-1_ARGS_'field2'[hadoop2-tez] 0.061s passed
-1_'field'_RESULTS.-1_ARGS_ALL[hadoop2-tez] 0.051s passed
-1_'field'_RESULTS.-1_ARGS_RESULTS[hadoop2-tez] 0.489s passed
-1_'field'_RESULTS.-1_UNKNOWN_'field'[hadoop2-tez] 0.587s passed
-1_'field'_RESULTS.-1_UNKNOWN_'field2'[hadoop2-tez] 0.094s passed
-1_'field'_RESULTS.-1_UNKNOWN_-1[hadoop2-tez] 0.657s passed
-1_'field'_RESULTS.-1_UNKNOWN_ALL[hadoop2-tez] 0.468s passed
-1_'field'_RESULTS.-1_UNKNOWN_RESULTS[hadoop2-tez] 0.558s passed
-1_'field'_RESULTS.-1_VALUES_'field2'[hadoop2-tez] 0.057s passed
-1_'field'_RESULTS.-1_VALUES_-1[hadoop2-tez] 0.426s passed
-1_'field'_RESULTS.-1_VALUES_ALL[hadoop2-tez] 0.411s passed
-1_'field'_RESULTS.-1_VALUES_RESULTS[hadoop2-tez] 0.447s passed
-1_'field'_RESULTS.0_'field2'_'field2'[hadoop2-tez] 0.448s passed
-1_'field'_RESULTS.0_'field2'_-1[hadoop2-tez] 0.490s passed
-1_'field'_RESULTS.0_'field2'_ALL[hadoop2-tez] 0.436s passed
-1_'field'_RESULTS.0_'field2'_RESULTS[hadoop2-tez] 0.459s passed
-1_'field'_RESULTS.0_ARGS_'field2'[hadoop2-tez] 0.046s passed
-1_'field'_RESULTS.0_ARGS_-1[hadoop2-tez] 0.424s passed
-1_'field'_RESULTS.0_ARGS_ALL[hadoop2-tez] 0.050s passed
-1_'field'_RESULTS.0_ARGS_RESULTS[hadoop2-tez] 0.409s passed
-1_'field'_RESULTS.0_UNKNOWN_'field2'[hadoop2-tez] 0.055s passed
-1_'field'_RESULTS.0_UNKNOWN_-1[hadoop2-tez] 0.503s passed
-1_'field'_RESULTS.0_UNKNOWN_ALL[hadoop2-tez] 0.436s passed
-1_'field'_RESULTS.0_UNKNOWN_RESULTS[hadoop2-tez] 0.433s passed
-1_'field'_RESULTS.0_VALUES_'field2'[hadoop2-tez] 0.071s passed
-1_'field'_RESULTS.0_VALUES_-1[hadoop2-tez] 0.363s passed
-1_'field'_RESULTS.0_VALUES_ALL[hadoop2-tez] 0.388s passed
-1_'field'_RESULTS.0_VALUES_RESULTS[hadoop2-tez] 0.361s passed
-1_'field'_RESULTS.ALL_'field2'_'field'[hadoop2-tez] 0.417s passed
-1_'field'_RESULTS.ALL_'field2'_'field2'[hadoop2-tez] 0.434s passed
-1_'field'_RESULTS.ALL_'field2'_-1[hadoop2-tez] 0.424s passed
-1_'field'_RESULTS.ALL_'field2'_ALL[hadoop2-tez] 0.413s passed
-1_'field'_RESULTS.ALL_'field2'_RESULTS[hadoop2-tez] 0.398s passed
-1_'field'_RESULTS.ALL_UNKNOWN_'field2'[hadoop2-tez] 0.050s passed
-1_'field'_RESULTS.ALL_UNKNOWN_-1[hadoop2-tez] 0.411s passed

Standard output

2016-01-14 16:08:34,946 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 16:08:34,969 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.detail.EachEachPipeAssemblyPlatformTest, with platform: hadoop2-tez
2016-01-14 16:08:35,427 INFO  tez.Hadoop2TezPlatform (Hadoop2TezPlatform.java:setUp(136)) - not using cluster
2016-01-14 16:08:35,743 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-01-14 16:08:36,016 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides: 
2016-01-14 16:08:36,170 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:36,172 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:36,298 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 414F04BE7C4D4E4291A25703BB70A2E5
2016-01-14 16:08:36,493 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.061
2016-01-14 16:08:36,510 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.079
2016-01-14 16:08:36,511 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:36,512 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:36,514 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:36,670 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:36,673 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:36,880 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 16:08:36,883 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting
2016-01-14 16:08:36,883 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:36,884 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_-1"]
2016-01-14 16:08:36,884 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  parallel execution of steps is enabled: false
2016-01-14 16:08:36,884 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  executing total steps: 1
2016-01-14 16:08:36,885 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  allocating management threads: 1
2016-01-14 16:08:36,885 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting step: (1/1) ...d'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:36,886 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [each.each] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:36,908 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tez session mode enabled: true
2016-01-14 16:08:37,095 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:37,101 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:37,102 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:37,148 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3118E89530D04CA6AB921E2E492E1FC3/F6BBFAF755164FD08BD3B112F7446F27/.tez/application_1452787717101_0001 doesn't exist and is created
2016-01-14 16:08:37,212 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:37,212 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:37,213 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3118E89530D04CA6AB921E2E492E1FC3/F6BBFAF755164FD08BD3B112F7446F27/.tez/application_1452787717101_0001
2016-01-14 16:08:37,244 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787717101_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:37,289 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:37,304 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:37,313 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: NEW
2016-01-14 16:08:37,313 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(238)) - DAGAppMaster is not started wait for 100ms...
2016-01-14 16:08:37,313 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:37,329 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:37,333 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:37,337 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3118E89530D04CA6AB921E2E492E1FC3/F6BBFAF755164FD08BD3B112F7446F27/.tez/application_1452787717101_0001/localmode-log-dir
2016-01-14 16:08:37,337 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3118E89530D04CA6AB921E2E492E1FC3/F6BBFAF755164FD08BD3B112F7446F27/.tez/application_1452787717101_0001/localmode-log-dir/history.txt.appattempt_1452787717101_0001_000000, maxErrors=10
2016-01-14 16:08:37,337 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:37,339 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787717101_0001_000000, appSubmitTime=1452787717230, launchTime=1452787717243
2016-01-14 16:08:37,345 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:37,345 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:37,350 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:37,350 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:37,403 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:50243
2016-01-14 16:08:37,414 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-01-14 16:08:37,414 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-01-14 16:08:37,414 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:37,446 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:37,514 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-01-14 16:08:37,515 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-01-14 16:08:37,515 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:37,516 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:37,516 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787717101_0001_000000, startTime=1452787717514
2016-01-14 16:08:37,517 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:37,615 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:37,631 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:37,631 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...d'_RESULTS.-1_'field2'_-1, applicationId=application_1452787717101_0001, dagName=[3118E89530D04CA6AB921E2E492E1FC3/F6BBFAF755164FD08BD3B112F7446F27] each.each/(1/1) ...d'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:37,871 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [3118E89530D04CA6AB921E2E492E1FC3/F6BBFAF755164FD08BD3B112F7446F27] each.each/(1/1) ...d'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:37,978 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787717101_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3118E89530D04CA6AB921E2E492E1FC3/F6BBFAF755164FD08BD3B112F7446F27/.tez/application_1452787717101_0001/localmode-log-dir/dag_1452787717101_0001_1.dot
2016-01-14 16:08:37,980 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3118E89530D04CA6AB921E2E492E1FC3/F6BBFAF755164FD08BD3B112F7446F27/.tez/application_1452787717101_0001/localmode-log-dir/dag_1452787717101_0001_1-tez-dag.pb.txt
2016-01-14 16:08:38,072 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787717101_0001_1
2016-01-14 16:08:38,072 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:38,072 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [3118E89530D04CA6AB921E2E492E1FC3/F6BBFAF755164FD08BD3B112F7446F27] each.each/(1/1) ...d'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:38 Running Dag: dag_1452787717101_0001_1
2016-01-14 16:08:38,110 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:38,110 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787717101_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787717101_0001_1, submitTime=1452787717871
2016-01-14 16:08:38,153 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex D302AC22697D4606BF6619FE25070C69
2016-01-14 16:08:38,156 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:38,159 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787717101_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787717101_0001_1, initTime=1452787718112
2016-01-14 16:08:38,159 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:38,165 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787717101_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:38,167 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:38,167 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787717101_0001_1][Event:DAG_STARTED]: dagID=dag_1452787717101_0001_1, startTime=1452787718166
2016-01-14 16:08:38,167 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:38,169 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787717101_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:38,169 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: D302AC22697D4606BF6619FE25070C69 : {61E88B117C9A427CAA12DB3CA85D5885={InputName=61E88B117C9A427CAA12DB3CA85D5885}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:38,170 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 61E88B117C9A427CAA12DB3CA85D5885, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:38,170 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69]
2016-01-14 16:08:38,178 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69]
2016-01-14 16:08:38,178 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69]
2016-01-14 16:08:38,181 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69]. Starting root input initializers: 1
2016-01-14 16:08:38,186 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...d'_RESULTS.-1_'field2'_-1, applicationId=application_1452787717101_0001, dagName=[3118E89530D04CA6AB921E2E492E1FC3/F6BBFAF755164FD08BD3B112F7446F27] each.each/(1/1) ...d'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:38,197 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 61E88B117C9A427CAA12DB3CA85D5885 on vertex vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69]
2016-01-14 16:08:38,201 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:38,219 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:38,222 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 61E88B117C9A427CAA12DB3CA85D5885 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:38,222 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:38,223 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:38,234 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] submitted tez dag to app master: application_1452787717101_0001, with dag id: dag_1452787717101_0001_1
2016-01-14 16:08:38,270 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:38,272 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 61E88B117C9A427CAA12DB3CA85D5885 on vertex vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69]
2016-01-14 16:08:38,274 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:38,274 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {61E88B117C9A427CAA12DB3CA85D5885=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:38,296 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69] parallelism set to 1
2016-01-14 16:08:38,296 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:38,305 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787717101_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787717101_0001_1_00, eventCount=1
2016-01-14 16:08:38,306 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69]
2016-01-14 16:08:38,306 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=84D1255F9CE84831829AB958B769A8C7, vertexId=vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:38,311 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=84D1255F9CE84831829AB958B769A8C7, vertexId=vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69]
2016-01-14 16:08:38,325 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=84D1255F9CE84831829AB958B769A8C7, vertexName=D302AC22697D4606BF6619FE25070C69, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:38,338 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=84D1255F9CE84831829AB958B769A8C7, vertexId=vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69]
2016-01-14 16:08:38,341 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:38,341 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787717101_0001_1][Event:VERTEX_INITIALIZED]: vertexName=D302AC22697D4606BF6619FE25070C69, vertexId=vertex_1452787717101_0001_1_00, initRequestedTime=1452787718169, initedTime=1452787718340, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:38,342 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69] with distanceFromRoot: 0
2016-01-14 16:08:38,342 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:38,347 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in D302AC22697D4606BF6619FE25070C69
2016-01-14 16:08:38,347 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69]
2016-01-14 16:08:38,349 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:38,349 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787717101_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787717101_0001_1_00, startRequestedTime=1452787718347, startedTime=1452787718347
2016-01-14 16:08:38,349 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:38,372 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:38,372 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787717101_0001_1][Event:TASK_STARTED]: vertexName=D302AC22697D4606BF6619FE25070C69, taskId=task_1452787717101_0001_1_00_000000, scheduledTime=1452787718371, launchTime=1452787718371
2016-01-14 16:08:38,373 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787717101_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:38,375 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69]
2016-01-14 16:08:38,377 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [3118E89530D04CA6AB921E2E492E1FC3/F6BBFAF755164FD08BD3B112F7446F27] each.each/(1/1) ...d'_RESULTS.-1_'field2'_-1, VertexName: D302AC22697D4606BF6619FE25070C69, VertexParallelism: 1, TaskAttemptID:attempt_1452787717101_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=61E88B117C9A427CAA12DB3CA85D5885, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=84D1255F9CE84831829AB958B769A8C7, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:38,380 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787717101_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:38,380 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:38,421 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:38,427 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:38,427 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:38,433 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787717101_0001_00_000001
2016-01-14 16:08:38,433 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787717101_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:38,447 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787717101_0001_00_000001
2016-01-14 16:08:38,447 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:38,451 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787717101_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:38,452 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:38,453 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787717101_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787717101_0001_00_000001, launchTime=1452787718452
2016-01-14 16:08:38,456 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787717101_0001_00_000001
2016-01-14 16:08:38,460 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787717101_0001_1_00_000000_0] to container: [container_1452787717101_0001_00_000001]
2016-01-14 16:08:38,460 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787717101_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:38,461 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787717101_0001_00_000001 given task: attempt_1452787717101_0001_1_00_000000_0
2016-01-14 16:08:38,461 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787717101_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787717101_0001_1_00_000000_0
2016-01-14 16:08:38 Starting to run new task attempt: attempt_1452787717101_0001_1_00_000000_0
2016-01-14 16:08:38,462 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787717101_0001_1_00_000000_0
2016-01-14 16:08:38,462 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:38,463 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787717101_0001_1_00_000000_0] started. Is using containerId: [container_1452787717101_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:38,464 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:38,464 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:38,465 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:38,466 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787717101_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=D302AC22697D4606BF6619FE25070C69, taskAttemptId=attempt_1452787717101_0001_1_00_000000_0, startTime=1452787718461, containerId=container_1452787717101_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787717101_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:38,467 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:38,467 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787717101_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:38,468 INFO  counters.Limits (Limits.java:ensureInitialized(59)) - Counter limits initialized with parameters:  GROUP_NAME_MAX=128, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200
2016-01-14 16:08:38,467 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:38,471 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787717101_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:38,491 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:38,492 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [3118E89530D04CA6AB921E2E492E1FC3/F6BBFAF755164FD08BD3B112F7446F27] each.each/(1/1) ...d'_RESULTS.-1_'field2'_-1, VertexName: D302AC22697D4606BF6619FE25070C69, VertexParallelism: 1, TaskAttemptID:attempt_1452787717101_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=61E88B117C9A427CAA12DB3CA85D5885, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=84D1255F9CE84831829AB958B769A8C7, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:38,494 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:38,498 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787717101_0001_1_00_000000_0
2016-01-14 16:08:38,499 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:38,499 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:38,503 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787717101_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:38,506 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=61E88B117C9A427CAA12DB3CA85D5885, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:38,507 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:38,507 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=84D1255F9CE84831829AB958B769A8C7, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:38,513 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:38,514 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:38,514 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 84D1255F9CE84831829AB958B769A8C7
2016-01-14 16:08:38,515 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:38,516 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 61E88B117C9A427CAA12DB3CA85D5885
2016-01-14 16:08:38,522 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 61E88B117C9A427CAA12DB3CA85D5885
2016-01-14 16:08:38,522 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 84D1255F9CE84831829AB958B769A8C7
2016-01-14 16:08:38,546 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:38,548 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:38,548 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 61E88B117C9A427CAA12DB3CA85D5885
2016-01-14 16:08:38,550 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 61E88B117C9A427CAA12DB3CA85D5885
2016-01-14 16:08:38,569 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: D302AC22697D4606BF6619FE25070C69, ordinal: 0
2016-01-14 16:08:38,570 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D302AC22697D4606BF6619FE25070C69, mem on start (mb), free: 215, total: 281, max: 672
2016-01-14 16:08:38,571 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:38,571 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:38,571 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:38,575 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:38,575 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 84D1255F9CE84831829AB958B769A8C7
2016-01-14 16:08:38,575 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:38,577 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:38,583 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:38,584 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:38,584 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:38,584 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:38,585 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:38,586 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:38,586 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 61E88B117C9A427CAA12DB3CA85D5885, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:38,586 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 84D1255F9CE84831829AB958B769A8C7, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:38,586 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:38,588 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 61E88B117C9A427CAA12DB3CA85D5885 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:38,588 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 61E88B117C9A427CAA12DB3CA85D5885
2016-01-14 16:08:38,588 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:38,589 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:38,589 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:38,590 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 61E88B117C9A427CAA12DB3CA85D5885
2016-01-14 16:08:38,590 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:38,593 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787717101_0001_1_00_000000_0
2016-01-14 16:08:38,595 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:38,601 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@6755f302
2016-01-14 16:08:38,609 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@6755f302
2016-01-14 16:08:38,610 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:38,610 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:38,626 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:38,648 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 61E88B117C9A427CAA12DB3CA85D5885
2016-01-14 16:08:38,648 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_-1"], id: 84D1255F9CE84831829AB958B769A8C7
2016-01-14 16:08:38,648 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_-1"]
2016-01-14 16:08:38,651 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:38,651 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:38,655 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: D302AC22697D4606BF6619FE25070C69, all 1 inputs ready in: 00:00:00.002
2016-01-14 16:08:38,662 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:38,663 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:38,664 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787717101_0001_1_00_000000_0
2016-01-14 16:08:38,664 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787717101_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:38,665 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787717101_0001_1_00_000000_0
2016-01-14 16:08:38,666 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D302AC22697D4606BF6619FE25070C69, mem on close (mb), free: 209, total: 281, max: 672
2016-01-14 16:08:38 Completed running task attempt: attempt_1452787717101_0001_1_00_000000_0
2016-01-14 16:08:38,672 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787717101_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:38,675 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787718655, Process_Duration=10, Process_End_Time=1452787718665, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:38,676 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:38,676 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:38,679 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:38,681 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787717101_0001_00_000001
2016-01-14 16:08:38,686 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787717101_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=D302AC22697D4606BF6619FE25070C69, taskAttemptId=attempt_1452787717101_0001_1_00_000000_0, startTime=1452787718461, finishTime=1452787718673, timeTaken=212, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787718655, Process_Duration=10, Process_End_Time=1452787718665, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:38,687 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787717101_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:38,687 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:38,688 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787717101_0001_1_00_000000_0
2016-01-14 16:08:38,690 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:38,693 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787717101_0001_1][Event:TASK_FINISHED]: vertexName=D302AC22697D4606BF6619FE25070C69, taskId=task_1452787717101_0001_1_00_000000, startTime=1452787718461, finishTime=1452787718689, timeTaken=228, status=SUCCEEDED, successfulAttemptID=attempt_1452787717101_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787718655, Process_Duration=10, Process_End_Time=1452787718665, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:38,696 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787717101_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:38,697 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787717101_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:38,697 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69] : 1
2016-01-14 16:08:38,698 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69]
2016-01-14 16:08:38,703 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:38,706 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787717101_0001_1][Event:VERTEX_FINISHED]: vertexName=D302AC22697D4606BF6619FE25070C69, vertexId=vertex_1452787717101_0001_1_00, initRequestedTime=1452787718169, initedTime=1452787718340, startRequestedTime=1452787718347, startedTime=1452787718347, finishTime=1452787718698, timeTaken=351, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787718655, Process_Duration=10, Process_End_Time=1452787718665, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787718461, firstTasksToStart=[ task_1452787717101_0001_1_00_000000 ], lastTaskFinishTime=1452787718673, lastTasksToFinish=[ task_1452787717101_0001_1_00_000000 ], minTaskDuration=212, maxTaskDuration=212, avgTaskDuration=212.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787717101_0001_1_00_000000 ], longestDurationTasks=[ task_1452787717101_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:38,707 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:38,708 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787717101_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787717101_0001_00_000001, stoppedTime=1452787718708, exitStatus=0
2016-01-14 16:08:38,708 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:38,709 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787717101_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:38,709 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:38,710 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787717101_0001_1
2016-01-14 16:08:38,710 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787717101_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787717101_0001_1
2016-01-14 16:08:38,711 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 84D1255F9CE84831829AB958B769A8C7 for vertex: vertex_1452787717101_0001_1_00 [D302AC22697D4606BF6619FE25070C69]
2016-01-14 16:08:38,715 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787717101_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:38,715 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787717101_0001_00_000001: 33 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:38,716 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787717101_0001_00_000001, Exiting
2016-01-14 16:08:38,717 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787717101_0001_00_000001
2016-01-14 16:08:38,717 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787717101_0001_00_000001
2016-01-14 16:08:38,721 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787717101_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:38,722 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787717101_0001_00_000001 completed successfully
2016-01-14 16:08:38,734 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787717101_0001_1, queueSize=0
2016-01-14 16:08:38,734 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:38,734 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787717101_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787717101_0001_1, startTime=1452787718166, finishTime=1452787718729, timeTaken=563, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787718655, Process_Duration=10, Process_End_Time=1452787718665, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:38,736 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787717101_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:38,737 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787717101_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:38,738 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787717101_0001_00_000001
2016-01-14 16:08:38,739 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787717101_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:38 Completed Dag: dag_1452787717101_0001_1
2016-01-14 16:08:38,741 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787717101_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:38,741 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787717101_0001_1_post
2016-01-14 16:08:38,742 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:38,743 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:38,750 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...d'_RESULTS.-1_'field2'_-1, applicationId=application_1452787717101_0001
2016-01-14 16:08:38,754 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:38,755 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:38,755 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:38,755 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:38,755 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:38,757 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:38,758 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:38,758 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:38,759 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:38,759 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:38,759 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:38,760 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:38,760 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:38,766 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3118E89530D04CA6AB921E2E492E1FC3/F6BBFAF755164FD08BD3B112F7446F27/.tez/application_1452787717101_0001
2016-01-14 16:08:38,767 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  completed in: 00:01.883
2016-01-14 16:08:38,912 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:38,951 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:38,951 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:39,031 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.034
2016-01-14 16:08:39,048 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.051
2016-01-14 16:08:39,049 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:39,050 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:39,050 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:39,075 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:39,076 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field2'
2016-01-14 16:08:39,112 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting
2016-01-14 16:08:39,112 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:39,113 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field2'"]
2016-01-14 16:08:39,113 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  parallel execution of steps is enabled: false
2016-01-14 16:08:39,113 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  executing total steps: 1
2016-01-14 16:08:39,114 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  allocating management threads: 1
2016-01-14 16:08:39,114 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting step: (1/1) ...ULTS.-1_'field2'_'field2'
2016-01-14 16:08:39,115 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [each.each] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:39,136 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tez session mode enabled: true
2016-01-14 16:08:39,142 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:39,143 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:39,143 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:39,154 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFEF27F755564E9E9F846138DB8BA71C/A8C2B918A43D49C2997EDED50CA084A7/.tez/application_1452787719142_0001 doesn't exist and is created
2016-01-14 16:08:39,178 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:39,178 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:39,180 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFEF27F755564E9E9F846138DB8BA71C/A8C2B918A43D49C2997EDED50CA084A7/.tez/application_1452787719142_0001
2016-01-14 16:08:39,186 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787719142_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:39,208 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:39,210 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:39,212 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:39,213 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:39,214 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFEF27F755564E9E9F846138DB8BA71C/A8C2B918A43D49C2997EDED50CA084A7/.tez/application_1452787719142_0001/localmode-log-dir
2016-01-14 16:08:39,214 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFEF27F755564E9E9F846138DB8BA71C/A8C2B918A43D49C2997EDED50CA084A7/.tez/application_1452787719142_0001/localmode-log-dir/history.txt.appattempt_1452787719142_0001_000000, maxErrors=10
2016-01-14 16:08:39,215 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:39,215 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787719142_0001_000000, appSubmitTime=1452787719185, launchTime=1452787719185
2016-01-14 16:08:39,247 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:39,250 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:39,253 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:39,253 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:39,258 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:49448
2016-01-14 16:08:39,264 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:39,268 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:39,268 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787719142_0001_000000, startTime=1452787719268
2016-01-14 16:08:39,268 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:39,279 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:39,279 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:39,279 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ULTS.-1_'field2'_'field2', applicationId=application_1452787719142_0001, dagName=[EFEF27F755564E9E9F846138DB8BA71C/A8C2B918A43D49C2997EDED50CA084A7] each.each/(1/1) ...ULTS.-1_'field2'_'field2'
2016-01-14 16:08:39,318 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [EFEF27F755564E9E9F846138DB8BA71C/A8C2B918A43D49C2997EDED50CA084A7] each.each/(1/1) ...ULTS.-1_'field2'_'field2'
2016-01-14 16:08:39,320 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787719142_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFEF27F755564E9E9F846138DB8BA71C/A8C2B918A43D49C2997EDED50CA084A7/.tez/application_1452787719142_0001/localmode-log-dir/dag_1452787719142_0001_1.dot
2016-01-14 16:08:39,321 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFEF27F755564E9E9F846138DB8BA71C/A8C2B918A43D49C2997EDED50CA084A7/.tez/application_1452787719142_0001/localmode-log-dir/dag_1452787719142_0001_1-tez-dag.pb.txt
2016-01-14 16:08:39,357 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787719142_0001_1
2016-01-14 16:08:39,357 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:39,357 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [EFEF27F755564E9E9F846138DB8BA71C/A8C2B918A43D49C2997EDED50CA084A7] each.each/(1/1) ...ULTS.-1_'field2'_'field2'
2016-01-14 16:08:39 Running Dag: dag_1452787719142_0001_1
2016-01-14 16:08:39,372 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:39,372 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719142_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787719142_0001_1, submitTime=1452787719318
2016-01-14 16:08:39,374 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex F5636AAF734E4754B851F5A55DB48347
2016-01-14 16:08:39,374 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:39,375 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719142_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787719142_0001_1, initTime=1452787719373
2016-01-14 16:08:39,375 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:39,376 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787719142_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:39,377 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719142_0001_1][Event:DAG_STARTED]: dagID=dag_1452787719142_0001_1, startTime=1452787719377
2016-01-14 16:08:39,377 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:39,378 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:39,379 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787719142_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:39,380 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: F5636AAF734E4754B851F5A55DB48347 : {B0B6B823ADF140DEB6553DF4FFB8A777={InputName=B0B6B823ADF140DEB6553DF4FFB8A777}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:39,380 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: B0B6B823ADF140DEB6553DF4FFB8A777, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:39,380 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347]
2016-01-14 16:08:39,380 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ULTS.-1_'field2'_'field2', applicationId=application_1452787719142_0001, dagName=[EFEF27F755564E9E9F846138DB8BA71C/A8C2B918A43D49C2997EDED50CA084A7] each.each/(1/1) ...ULTS.-1_'field2'_'field2'
2016-01-14 16:08:39,380 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347]
2016-01-14 16:08:39,381 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347]
2016-01-14 16:08:39,382 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347]. Starting root input initializers: 1
2016-01-14 16:08:39,385 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:39,385 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: B0B6B823ADF140DEB6553DF4FFB8A777 on vertex vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347]
2016-01-14 16:08:39,392 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:39,393 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input B0B6B823ADF140DEB6553DF4FFB8A777 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:39,394 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:39,395 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:39,398 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:39,399 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] submitted tez dag to app master: application_1452787719142_0001, with dag id: dag_1452787719142_0001_1
2016-01-14 16:08:39,399 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: B0B6B823ADF140DEB6553DF4FFB8A777 on vertex vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347]
2016-01-14 16:08:39,400 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:39,400 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {B0B6B823ADF140DEB6553DF4FFB8A777=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:39,401 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347] parallelism set to 1
2016-01-14 16:08:39,401 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:39,401 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719142_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787719142_0001_1_00, eventCount=1
2016-01-14 16:08:39,401 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347]
2016-01-14 16:08:39,402 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=B7150351B11746128B7148E20E1A82B2, vertexId=vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:39,402 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=B7150351B11746128B7148E20E1A82B2, vertexId=vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347]
2016-01-14 16:08:39,406 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=B7150351B11746128B7148E20E1A82B2, vertexName=F5636AAF734E4754B851F5A55DB48347, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:39,407 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=B7150351B11746128B7148E20E1A82B2, vertexId=vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347]
2016-01-14 16:08:39,408 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:39,408 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719142_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F5636AAF734E4754B851F5A55DB48347, vertexId=vertex_1452787719142_0001_1_00, initRequestedTime=1452787719380, initedTime=1452787719408, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:39,408 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347] with distanceFromRoot: 0
2016-01-14 16:08:39,408 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:39,409 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in F5636AAF734E4754B851F5A55DB48347
2016-01-14 16:08:39,409 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347]
2016-01-14 16:08:39,410 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:39,410 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719142_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787719142_0001_1_00, startRequestedTime=1452787719409, startedTime=1452787719409
2016-01-14 16:08:39,410 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:39,411 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:39,411 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719142_0001_1][Event:TASK_STARTED]: vertexName=F5636AAF734E4754B851F5A55DB48347, taskId=task_1452787719142_0001_1_00_000000, scheduledTime=1452787719411, launchTime=1452787719411
2016-01-14 16:08:39,412 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787719142_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:39,412 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347]
2016-01-14 16:08:39,413 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [EFEF27F755564E9E9F846138DB8BA71C/A8C2B918A43D49C2997EDED50CA084A7] each.each/(1/1) ...ULTS.-1_'field2'_'field2', VertexName: F5636AAF734E4754B851F5A55DB48347, VertexParallelism: 1, TaskAttemptID:attempt_1452787719142_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=B0B6B823ADF140DEB6553DF4FFB8A777, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=B7150351B11746128B7148E20E1A82B2, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:39,413 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787719142_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:39,413 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:39,415 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:39,416 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:39,416 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:39,417 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787719142_0001_00_000001
2016-01-14 16:08:39,417 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787719142_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:39,423 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787719142_0001_00_000001
2016-01-14 16:08:39,423 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:39,425 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787719142_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:39,426 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:39,427 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719142_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787719142_0001_00_000001, launchTime=1452787719426
2016-01-14 16:08:39,427 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787719142_0001_00_000001
2016-01-14 16:08:39,429 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787719142_0001_1_00_000000_0] to container: [container_1452787719142_0001_00_000001]
2016-01-14 16:08:39,429 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787719142_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:39,429 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787719142_0001_00_000001 given task: attempt_1452787719142_0001_1_00_000000_0
2016-01-14 16:08:39,430 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787719142_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787719142_0001_1_00_000000_0
2016-01-14 16:08:39,430 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787719142_0001_1_00_000000_0] started. Is using containerId: [container_1452787719142_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:39,430 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:39,430 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719142_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F5636AAF734E4754B851F5A55DB48347, taskAttemptId=attempt_1452787719142_0001_1_00_000000_0, startTime=1452787719429, containerId=container_1452787719142_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787719142_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:39 Starting to run new task attempt: attempt_1452787719142_0001_1_00_000000_0
2016-01-14 16:08:39,430 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787719142_0001_1_00_000000_0
2016-01-14 16:08:39,430 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:39,431 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:39,431 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:39,431 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:39,431 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:39,431 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:39,433 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [EFEF27F755564E9E9F846138DB8BA71C/A8C2B918A43D49C2997EDED50CA084A7] each.each/(1/1) ...ULTS.-1_'field2'_'field2', VertexName: F5636AAF734E4754B851F5A55DB48347, VertexParallelism: 1, TaskAttemptID:attempt_1452787719142_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=B0B6B823ADF140DEB6553DF4FFB8A777, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=B7150351B11746128B7148E20E1A82B2, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:39,433 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:39,430 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787719142_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:39,434 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787719142_0001_1_00_000000_0
2016-01-14 16:08:39,435 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:39,435 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:39,435 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787719142_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:39,436 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787719142_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:39,437 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=B0B6B823ADF140DEB6553DF4FFB8A777, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:39,437 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:39,438 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=B7150351B11746128B7148E20E1A82B2, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:39,438 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:39,439 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: B0B6B823ADF140DEB6553DF4FFB8A777
2016-01-14 16:08:39,438 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:39,439 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: B7150351B11746128B7148E20E1A82B2
2016-01-14 16:08:39,440 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:39,440 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: B7150351B11746128B7148E20E1A82B2
2016-01-14 16:08:39,439 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: B0B6B823ADF140DEB6553DF4FFB8A777
2016-01-14 16:08:39,447 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:39,447 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: B0B6B823ADF140DEB6553DF4FFB8A777
2016-01-14 16:08:39,448 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: B0B6B823ADF140DEB6553DF4FFB8A777
2016-01-14 16:08:39,449 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:39,459 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:39,459 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: B7150351B11746128B7148E20E1A82B2
2016-01-14 16:08:39,460 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F5636AAF734E4754B851F5A55DB48347, ordinal: 0
2016-01-14 16:08:39,461 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F5636AAF734E4754B851F5A55DB48347, mem on start (mb), free: 234, total: 281, max: 672
2016-01-14 16:08:39,461 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:39,461 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:39,461 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:39,461 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:39,461 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:39,462 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:39,462 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:39,462 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:39,463 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:39,463 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:39,464 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:39,464 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, B7150351B11746128B7148E20E1A82B2, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:39,465 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, B0B6B823ADF140DEB6553DF4FFB8A777, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:39,465 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:39,465 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: B0B6B823ADF140DEB6553DF4FFB8A777 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:39,465 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: B0B6B823ADF140DEB6553DF4FFB8A777
2016-01-14 16:08:39,465 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:39,465 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: B0B6B823ADF140DEB6553DF4FFB8A777
2016-01-14 16:08:39,465 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:39,466 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:39,466 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:39,466 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787719142_0001_1_00_000000_0
2016-01-14 16:08:39,470 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:39,471 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@2f1272ec
2016-01-14 16:08:39,473 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:39,473 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@2f1272ec
2016-01-14 16:08:39,474 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:39,474 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:39,477 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: B0B6B823ADF140DEB6553DF4FFB8A777
2016-01-14 16:08:39,477 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field2'"], id: B7150351B11746128B7148E20E1A82B2
2016-01-14 16:08:39,478 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field2'"]
2016-01-14 16:08:39,478 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:39,478 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:39,479 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F5636AAF734E4754B851F5A55DB48347, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:39,482 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:39,483 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:39,484 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787719142_0001_1_00_000000_0
2016-01-14 16:08:39,484 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787719142_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:39,485 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787719142_0001_1_00_000000_0
2016-01-14 16:08:39,486 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F5636AAF734E4754B851F5A55DB48347, mem on close (mb), free: 232, total: 281, max: 672
2016-01-14 16:08:39 Completed running task attempt: attempt_1452787719142_0001_1_00_000000_0
2016-01-14 16:08:39,488 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787719142_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:39,490 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:39,491 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719142_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F5636AAF734E4754B851F5A55DB48347, taskAttemptId=attempt_1452787719142_0001_1_00_000000_0, startTime=1452787719429, finishTime=1452787719490, timeTaken=61, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787719479, Process_Duration=6, Process_End_Time=1452787719485, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:39,492 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787719142_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:39,492 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787719142_0001_1_00_000000_0
2016-01-14 16:08:39,492 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:39,492 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:39,494 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719142_0001_1][Event:TASK_FINISHED]: vertexName=F5636AAF734E4754B851F5A55DB48347, taskId=task_1452787719142_0001_1_00_000000, startTime=1452787719429, finishTime=1452787719492, timeTaken=63, status=SUCCEEDED, successfulAttemptID=attempt_1452787719142_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787719479, Process_Duration=6, Process_End_Time=1452787719485, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:39,494 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787719142_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:39,494 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347] : 1
2016-01-14 16:08:39,494 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347]
2016-01-14 16:08:39,495 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787719479, Process_Duration=6, Process_End_Time=1452787719485, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:39,495 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:39,495 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:39,496 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787719142_0001_00_000001
2016-01-14 16:08:39,496 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:39,498 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719142_0001_1][Event:VERTEX_FINISHED]: vertexName=F5636AAF734E4754B851F5A55DB48347, vertexId=vertex_1452787719142_0001_1_00, initRequestedTime=1452787719380, initedTime=1452787719408, startRequestedTime=1452787719409, startedTime=1452787719409, finishTime=1452787719494, timeTaken=85, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787719479, Process_Duration=6, Process_End_Time=1452787719485, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787719429, firstTasksToStart=[ task_1452787719142_0001_1_00_000000 ], lastTaskFinishTime=1452787719490, lastTasksToFinish=[ task_1452787719142_0001_1_00_000000 ], minTaskDuration=61, maxTaskDuration=61, avgTaskDuration=61.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787719142_0001_1_00_000000 ], longestDurationTasks=[ task_1452787719142_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:39,498 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:39,499 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787719142_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:39,499 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:39,499 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719142_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787719142_0001_00_000001, stoppedTime=1452787719499, exitStatus=0
2016-01-14 16:08:39,500 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787719142_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:39,501 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:39,501 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787719142_0001_1
2016-01-14 16:08:39,502 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719142_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787719142_0001_1
2016-01-14 16:08:39,502 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: B7150351B11746128B7148E20E1A82B2 for vertex: vertex_1452787719142_0001_1_00 [F5636AAF734E4754B851F5A55DB48347]
2016-01-14 16:08:39,510 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787719142_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:39,510 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787719142_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:39,510 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787719142_0001_00_000001, Exiting
2016-01-14 16:08:39,510 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787719142_0001_00_000001
2016-01-14 16:08:39,510 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787719142_0001_00_000001
2016-01-14 16:08:39,513 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787719142_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:39,513 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787719142_0001_1, queueSize=0
2016-01-14 16:08:39,513 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787719142_0001_00_000001 completed successfully
2016-01-14 16:08:39,513 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:39,515 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719142_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787719142_0001_1, startTime=1452787719377, finishTime=1452787719511, timeTaken=134, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787719479, Process_Duration=6, Process_End_Time=1452787719485, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:39,515 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787719142_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:39,516 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787719142_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:39,516 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787719142_0001_00_000001
2016-01-14 16:08:39,517 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787719142_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:39 Completed Dag: dag_1452787719142_0001_1
2016-01-14 16:08:39,520 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787719142_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:39,522 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787719142_0001_1_post
2016-01-14 16:08:39,522 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:39,523 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:39,525 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ULTS.-1_'field2'_'field2', applicationId=application_1452787719142_0001
2016-01-14 16:08:39,527 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:39,527 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:39,528 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:39,528 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:39,528 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:39,528 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:39,530 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:39,530 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:39,530 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:39,530 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:39,531 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:39,531 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:39,531 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:39,536 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFEF27F755564E9E9F846138DB8BA71C/A8C2B918A43D49C2997EDED50CA084A7/.tez/application_1452787719142_0001
2016-01-14 16:08:39,537 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  completed in: 00:00.425
2016-01-14 16:08:39,632 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.-1_'field2'_'field2'
2016-01-14 16:08:39,664 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:39,665 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:39,728 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.027
2016-01-14 16:08:39,748 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.047
2016-01-14 16:08:39,749 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:39,749 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:39,750 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:39,767 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:39,768 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field'
2016-01-14 16:08:39,792 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting
2016-01-14 16:08:39,793 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:39,794 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field'"]
2016-01-14 16:08:39,794 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  parallel execution of steps is enabled: false
2016-01-14 16:08:39,794 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  executing total steps: 1
2016-01-14 16:08:39,794 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  allocating management threads: 1
2016-01-14 16:08:39,795 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting step: (1/1) ...SULTS.-1_'field2'_'field'
2016-01-14 16:08:39,796 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [each.each] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:39,814 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tez session mode enabled: true
2016-01-14 16:08:39,820 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:39,820 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:39,820 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:39,831 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EAC39CDF5A624A0CA1076FA4710EE50F/CC6730DE677D4B86934C11E5C58CD375/.tez/application_1452787719820_0001 doesn't exist and is created
2016-01-14 16:08:39,858 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:39,858 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:39,859 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EAC39CDF5A624A0CA1076FA4710EE50F/CC6730DE677D4B86934C11E5C58CD375/.tez/application_1452787719820_0001
2016-01-14 16:08:39,865 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787719820_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:39,879 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:39,880 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:39,882 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:39,882 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:39,883 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EAC39CDF5A624A0CA1076FA4710EE50F/CC6730DE677D4B86934C11E5C58CD375/.tez/application_1452787719820_0001/localmode-log-dir
2016-01-14 16:08:39,884 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EAC39CDF5A624A0CA1076FA4710EE50F/CC6730DE677D4B86934C11E5C58CD375/.tez/application_1452787719820_0001/localmode-log-dir/history.txt.appattempt_1452787719820_0001_000000, maxErrors=10
2016-01-14 16:08:39,884 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:39,885 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787719820_0001_000000, appSubmitTime=1452787719865, launchTime=1452787719865
2016-01-14 16:08:39,890 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:39,894 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:39,900 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:39,900 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:39,901 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:48044
2016-01-14 16:08:39,903 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:39,906 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787719820_0001_000000, startTime=1452787719905
2016-01-14 16:08:39,906 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:39,906 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:39,958 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:39,958 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:39,958 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...SULTS.-1_'field2'_'field', applicationId=application_1452787719820_0001, dagName=[EAC39CDF5A624A0CA1076FA4710EE50F/CC6730DE677D4B86934C11E5C58CD375] each.each/(1/1) ...SULTS.-1_'field2'_'field'
2016-01-14 16:08:39,981 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [EAC39CDF5A624A0CA1076FA4710EE50F/CC6730DE677D4B86934C11E5C58CD375] each.each/(1/1) ...SULTS.-1_'field2'_'field'
2016-01-14 16:08:39,982 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787719820_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EAC39CDF5A624A0CA1076FA4710EE50F/CC6730DE677D4B86934C11E5C58CD375/.tez/application_1452787719820_0001/localmode-log-dir/dag_1452787719820_0001_1.dot
2016-01-14 16:08:39,983 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EAC39CDF5A624A0CA1076FA4710EE50F/CC6730DE677D4B86934C11E5C58CD375/.tez/application_1452787719820_0001/localmode-log-dir/dag_1452787719820_0001_1-tez-dag.pb.txt
2016-01-14 16:08:40,008 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787719820_0001_1
2016-01-14 16:08:40,009 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:40,009 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [EAC39CDF5A624A0CA1076FA4710EE50F/CC6730DE677D4B86934C11E5C58CD375] each.each/(1/1) ...SULTS.-1_'field2'_'field'
2016-01-14 16:08:40 Running Dag: dag_1452787719820_0001_1
2016-01-14 16:08:40,022 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719820_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787719820_0001_1, submitTime=1452787719981
2016-01-14 16:08:40,022 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:40,023 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex C4C0E1C62DFE46D285C2B9B371808FCC
2016-01-14 16:08:40,023 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:40,023 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719820_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787719820_0001_1, initTime=1452787720022
2016-01-14 16:08:40,024 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787719820_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:40,024 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:40,025 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:40,025 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719820_0001_1][Event:DAG_STARTED]: dagID=dag_1452787719820_0001_1, startTime=1452787720025
2016-01-14 16:08:40,025 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:40,026 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787719820_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:40,026 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: C4C0E1C62DFE46D285C2B9B371808FCC : {145097EF1F9243E6B56C961E67B2F91B={InputName=145097EF1F9243E6B56C961E67B2F91B}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:40,026 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 145097EF1F9243E6B56C961E67B2F91B, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:40,026 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC]
2016-01-14 16:08:40,026 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC]
2016-01-14 16:08:40,027 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC]
2016-01-14 16:08:40,027 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC]. Starting root input initializers: 1
2016-01-14 16:08:40,028 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:40,028 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...SULTS.-1_'field2'_'field', applicationId=application_1452787719820_0001, dagName=[EAC39CDF5A624A0CA1076FA4710EE50F/CC6730DE677D4B86934C11E5C58CD375] each.each/(1/1) ...SULTS.-1_'field2'_'field'
2016-01-14 16:08:40,028 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 145097EF1F9243E6B56C961E67B2F91B on vertex vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC]
2016-01-14 16:08:40,030 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:40,031 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 145097EF1F9243E6B56C961E67B2F91B asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:40,031 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:40,032 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:40,034 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:40,034 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 145097EF1F9243E6B56C961E67B2F91B on vertex vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC]
2016-01-14 16:08:40,034 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:40,034 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {145097EF1F9243E6B56C961E67B2F91B=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:40,035 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC] parallelism set to 1
2016-01-14 16:08:40,035 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:40,035 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719820_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787719820_0001_1_00, eventCount=1
2016-01-14 16:08:40,036 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC]
2016-01-14 16:08:40,036 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=E83484676816498D93F9AE03ED8D5960, vertexId=vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:40,037 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=E83484676816498D93F9AE03ED8D5960, vertexId=vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC]
2016-01-14 16:08:40,039 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=E83484676816498D93F9AE03ED8D5960, vertexName=C4C0E1C62DFE46D285C2B9B371808FCC, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:40,039 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=E83484676816498D93F9AE03ED8D5960, vertexId=vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC]
2016-01-14 16:08:40,042 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:40,042 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719820_0001_1][Event:VERTEX_INITIALIZED]: vertexName=C4C0E1C62DFE46D285C2B9B371808FCC, vertexId=vertex_1452787719820_0001_1_00, initRequestedTime=1452787720026, initedTime=1452787720042, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:40,043 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC] with distanceFromRoot: 0
2016-01-14 16:08:40,043 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:40,043 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in C4C0E1C62DFE46D285C2B9B371808FCC
2016-01-14 16:08:40,044 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC]
2016-01-14 16:08:40,044 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:40,045 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719820_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787719820_0001_1_00, startRequestedTime=1452787720043, startedTime=1452787720043
2016-01-14 16:08:40,045 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:40,046 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:40,046 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719820_0001_1][Event:TASK_STARTED]: vertexName=C4C0E1C62DFE46D285C2B9B371808FCC, taskId=task_1452787719820_0001_1_00_000000, scheduledTime=1452787720045, launchTime=1452787720045
2016-01-14 16:08:40,047 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787719820_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:40,047 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC]
2016-01-14 16:08:40,047 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [EAC39CDF5A624A0CA1076FA4710EE50F/CC6730DE677D4B86934C11E5C58CD375] each.each/(1/1) ...SULTS.-1_'field2'_'field', VertexName: C4C0E1C62DFE46D285C2B9B371808FCC, VertexParallelism: 1, TaskAttemptID:attempt_1452787719820_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=145097EF1F9243E6B56C961E67B2F91B, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=E83484676816498D93F9AE03ED8D5960, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:40,048 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787719820_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:40,048 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:40,049 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:40,049 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:40,049 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:40,050 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787719820_0001_00_000001
2016-01-14 16:08:40,050 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787719820_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:40,053 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787719820_0001_00_000001
2016-01-14 16:08:40,053 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:40,054 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787719820_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:40,054 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:40,055 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719820_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787719820_0001_00_000001, launchTime=1452787720054
2016-01-14 16:08:40,056 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787719820_0001_00_000001
2016-01-14 16:08:40,056 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] submitted tez dag to app master: application_1452787719820_0001, with dag id: dag_1452787719820_0001_1
2016-01-14 16:08:40,057 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787719820_0001_1_00_000000_0] to container: [container_1452787719820_0001_00_000001]
2016-01-14 16:08:40,058 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787719820_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:40,058 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787719820_0001_00_000001 given task: attempt_1452787719820_0001_1_00_000000_0
2016-01-14 16:08:40,058 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787719820_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787719820_0001_1_00_000000_0
2016-01-14 16:08:40,058 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787719820_0001_1_00_000000_0] started. Is using containerId: [container_1452787719820_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:40,059 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719820_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=C4C0E1C62DFE46D285C2B9B371808FCC, taskAttemptId=attempt_1452787719820_0001_1_00_000000_0, startTime=1452787720058, containerId=container_1452787719820_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787719820_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:40 Starting to run new task attempt: attempt_1452787719820_0001_1_00_000000_0
2016-01-14 16:08:40,059 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787719820_0001_1_00_000000_0
2016-01-14 16:08:40,059 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787719820_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:40,059 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:40,059 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787719820_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:40,060 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:40,063 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:40,060 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:40,064 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:40,064 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:40,065 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:40,065 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [EAC39CDF5A624A0CA1076FA4710EE50F/CC6730DE677D4B86934C11E5C58CD375] each.each/(1/1) ...SULTS.-1_'field2'_'field', VertexName: C4C0E1C62DFE46D285C2B9B371808FCC, VertexParallelism: 1, TaskAttemptID:attempt_1452787719820_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=145097EF1F9243E6B56C961E67B2F91B, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=E83484676816498D93F9AE03ED8D5960, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:40,066 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:40,066 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787719820_0001_1_00_000000_0
2016-01-14 16:08:40,067 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:40,067 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:40,068 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=145097EF1F9243E6B56C961E67B2F91B, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:40,070 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787719820_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:40,073 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:40,068 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=E83484676816498D93F9AE03ED8D5960, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:40,068 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:40,074 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:40,074 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 145097EF1F9243E6B56C961E67B2F91B
2016-01-14 16:08:40,074 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 145097EF1F9243E6B56C961E67B2F91B
2016-01-14 16:08:40,076 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: E83484676816498D93F9AE03ED8D5960
2016-01-14 16:08:40,076 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:40,076 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: E83484676816498D93F9AE03ED8D5960
2016-01-14 16:08:40,078 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:40,078 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 145097EF1F9243E6B56C961E67B2F91B
2016-01-14 16:08:40,079 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 145097EF1F9243E6B56C961E67B2F91B
2016-01-14 16:08:40,079 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:40,094 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: C4C0E1C62DFE46D285C2B9B371808FCC, ordinal: 0
2016-01-14 16:08:40,094 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C4C0E1C62DFE46D285C2B9B371808FCC, mem on start (mb), free: 154, total: 281, max: 672
2016-01-14 16:08:40,095 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:40,095 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:40,096 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:40,099 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:40,099 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: E83484676816498D93F9AE03ED8D5960
2016-01-14 16:08:40,099 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:40,100 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:40,100 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:40,100 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:40,100 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:40,100 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:40,100 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:40,101 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:40,101 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 145097EF1F9243E6B56C961E67B2F91B, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:40,101 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, E83484676816498D93F9AE03ED8D5960, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:40,101 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:40,101 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 145097EF1F9243E6B56C961E67B2F91B being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:40,101 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 145097EF1F9243E6B56C961E67B2F91B
2016-01-14 16:08:40,101 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:40,102 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:40,102 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:40,102 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 145097EF1F9243E6B56C961E67B2F91B
2016-01-14 16:08:40,103 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:40,104 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787719820_0001_1_00_000000_0
2016-01-14 16:08:40,105 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:40,106 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@4da8a55
2016-01-14 16:08:40,108 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:40,110 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 145097EF1F9243E6B56C961E67B2F91B
2016-01-14 16:08:40,111 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field'"], id: E83484676816498D93F9AE03ED8D5960
2016-01-14 16:08:40,111 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field'"]
2016-01-14 16:08:40,113 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:40,113 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:40,115 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@4da8a55
2016-01-14 16:08:40,115 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:40,115 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:40,116 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: C4C0E1C62DFE46D285C2B9B371808FCC, all 1 inputs ready in: 00:00:00.001
2016-01-14 16:08:40,119 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:40,120 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:40,121 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787719820_0001_1_00_000000_0
2016-01-14 16:08:40,121 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787719820_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:40,122 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787719820_0001_1_00_000000_0
2016-01-14 16:08:40,122 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C4C0E1C62DFE46D285C2B9B371808FCC, mem on close (mb), free: 152, total: 281, max: 672
2016-01-14 16:08:40 Completed running task attempt: attempt_1452787719820_0001_1_00_000000_0
2016-01-14 16:08:40,124 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787719820_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:40,125 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=652, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787720116, Process_Duration=6, Process_End_Time=1452787720122, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:40,126 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719820_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=C4C0E1C62DFE46D285C2B9B371808FCC, taskAttemptId=attempt_1452787719820_0001_1_00_000000_0, startTime=1452787720058, finishTime=1452787720125, timeTaken=67, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=652, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787720116, Process_Duration=6, Process_End_Time=1452787720122, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:40,126 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787719820_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:40,127 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:40,125 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:40,127 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787719820_0001_1_00_000000_0
2016-01-14 16:08:40,128 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:40,128 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719820_0001_1][Event:TASK_FINISHED]: vertexName=C4C0E1C62DFE46D285C2B9B371808FCC, taskId=task_1452787719820_0001_1_00_000000, startTime=1452787720058, finishTime=1452787720127, timeTaken=69, status=SUCCEEDED, successfulAttemptID=attempt_1452787719820_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=652, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787720116, Process_Duration=6, Process_End_Time=1452787720122, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:40,126 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:40,129 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:40,129 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787719820_0001_00_000001
2016-01-14 16:08:40,128 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787719820_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:40,131 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC] : 1
2016-01-14 16:08:40,131 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC]
2016-01-14 16:08:40,133 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:40,135 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719820_0001_1][Event:VERTEX_FINISHED]: vertexName=C4C0E1C62DFE46D285C2B9B371808FCC, vertexId=vertex_1452787719820_0001_1_00, initRequestedTime=1452787720026, initedTime=1452787720042, startRequestedTime=1452787720043, startedTime=1452787720043, finishTime=1452787720131, timeTaken=88, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=652, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787720116, Process_Duration=6, Process_End_Time=1452787720122, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787720058, firstTasksToStart=[ task_1452787719820_0001_1_00_000000 ], lastTaskFinishTime=1452787720125, lastTasksToFinish=[ task_1452787719820_0001_1_00_000000 ], minTaskDuration=67, maxTaskDuration=67, avgTaskDuration=67.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787719820_0001_1_00_000000 ], longestDurationTasks=[ task_1452787719820_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:40,135 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:40,135 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787719820_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:40,136 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:40,137 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719820_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787719820_0001_00_000001, stoppedTime=1452787720136, exitStatus=0
2016-01-14 16:08:40,137 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787719820_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:40,137 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:40,138 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787719820_0001_1
2016-01-14 16:08:40,138 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719820_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787719820_0001_1
2016-01-14 16:08:40,138 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: E83484676816498D93F9AE03ED8D5960 for vertex: vertex_1452787719820_0001_1_00 [C4C0E1C62DFE46D285C2B9B371808FCC]
2016-01-14 16:08:40,141 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787719820_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:40,141 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787719820_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:40,142 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787719820_0001_00_000001, Exiting
2016-01-14 16:08:40,142 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787719820_0001_00_000001
2016-01-14 16:08:40,142 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787719820_0001_00_000001
2016-01-14 16:08:40,145 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787719820_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:40,146 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787719820_0001_00_000001 completed successfully
2016-01-14 16:08:40,154 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787719820_0001_1, queueSize=0
2016-01-14 16:08:40,155 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:40,155 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787719820_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787719820_0001_1, startTime=1452787720025, finishTime=1452787720153, timeTaken=128, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=652, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787720116, Process_Duration=6, Process_End_Time=1452787720122, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:40,155 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787719820_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:40,156 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787719820_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:40,156 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787719820_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:40 Completed Dag: dag_1452787719820_0001_1
2016-01-14 16:08:40,156 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787719820_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:40,156 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787719820_0001_00_000001
2016-01-14 16:08:40,156 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787719820_0001_1_post
2016-01-14 16:08:40,157 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:40,158 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:40,167 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...SULTS.-1_'field2'_'field', applicationId=application_1452787719820_0001
2016-01-14 16:08:40,170 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:40,170 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:40,170 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:40,170 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:40,170 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:40,171 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:40,171 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:40,172 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:40,172 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:40,172 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:40,172 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:40,173 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:40,173 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:40,179 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EAC39CDF5A624A0CA1076FA4710EE50F/CC6730DE677D4B86934C11E5C58CD375/.tez/application_1452787719820_0001
2016-01-14 16:08:40,180 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  completed in: 00:00.388
2016-01-14 16:08:40,287 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.-1_'field2'_'field'
2016-01-14 16:08:40,313 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:40,313 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:40,365 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.023
2016-01-14 16:08:40,370 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.028
2016-01-14 16:08:40,371 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:40,371 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:40,371 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:40,389 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:40,390 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_RESULTS
2016-01-14 16:08:40,407 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting
2016-01-14 16:08:40,407 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:40,407 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_RESULTS"]
2016-01-14 16:08:40,408 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  parallel execution of steps is enabled: false
2016-01-14 16:08:40,408 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  executing total steps: 1
2016-01-14 16:08:40,408 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  allocating management threads: 1
2016-01-14 16:08:40,409 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting step: (1/1) ...SULTS.-1_'field2'_RESULTS
2016-01-14 16:08:40,409 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [each.each] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:40,430 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tez session mode enabled: true
2016-01-14 16:08:40,436 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:40,437 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:40,437 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:40,451 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/61FCAF3B4EA34F8388CC44DDDE5CFD39/A484680B42BA49B6A6A86FCD444116D4/.tez/application_1452787720437_0001 doesn't exist and is created
2016-01-14 16:08:40,469 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:40,469 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:40,470 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/61FCAF3B4EA34F8388CC44DDDE5CFD39/A484680B42BA49B6A6A86FCD444116D4/.tez/application_1452787720437_0001
2016-01-14 16:08:40,474 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787720437_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:40,485 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:40,486 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:40,488 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:40,488 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:40,489 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/61FCAF3B4EA34F8388CC44DDDE5CFD39/A484680B42BA49B6A6A86FCD444116D4/.tez/application_1452787720437_0001/localmode-log-dir
2016-01-14 16:08:40,489 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/61FCAF3B4EA34F8388CC44DDDE5CFD39/A484680B42BA49B6A6A86FCD444116D4/.tez/application_1452787720437_0001/localmode-log-dir/history.txt.appattempt_1452787720437_0001_000000, maxErrors=10
2016-01-14 16:08:40,489 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:40,489 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787720437_0001_000000, appSubmitTime=1452787720473, launchTime=1452787720473
2016-01-14 16:08:40,495 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:40,498 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:40,500 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:40,500 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:40,504 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:55304
2016-01-14 16:08:40,508 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:40,510 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787720437_0001_000000, startTime=1452787720510
2016-01-14 16:08:40,510 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:40,510 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:40,570 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:40,570 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:40,570 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...SULTS.-1_'field2'_RESULTS, applicationId=application_1452787720437_0001, dagName=[61FCAF3B4EA34F8388CC44DDDE5CFD39/A484680B42BA49B6A6A86FCD444116D4] each.each/(1/1) ...SULTS.-1_'field2'_RESULTS
2016-01-14 16:08:40,590 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [61FCAF3B4EA34F8388CC44DDDE5CFD39/A484680B42BA49B6A6A86FCD444116D4] each.each/(1/1) ...SULTS.-1_'field2'_RESULTS
2016-01-14 16:08:40,591 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787720437_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/61FCAF3B4EA34F8388CC44DDDE5CFD39/A484680B42BA49B6A6A86FCD444116D4/.tez/application_1452787720437_0001/localmode-log-dir/dag_1452787720437_0001_1.dot
2016-01-14 16:08:40,592 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/61FCAF3B4EA34F8388CC44DDDE5CFD39/A484680B42BA49B6A6A86FCD444116D4/.tez/application_1452787720437_0001/localmode-log-dir/dag_1452787720437_0001_1-tez-dag.pb.txt
2016-01-14 16:08:40,619 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787720437_0001_1
2016-01-14 16:08:40,619 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:40,619 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [61FCAF3B4EA34F8388CC44DDDE5CFD39/A484680B42BA49B6A6A86FCD444116D4] each.each/(1/1) ...SULTS.-1_'field2'_RESULTS
2016-01-14 16:08:40 Running Dag: dag_1452787720437_0001_1
2016-01-14 16:08:40,635 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720437_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787720437_0001_1, submitTime=1452787720590
2016-01-14 16:08:40,635 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:40,635 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex BEC5E3F2AB294D979E8D5865F990EE9D
2016-01-14 16:08:40,636 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:40,636 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:40,637 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720437_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787720437_0001_1, initTime=1452787720635
2016-01-14 16:08:40,637 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787720437_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:40,637 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720437_0001_1][Event:DAG_STARTED]: dagID=dag_1452787720437_0001_1, startTime=1452787720637
2016-01-14 16:08:40,638 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:40,638 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787720437_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:40,638 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: BEC5E3F2AB294D979E8D5865F990EE9D : {25C22E34078847EBBF9380D20D16D814={InputName=25C22E34078847EBBF9380D20D16D814}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:40,638 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 25C22E34078847EBBF9380D20D16D814, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:40,638 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D]
2016-01-14 16:08:40,638 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D]
2016-01-14 16:08:40,638 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D]
2016-01-14 16:08:40,639 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D]. Starting root input initializers: 1
2016-01-14 16:08:40,639 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:40,639 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:40,640 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 25C22E34078847EBBF9380D20D16D814 on vertex vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D]
2016-01-14 16:08:40,640 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...SULTS.-1_'field2'_RESULTS, applicationId=application_1452787720437_0001, dagName=[61FCAF3B4EA34F8388CC44DDDE5CFD39/A484680B42BA49B6A6A86FCD444116D4] each.each/(1/1) ...SULTS.-1_'field2'_RESULTS
2016-01-14 16:08:40,642 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:40,642 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 25C22E34078847EBBF9380D20D16D814 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:40,643 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:40,644 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:40,646 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:40,647 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 25C22E34078847EBBF9380D20D16D814 on vertex vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D]
2016-01-14 16:08:40,647 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:40,647 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {25C22E34078847EBBF9380D20D16D814=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:40,647 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D] parallelism set to 1
2016-01-14 16:08:40,647 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:40,648 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720437_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787720437_0001_1_00, eventCount=1
2016-01-14 16:08:40,648 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D]
2016-01-14 16:08:40,648 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=2F83E9292B9A4A07BBCB415D0852E2D2, vertexId=vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:40,648 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=2F83E9292B9A4A07BBCB415D0852E2D2, vertexId=vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D]
2016-01-14 16:08:40,650 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=2F83E9292B9A4A07BBCB415D0852E2D2, vertexName=BEC5E3F2AB294D979E8D5865F990EE9D, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:40,651 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=2F83E9292B9A4A07BBCB415D0852E2D2, vertexId=vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D]
2016-01-14 16:08:40,652 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720437_0001_1][Event:VERTEX_INITIALIZED]: vertexName=BEC5E3F2AB294D979E8D5865F990EE9D, vertexId=vertex_1452787720437_0001_1_00, initRequestedTime=1452787720638, initedTime=1452787720652, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:40,652 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:40,652 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D] with distanceFromRoot: 0
2016-01-14 16:08:40,652 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:40,652 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in BEC5E3F2AB294D979E8D5865F990EE9D
2016-01-14 16:08:40,653 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D]
2016-01-14 16:08:40,653 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:40,653 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720437_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787720437_0001_1_00, startRequestedTime=1452787720652, startedTime=1452787720652
2016-01-14 16:08:40,653 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:40,654 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:40,654 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720437_0001_1][Event:TASK_STARTED]: vertexName=BEC5E3F2AB294D979E8D5865F990EE9D, taskId=task_1452787720437_0001_1_00_000000, scheduledTime=1452787720654, launchTime=1452787720654
2016-01-14 16:08:40,655 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787720437_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:40,655 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D]
2016-01-14 16:08:40,655 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [61FCAF3B4EA34F8388CC44DDDE5CFD39/A484680B42BA49B6A6A86FCD444116D4] each.each/(1/1) ...SULTS.-1_'field2'_RESULTS, VertexName: BEC5E3F2AB294D979E8D5865F990EE9D, VertexParallelism: 1, TaskAttemptID:attempt_1452787720437_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=25C22E34078847EBBF9380D20D16D814, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=2F83E9292B9A4A07BBCB415D0852E2D2, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:40,655 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787720437_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:40,656 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:40,656 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:40,657 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:40,657 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:40,658 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787720437_0001_00_000001
2016-01-14 16:08:40,658 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787720437_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:40,660 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787720437_0001_00_000001
2016-01-14 16:08:40,660 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:40,661 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787720437_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:40,661 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:40,662 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720437_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787720437_0001_00_000001, launchTime=1452787720661
2016-01-14 16:08:40,662 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787720437_0001_00_000001
2016-01-14 16:08:40,662 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] submitted tez dag to app master: application_1452787720437_0001, with dag id: dag_1452787720437_0001_1
2016-01-14 16:08:40,665 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787720437_0001_1_00_000000_0] to container: [container_1452787720437_0001_00_000001]
2016-01-14 16:08:40,665 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787720437_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:40,666 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787720437_0001_00_000001 given task: attempt_1452787720437_0001_1_00_000000_0
2016-01-14 16:08:40,666 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787720437_0001_1_00_000000_0] started. Is using containerId: [container_1452787720437_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:40,666 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720437_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=BEC5E3F2AB294D979E8D5865F990EE9D, taskAttemptId=attempt_1452787720437_0001_1_00_000000_0, startTime=1452787720666, containerId=container_1452787720437_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787720437_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:40,666 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:40,667 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787720437_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:40,667 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787720437_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:40,666 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787720437_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787720437_0001_1_00_000000_0
2016-01-14 16:08:40 Starting to run new task attempt: attempt_1452787720437_0001_1_00_000000_0
2016-01-14 16:08:40,669 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787720437_0001_1_00_000000_0
2016-01-14 16:08:40,669 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:40,669 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:40,670 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:40,670 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:40,670 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:40,670 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:40,671 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [61FCAF3B4EA34F8388CC44DDDE5CFD39/A484680B42BA49B6A6A86FCD444116D4] each.each/(1/1) ...SULTS.-1_'field2'_RESULTS, VertexName: BEC5E3F2AB294D979E8D5865F990EE9D, VertexParallelism: 1, TaskAttemptID:attempt_1452787720437_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=25C22E34078847EBBF9380D20D16D814, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=2F83E9292B9A4A07BBCB415D0852E2D2, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:40,671 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:40,672 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787720437_0001_1_00_000000_0
2016-01-14 16:08:40,672 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:40,672 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:40,673 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787720437_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:40,673 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:40,675 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=25C22E34078847EBBF9380D20D16D814, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:40,675 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=2F83E9292B9A4A07BBCB415D0852E2D2, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:40,676 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:40,676 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 25C22E34078847EBBF9380D20D16D814
2016-01-14 16:08:40,677 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:40,677 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:40,678 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 2F83E9292B9A4A07BBCB415D0852E2D2
2016-01-14 16:08:40,678 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:40,679 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 2F83E9292B9A4A07BBCB415D0852E2D2
2016-01-14 16:08:40,677 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 25C22E34078847EBBF9380D20D16D814
2016-01-14 16:08:40,682 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:40,683 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 25C22E34078847EBBF9380D20D16D814
2016-01-14 16:08:40,683 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 25C22E34078847EBBF9380D20D16D814
2016-01-14 16:08:40,692 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: BEC5E3F2AB294D979E8D5865F990EE9D, ordinal: 0
2016-01-14 16:08:40,692 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BEC5E3F2AB294D979E8D5865F990EE9D, mem on start (mb), free: 292, total: 388, max: 672
2016-01-14 16:08:40,693 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:40,693 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:40,693 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:40,696 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:40,696 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 2F83E9292B9A4A07BBCB415D0852E2D2
2016-01-14 16:08:40,696 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:40,697 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:40,697 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:40,697 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:40,698 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:40,698 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:40,698 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:40,698 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:40,698 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 2F83E9292B9A4A07BBCB415D0852E2D2, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:40,698 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 25C22E34078847EBBF9380D20D16D814, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:40,698 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:40,699 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 25C22E34078847EBBF9380D20D16D814 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:40,699 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:40,699 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:40,700 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 25C22E34078847EBBF9380D20D16D814
2016-01-14 16:08:40,700 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:40,700 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 25C22E34078847EBBF9380D20D16D814
2016-01-14 16:08:40,701 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:40,701 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787720437_0001_1_00_000000_0
2016-01-14 16:08:40,701 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:40,702 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@77b2ffee
2016-01-14 16:08:40,703 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:40,703 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@77b2ffee
2016-01-14 16:08:40,704 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:40,704 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:40,704 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 25C22E34078847EBBF9380D20D16D814
2016-01-14 16:08:40,704 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_RESULTS"], id: 2F83E9292B9A4A07BBCB415D0852E2D2
2016-01-14 16:08:40,705 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_RESULTS"]
2016-01-14 16:08:40,705 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:40,705 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:40,706 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: BEC5E3F2AB294D979E8D5865F990EE9D, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:40,708 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:40,709 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:40,709 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787720437_0001_1_00_000000_0
2016-01-14 16:08:40,710 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787720437_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:40,711 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787720437_0001_1_00_000000_0
2016-01-14 16:08:40,711 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BEC5E3F2AB294D979E8D5865F990EE9D, mem on close (mb), free: 291, total: 388, max: 672
2016-01-14 16:08:40 Completed running task attempt: attempt_1452787720437_0001_1_00_000000_0
2016-01-14 16:08:40,712 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787720437_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:40,713 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787720706, Process_Duration=5, Process_End_Time=1452787720711, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=2][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:40,714 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720437_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=BEC5E3F2AB294D979E8D5865F990EE9D, taskAttemptId=attempt_1452787720437_0001_1_00_000000_0, startTime=1452787720666, finishTime=1452787720713, timeTaken=47, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787720706, Process_Duration=5, Process_End_Time=1452787720711, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=2, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:40,713 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:40,715 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787720437_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:40,716 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:40,716 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787720437_0001_1_00_000000_0
2016-01-14 16:08:40,714 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:40,717 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:40,717 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787720437_0001_00_000001
2016-01-14 16:08:40,717 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:40,717 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720437_0001_1][Event:TASK_FINISHED]: vertexName=BEC5E3F2AB294D979E8D5865F990EE9D, taskId=task_1452787720437_0001_1_00_000000, startTime=1452787720666, finishTime=1452787720716, timeTaken=50, status=SUCCEEDED, successfulAttemptID=attempt_1452787720437_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787720706, Process_Duration=5, Process_End_Time=1452787720711, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=2, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:40,718 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787720437_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:40,718 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D] : 1
2016-01-14 16:08:40,718 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D]
2016-01-14 16:08:40,720 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:40,721 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720437_0001_1][Event:VERTEX_FINISHED]: vertexName=BEC5E3F2AB294D979E8D5865F990EE9D, vertexId=vertex_1452787720437_0001_1_00, initRequestedTime=1452787720638, initedTime=1452787720652, startRequestedTime=1452787720652, startedTime=1452787720652, finishTime=1452787720718, timeTaken=66, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787720706, Process_Duration=5, Process_End_Time=1452787720711, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=2, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787720666, firstTasksToStart=[ task_1452787720437_0001_1_00_000000 ], lastTaskFinishTime=1452787720713, lastTasksToFinish=[ task_1452787720437_0001_1_00_000000 ], minTaskDuration=47, maxTaskDuration=47, avgTaskDuration=47.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787720437_0001_1_00_000000 ], longestDurationTasks=[ task_1452787720437_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:40,722 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:40,722 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787720437_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:40,722 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720437_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787720437_0001_00_000001, stoppedTime=1452787720722, exitStatus=0
2016-01-14 16:08:40,722 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787720437_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:40,723 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:40,723 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787720437_0001_1
2016-01-14 16:08:40,723 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:40,724 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720437_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787720437_0001_1
2016-01-14 16:08:40,724 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 2F83E9292B9A4A07BBCB415D0852E2D2 for vertex: vertex_1452787720437_0001_1_00 [BEC5E3F2AB294D979E8D5865F990EE9D]
2016-01-14 16:08:40,728 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787720437_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:40,728 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787720437_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:40,728 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787720437_0001_00_000001, Exiting
2016-01-14 16:08:40,728 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787720437_0001_00_000001
2016-01-14 16:08:40,728 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787720437_0001_00_000001
2016-01-14 16:08:40,731 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787720437_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:40,732 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787720437_0001_00_000001 completed successfully
2016-01-14 16:08:40,737 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787720437_0001_1, queueSize=0
2016-01-14 16:08:40,737 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:40,737 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720437_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787720437_0001_1, startTime=1452787720637, finishTime=1452787720735, timeTaken=98, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787720706, Process_Duration=5, Process_End_Time=1452787720711, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=2, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:40,737 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787720437_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:40,738 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787720437_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:40,738 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787720437_0001_00_000001
2016-01-14 16:08:40,739 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787720437_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:40 Completed Dag: dag_1452787720437_0001_1
2016-01-14 16:08:40,741 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787720437_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:40,742 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787720437_0001_1_post
2016-01-14 16:08:40,742 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:40,743 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:40,746 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...SULTS.-1_'field2'_RESULTS, applicationId=application_1452787720437_0001
2016-01-14 16:08:40,749 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:40,749 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:40,749 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:40,749 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:40,750 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:40,750 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:40,751 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:40,751 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:40,752 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:40,752 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:40,752 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:40,753 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:40,753 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:40,758 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/61FCAF3B4EA34F8388CC44DDDE5CFD39/A484680B42BA49B6A6A86FCD444116D4/.tez/application_1452787720437_0001
2016-01-14 16:08:40,759 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  completed in: 00:00.351
2016-01-14 16:08:40,846 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.-1_'field2'_RESULTS
2016-01-14 16:08:40,870 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:40,870 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:40,922 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.021
2016-01-14 16:08:40,933 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.031
2016-01-14 16:08:40,933 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:40,933 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:40,934 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:40,955 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:40,956 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:40,968 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting
2016-01-14 16:08:40,969 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:40,969 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_ALL"]
2016-01-14 16:08:40,969 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  parallel execution of steps is enabled: false
2016-01-14 16:08:40,969 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  executing total steps: 1
2016-01-14 16:08:40,970 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  allocating management threads: 1
2016-01-14 16:08:40,970 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting step: (1/1) ...'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:40,971 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [each.each] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:40,984 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tez session mode enabled: true
2016-01-14 16:08:40,988 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:40,989 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:40,989 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:40,998 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/56A500BBA3664CADB2998D36E221665C/DFC88A0535E24368845D72E736A51CAD/.tez/application_1452787720989_0001 doesn't exist and is created
2016-01-14 16:08:41,016 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:41,016 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:41,017 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/56A500BBA3664CADB2998D36E221665C/DFC88A0535E24368845D72E736A51CAD/.tez/application_1452787720989_0001
2016-01-14 16:08:41,021 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787720989_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:41,035 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:41,036 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:41,038 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:41,038 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:41,038 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/56A500BBA3664CADB2998D36E221665C/DFC88A0535E24368845D72E736A51CAD/.tez/application_1452787720989_0001/localmode-log-dir
2016-01-14 16:08:41,038 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/56A500BBA3664CADB2998D36E221665C/DFC88A0535E24368845D72E736A51CAD/.tez/application_1452787720989_0001/localmode-log-dir/history.txt.appattempt_1452787720989_0001_000000, maxErrors=10
2016-01-14 16:08:41,038 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:41,039 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787720989_0001_000000, appSubmitTime=1452787721020, launchTime=1452787721021
2016-01-14 16:08:41,042 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:41,043 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:41,044 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:41,046 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:41,048 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:52283
2016-01-14 16:08:41,052 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:41,055 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787720989_0001_000000, startTime=1452787721055
2016-01-14 16:08:41,055 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:41,055 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:41,117 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:41,117 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:41,117 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...'_RESULTS.-1_'field2'_ALL, applicationId=application_1452787720989_0001, dagName=[56A500BBA3664CADB2998D36E221665C/DFC88A0535E24368845D72E736A51CAD] each.each/(1/1) ...'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:41,143 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [56A500BBA3664CADB2998D36E221665C/DFC88A0535E24368845D72E736A51CAD] each.each/(1/1) ...'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:41,144 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787720989_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/56A500BBA3664CADB2998D36E221665C/DFC88A0535E24368845D72E736A51CAD/.tez/application_1452787720989_0001/localmode-log-dir/dag_1452787720989_0001_1.dot
2016-01-14 16:08:41,145 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/56A500BBA3664CADB2998D36E221665C/DFC88A0535E24368845D72E736A51CAD/.tez/application_1452787720989_0001/localmode-log-dir/dag_1452787720989_0001_1-tez-dag.pb.txt
2016-01-14 16:08:41,167 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787720989_0001_1
2016-01-14 16:08:41,167 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:41,167 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [56A500BBA3664CADB2998D36E221665C/DFC88A0535E24368845D72E736A51CAD] each.each/(1/1) ...'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:41 Running Dag: dag_1452787720989_0001_1
2016-01-14 16:08:41,180 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720989_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787720989_0001_1, submitTime=1452787721143
2016-01-14 16:08:41,180 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:41,181 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex A53AA72185E84B9DA01F751EDF369BEB
2016-01-14 16:08:41,181 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:41,182 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:41,182 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720989_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787720989_0001_1, initTime=1452787721180
2016-01-14 16:08:41,183 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787720989_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:41,184 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720989_0001_1][Event:DAG_STARTED]: dagID=dag_1452787720989_0001_1, startTime=1452787721184
2016-01-14 16:08:41,184 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:41,185 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787720989_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:41,185 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: A53AA72185E84B9DA01F751EDF369BEB : {C1F9CA67283B4BAF81F52F47A6A1D451={InputName=C1F9CA67283B4BAF81F52F47A6A1D451}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:41,185 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: C1F9CA67283B4BAF81F52F47A6A1D451, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:41,185 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB]
2016-01-14 16:08:41,185 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB]
2016-01-14 16:08:41,185 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB]
2016-01-14 16:08:41,185 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB]. Starting root input initializers: 1
2016-01-14 16:08:41,186 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:41,186 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:41,187 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: C1F9CA67283B4BAF81F52F47A6A1D451 on vertex vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB]
2016-01-14 16:08:41,187 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...'_RESULTS.-1_'field2'_ALL, applicationId=application_1452787720989_0001, dagName=[56A500BBA3664CADB2998D36E221665C/DFC88A0535E24368845D72E736A51CAD] each.each/(1/1) ...'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:41,189 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:41,189 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input C1F9CA67283B4BAF81F52F47A6A1D451 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:41,190 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:41,190 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:41,193 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:41,195 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: C1F9CA67283B4BAF81F52F47A6A1D451 on vertex vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB]
2016-01-14 16:08:41,195 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:41,195 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {C1F9CA67283B4BAF81F52F47A6A1D451=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:41,195 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB] parallelism set to 1
2016-01-14 16:08:41,196 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:41,196 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720989_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787720989_0001_1_00, eventCount=1
2016-01-14 16:08:41,197 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB]
2016-01-14 16:08:41,197 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=D6574254DCF8446CB9B24C3618F42412, vertexId=vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:41,197 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=D6574254DCF8446CB9B24C3618F42412, vertexId=vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB]
2016-01-14 16:08:41,200 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=D6574254DCF8446CB9B24C3618F42412, vertexName=A53AA72185E84B9DA01F751EDF369BEB, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:41,200 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=D6574254DCF8446CB9B24C3618F42412, vertexId=vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB]
2016-01-14 16:08:41,201 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:41,202 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720989_0001_1][Event:VERTEX_INITIALIZED]: vertexName=A53AA72185E84B9DA01F751EDF369BEB, vertexId=vertex_1452787720989_0001_1_00, initRequestedTime=1452787721185, initedTime=1452787721201, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:41,202 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB] with distanceFromRoot: 0
2016-01-14 16:08:41,202 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:41,202 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in A53AA72185E84B9DA01F751EDF369BEB
2016-01-14 16:08:41,202 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB]
2016-01-14 16:08:41,203 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:41,203 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720989_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787720989_0001_1_00, startRequestedTime=1452787721202, startedTime=1452787721202
2016-01-14 16:08:41,203 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:41,203 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:41,204 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720989_0001_1][Event:TASK_STARTED]: vertexName=A53AA72185E84B9DA01F751EDF369BEB, taskId=task_1452787720989_0001_1_00_000000, scheduledTime=1452787721203, launchTime=1452787721203
2016-01-14 16:08:41,204 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787720989_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:41,204 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB]
2016-01-14 16:08:41,204 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [56A500BBA3664CADB2998D36E221665C/DFC88A0535E24368845D72E736A51CAD] each.each/(1/1) ...'_RESULTS.-1_'field2'_ALL, VertexName: A53AA72185E84B9DA01F751EDF369BEB, VertexParallelism: 1, TaskAttemptID:attempt_1452787720989_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=C1F9CA67283B4BAF81F52F47A6A1D451, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D6574254DCF8446CB9B24C3618F42412, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:41,205 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787720989_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:41,205 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:41,206 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:41,206 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:41,206 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:41,207 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787720989_0001_00_000001
2016-01-14 16:08:41,207 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787720989_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:41,209 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787720989_0001_00_000001
2016-01-14 16:08:41,209 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:41,209 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787720989_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:41,210 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720989_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787720989_0001_00_000001, launchTime=1452787721209
2016-01-14 16:08:41,210 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:41,210 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787720989_0001_00_000001
2016-01-14 16:08:41,211 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787720989_0001_1_00_000000_0] to container: [container_1452787720989_0001_00_000001]
2016-01-14 16:08:41,211 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787720989_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:41,211 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787720989_0001_00_000001 given task: attempt_1452787720989_0001_1_00_000000_0
2016-01-14 16:08:41,212 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787720989_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787720989_0001_1_00_000000_0
2016-01-14 16:08:41,212 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787720989_0001_1_00_000000_0] started. Is using containerId: [container_1452787720989_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:41 Starting to run new task attempt: attempt_1452787720989_0001_1_00_000000_0
2016-01-14 16:08:41,212 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787720989_0001_1_00_000000_0
2016-01-14 16:08:41,213 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:41,213 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:41,213 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:41,213 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:41,213 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:41,213 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:41,214 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [56A500BBA3664CADB2998D36E221665C/DFC88A0535E24368845D72E736A51CAD] each.each/(1/1) ...'_RESULTS.-1_'field2'_ALL, VertexName: A53AA72185E84B9DA01F751EDF369BEB, VertexParallelism: 1, TaskAttemptID:attempt_1452787720989_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=C1F9CA67283B4BAF81F52F47A6A1D451, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D6574254DCF8446CB9B24C3618F42412, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:41,213 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:41,214 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:41,217 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787720989_0001_1_00_000000_0
2016-01-14 16:08:41,217 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:41,217 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:41,213 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720989_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=A53AA72185E84B9DA01F751EDF369BEB, taskAttemptId=attempt_1452787720989_0001_1_00_000000_0, startTime=1452787721211, containerId=container_1452787720989_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787720989_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:41,218 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787720989_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:41,218 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787720989_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:41,221 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=C1F9CA67283B4BAF81F52F47A6A1D451, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:41,221 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:41,222 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:41,222 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787720989_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:41,223 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=D6574254DCF8446CB9B24C3618F42412, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:41,223 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:41,224 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: D6574254DCF8446CB9B24C3618F42412
2016-01-14 16:08:41,224 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:41,225 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: D6574254DCF8446CB9B24C3618F42412
2016-01-14 16:08:41,222 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: C1F9CA67283B4BAF81F52F47A6A1D451
2016-01-14 16:08:41,225 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: C1F9CA67283B4BAF81F52F47A6A1D451
2016-01-14 16:08:41,227 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:41,235 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] submitted tez dag to app master: application_1452787720989_0001, with dag id: dag_1452787720989_0001_1
2016-01-14 16:08:41,237 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:41,237 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: C1F9CA67283B4BAF81F52F47A6A1D451
2016-01-14 16:08:41,238 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: C1F9CA67283B4BAF81F52F47A6A1D451
2016-01-14 16:08:41,245 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:41,245 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: D6574254DCF8446CB9B24C3618F42412
2016-01-14 16:08:41,251 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: A53AA72185E84B9DA01F751EDF369BEB, ordinal: 0
2016-01-14 16:08:41,251 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A53AA72185E84B9DA01F751EDF369BEB, mem on start (mb), free: 209, total: 388, max: 672
2016-01-14 16:08:41,251 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:41,251 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:41,251 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:41,252 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:41,252 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:41,252 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:41,253 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:41,253 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:41,253 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:41,254 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:41,254 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:41,254 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, D6574254DCF8446CB9B24C3618F42412, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:41,255 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, C1F9CA67283B4BAF81F52F47A6A1D451, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:41,255 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:41,255 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: C1F9CA67283B4BAF81F52F47A6A1D451 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:41,255 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: C1F9CA67283B4BAF81F52F47A6A1D451
2016-01-14 16:08:41,256 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:41,256 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: C1F9CA67283B4BAF81F52F47A6A1D451
2016-01-14 16:08:41,256 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:41,258 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:41,259 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:41,259 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787720989_0001_1_00_000000_0
2016-01-14 16:08:41,259 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:41,260 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@100e3d0f
2016-01-14 16:08:41,261 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@100e3d0f
2016-01-14 16:08:41,261 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:41,261 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:41,265 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:41,266 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: C1F9CA67283B4BAF81F52F47A6A1D451
2016-01-14 16:08:41,266 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_ALL"], id: D6574254DCF8446CB9B24C3618F42412
2016-01-14 16:08:41,266 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_ALL"]
2016-01-14 16:08:41,267 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:41,267 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:41,268 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: A53AA72185E84B9DA01F751EDF369BEB, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:41,272 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:41,273 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:41,273 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787720989_0001_1_00_000000_0
2016-01-14 16:08:41,274 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787720989_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:41,275 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787720989_0001_1_00_000000_0
2016-01-14 16:08:41,275 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A53AA72185E84B9DA01F751EDF369BEB, mem on close (mb), free: 208, total: 388, max: 672
2016-01-14 16:08:41 Completed running task attempt: attempt_1452787720989_0001_1_00_000000_0
2016-01-14 16:08:41,276 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787720989_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:41,277 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787721268, Process_Duration=6, Process_End_Time=1452787721274, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:41,278 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720989_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=A53AA72185E84B9DA01F751EDF369BEB, taskAttemptId=attempt_1452787720989_0001_1_00_000000_0, startTime=1452787721211, finishTime=1452787721277, timeTaken=66, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787721268, Process_Duration=6, Process_End_Time=1452787721274, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:41,278 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:41,279 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:41,278 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:41,279 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787720989_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:41,279 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787720989_0001_00_000001
2016-01-14 16:08:41,280 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787720989_0001_1_00_000000_0
2016-01-14 16:08:41,280 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:41,280 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:41,281 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720989_0001_1][Event:TASK_FINISHED]: vertexName=A53AA72185E84B9DA01F751EDF369BEB, taskId=task_1452787720989_0001_1_00_000000, startTime=1452787721211, finishTime=1452787721280, timeTaken=69, status=SUCCEEDED, successfulAttemptID=attempt_1452787720989_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787721268, Process_Duration=6, Process_End_Time=1452787721274, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:41,281 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787720989_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:41,281 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB] : 1
2016-01-14 16:08:41,281 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB]
2016-01-14 16:08:41,283 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:41,283 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720989_0001_1][Event:VERTEX_FINISHED]: vertexName=A53AA72185E84B9DA01F751EDF369BEB, vertexId=vertex_1452787720989_0001_1_00, initRequestedTime=1452787721185, initedTime=1452787721201, startRequestedTime=1452787721202, startedTime=1452787721202, finishTime=1452787721281, timeTaken=79, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787721268, Process_Duration=6, Process_End_Time=1452787721274, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787721211, firstTasksToStart=[ task_1452787720989_0001_1_00_000000 ], lastTaskFinishTime=1452787721277, lastTasksToFinish=[ task_1452787720989_0001_1_00_000000 ], minTaskDuration=66, maxTaskDuration=66, avgTaskDuration=66.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787720989_0001_1_00_000000 ], longestDurationTasks=[ task_1452787720989_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:41,283 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:41,283 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787720989_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:41,284 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720989_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787720989_0001_00_000001, stoppedTime=1452787721284, exitStatus=0
2016-01-14 16:08:41,284 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787720989_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:41,284 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:41,284 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:41,284 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787720989_0001_1
2016-01-14 16:08:41,285 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720989_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787720989_0001_1
2016-01-14 16:08:41,285 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: D6574254DCF8446CB9B24C3618F42412 for vertex: vertex_1452787720989_0001_1_00 [A53AA72185E84B9DA01F751EDF369BEB]
2016-01-14 16:08:41,290 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787720989_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:41,290 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787720989_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:41,290 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787720989_0001_00_000001, Exiting
2016-01-14 16:08:41,290 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787720989_0001_00_000001
2016-01-14 16:08:41,290 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787720989_0001_00_000001
2016-01-14 16:08:41,292 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787720989_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:41,293 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787720989_0001_00_000001 completed successfully
2016-01-14 16:08:41,295 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787720989_0001_1, queueSize=0
2016-01-14 16:08:41,295 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:41,295 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787720989_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787720989_0001_1, startTime=1452787721184, finishTime=1452787721293, timeTaken=109, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787721268, Process_Duration=6, Process_End_Time=1452787721274, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:41,295 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787720989_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:41,296 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787720989_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:41,296 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787720989_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:41,296 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787720989_0001_00_000001
2016-01-14 16:08:41 Completed Dag: dag_1452787720989_0001_1
2016-01-14 16:08:41,296 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787720989_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:41,296 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787720989_0001_1_post
2016-01-14 16:08:41,297 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:41,297 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:41,303 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...'_RESULTS.-1_'field2'_ALL, applicationId=application_1452787720989_0001
2016-01-14 16:08:41,305 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:41,305 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:41,305 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:41,305 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:41,306 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:41,306 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:41,306 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:41,307 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:41,307 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:41,307 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:41,307 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:41,308 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:41,308 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:41,312 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/56A500BBA3664CADB2998D36E221665C/DFC88A0535E24368845D72E736A51CAD/.tez/application_1452787720989_0001
2016-01-14 16:08:41,312 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  completed in: 00:00.344
2016-01-14 16:08:41,413 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:41,447 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:41,447 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:41,512 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-01-14 16:08:41,518 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.030
2016-01-14 16:08:41,519 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:41,519 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:41,520 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:41,545 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:41,546 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:41,562 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting
2016-01-14 16:08:41,563 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:41,563 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_-1"]
2016-01-14 16:08:41,563 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  parallel execution of steps is enabled: false
2016-01-14 16:08:41,563 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  executing total steps: 1
2016-01-14 16:08:41,563 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  allocating management threads: 1
2016-01-14 16:08:41,564 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting step: (1/1) ...ld'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:41,565 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [each.each] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:41,585 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tez session mode enabled: true
2016-01-14 16:08:41,590 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:41,590 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:41,590 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:41,600 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38B591FED00B43F3860B2EA89E016103/EC9618819A4847E7927AEFEC867BD7AB/.tez/application_1452787721590_0001 doesn't exist and is created
2016-01-14 16:08:41,618 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:41,618 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:41,619 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38B591FED00B43F3860B2EA89E016103/EC9618819A4847E7927AEFEC867BD7AB/.tez/application_1452787721590_0001
2016-01-14 16:08:41,625 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787721590_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:41,640 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:41,641 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:41,643 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:41,643 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:41,644 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38B591FED00B43F3860B2EA89E016103/EC9618819A4847E7927AEFEC867BD7AB/.tez/application_1452787721590_0001/localmode-log-dir
2016-01-14 16:08:41,644 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38B591FED00B43F3860B2EA89E016103/EC9618819A4847E7927AEFEC867BD7AB/.tez/application_1452787721590_0001/localmode-log-dir/history.txt.appattempt_1452787721590_0001_000000, maxErrors=10
2016-01-14 16:08:41,644 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:41,644 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787721590_0001_000000, appSubmitTime=1452787721624, launchTime=1452787721624
2016-01-14 16:08:41,679 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:41,680 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:41,683 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:41,683 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:41,686 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:33940
2016-01-14 16:08:41,689 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:41,692 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787721590_0001_000000, startTime=1452787721692
2016-01-14 16:08:41,692 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:41,692 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:41,719 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:41,719 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:41,719 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1, applicationId=application_1452787721590_0001, dagName=[38B591FED00B43F3860B2EA89E016103/EC9618819A4847E7927AEFEC867BD7AB] each.each/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:41,739 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [38B591FED00B43F3860B2EA89E016103/EC9618819A4847E7927AEFEC867BD7AB] each.each/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:41,741 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787721590_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38B591FED00B43F3860B2EA89E016103/EC9618819A4847E7927AEFEC867BD7AB/.tez/application_1452787721590_0001/localmode-log-dir/dag_1452787721590_0001_1.dot
2016-01-14 16:08:41,742 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38B591FED00B43F3860B2EA89E016103/EC9618819A4847E7927AEFEC867BD7AB/.tez/application_1452787721590_0001/localmode-log-dir/dag_1452787721590_0001_1-tez-dag.pb.txt
2016-01-14 16:08:41,768 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787721590_0001_1
2016-01-14 16:08:41,768 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:41,768 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [38B591FED00B43F3860B2EA89E016103/EC9618819A4847E7927AEFEC867BD7AB] each.each/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:41 Running Dag: dag_1452787721590_0001_1
2016-01-14 16:08:41,789 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787721590_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787721590_0001_1, submitTime=1452787721740
2016-01-14 16:08:41,789 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:41,789 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E654F0CA03724B588510DCB69E230542
2016-01-14 16:08:41,790 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:41,791 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:41,791 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787721590_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787721590_0001_1, initTime=1452787721789
2016-01-14 16:08:41,791 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787721590_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:41,792 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787721590_0001_1][Event:DAG_STARTED]: dagID=dag_1452787721590_0001_1, startTime=1452787721792
2016-01-14 16:08:41,792 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:41,792 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:41,792 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787721590_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:41,793 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E654F0CA03724B588510DCB69E230542 : {561B31A878CA4666802213B703A49E4E={InputName=561B31A878CA4666802213B703A49E4E}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:41,793 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 561B31A878CA4666802213B703A49E4E, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:41,793 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542]
2016-01-14 16:08:41,793 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542]
2016-01-14 16:08:41,794 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542]
2016-01-14 16:08:41,794 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542]. Starting root input initializers: 1
2016-01-14 16:08:41,795 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1, applicationId=application_1452787721590_0001, dagName=[38B591FED00B43F3860B2EA89E016103/EC9618819A4847E7927AEFEC867BD7AB] each.each/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:41,795 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:41,795 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 561B31A878CA4666802213B703A49E4E on vertex vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542]
2016-01-14 16:08:41,798 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:41,798 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 561B31A878CA4666802213B703A49E4E asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:41,799 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:41,799 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:41,802 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:41,803 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 561B31A878CA4666802213B703A49E4E on vertex vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542]
2016-01-14 16:08:41,803 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:41,803 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {561B31A878CA4666802213B703A49E4E=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:41,804 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542] parallelism set to 1
2016-01-14 16:08:41,804 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:41,804 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787721590_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787721590_0001_1_00, eventCount=1
2016-01-14 16:08:41,804 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542]
2016-01-14 16:08:41,805 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=4E9FD433E0294AA68D0D16A144944C86, vertexId=vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:41,805 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=4E9FD433E0294AA68D0D16A144944C86, vertexId=vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542]
2016-01-14 16:08:41,808 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=4E9FD433E0294AA68D0D16A144944C86, vertexName=E654F0CA03724B588510DCB69E230542, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:41,808 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=4E9FD433E0294AA68D0D16A144944C86, vertexId=vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542]
2016-01-14 16:08:41,810 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:41,810 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787721590_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E654F0CA03724B588510DCB69E230542, vertexId=vertex_1452787721590_0001_1_00, initRequestedTime=1452787721793, initedTime=1452787721810, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:41,810 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542] with distanceFromRoot: 0
2016-01-14 16:08:41,811 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:41,811 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E654F0CA03724B588510DCB69E230542
2016-01-14 16:08:41,811 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542]
2016-01-14 16:08:41,812 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:41,813 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787721590_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787721590_0001_1_00, startRequestedTime=1452787721811, startedTime=1452787721811
2016-01-14 16:08:41,813 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:41,814 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:41,814 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787721590_0001_1][Event:TASK_STARTED]: vertexName=E654F0CA03724B588510DCB69E230542, taskId=task_1452787721590_0001_1_00_000000, scheduledTime=1452787721813, launchTime=1452787721813
2016-01-14 16:08:41,814 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787721590_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:41,815 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542]
2016-01-14 16:08:41,815 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [38B591FED00B43F3860B2EA89E016103/EC9618819A4847E7927AEFEC867BD7AB] each.each/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1, VertexName: E654F0CA03724B588510DCB69E230542, VertexParallelism: 1, TaskAttemptID:attempt_1452787721590_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=561B31A878CA4666802213B703A49E4E, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=4E9FD433E0294AA68D0D16A144944C86, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:41,816 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787721590_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:41,816 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:41,817 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:41,818 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:41,818 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:41,819 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787721590_0001_00_000001
2016-01-14 16:08:41,819 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787721590_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:41,822 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787721590_0001_00_000001
2016-01-14 16:08:41,822 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:41,823 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787721590_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:41,823 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:41,824 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787721590_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787721590_0001_00_000001, launchTime=1452787721823
2016-01-14 16:08:41,825 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787721590_0001_00_000001
2016-01-14 16:08:41,825 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] submitted tez dag to app master: application_1452787721590_0001, with dag id: dag_1452787721590_0001_1
2016-01-14 16:08:41,826 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787721590_0001_1_00_000000_0] to container: [container_1452787721590_0001_00_000001]
2016-01-14 16:08:41,832 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787721590_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:41,833 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787721590_0001_00_000001 given task: attempt_1452787721590_0001_1_00_000000_0
2016-01-14 16:08:41,833 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787721590_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787721590_0001_1_00_000000_0
2016-01-14 16:08:41,834 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787721590_0001_1_00_000000_0] started. Is using containerId: [container_1452787721590_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:41,834 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787721590_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E654F0CA03724B588510DCB69E230542, taskAttemptId=attempt_1452787721590_0001_1_00_000000_0, startTime=1452787721833, containerId=container_1452787721590_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787721590_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:41,835 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787721590_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:41,835 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:41,836 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787721590_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:41 Starting to run new task attempt: attempt_1452787721590_0001_1_00_000000_0
2016-01-14 16:08:41,837 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787721590_0001_1_00_000000_0
2016-01-14 16:08:41,837 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:41,837 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:41,837 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:41,837 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:41,837 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:41,837 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:41,838 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [38B591FED00B43F3860B2EA89E016103/EC9618819A4847E7927AEFEC867BD7AB] each.each/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1, VertexName: E654F0CA03724B588510DCB69E230542, VertexParallelism: 1, TaskAttemptID:attempt_1452787721590_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=561B31A878CA4666802213B703A49E4E, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=4E9FD433E0294AA68D0D16A144944C86, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:41,838 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:41,841 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787721590_0001_1_00_000000_0
2016-01-14 16:08:41,842 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:41,842 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:41,843 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=561B31A878CA4666802213B703A49E4E, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:41,844 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:41,844 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 561B31A878CA4666802213B703A49E4E
2016-01-14 16:08:41,845 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 561B31A878CA4666802213B703A49E4E
2016-01-14 16:08:41,847 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:41,849 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787721590_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:41,850 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:41,851 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 561B31A878CA4666802213B703A49E4E
2016-01-14 16:08:41,851 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 561B31A878CA4666802213B703A49E4E
2016-01-14 16:08:41,852 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=4E9FD433E0294AA68D0D16A144944C86, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:41,852 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:41,852 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 4E9FD433E0294AA68D0D16A144944C86
2016-01-14 16:08:41,853 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:41,853 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 4E9FD433E0294AA68D0D16A144944C86
2016-01-14 16:08:41,854 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:41,867 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E654F0CA03724B588510DCB69E230542, ordinal: 0
2016-01-14 16:08:41,868 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E654F0CA03724B588510DCB69E230542, mem on start (mb), free: 332, total: 385, max: 672
2016-01-14 16:08:41,868 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:41,868 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 4E9FD433E0294AA68D0D16A144944C86
2016-01-14 16:08:41,868 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:41,869 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:41,869 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:41,870 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:41,870 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:41,871 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:41,871 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:41,871 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:41,872 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:41,872 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:41,873 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:41,873 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 561B31A878CA4666802213B703A49E4E, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:41,874 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 4E9FD433E0294AA68D0D16A144944C86, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:41,874 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:41,875 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 561B31A878CA4666802213B703A49E4E
2016-01-14 16:08:41,875 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:41,875 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 561B31A878CA4666802213B703A49E4E
2016-01-14 16:08:41,876 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 561B31A878CA4666802213B703A49E4E being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:41,877 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:41,878 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:41,878 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:41,879 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787721590_0001_1_00_000000_0
2016-01-14 16:08:41,879 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:41,880 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@1c0d5408
2016-01-14 16:08:41,882 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@1c0d5408
2016-01-14 16:08:41,882 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:41,882 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:41,884 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:41,886 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 561B31A878CA4666802213B703A49E4E
2016-01-14 16:08:41,886 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_-1"], id: 4E9FD433E0294AA68D0D16A144944C86
2016-01-14 16:08:41,887 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_-1"]
2016-01-14 16:08:41,888 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:41,889 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:41,889 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E654F0CA03724B588510DCB69E230542, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:41,894 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:41,895 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:41,895 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787721590_0001_1_00_000000_0
2016-01-14 16:08:41,896 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787721590_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:41,897 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787721590_0001_1_00_000000_0
2016-01-14 16:08:41,897 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E654F0CA03724B588510DCB69E230542, mem on close (mb), free: 331, total: 385, max: 672
2016-01-14 16:08:41 Completed running task attempt: attempt_1452787721590_0001_1_00_000000_0
2016-01-14 16:08:41,899 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787721590_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:41,900 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787721890, Process_Duration=7, Process_End_Time=1452787721897, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:41,901 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:41,901 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787721590_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E654F0CA03724B588510DCB69E230542, taskAttemptId=attempt_1452787721590_0001_1_00_000000_0, startTime=1452787721833, finishTime=1452787721900, timeTaken=67, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787721890, Process_Duration=7, Process_End_Time=1452787721897, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:41,902 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:41,903 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787721590_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:41,904 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:41,904 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787721590_0001_1_00_000000_0
2016-01-14 16:08:41,906 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:41,907 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787721590_0001_1][Event:TASK_FINISHED]: vertexName=E654F0CA03724B588510DCB69E230542, taskId=task_1452787721590_0001_1_00_000000, startTime=1452787721833, finishTime=1452787721906, timeTaken=73, status=SUCCEEDED, successfulAttemptID=attempt_1452787721590_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787721890, Process_Duration=7, Process_End_Time=1452787721897, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:41,907 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787721590_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:41,907 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542] : 1
2016-01-14 16:08:41,907 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542]
2016-01-14 16:08:41,908 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:41,910 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:41,911 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787721590_0001_1][Event:VERTEX_FINISHED]: vertexName=E654F0CA03724B588510DCB69E230542, vertexId=vertex_1452787721590_0001_1_00, initRequestedTime=1452787721793, initedTime=1452787721810, startRequestedTime=1452787721811, startedTime=1452787721811, finishTime=1452787721907, timeTaken=96, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787721890, Process_Duration=7, Process_End_Time=1452787721897, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787721833, firstTasksToStart=[ task_1452787721590_0001_1_00_000000 ], lastTaskFinishTime=1452787721900, lastTasksToFinish=[ task_1452787721590_0001_1_00_000000 ], minTaskDuration=67, maxTaskDuration=67, avgTaskDuration=67.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787721590_0001_1_00_000000 ], longestDurationTasks=[ task_1452787721590_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:41,912 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:41,912 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787721590_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:41,913 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:41,913 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787721590_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787721590_0001_00_000001, stoppedTime=1452787721913, exitStatus=0
2016-01-14 16:08:41,914 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787721590_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:41,914 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:41,914 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787721590_0001_1
2016-01-14 16:08:41,915 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787721590_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787721590_0001_1
2016-01-14 16:08:41,915 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 4E9FD433E0294AA68D0D16A144944C86 for vertex: vertex_1452787721590_0001_1_00 [E654F0CA03724B588510DCB69E230542]
2016-01-14 16:08:41,913 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787721590_0001_00_000001
2016-01-14 16:08:41,920 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787721590_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:41,920 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787721590_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:41,921 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787721590_0001_00_000001, Exiting
2016-01-14 16:08:41,921 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787721590_0001_00_000001
2016-01-14 16:08:41,921 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787721590_0001_00_000001
2016-01-14 16:08:41,925 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787721590_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:41,926 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787721590_0001_00_000001 completed successfully
2016-01-14 16:08:41,932 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787721590_0001_1, queueSize=0
2016-01-14 16:08:41,932 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:41,933 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787721590_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787721590_0001_1, startTime=1452787721792, finishTime=1452787721930, timeTaken=138, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787721890, Process_Duration=7, Process_End_Time=1452787721897, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:41,933 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787721590_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:41,934 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787721590_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:41,934 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787721590_0001_00_000001
2016-01-14 16:08:41,935 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787721590_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:41 Completed Dag: dag_1452787721590_0001_1
2016-01-14 16:08:41,937 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787721590_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:41,937 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787721590_0001_1_post
2016-01-14 16:08:41,938 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:41,938 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:41,943 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1, applicationId=application_1452787721590_0001
2016-01-14 16:08:41,946 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:41,946 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:41,946 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:41,946 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:41,946 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:41,949 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:41,950 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:41,950 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:41,950 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:41,951 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:41,951 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:41,951 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:41,951 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:41,956 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38B591FED00B43F3860B2EA89E016103/EC9618819A4847E7927AEFEC867BD7AB/.tez/application_1452787721590_0001
2016-01-14 16:08:41,957 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  completed in: 00:00.394
2016-01-14 16:08:42,070 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:42,108 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:42,109 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:42,159 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.008
2016-01-14 16:08:42,163 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.013
2016-01-14 16:08:42,164 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:42,164 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:42,165 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.-1_UNKNOWN_'field2'
2016-01-14 16:08:42,202 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:42,202 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:42,262 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 16:08:42,280 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.035
2016-01-14 16:08:42,282 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:42,282 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:42,282 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:42,307 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:42,309 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:42,329 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting
2016-01-14 16:08:42,333 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:42,335 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_'field'"]
2016-01-14 16:08:42,336 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  parallel execution of steps is enabled: false
2016-01-14 16:08:42,337 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  executing total steps: 1
2016-01-14 16:08:42,337 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  allocating management threads: 1
2016-01-14 16:08:42,339 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting step: (1/1) ...ESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:42,340 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [each.each] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:42,359 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tez session mode enabled: true
2016-01-14 16:08:42,366 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:42,366 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:42,366 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:42,381 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/681A797CC0AC45B1803086B06D21E74D/EE662BC76CFD4A6F90A3776A2D05BC33/.tez/application_1452787722366_0001 doesn't exist and is created
2016-01-14 16:08:42,405 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:42,406 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:42,408 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/681A797CC0AC45B1803086B06D21E74D/EE662BC76CFD4A6F90A3776A2D05BC33/.tez/application_1452787722366_0001
2016-01-14 16:08:42,414 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787722366_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:42,432 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:42,434 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:42,439 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:42,440 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:42,440 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/681A797CC0AC45B1803086B06D21E74D/EE662BC76CFD4A6F90A3776A2D05BC33/.tez/application_1452787722366_0001/localmode-log-dir
2016-01-14 16:08:42,441 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/681A797CC0AC45B1803086B06D21E74D/EE662BC76CFD4A6F90A3776A2D05BC33/.tez/application_1452787722366_0001/localmode-log-dir/history.txt.appattempt_1452787722366_0001_000000, maxErrors=10
2016-01-14 16:08:42,441 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:42,442 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787722366_0001_000000, appSubmitTime=1452787722413, launchTime=1452787722413
2016-01-14 16:08:42,452 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:42,453 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:42,454 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:42,455 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:42,460 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:43406
2016-01-14 16:08:42,463 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:42,465 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787722366_0001_000000, startTime=1452787722465
2016-01-14 16:08:42,465 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:42,465 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:42,507 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:42,507 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:42,507 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_'field', applicationId=application_1452787722366_0001, dagName=[681A797CC0AC45B1803086B06D21E74D/EE662BC76CFD4A6F90A3776A2D05BC33] each.each/(1/1) ...ESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:42,525 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [681A797CC0AC45B1803086B06D21E74D/EE662BC76CFD4A6F90A3776A2D05BC33] each.each/(1/1) ...ESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:42,527 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787722366_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/681A797CC0AC45B1803086B06D21E74D/EE662BC76CFD4A6F90A3776A2D05BC33/.tez/application_1452787722366_0001/localmode-log-dir/dag_1452787722366_0001_1.dot
2016-01-14 16:08:42,528 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/681A797CC0AC45B1803086B06D21E74D/EE662BC76CFD4A6F90A3776A2D05BC33/.tez/application_1452787722366_0001/localmode-log-dir/dag_1452787722366_0001_1-tez-dag.pb.txt
2016-01-14 16:08:42,541 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787722366_0001_1
2016-01-14 16:08:42,541 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:42,541 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [681A797CC0AC45B1803086B06D21E74D/EE662BC76CFD4A6F90A3776A2D05BC33] each.each/(1/1) ...ESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:42 Running Dag: dag_1452787722366_0001_1
2016-01-14 16:08:42,554 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:42,555 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722366_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787722366_0001_1, submitTime=1452787722525
2016-01-14 16:08:42,555 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex D0513F2502DE47518F1B1841C08F4919
2016-01-14 16:08:42,555 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:42,556 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:42,556 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722366_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787722366_0001_1, initTime=1452787722555
2016-01-14 16:08:42,557 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787722366_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:42,557 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722366_0001_1][Event:DAG_STARTED]: dagID=dag_1452787722366_0001_1, startTime=1452787722557
2016-01-14 16:08:42,557 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:42,558 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_'field', applicationId=application_1452787722366_0001, dagName=[681A797CC0AC45B1803086B06D21E74D/EE662BC76CFD4A6F90A3776A2D05BC33] each.each/(1/1) ...ESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:42,558 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:42,559 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787722366_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:42,559 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: D0513F2502DE47518F1B1841C08F4919 : {CA6C51AFB97041F8B2457D4885E20317={InputName=CA6C51AFB97041F8B2457D4885E20317}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:42,559 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: CA6C51AFB97041F8B2457D4885E20317, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:42,560 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919]
2016-01-14 16:08:42,560 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919]
2016-01-14 16:08:42,560 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919]
2016-01-14 16:08:42,560 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919]. Starting root input initializers: 1
2016-01-14 16:08:42,561 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:42,561 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: CA6C51AFB97041F8B2457D4885E20317 on vertex vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919]
2016-01-14 16:08:42,562 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:42,563 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input CA6C51AFB97041F8B2457D4885E20317 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:42,563 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:42,564 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:42,565 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:42,566 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: CA6C51AFB97041F8B2457D4885E20317 on vertex vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919]
2016-01-14 16:08:42,566 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:42,566 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {CA6C51AFB97041F8B2457D4885E20317=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:42,567 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919] parallelism set to 1
2016-01-14 16:08:42,567 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:42,567 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722366_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787722366_0001_1_00, eventCount=1
2016-01-14 16:08:42,567 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919]
2016-01-14 16:08:42,567 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=30E29D0AF0FD42119E104BC79E9D0F9B, vertexId=vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:42,567 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=30E29D0AF0FD42119E104BC79E9D0F9B, vertexId=vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919]
2016-01-14 16:08:42,570 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=30E29D0AF0FD42119E104BC79E9D0F9B, vertexName=D0513F2502DE47518F1B1841C08F4919, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:42,570 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=30E29D0AF0FD42119E104BC79E9D0F9B, vertexId=vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919]
2016-01-14 16:08:42,572 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:42,572 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722366_0001_1][Event:VERTEX_INITIALIZED]: vertexName=D0513F2502DE47518F1B1841C08F4919, vertexId=vertex_1452787722366_0001_1_00, initRequestedTime=1452787722559, initedTime=1452787722571, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:42,572 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919] with distanceFromRoot: 0
2016-01-14 16:08:42,572 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:42,573 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in D0513F2502DE47518F1B1841C08F4919
2016-01-14 16:08:42,573 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919]
2016-01-14 16:08:42,573 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:42,574 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722366_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787722366_0001_1_00, startRequestedTime=1452787722573, startedTime=1452787722573
2016-01-14 16:08:42,574 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:42,574 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:42,575 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722366_0001_1][Event:TASK_STARTED]: vertexName=D0513F2502DE47518F1B1841C08F4919, taskId=task_1452787722366_0001_1_00_000000, scheduledTime=1452787722574, launchTime=1452787722574
2016-01-14 16:08:42,575 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787722366_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:42,575 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919]
2016-01-14 16:08:42,576 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [681A797CC0AC45B1803086B06D21E74D/EE662BC76CFD4A6F90A3776A2D05BC33] each.each/(1/1) ...ESULTS.-1_UNKNOWN_'field', VertexName: D0513F2502DE47518F1B1841C08F4919, VertexParallelism: 1, TaskAttemptID:attempt_1452787722366_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=CA6C51AFB97041F8B2457D4885E20317, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=30E29D0AF0FD42119E104BC79E9D0F9B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:42,576 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787722366_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:42,576 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:42,577 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:42,578 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:42,578 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:42,579 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787722366_0001_00_000001
2016-01-14 16:08:42,579 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787722366_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:42,581 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] submitted tez dag to app master: application_1452787722366_0001, with dag id: dag_1452787722366_0001_1
2016-01-14 16:08:42,581 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787722366_0001_00_000001
2016-01-14 16:08:42,581 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:42,582 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:42,583 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787722366_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:42,583 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722366_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787722366_0001_00_000001, launchTime=1452787722582
2016-01-14 16:08:42,585 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787722366_0001_00_000001
2016-01-14 16:08:42,588 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787722366_0001_1_00_000000_0] to container: [container_1452787722366_0001_00_000001]
2016-01-14 16:08:42,589 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787722366_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:42,589 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787722366_0001_1_00_000000_0] started. Is using containerId: [container_1452787722366_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:42,590 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:42,590 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722366_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=D0513F2502DE47518F1B1841C08F4919, taskAttemptId=attempt_1452787722366_0001_1_00_000000_0, startTime=1452787722589, containerId=container_1452787722366_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787722366_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:42,590 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787722366_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:42,590 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787722366_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:42,590 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787722366_0001_00_000001 given task: attempt_1452787722366_0001_1_00_000000_0
2016-01-14 16:08:42,590 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787722366_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787722366_0001_1_00_000000_0
2016-01-14 16:08:42 Starting to run new task attempt: attempt_1452787722366_0001_1_00_000000_0
2016-01-14 16:08:42,591 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787722366_0001_1_00_000000_0
2016-01-14 16:08:42,591 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:42,592 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:42,592 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:42,592 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:42,592 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:42,592 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:42,593 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [681A797CC0AC45B1803086B06D21E74D/EE662BC76CFD4A6F90A3776A2D05BC33] each.each/(1/1) ...ESULTS.-1_UNKNOWN_'field', VertexName: D0513F2502DE47518F1B1841C08F4919, VertexParallelism: 1, TaskAttemptID:attempt_1452787722366_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=CA6C51AFB97041F8B2457D4885E20317, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=30E29D0AF0FD42119E104BC79E9D0F9B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:42,593 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:42,593 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787722366_0001_1_00_000000_0
2016-01-14 16:08:42,594 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:42,594 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:42,596 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787722366_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:42,596 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=CA6C51AFB97041F8B2457D4885E20317, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:42,596 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=30E29D0AF0FD42119E104BC79E9D0F9B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:42,597 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:42,597 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:42,597 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 30E29D0AF0FD42119E104BC79E9D0F9B
2016-01-14 16:08:42,597 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:42,597 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 30E29D0AF0FD42119E104BC79E9D0F9B
2016-01-14 16:08:42,596 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:42,597 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: CA6C51AFB97041F8B2457D4885E20317
2016-01-14 16:08:42,598 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: CA6C51AFB97041F8B2457D4885E20317
2016-01-14 16:08:42,601 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:42,601 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: CA6C51AFB97041F8B2457D4885E20317
2016-01-14 16:08:42,601 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: CA6C51AFB97041F8B2457D4885E20317
2016-01-14 16:08:42,602 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:42,614 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:42,614 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 30E29D0AF0FD42119E104BC79E9D0F9B
2016-01-14 16:08:42,615 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: D0513F2502DE47518F1B1841C08F4919, ordinal: 0
2016-01-14 16:08:42,615 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D0513F2502DE47518F1B1841C08F4919, mem on start (mb), free: 237, total: 385, max: 672
2016-01-14 16:08:42,615 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:42,616 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:42,616 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:42,616 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:42,616 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:42,616 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:42,617 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:42,617 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:42,619 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:42,620 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:42,620 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:42,620 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 30E29D0AF0FD42119E104BC79E9D0F9B, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:42,620 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, CA6C51AFB97041F8B2457D4885E20317, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:42,620 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:42,620 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: CA6C51AFB97041F8B2457D4885E20317 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:42,621 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:42,621 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:42,620 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: CA6C51AFB97041F8B2457D4885E20317
2016-01-14 16:08:42,621 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:42,621 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: CA6C51AFB97041F8B2457D4885E20317
2016-01-14 16:08:42,621 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:42,622 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787722366_0001_1_00_000000_0
2016-01-14 16:08:42,622 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:42,623 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@47f71f1f
2016-01-14 16:08:42,626 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@47f71f1f
2016-01-14 16:08:42,626 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:42,626 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:42,626 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:42,628 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: CA6C51AFB97041F8B2457D4885E20317
2016-01-14 16:08:42,628 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_'field'"], id: 30E29D0AF0FD42119E104BC79E9D0F9B
2016-01-14 16:08:42,628 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_'field'"]
2016-01-14 16:08:42,628 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:42,628 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:42,629 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: D0513F2502DE47518F1B1841C08F4919, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:42,632 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:42,632 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:42,632 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787722366_0001_1_00_000000_0
2016-01-14 16:08:42,633 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787722366_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:42,633 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787722366_0001_1_00_000000_0
2016-01-14 16:08:42,634 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D0513F2502DE47518F1B1841C08F4919, mem on close (mb), free: 235, total: 385, max: 672
2016-01-14 16:08:42 Completed running task attempt: attempt_1452787722366_0001_1_00_000000_0
2016-01-14 16:08:42,635 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787722366_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:42,637 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722366_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=D0513F2502DE47518F1B1841C08F4919, taskAttemptId=attempt_1452787722366_0001_1_00_000000_0, startTime=1452787722589, finishTime=1452787722637, timeTaken=48, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787722629, Process_Duration=4, Process_End_Time=1452787722633, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:42,637 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787722366_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:42,637 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:42,637 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:42,637 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787722366_0001_1_00_000000_0
2016-01-14 16:08:42,639 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:42,639 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722366_0001_1][Event:TASK_FINISHED]: vertexName=D0513F2502DE47518F1B1841C08F4919, taskId=task_1452787722366_0001_1_00_000000, startTime=1452787722589, finishTime=1452787722638, timeTaken=49, status=SUCCEEDED, successfulAttemptID=attempt_1452787722366_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787722629, Process_Duration=4, Process_End_Time=1452787722633, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:42,639 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787722366_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:42,640 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919] : 1
2016-01-14 16:08:42,640 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787722629, Process_Duration=4, Process_End_Time=1452787722633, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:42,640 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919]
2016-01-14 16:08:42,643 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:42,643 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722366_0001_1][Event:VERTEX_FINISHED]: vertexName=D0513F2502DE47518F1B1841C08F4919, vertexId=vertex_1452787722366_0001_1_00, initRequestedTime=1452787722559, initedTime=1452787722571, startRequestedTime=1452787722573, startedTime=1452787722573, finishTime=1452787722641, timeTaken=68, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787722629, Process_Duration=4, Process_End_Time=1452787722633, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787722589, firstTasksToStart=[ task_1452787722366_0001_1_00_000000 ], lastTaskFinishTime=1452787722637, lastTasksToFinish=[ task_1452787722366_0001_1_00_000000 ], minTaskDuration=48, maxTaskDuration=48, avgTaskDuration=48.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787722366_0001_1_00_000000 ], longestDurationTasks=[ task_1452787722366_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:42,643 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:42,644 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787722366_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:42,644 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722366_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787722366_0001_00_000001, stoppedTime=1452787722644, exitStatus=0
2016-01-14 16:08:42,644 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:42,644 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:42,644 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:42,644 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787722366_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:42,645 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787722366_0001_00_000001
2016-01-14 16:08:42,645 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:42,645 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787722366_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:42,645 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787722366_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:42,646 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787722366_0001_00_000001, Exiting
2016-01-14 16:08:42,646 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787722366_0001_00_000001
2016-01-14 16:08:42,646 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787722366_0001_00_000001
2016-01-14 16:08:42,645 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787722366_0001_1
2016-01-14 16:08:42,648 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722366_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787722366_0001_1
2016-01-14 16:08:42,648 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 30E29D0AF0FD42119E104BC79E9D0F9B for vertex: vertex_1452787722366_0001_1_00 [D0513F2502DE47518F1B1841C08F4919]
2016-01-14 16:08:42,649 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787722366_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:42,649 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787722366_0001_00_000001 completed successfully
2016-01-14 16:08:42,656 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787722366_0001_1, queueSize=0
2016-01-14 16:08:42,657 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:42,658 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722366_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787722366_0001_1, startTime=1452787722557, finishTime=1452787722655, timeTaken=98, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787722629, Process_Duration=4, Process_End_Time=1452787722633, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:42,658 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787722366_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:42,658 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787722366_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:42,659 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787722366_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:42,659 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787722366_0001_00_000001
2016-01-14 16:08:42 Completed Dag: dag_1452787722366_0001_1
2016-01-14 16:08:42,660 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787722366_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:42,660 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787722366_0001_1_post
2016-01-14 16:08:42,661 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:42,661 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:42,666 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_'field', applicationId=application_1452787722366_0001
2016-01-14 16:08:42,672 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:42,672 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:42,672 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:42,673 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:42,673 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:42,673 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:42,674 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:42,674 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:42,674 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:42,674 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:42,676 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:42,676 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:42,676 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:42,680 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/681A797CC0AC45B1803086B06D21E74D/EE662BC76CFD4A6F90A3776A2D05BC33/.tez/application_1452787722366_0001
2016-01-14 16:08:42,681 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  completed in: 00:00.351
2016-01-14 16:08:42,752 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:42,783 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:42,784 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:42,843 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 16:08:42,859 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 16:08:42,859 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:42,860 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:42,860 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:42,875 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:42,876 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:42,889 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting
2016-01-14 16:08:42,889 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:42,889 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_RESULTS"]
2016-01-14 16:08:42,889 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  parallel execution of steps is enabled: false
2016-01-14 16:08:42,890 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  executing total steps: 1
2016-01-14 16:08:42,890 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  allocating management threads: 1
2016-01-14 16:08:42,891 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting step: (1/1) ...ESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:42,891 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [each.each] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:42,905 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tez session mode enabled: true
2016-01-14 16:08:42,910 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:42,910 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:42,910 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:42,919 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/527F67BE711345779CF7A33E9FD58E3F/C10A44795B7D4A6CBF05AA28E01E6A42/.tez/application_1452787722910_0001 doesn't exist and is created
2016-01-14 16:08:42,935 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:42,935 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:42,936 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/527F67BE711345779CF7A33E9FD58E3F/C10A44795B7D4A6CBF05AA28E01E6A42/.tez/application_1452787722910_0001
2016-01-14 16:08:42,939 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787722910_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:42,952 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:42,953 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:42,954 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:42,954 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:42,955 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/527F67BE711345779CF7A33E9FD58E3F/C10A44795B7D4A6CBF05AA28E01E6A42/.tez/application_1452787722910_0001/localmode-log-dir
2016-01-14 16:08:42,955 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/527F67BE711345779CF7A33E9FD58E3F/C10A44795B7D4A6CBF05AA28E01E6A42/.tez/application_1452787722910_0001/localmode-log-dir/history.txt.appattempt_1452787722910_0001_000000, maxErrors=10
2016-01-14 16:08:42,955 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:42,956 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787722910_0001_000000, appSubmitTime=1452787722938, launchTime=1452787722939
2016-01-14 16:08:42,960 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:42,963 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:42,964 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:59811
2016-01-14 16:08:42,964 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:42,965 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:42,966 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:42,969 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787722910_0001_000000, startTime=1452787722969
2016-01-14 16:08:42,969 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:42,969 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:43,035 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:43,035 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:43,036 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_RESULTS, applicationId=application_1452787722910_0001, dagName=[527F67BE711345779CF7A33E9FD58E3F/C10A44795B7D4A6CBF05AA28E01E6A42] each.each/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:43,056 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [527F67BE711345779CF7A33E9FD58E3F/C10A44795B7D4A6CBF05AA28E01E6A42] each.each/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:43,057 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787722910_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/527F67BE711345779CF7A33E9FD58E3F/C10A44795B7D4A6CBF05AA28E01E6A42/.tez/application_1452787722910_0001/localmode-log-dir/dag_1452787722910_0001_1.dot
2016-01-14 16:08:43,058 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/527F67BE711345779CF7A33E9FD58E3F/C10A44795B7D4A6CBF05AA28E01E6A42/.tez/application_1452787722910_0001/localmode-log-dir/dag_1452787722910_0001_1-tez-dag.pb.txt
2016-01-14 16:08:43,069 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787722910_0001_1
2016-01-14 16:08:43,069 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:43,070 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [527F67BE711345779CF7A33E9FD58E3F/C10A44795B7D4A6CBF05AA28E01E6A42] each.each/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:43 Running Dag: dag_1452787722910_0001_1
2016-01-14 16:08:43,081 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722910_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787722910_0001_1, submitTime=1452787723056
2016-01-14 16:08:43,081 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:43,082 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex F80E54E449DE4326B514F6DAB1B48A7A
2016-01-14 16:08:43,082 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:43,083 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:43,084 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722910_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787722910_0001_1, initTime=1452787723081
2016-01-14 16:08:43,085 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787722910_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:43,085 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722910_0001_1][Event:DAG_STARTED]: dagID=dag_1452787722910_0001_1, startTime=1452787723085
2016-01-14 16:08:43,085 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:43,085 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:43,086 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787722910_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:43,086 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: F80E54E449DE4326B514F6DAB1B48A7A : {732896BFDF594475AC338578BB16486F={InputName=732896BFDF594475AC338578BB16486F}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:43,086 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 732896BFDF594475AC338578BB16486F, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:43,086 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A]
2016-01-14 16:08:43,086 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A]
2016-01-14 16:08:43,086 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A]
2016-01-14 16:08:43,087 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A]. Starting root input initializers: 1
2016-01-14 16:08:43,087 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:43,087 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 732896BFDF594475AC338578BB16486F on vertex vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A]
2016-01-14 16:08:43,087 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_RESULTS, applicationId=application_1452787722910_0001, dagName=[527F67BE711345779CF7A33E9FD58E3F/C10A44795B7D4A6CBF05AA28E01E6A42] each.each/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:43,091 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:43,091 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 732896BFDF594475AC338578BB16486F asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:43,092 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:43,092 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:43,095 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:43,096 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 732896BFDF594475AC338578BB16486F on vertex vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A]
2016-01-14 16:08:43,096 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:43,096 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {732896BFDF594475AC338578BB16486F=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:43,097 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A] parallelism set to 1
2016-01-14 16:08:43,097 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:43,097 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722910_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787722910_0001_1_00, eventCount=1
2016-01-14 16:08:43,097 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A]
2016-01-14 16:08:43,097 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=D9946B4E409F4048A73B4F7E683B5E55, vertexId=vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:43,098 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=D9946B4E409F4048A73B4F7E683B5E55, vertexId=vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A]
2016-01-14 16:08:43,100 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=D9946B4E409F4048A73B4F7E683B5E55, vertexName=F80E54E449DE4326B514F6DAB1B48A7A, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:43,100 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=D9946B4E409F4048A73B4F7E683B5E55, vertexId=vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A]
2016-01-14 16:08:43,101 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722910_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F80E54E449DE4326B514F6DAB1B48A7A, vertexId=vertex_1452787722910_0001_1_00, initRequestedTime=1452787723086, initedTime=1452787723101, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:43,101 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A] with distanceFromRoot: 0
2016-01-14 16:08:43,101 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:43,102 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:43,102 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in F80E54E449DE4326B514F6DAB1B48A7A
2016-01-14 16:08:43,103 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A]
2016-01-14 16:08:43,103 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:43,103 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722910_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787722910_0001_1_00, startRequestedTime=1452787723102, startedTime=1452787723102
2016-01-14 16:08:43,104 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:43,104 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:43,104 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722910_0001_1][Event:TASK_STARTED]: vertexName=F80E54E449DE4326B514F6DAB1B48A7A, taskId=task_1452787722910_0001_1_00_000000, scheduledTime=1452787723104, launchTime=1452787723104
2016-01-14 16:08:43,105 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787722910_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:43,105 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A]
2016-01-14 16:08:43,105 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [527F67BE711345779CF7A33E9FD58E3F/C10A44795B7D4A6CBF05AA28E01E6A42] each.each/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS, VertexName: F80E54E449DE4326B514F6DAB1B48A7A, VertexParallelism: 1, TaskAttemptID:attempt_1452787722910_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=732896BFDF594475AC338578BB16486F, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D9946B4E409F4048A73B4F7E683B5E55, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:43,106 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] submitted tez dag to app master: application_1452787722910_0001, with dag id: dag_1452787722910_0001_1
2016-01-14 16:08:43,107 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787722910_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:43,107 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:43,108 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:43,111 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:43,111 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:43,113 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787722910_0001_00_000001
2016-01-14 16:08:43,114 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787722910_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:43,115 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787722910_0001_00_000001
2016-01-14 16:08:43,115 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:43,116 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:43,116 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787722910_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:43,116 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722910_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787722910_0001_00_000001, launchTime=1452787723116
2016-01-14 16:08:43,118 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787722910_0001_00_000001
2016-01-14 16:08:43,119 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787722910_0001_1_00_000000_0] to container: [container_1452787722910_0001_00_000001]
2016-01-14 16:08:43,119 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787722910_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:43,119 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787722910_0001_00_000001 given task: attempt_1452787722910_0001_1_00_000000_0
2016-01-14 16:08:43,119 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787722910_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787722910_0001_1_00_000000_0
2016-01-14 16:08:43 Starting to run new task attempt: attempt_1452787722910_0001_1_00_000000_0
2016-01-14 16:08:43,120 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787722910_0001_1_00_000000_0
2016-01-14 16:08:43,120 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787722910_0001_1_00_000000_0] started. Is using containerId: [container_1452787722910_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:43,120 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:43,120 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:43,120 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722910_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F80E54E449DE4326B514F6DAB1B48A7A, taskAttemptId=attempt_1452787722910_0001_1_00_000000_0, startTime=1452787723119, containerId=container_1452787722910_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787722910_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:43,120 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787722910_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:43,121 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787722910_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:43,121 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:43,121 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:43,122 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:43,122 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:43,122 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:43,123 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [527F67BE711345779CF7A33E9FD58E3F/C10A44795B7D4A6CBF05AA28E01E6A42] each.each/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS, VertexName: F80E54E449DE4326B514F6DAB1B48A7A, VertexParallelism: 1, TaskAttemptID:attempt_1452787722910_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=732896BFDF594475AC338578BB16486F, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D9946B4E409F4048A73B4F7E683B5E55, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:43,123 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:43,128 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787722910_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:43,128 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787722910_0001_1_00_000000_0
2016-01-14 16:08:43,128 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:43,128 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:43,129 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:43,130 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=732896BFDF594475AC338578BB16486F, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:43,130 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:43,131 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 732896BFDF594475AC338578BB16486F
2016-01-14 16:08:43,131 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 732896BFDF594475AC338578BB16486F
2016-01-14 16:08:43,132 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:43,130 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=D9946B4E409F4048A73B4F7E683B5E55, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:43,132 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:43,132 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: D9946B4E409F4048A73B4F7E683B5E55
2016-01-14 16:08:43,132 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:43,132 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: D9946B4E409F4048A73B4F7E683B5E55
2016-01-14 16:08:43,139 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:43,139 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 732896BFDF594475AC338578BB16486F
2016-01-14 16:08:43,139 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 732896BFDF594475AC338578BB16486F
2016-01-14 16:08:43,145 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F80E54E449DE4326B514F6DAB1B48A7A, ordinal: 0
2016-01-14 16:08:43,146 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F80E54E449DE4326B514F6DAB1B48A7A, mem on start (mb), free: 158, total: 385, max: 672
2016-01-14 16:08:43,146 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:43,146 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:43,147 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:43,151 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:43,151 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: D9946B4E409F4048A73B4F7E683B5E55
2016-01-14 16:08:43,151 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:43,151 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:43,152 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:43,152 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:43,152 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:43,152 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:43,153 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:43,153 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:43,153 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 732896BFDF594475AC338578BB16486F, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:43,154 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, D9946B4E409F4048A73B4F7E683B5E55, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:43,154 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:43,154 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 732896BFDF594475AC338578BB16486F
2016-01-14 16:08:43,154 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:43,154 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 732896BFDF594475AC338578BB16486F
2016-01-14 16:08:43,155 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 732896BFDF594475AC338578BB16486F being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:43,155 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:43,156 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:43,156 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:43,156 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787722910_0001_1_00_000000_0
2016-01-14 16:08:43,157 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:43,159 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@2addc608
2016-01-14 16:08:43,160 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:43,160 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@2addc608
2016-01-14 16:08:43,161 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:43,161 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:43,161 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 732896BFDF594475AC338578BB16486F
2016-01-14 16:08:43,162 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_RESULTS"], id: D9946B4E409F4048A73B4F7E683B5E55
2016-01-14 16:08:43,162 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_RESULTS"]
2016-01-14 16:08:43,163 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:43,163 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:43,163 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F80E54E449DE4326B514F6DAB1B48A7A, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:43,167 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:43,167 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:43,168 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787722910_0001_1_00_000000_0
2016-01-14 16:08:43,168 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787722910_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:43,169 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787722910_0001_1_00_000000_0
2016-01-14 16:08:43,169 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F80E54E449DE4326B514F6DAB1B48A7A, mem on close (mb), free: 156, total: 385, max: 672
2016-01-14 16:08:43 Completed running task attempt: attempt_1452787722910_0001_1_00_000000_0
2016-01-14 16:08:43,170 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787722910_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:43,171 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787723164, Process_Duration=5, Process_End_Time=1452787723169, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:43,172 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722910_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F80E54E449DE4326B514F6DAB1B48A7A, taskAttemptId=attempt_1452787722910_0001_1_00_000000_0, startTime=1452787723119, finishTime=1452787723171, timeTaken=52, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787723164, Process_Duration=5, Process_End_Time=1452787723169, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:43,172 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:43,173 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:43,173 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:43,173 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787722910_0001_00_000001
2016-01-14 16:08:43,172 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787722910_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:43,174 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787722910_0001_1_00_000000_0
2016-01-14 16:08:43,174 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:43,174 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722910_0001_1][Event:TASK_FINISHED]: vertexName=F80E54E449DE4326B514F6DAB1B48A7A, taskId=task_1452787722910_0001_1_00_000000, startTime=1452787723119, finishTime=1452787723174, timeTaken=55, status=SUCCEEDED, successfulAttemptID=attempt_1452787722910_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787723164, Process_Duration=5, Process_End_Time=1452787723169, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:43,175 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787722910_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:43,175 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A] : 1
2016-01-14 16:08:43,175 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A]
2016-01-14 16:08:43,176 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:43,177 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722910_0001_1][Event:VERTEX_FINISHED]: vertexName=F80E54E449DE4326B514F6DAB1B48A7A, vertexId=vertex_1452787722910_0001_1_00, initRequestedTime=1452787723086, initedTime=1452787723101, startRequestedTime=1452787723102, startedTime=1452787723102, finishTime=1452787723175, timeTaken=73, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787723164, Process_Duration=5, Process_End_Time=1452787723169, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787723119, firstTasksToStart=[ task_1452787722910_0001_1_00_000000 ], lastTaskFinishTime=1452787723171, lastTasksToFinish=[ task_1452787722910_0001_1_00_000000 ], minTaskDuration=52, maxTaskDuration=52, avgTaskDuration=52.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787722910_0001_1_00_000000 ], longestDurationTasks=[ task_1452787722910_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:43,177 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:43,177 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:43,177 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787722910_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:43,178 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722910_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787722910_0001_00_000001, stoppedTime=1452787723178, exitStatus=0
2016-01-14 16:08:43,178 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787722910_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:43,178 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:43,178 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:43,179 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787722910_0001_1
2016-01-14 16:08:43,179 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787722910_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:43,179 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787722910_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:43,179 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722910_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787722910_0001_1
2016-01-14 16:08:43,180 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: D9946B4E409F4048A73B4F7E683B5E55 for vertex: vertex_1452787722910_0001_1_00 [F80E54E449DE4326B514F6DAB1B48A7A]
2016-01-14 16:08:43,180 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787722910_0001_00_000001, Exiting
2016-01-14 16:08:43,180 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787722910_0001_00_000001
2016-01-14 16:08:43,180 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787722910_0001_00_000001
2016-01-14 16:08:43,183 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787722910_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:43,183 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787722910_0001_00_000001 completed successfully
2016-01-14 16:08:43,190 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787722910_0001_1, queueSize=0
2016-01-14 16:08:43,190 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:43,191 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787722910_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787722910_0001_1, startTime=1452787723085, finishTime=1452787723189, timeTaken=104, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787723164, Process_Duration=5, Process_End_Time=1452787723169, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:43,191 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787722910_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:43,191 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787722910_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:43,191 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787722910_0001_00_000001
2016-01-14 16:08:43,191 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787722910_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:43 Completed Dag: dag_1452787722910_0001_1
2016-01-14 16:08:43,192 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787722910_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:43,193 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787722910_0001_1_post
2016-01-14 16:08:43,193 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:43,193 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:43,198 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_RESULTS, applicationId=application_1452787722910_0001
2016-01-14 16:08:43,200 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:43,200 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:43,200 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:43,200 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:43,201 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:43,201 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:43,201 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:43,202 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:43,202 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:43,202 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:43,202 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:43,203 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:43,203 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:43,207 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/527F67BE711345779CF7A33E9FD58E3F/C10A44795B7D4A6CBF05AA28E01E6A42/.tez/application_1452787722910_0001
2016-01-14 16:08:43,208 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  completed in: 00:00.318
2016-01-14 16:08:43,309 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:43,332 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:43,333 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:43,374 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.015
2016-01-14 16:08:43,383 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.024
2016-01-14 16:08:43,384 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:43,384 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:43,384 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:43,400 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:43,401 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:43,411 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting
2016-01-14 16:08:43,411 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:43,411 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_ALL"]
2016-01-14 16:08:43,412 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  parallel execution of steps is enabled: false
2016-01-14 16:08:43,412 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  executing total steps: 1
2016-01-14 16:08:43,412 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  allocating management threads: 1
2016-01-14 16:08:43,413 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting step: (1/1) ...d'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:43,413 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [each.each] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:43,425 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tez session mode enabled: true
2016-01-14 16:08:43,430 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:43,431 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:43,431 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:43,441 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/8300D3153E1F4E0A80F8A55390A6772A/EB1BF45DB47E41CE8392FBFF021FCD73/.tez/application_1452787723430_0001 doesn't exist and is created
2016-01-14 16:08:43,458 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:43,458 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:43,459 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/8300D3153E1F4E0A80F8A55390A6772A/EB1BF45DB47E41CE8392FBFF021FCD73/.tez/application_1452787723430_0001
2016-01-14 16:08:43,462 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787723430_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:43,472 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:43,473 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:43,474 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:43,474 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:43,475 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/8300D3153E1F4E0A80F8A55390A6772A/EB1BF45DB47E41CE8392FBFF021FCD73/.tez/application_1452787723430_0001/localmode-log-dir
2016-01-14 16:08:43,475 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/8300D3153E1F4E0A80F8A55390A6772A/EB1BF45DB47E41CE8392FBFF021FCD73/.tez/application_1452787723430_0001/localmode-log-dir/history.txt.appattempt_1452787723430_0001_000000, maxErrors=10
2016-01-14 16:08:43,475 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:43,475 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787723430_0001_000000, appSubmitTime=1452787723461, launchTime=1452787723461
2016-01-14 16:08:43,478 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:43,481 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:43,482 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:43,482 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:43,484 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:50464
2016-01-14 16:08:43,485 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:43,487 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787723430_0001_000000, startTime=1452787723487
2016-01-14 16:08:43,487 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:43,487 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:43,558 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:43,559 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:43,559 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL, applicationId=application_1452787723430_0001, dagName=[8300D3153E1F4E0A80F8A55390A6772A/EB1BF45DB47E41CE8392FBFF021FCD73] each.each/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:43,575 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [8300D3153E1F4E0A80F8A55390A6772A/EB1BF45DB47E41CE8392FBFF021FCD73] each.each/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:43,577 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787723430_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/8300D3153E1F4E0A80F8A55390A6772A/EB1BF45DB47E41CE8392FBFF021FCD73/.tez/application_1452787723430_0001/localmode-log-dir/dag_1452787723430_0001_1.dot
2016-01-14 16:08:43,578 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/8300D3153E1F4E0A80F8A55390A6772A/EB1BF45DB47E41CE8392FBFF021FCD73/.tez/application_1452787723430_0001/localmode-log-dir/dag_1452787723430_0001_1-tez-dag.pb.txt
2016-01-14 16:08:43,584 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787723430_0001_1
2016-01-14 16:08:43,584 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:43,584 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [8300D3153E1F4E0A80F8A55390A6772A/EB1BF45DB47E41CE8392FBFF021FCD73] each.each/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:43 Running Dag: dag_1452787723430_0001_1
2016-01-14 16:08:43,596 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723430_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787723430_0001_1, submitTime=1452787723575
2016-01-14 16:08:43,596 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:43,597 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex A9F50BC88C9441CB85234E902FE11CD5
2016-01-14 16:08:43,597 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:43,598 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:43,599 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723430_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787723430_0001_1, initTime=1452787723597
2016-01-14 16:08:43,599 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787723430_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:43,600 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723430_0001_1][Event:DAG_STARTED]: dagID=dag_1452787723430_0001_1, startTime=1452787723599
2016-01-14 16:08:43,600 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:43,600 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787723430_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:43,600 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL, applicationId=application_1452787723430_0001, dagName=[8300D3153E1F4E0A80F8A55390A6772A/EB1BF45DB47E41CE8392FBFF021FCD73] each.each/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:43,600 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: A9F50BC88C9441CB85234E902FE11CD5 : {F5BA45A6AE334B5892D7D09A0414A758={InputName=F5BA45A6AE334B5892D7D09A0414A758}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:43,600 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: F5BA45A6AE334B5892D7D09A0414A758, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:43,600 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5]
2016-01-14 16:08:43,601 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5]
2016-01-14 16:08:43,601 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5]
2016-01-14 16:08:43,601 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5]. Starting root input initializers: 1
2016-01-14 16:08:43,601 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:43,602 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:43,602 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: F5BA45A6AE334B5892D7D09A0414A758 on vertex vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5]
2016-01-14 16:08:43,604 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:43,604 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input F5BA45A6AE334B5892D7D09A0414A758 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:43,605 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:43,605 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:43,606 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:43,609 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: F5BA45A6AE334B5892D7D09A0414A758 on vertex vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5]
2016-01-14 16:08:43,609 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:43,609 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {F5BA45A6AE334B5892D7D09A0414A758=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:43,610 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5] parallelism set to 1
2016-01-14 16:08:43,610 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:43,610 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723430_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787723430_0001_1_00, eventCount=1
2016-01-14 16:08:43,610 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5]
2016-01-14 16:08:43,610 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=3811E2D9080B421DB0D7E10AC1DD9F8D, vertexId=vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:43,611 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=3811E2D9080B421DB0D7E10AC1DD9F8D, vertexId=vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5]
2016-01-14 16:08:43,612 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=3811E2D9080B421DB0D7E10AC1DD9F8D, vertexName=A9F50BC88C9441CB85234E902FE11CD5, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:43,613 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=3811E2D9080B421DB0D7E10AC1DD9F8D, vertexId=vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5]
2016-01-14 16:08:43,614 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:43,614 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723430_0001_1][Event:VERTEX_INITIALIZED]: vertexName=A9F50BC88C9441CB85234E902FE11CD5, vertexId=vertex_1452787723430_0001_1_00, initRequestedTime=1452787723600, initedTime=1452787723614, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:43,615 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5] with distanceFromRoot: 0
2016-01-14 16:08:43,615 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:43,615 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in A9F50BC88C9441CB85234E902FE11CD5
2016-01-14 16:08:43,615 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5]
2016-01-14 16:08:43,615 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:43,616 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723430_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787723430_0001_1_00, startRequestedTime=1452787723615, startedTime=1452787723615
2016-01-14 16:08:43,616 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:43,616 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:43,617 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723430_0001_1][Event:TASK_STARTED]: vertexName=A9F50BC88C9441CB85234E902FE11CD5, taskId=task_1452787723430_0001_1_00_000000, scheduledTime=1452787723616, launchTime=1452787723616
2016-01-14 16:08:43,617 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787723430_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:43,617 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5]
2016-01-14 16:08:43,617 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [8300D3153E1F4E0A80F8A55390A6772A/EB1BF45DB47E41CE8392FBFF021FCD73] each.each/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL, VertexName: A9F50BC88C9441CB85234E902FE11CD5, VertexParallelism: 1, TaskAttemptID:attempt_1452787723430_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=F5BA45A6AE334B5892D7D09A0414A758, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=3811E2D9080B421DB0D7E10AC1DD9F8D, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:43,617 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787723430_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:43,618 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:43,618 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:43,619 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:43,619 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:43,619 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787723430_0001_00_000001
2016-01-14 16:08:43,620 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787723430_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:43,621 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787723430_0001_00_000001
2016-01-14 16:08:43,622 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:43,623 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:43,623 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787723430_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:43,623 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723430_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787723430_0001_00_000001, launchTime=1452787723622
2016-01-14 16:08:43,623 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] submitted tez dag to app master: application_1452787723430_0001, with dag id: dag_1452787723430_0001_1
2016-01-14 16:08:43,624 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787723430_0001_00_000001
2016-01-14 16:08:43,625 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787723430_0001_1_00_000000_0] to container: [container_1452787723430_0001_00_000001]
2016-01-14 16:08:43,625 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787723430_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:43,626 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787723430_0001_00_000001 given task: attempt_1452787723430_0001_1_00_000000_0
2016-01-14 16:08:43,626 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787723430_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787723430_0001_1_00_000000_0
2016-01-14 16:08:43,627 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787723430_0001_1_00_000000_0] started. Is using containerId: [container_1452787723430_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:43 Starting to run new task attempt: attempt_1452787723430_0001_1_00_000000_0
2016-01-14 16:08:43,627 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787723430_0001_1_00_000000_0
2016-01-14 16:08:43,627 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:43,627 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723430_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=A9F50BC88C9441CB85234E902FE11CD5, taskAttemptId=attempt_1452787723430_0001_1_00_000000_0, startTime=1452787723626, containerId=container_1452787723430_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787723430_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:43,627 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:43,627 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787723430_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:43,627 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:43,628 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787723430_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:43,628 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:43,628 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:43,628 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:43,628 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:43,628 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [8300D3153E1F4E0A80F8A55390A6772A/EB1BF45DB47E41CE8392FBFF021FCD73] each.each/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL, VertexName: A9F50BC88C9441CB85234E902FE11CD5, VertexParallelism: 1, TaskAttemptID:attempt_1452787723430_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=F5BA45A6AE334B5892D7D09A0414A758, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=3811E2D9080B421DB0D7E10AC1DD9F8D, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:43,629 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:43,629 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787723430_0001_1_00_000000_0
2016-01-14 16:08:43,629 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:43,629 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:43,630 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:43,635 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=3811E2D9080B421DB0D7E10AC1DD9F8D, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:43,635 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787723430_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:43,637 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:43,637 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 3811E2D9080B421DB0D7E10AC1DD9F8D
2016-01-14 16:08:43,638 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:43,638 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 3811E2D9080B421DB0D7E10AC1DD9F8D
2016-01-14 16:08:43,638 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:43,635 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=F5BA45A6AE334B5892D7D09A0414A758, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:43,643 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:43,643 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: F5BA45A6AE334B5892D7D09A0414A758
2016-01-14 16:08:43,644 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: F5BA45A6AE334B5892D7D09A0414A758
2016-01-14 16:08:43,648 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: A9F50BC88C9441CB85234E902FE11CD5, ordinal: 0
2016-01-14 16:08:43,649 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A9F50BC88C9441CB85234E902FE11CD5, mem on start (mb), free: 291, total: 384, max: 672
2016-01-14 16:08:43,649 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:43,649 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:43,650 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:43,650 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: F5BA45A6AE334B5892D7D09A0414A758
2016-01-14 16:08:43,650 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: F5BA45A6AE334B5892D7D09A0414A758
2016-01-14 16:08:43,651 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:43,657 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:43,657 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 3811E2D9080B421DB0D7E10AC1DD9F8D
2016-01-14 16:08:43,657 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:43,657 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:43,657 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:43,658 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:43,658 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:43,658 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:43,659 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:43,659 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:43,659 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 3811E2D9080B421DB0D7E10AC1DD9F8D, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:43,659 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, F5BA45A6AE334B5892D7D09A0414A758, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:43,660 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:43,660 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: F5BA45A6AE334B5892D7D09A0414A758
2016-01-14 16:08:43,660 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:43,660 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: F5BA45A6AE334B5892D7D09A0414A758
2016-01-14 16:08:43,660 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: F5BA45A6AE334B5892D7D09A0414A758 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:43,661 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:43,661 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:43,661 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:43,662 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787723430_0001_1_00_000000_0
2016-01-14 16:08:43,663 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:43,664 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@7739fd54
2016-01-14 16:08:43,665 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:43,666 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: F5BA45A6AE334B5892D7D09A0414A758
2016-01-14 16:08:43,666 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_ALL"], id: 3811E2D9080B421DB0D7E10AC1DD9F8D
2016-01-14 16:08:43,666 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_ALL"]
2016-01-14 16:08:43,666 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:43,667 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:43,667 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@7739fd54
2016-01-14 16:08:43,667 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:43,667 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:43,668 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: A9F50BC88C9441CB85234E902FE11CD5, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:43,670 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:43,670 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:43,671 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787723430_0001_1_00_000000_0
2016-01-14 16:08:43,671 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787723430_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:43,672 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787723430_0001_1_00_000000_0
2016-01-14 16:08:43,672 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A9F50BC88C9441CB85234E902FE11CD5, mem on close (mb), free: 289, total: 384, max: 672
2016-01-14 16:08:43 Completed running task attempt: attempt_1452787723430_0001_1_00_000000_0
2016-01-14 16:08:43,673 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787723430_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:43,674 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787723668, Process_Duration=4, Process_End_Time=1452787723672, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:43,675 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723430_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=A9F50BC88C9441CB85234E902FE11CD5, taskAttemptId=attempt_1452787723430_0001_1_00_000000_0, startTime=1452787723626, finishTime=1452787723674, timeTaken=48, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787723668, Process_Duration=4, Process_End_Time=1452787723672, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:43,674 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:43,676 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:43,676 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:43,675 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787723430_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:43,676 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787723430_0001_1_00_000000_0
2016-01-14 16:08:43,676 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787723430_0001_00_000001
2016-01-14 16:08:43,677 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:43,677 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723430_0001_1][Event:TASK_FINISHED]: vertexName=A9F50BC88C9441CB85234E902FE11CD5, taskId=task_1452787723430_0001_1_00_000000, startTime=1452787723626, finishTime=1452787723677, timeTaken=51, status=SUCCEEDED, successfulAttemptID=attempt_1452787723430_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787723668, Process_Duration=4, Process_End_Time=1452787723672, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:43,678 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787723430_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:43,677 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:43,678 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5] : 1
2016-01-14 16:08:43,678 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5]
2016-01-14 16:08:43,679 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723430_0001_1][Event:VERTEX_FINISHED]: vertexName=A9F50BC88C9441CB85234E902FE11CD5, vertexId=vertex_1452787723430_0001_1_00, initRequestedTime=1452787723600, initedTime=1452787723614, startRequestedTime=1452787723615, startedTime=1452787723615, finishTime=1452787723678, timeTaken=63, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787723668, Process_Duration=4, Process_End_Time=1452787723672, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787723626, firstTasksToStart=[ task_1452787723430_0001_1_00_000000 ], lastTaskFinishTime=1452787723674, lastTasksToFinish=[ task_1452787723430_0001_1_00_000000 ], minTaskDuration=48, maxTaskDuration=48, avgTaskDuration=48.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787723430_0001_1_00_000000 ], longestDurationTasks=[ task_1452787723430_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:43,680 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:43,680 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:43,680 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787723430_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:43,680 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723430_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787723430_0001_00_000001, stoppedTime=1452787723680, exitStatus=0
2016-01-14 16:08:43,680 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787723430_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:43,680 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:43,680 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787723430_0001_1
2016-01-14 16:08:43,681 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:43,681 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723430_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787723430_0001_1
2016-01-14 16:08:43,681 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 3811E2D9080B421DB0D7E10AC1DD9F8D for vertex: vertex_1452787723430_0001_1_00 [A9F50BC88C9441CB85234E902FE11CD5]
2016-01-14 16:08:43,687 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787723430_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:43,687 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787723430_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:43,687 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787723430_0001_00_000001, Exiting
2016-01-14 16:08:43,688 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787723430_0001_00_000001
2016-01-14 16:08:43,688 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787723430_0001_00_000001
2016-01-14 16:08:43,690 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787723430_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:43,690 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787723430_0001_00_000001 completed successfully
2016-01-14 16:08:43,690 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787723430_0001_1, queueSize=0
2016-01-14 16:08:43,691 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:43,691 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723430_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787723430_0001_1, startTime=1452787723599, finishTime=1452787723688, timeTaken=89, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787723668, Process_Duration=4, Process_End_Time=1452787723672, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:43,691 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787723430_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:43,691 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787723430_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:43,691 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787723430_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:43,692 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787723430_0001_00_000001
2016-01-14 16:08:43 Completed Dag: dag_1452787723430_0001_1
2016-01-14 16:08:43,692 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787723430_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:43,692 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787723430_0001_1_post
2016-01-14 16:08:43,692 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:43,692 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:43,698 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL, applicationId=application_1452787723430_0001
2016-01-14 16:08:43,700 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:43,700 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:43,700 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:43,700 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:43,700 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:43,701 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:43,701 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:43,702 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:43,702 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:43,702 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:43,702 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:43,703 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:43,703 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:43,708 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/8300D3153E1F4E0A80F8A55390A6772A/EB1BF45DB47E41CE8392FBFF021FCD73/.tez/application_1452787723430_0001
2016-01-14 16:08:43,708 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  completed in: 00:00.297
2016-01-14 16:08:43,757 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:43,758 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:43,778 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:43,808 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:43,809 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:43,851 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 16:08:43,864 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.028
2016-01-14 16:08:43,864 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:43,864 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:43,865 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:43,878 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:43,879 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:43,889 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting
2016-01-14 16:08:43,890 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:43,890 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_-1"]
2016-01-14 16:08:43,890 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  parallel execution of steps is enabled: false
2016-01-14 16:08:43,890 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  executing total steps: 1
2016-01-14 16:08:43,890 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  allocating management threads: 1
2016-01-14 16:08:43,891 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting step: (1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:43,891 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [each.each] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:43,902 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tez session mode enabled: true
2016-01-14 16:08:43,907 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:43,907 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:43,908 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:43,916 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/0CE3505C7029469E9E695C78CC17BD2F/D4C03AEEF57645C1940A68D1AEE0D679/.tez/application_1452787723907_0001 doesn't exist and is created
2016-01-14 16:08:43,932 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:43,933 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:43,933 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/0CE3505C7029469E9E695C78CC17BD2F/D4C03AEEF57645C1940A68D1AEE0D679/.tez/application_1452787723907_0001
2016-01-14 16:08:43,936 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787723907_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:43,948 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:43,949 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:43,951 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:43,951 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:43,952 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/0CE3505C7029469E9E695C78CC17BD2F/D4C03AEEF57645C1940A68D1AEE0D679/.tez/application_1452787723907_0001/localmode-log-dir
2016-01-14 16:08:43,952 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/0CE3505C7029469E9E695C78CC17BD2F/D4C03AEEF57645C1940A68D1AEE0D679/.tez/application_1452787723907_0001/localmode-log-dir/history.txt.appattempt_1452787723907_0001_000000, maxErrors=10
2016-01-14 16:08:43,953 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:43,953 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787723907_0001_000000, appSubmitTime=1452787723936, launchTime=1452787723936
2016-01-14 16:08:43,956 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:43,958 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:43,959 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:43,960 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:43,963 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:52885
2016-01-14 16:08:43,964 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:43,968 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787723907_0001_000000, startTime=1452787723968
2016-01-14 16:08:43,968 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:43,968 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:44,033 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:44,033 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:44,033 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...eld'_RESULTS.-1_VALUES_-1, applicationId=application_1452787723907_0001, dagName=[0CE3505C7029469E9E695C78CC17BD2F/D4C03AEEF57645C1940A68D1AEE0D679] each.each/(1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:44,051 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [0CE3505C7029469E9E695C78CC17BD2F/D4C03AEEF57645C1940A68D1AEE0D679] each.each/(1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:44,052 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787723907_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/0CE3505C7029469E9E695C78CC17BD2F/D4C03AEEF57645C1940A68D1AEE0D679/.tez/application_1452787723907_0001/localmode-log-dir/dag_1452787723907_0001_1.dot
2016-01-14 16:08:44,053 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/0CE3505C7029469E9E695C78CC17BD2F/D4C03AEEF57645C1940A68D1AEE0D679/.tez/application_1452787723907_0001/localmode-log-dir/dag_1452787723907_0001_1-tez-dag.pb.txt
2016-01-14 16:08:44,058 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787723907_0001_1
2016-01-14 16:08:44,058 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:44,058 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [0CE3505C7029469E9E695C78CC17BD2F/D4C03AEEF57645C1940A68D1AEE0D679] each.each/(1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:44 Running Dag: dag_1452787723907_0001_1
2016-01-14 16:08:44,070 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723907_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787723907_0001_1, submitTime=1452787724051
2016-01-14 16:08:44,070 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:44,071 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex B15C2E2BB7BB44138169D50FD4BE1595
2016-01-14 16:08:44,071 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:44,072 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:44,072 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723907_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787723907_0001_1, initTime=1452787724071
2016-01-14 16:08:44,072 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787723907_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:44,073 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723907_0001_1][Event:DAG_STARTED]: dagID=dag_1452787723907_0001_1, startTime=1452787724073
2016-01-14 16:08:44,073 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:44,073 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:44,073 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...eld'_RESULTS.-1_VALUES_-1, applicationId=application_1452787723907_0001, dagName=[0CE3505C7029469E9E695C78CC17BD2F/D4C03AEEF57645C1940A68D1AEE0D679] each.each/(1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:44,074 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787723907_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:44,074 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: B15C2E2BB7BB44138169D50FD4BE1595 : {3834EF9A782F4631B246A76AB26312DC={InputName=3834EF9A782F4631B246A76AB26312DC}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:44,074 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 3834EF9A782F4631B246A76AB26312DC, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:44,074 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595]
2016-01-14 16:08:44,074 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595]
2016-01-14 16:08:44,075 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595]
2016-01-14 16:08:44,075 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595]. Starting root input initializers: 1
2016-01-14 16:08:44,075 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:44,076 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 3834EF9A782F4631B246A76AB26312DC on vertex vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595]
2016-01-14 16:08:44,078 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:44,078 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 3834EF9A782F4631B246A76AB26312DC asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:44,079 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:44,079 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:44,080 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:44,082 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 3834EF9A782F4631B246A76AB26312DC on vertex vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595]
2016-01-14 16:08:44,082 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:44,082 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {3834EF9A782F4631B246A76AB26312DC=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:44,083 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595] parallelism set to 1
2016-01-14 16:08:44,083 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:44,083 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723907_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787723907_0001_1_00, eventCount=1
2016-01-14 16:08:44,083 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595]
2016-01-14 16:08:44,083 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=C77C292B41EC4D1C9BC0263A67051F70, vertexId=vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:44,084 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=C77C292B41EC4D1C9BC0263A67051F70, vertexId=vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595]
2016-01-14 16:08:44,085 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=C77C292B41EC4D1C9BC0263A67051F70, vertexName=B15C2E2BB7BB44138169D50FD4BE1595, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:44,086 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=C77C292B41EC4D1C9BC0263A67051F70, vertexId=vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595]
2016-01-14 16:08:44,087 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723907_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B15C2E2BB7BB44138169D50FD4BE1595, vertexId=vertex_1452787723907_0001_1_00, initRequestedTime=1452787724074, initedTime=1452787724087, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:44,087 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:44,088 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595] with distanceFromRoot: 0
2016-01-14 16:08:44,088 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:44,088 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in B15C2E2BB7BB44138169D50FD4BE1595
2016-01-14 16:08:44,089 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595]
2016-01-14 16:08:44,089 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723907_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787723907_0001_1_00, startRequestedTime=1452787724088, startedTime=1452787724088
2016-01-14 16:08:44,089 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:44,089 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:44,090 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:44,090 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723907_0001_1][Event:TASK_STARTED]: vertexName=B15C2E2BB7BB44138169D50FD4BE1595, taskId=task_1452787723907_0001_1_00_000000, scheduledTime=1452787724090, launchTime=1452787724090
2016-01-14 16:08:44,091 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787723907_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:44,091 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595]
2016-01-14 16:08:44,092 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [0CE3505C7029469E9E695C78CC17BD2F/D4C03AEEF57645C1940A68D1AEE0D679] each.each/(1/1) ...eld'_RESULTS.-1_VALUES_-1, VertexName: B15C2E2BB7BB44138169D50FD4BE1595, VertexParallelism: 1, TaskAttemptID:attempt_1452787723907_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=3834EF9A782F4631B246A76AB26312DC, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=C77C292B41EC4D1C9BC0263A67051F70, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:44,092 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787723907_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:44,092 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:44,093 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:44,093 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:44,094 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:44,094 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787723907_0001_00_000001
2016-01-14 16:08:44,094 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787723907_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:44,096 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787723907_0001_00_000001
2016-01-14 16:08:44,096 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:44,096 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] submitted tez dag to app master: application_1452787723907_0001, with dag id: dag_1452787723907_0001_1
2016-01-14 16:08:44,097 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787723907_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:44,097 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723907_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787723907_0001_00_000001, launchTime=1452787724097
2016-01-14 16:08:44,097 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:44,099 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787723907_0001_00_000001
2016-01-14 16:08:44,100 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787723907_0001_1_00_000000_0] to container: [container_1452787723907_0001_00_000001]
2016-01-14 16:08:44,100 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787723907_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:44,100 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787723907_0001_00_000001 given task: attempt_1452787723907_0001_1_00_000000_0
2016-01-14 16:08:44,101 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787723907_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787723907_0001_1_00_000000_0
2016-01-14 16:08:44,101 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787723907_0001_1_00_000000_0] started. Is using containerId: [container_1452787723907_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:44,101 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723907_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B15C2E2BB7BB44138169D50FD4BE1595, taskAttemptId=attempt_1452787723907_0001_1_00_000000_0, startTime=1452787724101, containerId=container_1452787723907_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787723907_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:44,101 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787723907_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:44 Starting to run new task attempt: attempt_1452787723907_0001_1_00_000000_0
2016-01-14 16:08:44,101 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787723907_0001_1_00_000000_0
2016-01-14 16:08:44,101 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787723907_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:44,101 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:44,102 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:44,102 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:44,102 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:44,102 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:44,102 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:44,102 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:44,102 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [0CE3505C7029469E9E695C78CC17BD2F/D4C03AEEF57645C1940A68D1AEE0D679] each.each/(1/1) ...eld'_RESULTS.-1_VALUES_-1, VertexName: B15C2E2BB7BB44138169D50FD4BE1595, VertexParallelism: 1, TaskAttemptID:attempt_1452787723907_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=3834EF9A782F4631B246A76AB26312DC, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=C77C292B41EC4D1C9BC0263A67051F70, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:44,103 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:44,103 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787723907_0001_1_00_000000_0
2016-01-14 16:08:44,103 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:44,103 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:44,104 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=3834EF9A782F4631B246A76AB26312DC, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:44,105 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=C77C292B41EC4D1C9BC0263A67051F70, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:44,105 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787723907_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:44,104 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:44,108 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:44,106 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:44,109 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: C77C292B41EC4D1C9BC0263A67051F70
2016-01-14 16:08:44,109 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:44,109 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: C77C292B41EC4D1C9BC0263A67051F70
2016-01-14 16:08:44,106 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:44,111 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 3834EF9A782F4631B246A76AB26312DC
2016-01-14 16:08:44,111 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 3834EF9A782F4631B246A76AB26312DC
2016-01-14 16:08:44,116 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:44,116 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B15C2E2BB7BB44138169D50FD4BE1595, ordinal: 0
2016-01-14 16:08:44,116 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B15C2E2BB7BB44138169D50FD4BE1595, mem on start (mb), free: 213, total: 384, max: 672
2016-01-14 16:08:44,116 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:44,116 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:44,116 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 3834EF9A782F4631B246A76AB26312DC
2016-01-14 16:08:44,117 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 3834EF9A782F4631B246A76AB26312DC
2016-01-14 16:08:44,117 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:44,122 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:44,122 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: C77C292B41EC4D1C9BC0263A67051F70
2016-01-14 16:08:44,122 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:44,122 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:44,122 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:44,123 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:44,123 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:44,123 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:44,123 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:44,123 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:44,123 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, C77C292B41EC4D1C9BC0263A67051F70, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:44,123 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 3834EF9A782F4631B246A76AB26312DC, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:44,124 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:44,124 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 3834EF9A782F4631B246A76AB26312DC being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:44,124 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:44,124 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:44,124 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 3834EF9A782F4631B246A76AB26312DC
2016-01-14 16:08:44,124 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:44,124 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 3834EF9A782F4631B246A76AB26312DC
2016-01-14 16:08:44,125 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:44,125 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787723907_0001_1_00_000000_0
2016-01-14 16:08:44,125 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:44,126 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@10efcd37
2016-01-14 16:08:44,127 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@10efcd37
2016-01-14 16:08:44,127 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:44,127 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:44,127 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:44,129 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 3834EF9A782F4631B246A76AB26312DC
2016-01-14 16:08:44,129 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_-1"], id: C77C292B41EC4D1C9BC0263A67051F70
2016-01-14 16:08:44,129 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_-1"]
2016-01-14 16:08:44,129 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:44,130 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:44,130 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B15C2E2BB7BB44138169D50FD4BE1595, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:44,132 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:44,136 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:44,140 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:44,144 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:44,144 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:44,144 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787723907_0001_1_00_000000_0
2016-01-14 16:08:44,145 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787723907_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:44,146 INFO  task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452787723907_0001_1_00_000000_0
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:44,152 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 18 [[File System Counters FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452787724130, Process_Duration=16, Process_End_Time=1452787724146, Read_Duration=0, Tuples_Read=1][cascading.flow.StepCounters Tuples_Read=1]]
2016-01-14 16:08:44,153 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B15C2E2BB7BB44138169D50FD4BE1595, mem on close (mb), free: 211, total: 384, max: 672
2016-01-14 16:08:44,153 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=B15C2E2BB7BB44138169D50FD4BE1595, index=0
2016-01-14 16:08:44,153 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=B15C2E2BB7BB44138169D50FD4BE1595, sourceVertex=3834EF9A782F4631B246A76AB26312DC
2016-01-14 16:08:44,154 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=B15C2E2BB7BB44138169D50FD4BE1595, sourceVertex=C77C292B41EC4D1C9BC0263A67051F70
2016-01-14 16:08:44,154 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787723907_0001_00_000001
2016-01-14 16:08:44,155 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787723907_0001_00_000001
2016-01-14 16:08:44,155 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:44,156 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723907_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B15C2E2BB7BB44138169D50FD4BE1595, taskAttemptId=attempt_1452787723907_0001_1_00_000000_0, startTime=1452787724101, finishTime=1452787724153, timeTaken=52, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452787724130, Process_Duration=16, Process_End_Time=1452787724146, Read_Duration=0, Tuples_Read=1, cascading.flow.StepCounters, Tuples_Read=1
2016-01-14 16:08:44,157 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787723907_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 16:08:44,157 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787723907_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 16:08:44,157 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452787723907_0001_00_000001 completed but with errors
2016-01-14 16:08:44,158 INFO  impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452787723907_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 16:08:44,160 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:44,160 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723907_0001_1][Event:TASK_FINISHED]: vertexName=B15C2E2BB7BB44138169D50FD4BE1595, taskId=task_1452787723907_0001_1_00_000000, startTime=1452787724101, finishTime=1452787724158, timeTaken=57, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-01-14 16:08:44,161 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787723907_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 16:08:44,163 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:44,165 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(686)) - Container container_1452787723907_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 16:08:44,165 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:44,165 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723907_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787723907_0001_00_000001, stoppedTime=1452787724165, exitStatus=1
2016-01-14 16:08:44,166 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787723907_0001_00_000001 transitioned from RUNNING to COMPLETED via event C_COMPLETED
2016-01-14 16:08:44,166 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595] : 1
2016-01-14 16:08:44,166 INFO  impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595] because task failed: task_1452787723907_0001_1_00_000000
2016-01-14 16:08:44,167 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595] due to trigger: OWN_TASK_FAILURE
2016-01-14 16:08:44,167 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 16:08:44,168 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595]
2016-01-14 16:08:44,168 INFO  impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=C77C292B41EC4D1C9BC0263A67051F70, vertexId=vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595]
2016-01-14 16:08:44,172 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:44,172 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723907_0001_1][Event:VERTEX_FINISHED]: vertexName=B15C2E2BB7BB44138169D50FD4BE1595, vertexId=vertex_1452787723907_0001_1_00, initRequestedTime=1452787724074, initedTime=1452787724087, startRequestedTime=1452787724088, startedTime=1452787724088, finishTime=1452787724171, timeTaken=83, status=FAILED, diagnostics=Task failed, taskId=task_1452787723907_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452787724101, firstTasksToStart=[ task_1452787723907_0001_1_00_000000 ], lastTaskFinishTime=1452787724153, lastTasksToFinish=[ task_1452787723907_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 16:08:44,173 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 16:08:44,175 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452787723907_0001_1_00_000000_0 failed: true container: container_1452787723907_0001_00_000001 numFailedTAs: 0
2016-01-14 16:08:44,176 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787723907_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 16:08:44,178 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 16:08:44,178 INFO  impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 16:08:44,179 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787723907_0001_1
2016-01-14 16:08:44,179 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: C77C292B41EC4D1C9BC0263A67051F70 for vertex: vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595]
2016-01-14 16:08:44,181 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787723907_0001_1, queueSize=0
2016-01-14 16:08:44,181 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:44,182 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787723907_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787723907_0001_1, startTime=1452787724073, finishTime=1452787724181, timeTaken=108, status=FAILED, diagnostics=Vertex failed, vertexName=B15C2E2BB7BB44138169D50FD4BE1595, vertexId=vertex_1452787723907_0001_1_00, diagnostics=[Task failed, taskId=task_1452787723907_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452787723907_0001_1_00 [B15C2E2BB7BB44138169D50FD4BE1595] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 16:08:44,183 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787723907_0001_1 finished with state: FAILED
2016-01-14 16:08:44,183 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787723907_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:44 Completed Dag: dag_1452787723907_0001_1
2016-01-14 16:08:44,184 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787723907_0001_1, dagState=FAILED
2016-01-14 16:08:44,184 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787723907_0001_1_post
2016-01-14 16:08:44,184 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:44,184 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:44,191 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...eld'_RESULTS.-1_VALUES_-1, applicationId=application_1452787723907_0001
2016-01-14 16:08:44,193 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:44,193 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:44,193 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:44,193 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:44,194 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:44,194 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:44,195 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:44,195 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:44,195 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:44,196 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:44,196 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:44,196 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:44,197 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:44,202 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/0CE3505C7029469E9E695C78CC17BD2F/D4C03AEEF57645C1940A68D1AEE0D679/.tez/application_1452787723907_0001
2016-01-14 16:08:44,202 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] stopping all jobs
2016-01-14 16:08:44,203 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] stopping: (1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:44,203 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] stopped all jobs
2016-01-14 16:08:44,204 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  completed in: 00:00.315
2016-01-14 16:08:44,204 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:44,227 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:44,227 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:44,258 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.005
2016-01-14 16:08:44,260 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.007
2016-01-14 16:08:44,260 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:44,261 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:44,261 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.-1_VALUES_'field2'
2016-01-14 16:08:44,284 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:44,285 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:44,319 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.009
2016-01-14 16:08:44,328 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-01-14 16:08:44,328 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:44,329 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:44,329 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:44,343 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:44,344 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:44,355 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting
2016-01-14 16:08:44,355 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:44,355 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_RESULTS"]
2016-01-14 16:08:44,355 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  parallel execution of steps is enabled: false
2016-01-14 16:08:44,355 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  executing total steps: 1
2016-01-14 16:08:44,356 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  allocating management threads: 1
2016-01-14 16:08:44,357 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting step: (1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:44,358 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [each.each] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:44,372 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tez session mode enabled: true
2016-01-14 16:08:44,377 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:44,378 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:44,378 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:44,389 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/338F87B5E80049FEBBFCA95CCA141791/DE68B792E7D240D6965DF721EDD92C3B/.tez/application_1452787724377_0001 doesn't exist and is created
2016-01-14 16:08:44,405 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:44,405 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:44,406 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/338F87B5E80049FEBBFCA95CCA141791/DE68B792E7D240D6965DF721EDD92C3B/.tez/application_1452787724377_0001
2016-01-14 16:08:44,409 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787724377_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:44,419 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:44,420 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:44,422 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:44,422 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:44,422 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/338F87B5E80049FEBBFCA95CCA141791/DE68B792E7D240D6965DF721EDD92C3B/.tez/application_1452787724377_0001/localmode-log-dir
2016-01-14 16:08:44,423 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/338F87B5E80049FEBBFCA95CCA141791/DE68B792E7D240D6965DF721EDD92C3B/.tez/application_1452787724377_0001/localmode-log-dir/history.txt.appattempt_1452787724377_0001_000000, maxErrors=10
2016-01-14 16:08:44,423 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:44,423 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787724377_0001_000000, appSubmitTime=1452787724409, launchTime=1452787724409
2016-01-14 16:08:44,431 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:44,432 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:44,432 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:37060
2016-01-14 16:08:44,436 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:44,436 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:44,437 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:44,439 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:44,439 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787724377_0001_000000, startTime=1452787724439
2016-01-14 16:08:44,439 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:44,506 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:44,506 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:44,506 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...RESULTS.-1_VALUES_RESULTS, applicationId=application_1452787724377_0001, dagName=[338F87B5E80049FEBBFCA95CCA141791/DE68B792E7D240D6965DF721EDD92C3B] each.each/(1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:44,524 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [338F87B5E80049FEBBFCA95CCA141791/DE68B792E7D240D6965DF721EDD92C3B] each.each/(1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:44,526 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787724377_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/338F87B5E80049FEBBFCA95CCA141791/DE68B792E7D240D6965DF721EDD92C3B/.tez/application_1452787724377_0001/localmode-log-dir/dag_1452787724377_0001_1.dot
2016-01-14 16:08:44,526 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/338F87B5E80049FEBBFCA95CCA141791/DE68B792E7D240D6965DF721EDD92C3B/.tez/application_1452787724377_0001/localmode-log-dir/dag_1452787724377_0001_1-tez-dag.pb.txt
2016-01-14 16:08:44,529 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:44,529 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:44,531 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787724377_0001_1
2016-01-14 16:08:44,531 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:44,531 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [338F87B5E80049FEBBFCA95CCA141791/DE68B792E7D240D6965DF721EDD92C3B] each.each/(1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:44 Running Dag: dag_1452787724377_0001_1
2016-01-14 16:08:44,545 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724377_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787724377_0001_1, submitTime=1452787724524
2016-01-14 16:08:44,545 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:44,545 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex AB3EC179C8F64F9F922AB99F1FA406F5
2016-01-14 16:08:44,546 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:44,546 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724377_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787724377_0001_1, initTime=1452787724545
2016-01-14 16:08:44,546 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787724377_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:44,546 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:44,548 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:44,547 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724377_0001_1][Event:DAG_STARTED]: dagID=dag_1452787724377_0001_1, startTime=1452787724547
2016-01-14 16:08:44,548 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...RESULTS.-1_VALUES_RESULTS, applicationId=application_1452787724377_0001, dagName=[338F87B5E80049FEBBFCA95CCA141791/DE68B792E7D240D6965DF721EDD92C3B] each.each/(1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:44,548 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:44,565 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787724377_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:44,565 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: AB3EC179C8F64F9F922AB99F1FA406F5 : {8C3FA66A1CA44E28B8EF02D2382201C6={InputName=8C3FA66A1CA44E28B8EF02D2382201C6}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:44,565 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 8C3FA66A1CA44E28B8EF02D2382201C6, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:44,565 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5]
2016-01-14 16:08:44,566 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5]
2016-01-14 16:08:44,567 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5]
2016-01-14 16:08:44,567 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5]. Starting root input initializers: 1
2016-01-14 16:08:44,568 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:44,568 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 8C3FA66A1CA44E28B8EF02D2382201C6 on vertex vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5]
2016-01-14 16:08:44,570 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:44,570 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 8C3FA66A1CA44E28B8EF02D2382201C6 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:44,571 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:44,571 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:44,574 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:44,574 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 8C3FA66A1CA44E28B8EF02D2382201C6 on vertex vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5]
2016-01-14 16:08:44,575 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:44,575 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {8C3FA66A1CA44E28B8EF02D2382201C6=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:44,575 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5] parallelism set to 1
2016-01-14 16:08:44,575 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:44,576 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724377_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787724377_0001_1_00, eventCount=1
2016-01-14 16:08:44,576 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5]
2016-01-14 16:08:44,576 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=674212C13597432AB58E6407A930E181, vertexId=vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:44,576 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=674212C13597432AB58E6407A930E181, vertexId=vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5]
2016-01-14 16:08:44,578 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=674212C13597432AB58E6407A930E181, vertexName=AB3EC179C8F64F9F922AB99F1FA406F5, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:44,578 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=674212C13597432AB58E6407A930E181, vertexId=vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5]
2016-01-14 16:08:44,580 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724377_0001_1][Event:VERTEX_INITIALIZED]: vertexName=AB3EC179C8F64F9F922AB99F1FA406F5, vertexId=vertex_1452787724377_0001_1_00, initRequestedTime=1452787724565, initedTime=1452787724580, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:44,580 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5] with distanceFromRoot: 0
2016-01-14 16:08:44,580 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:44,581 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:44,582 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in AB3EC179C8F64F9F922AB99F1FA406F5
2016-01-14 16:08:44,582 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5]
2016-01-14 16:08:44,582 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:44,583 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724377_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787724377_0001_1_00, startRequestedTime=1452787724581, startedTime=1452787724581
2016-01-14 16:08:44,583 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:44,584 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:44,584 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724377_0001_1][Event:TASK_STARTED]: vertexName=AB3EC179C8F64F9F922AB99F1FA406F5, taskId=task_1452787724377_0001_1_00_000000, scheduledTime=1452787724583, launchTime=1452787724583
2016-01-14 16:08:44,584 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787724377_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:44,585 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5]
2016-01-14 16:08:44,585 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [338F87B5E80049FEBBFCA95CCA141791/DE68B792E7D240D6965DF721EDD92C3B] each.each/(1/1) ...RESULTS.-1_VALUES_RESULTS, VertexName: AB3EC179C8F64F9F922AB99F1FA406F5, VertexParallelism: 1, TaskAttemptID:attempt_1452787724377_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8C3FA66A1CA44E28B8EF02D2382201C6, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=674212C13597432AB58E6407A930E181, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:44,586 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787724377_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:44,586 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] submitted tez dag to app master: application_1452787724377_0001, with dag id: dag_1452787724377_0001_1
2016-01-14 16:08:44,586 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:44,588 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:44,588 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:44,588 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:44,591 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787724377_0001_00_000001
2016-01-14 16:08:44,591 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787724377_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:44,593 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787724377_0001_00_000001
2016-01-14 16:08:44,593 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:44,594 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:44,594 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724377_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787724377_0001_00_000001, launchTime=1452787724593
2016-01-14 16:08:44,594 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787724377_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:44,595 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787724377_0001_00_000001
2016-01-14 16:08:44,595 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787724377_0001_1_00_000000_0] to container: [container_1452787724377_0001_00_000001]
2016-01-14 16:08:44,595 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787724377_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:44,596 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787724377_0001_00_000001 given task: attempt_1452787724377_0001_1_00_000000_0
2016-01-14 16:08:44,596 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787724377_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787724377_0001_1_00_000000_0
2016-01-14 16:08:44,596 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787724377_0001_1_00_000000_0] started. Is using containerId: [container_1452787724377_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:44 Starting to run new task attempt: attempt_1452787724377_0001_1_00_000000_0
2016-01-14 16:08:44,596 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787724377_0001_1_00_000000_0
2016-01-14 16:08:44,596 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724377_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=AB3EC179C8F64F9F922AB99F1FA406F5, taskAttemptId=attempt_1452787724377_0001_1_00_000000_0, startTime=1452787724596, containerId=container_1452787724377_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787724377_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:44,597 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:44,597 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787724377_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:44,597 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:44,597 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787724377_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:44,597 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:44,597 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:44,597 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:44,598 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:44,598 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:44,598 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [338F87B5E80049FEBBFCA95CCA141791/DE68B792E7D240D6965DF721EDD92C3B] each.each/(1/1) ...RESULTS.-1_VALUES_RESULTS, VertexName: AB3EC179C8F64F9F922AB99F1FA406F5, VertexParallelism: 1, TaskAttemptID:attempt_1452787724377_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8C3FA66A1CA44E28B8EF02D2382201C6, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=674212C13597432AB58E6407A930E181, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:44,598 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:44,598 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787724377_0001_1_00_000000_0
2016-01-14 16:08:44,599 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:44,599 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:44,600 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=8C3FA66A1CA44E28B8EF02D2382201C6, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:44,601 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=674212C13597432AB58E6407A930E181, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:44,600 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:44,602 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:44,602 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 674212C13597432AB58E6407A930E181
2016-01-14 16:08:44,603 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:44,603 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 674212C13597432AB58E6407A930E181
2016-01-14 16:08:44,605 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:44,601 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787724377_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:44,601 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:44,611 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 8C3FA66A1CA44E28B8EF02D2382201C6
2016-01-14 16:08:44,611 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 8C3FA66A1CA44E28B8EF02D2382201C6
2016-01-14 16:08:44,620 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: AB3EC179C8F64F9F922AB99F1FA406F5, ordinal: 0
2016-01-14 16:08:44,622 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AB3EC179C8F64F9F922AB99F1FA406F5, mem on start (mb), free: 331, total: 378, max: 672
2016-01-14 16:08:44,623 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:44,623 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:44,623 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:44,623 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 8C3FA66A1CA44E28B8EF02D2382201C6
2016-01-14 16:08:44,623 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 8C3FA66A1CA44E28B8EF02D2382201C6
2016-01-14 16:08:44,623 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:44,624 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:44,624 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 674212C13597432AB58E6407A930E181
2016-01-14 16:08:44,624 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:44,625 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:44,625 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:44,625 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:44,625 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:44,625 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:44,626 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:44,626 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:44,626 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 674212C13597432AB58E6407A930E181, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:44,627 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 8C3FA66A1CA44E28B8EF02D2382201C6, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:44,627 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:44,627 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 8C3FA66A1CA44E28B8EF02D2382201C6 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:44,628 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:44,628 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:44,627 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 8C3FA66A1CA44E28B8EF02D2382201C6
2016-01-14 16:08:44,629 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:44,629 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 8C3FA66A1CA44E28B8EF02D2382201C6
2016-01-14 16:08:44,629 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:44,630 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787724377_0001_1_00_000000_0
2016-01-14 16:08:44,633 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:44,636 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 8C3FA66A1CA44E28B8EF02D2382201C6
2016-01-14 16:08:44,636 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_RESULTS"], id: 674212C13597432AB58E6407A930E181
2016-01-14 16:08:44,637 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_RESULTS"]
2016-01-14 16:08:44,637 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:44,637 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:44,638 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:44,638 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@72596ae6
2016-01-14 16:08:44,639 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@72596ae6
2016-01-14 16:08:44,640 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:44,640 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:44,640 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: AB3EC179C8F64F9F922AB99F1FA406F5, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:44,641 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:44,645 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:44,647 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:44,650 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:44,650 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:44,650 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787724377_0001_1_00_000000_0
2016-01-14 16:08:44,651 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787724377_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:44,652 INFO  task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452787724377_0001_1_00_000000_0
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:44,654 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 18 [[File System Counters FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=396886016, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452787724641, Process_Duration=11, Process_End_Time=1452787724652, Read_Duration=0, Tuples_Read=1][cascading.flow.StepCounters Tuples_Read=1]]
2016-01-14 16:08:44,654 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724377_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=AB3EC179C8F64F9F922AB99F1FA406F5, taskAttemptId=attempt_1452787724377_0001_1_00_000000_0, startTime=1452787724596, finishTime=1452787724654, timeTaken=58, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=396886016, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452787724641, Process_Duration=11, Process_End_Time=1452787724652, Read_Duration=0, Tuples_Read=1, cascading.flow.StepCounters, Tuples_Read=1
2016-01-14 16:08:44,655 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787724377_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 16:08:44,656 INFO  impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452787724377_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 16:08:44,656 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724377_0001_1][Event:TASK_FINISHED]: vertexName=AB3EC179C8F64F9F922AB99F1FA406F5, taskId=task_1452787724377_0001_1_00_000000, startTime=1452787724596, finishTime=1452787724656, timeTaken=60, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-01-14 16:08:44,656 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787724377_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 16:08:44,656 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5] : 1
2016-01-14 16:08:44,657 INFO  impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5] because task failed: task_1452787724377_0001_1_00_000000
2016-01-14 16:08:44,657 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5] due to trigger: OWN_TASK_FAILURE
2016-01-14 16:08:44,657 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 16:08:44,657 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5]
2016-01-14 16:08:44,657 INFO  impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=674212C13597432AB58E6407A930E181, vertexId=vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5]
2016-01-14 16:08:44,659 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:44,654 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:44,660 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:44,661 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:44,662 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724377_0001_1][Event:VERTEX_FINISHED]: vertexName=AB3EC179C8F64F9F922AB99F1FA406F5, vertexId=vertex_1452787724377_0001_1_00, initRequestedTime=1452787724565, initedTime=1452787724580, startRequestedTime=1452787724581, startedTime=1452787724581, finishTime=1452787724658, timeTaken=77, status=FAILED, diagnostics=Task failed, taskId=task_1452787724377_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452787724596, firstTasksToStart=[ task_1452787724377_0001_1_00_000000 ], lastTaskFinishTime=1452787724654, lastTasksToFinish=[ task_1452787724377_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 16:08:44,662 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 16:08:44,664 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 16:08:44,664 INFO  impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 16:08:44,664 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787724377_0001_1
2016-01-14 16:08:44,664 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: 674212C13597432AB58E6407A930E181 for vertex: vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5]
2016-01-14 16:08:44,665 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787724377_0001_1, queueSize=0
2016-01-14 16:08:44,665 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:44,666 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724377_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787724377_0001_1, startTime=1452787724547, finishTime=1452787724664, timeTaken=117, status=FAILED, diagnostics=Vertex failed, vertexName=AB3EC179C8F64F9F922AB99F1FA406F5, vertexId=vertex_1452787724377_0001_1_00, diagnostics=[Task failed, taskId=task_1452787724377_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452787724377_0001_1_00 [AB3EC179C8F64F9F922AB99F1FA406F5] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 16:08:44,666 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787724377_0001_1 finished with state: FAILED
2016-01-14 16:08:44,666 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787724377_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:44,667 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AB3EC179C8F64F9F922AB99F1FA406F5, mem on close (mb), free: 328, total: 378, max: 672
2016-01-14 16:08:44,668 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=AB3EC179C8F64F9F922AB99F1FA406F5, index=0
2016-01-14 16:08:44,668 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=AB3EC179C8F64F9F922AB99F1FA406F5, sourceVertex=8C3FA66A1CA44E28B8EF02D2382201C6
2016-01-14 16:08:44,670 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=AB3EC179C8F64F9F922AB99F1FA406F5, sourceVertex=674212C13597432AB58E6407A930E181
2016-01-14 16:08:44,670 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787724377_0001_00_000001
2016-01-14 16:08:44,670 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787724377_0001_00_000001
2016-01-14 16:08:44,671 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:44,673 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724377_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787724377_0001_00_000001, stoppedTime=1452787724669, exitStatus=0
2016-01-14 16:08:44,673 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787724377_0001_00_000001 transitioned from RUNNING to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:44,673 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452787724377_0001_1_00_000000_0 failed: true container: container_1452787724377_0001_00_000001 numFailedTAs: 0
2016-01-14 16:08:44 Completed Dag: dag_1452787724377_0001_1
2016-01-14 16:08:44,677 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787724377_0001_1, dagState=FAILED
2016-01-14 16:08:44,678 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787724377_0001_1_post
2016-01-14 16:08:44,678 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:44,678 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:44,679 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1452787724377_0001_00_000001. Relying on regular task shutdown for it to end
2016-01-14 16:08:44,679 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787724377_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 16:08:44,683 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787724377_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 16:08:44,684 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452787724377_0001_00_000001 completed but with errors
2016-01-14 16:08:44,684 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(1033)) - Container container_1452787724377_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 16:08:44,684 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787724377_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 16:08:44,684 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787724377_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 16:08:44,686 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...RESULTS.-1_VALUES_RESULTS, applicationId=application_1452787724377_0001
2016-01-14 16:08:44,698 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:44,698 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:44,698 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:44,699 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:44,699 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:44,699 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:44,699 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:44,700 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:44,700 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:44,700 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:44,700 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:44,700 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:44,701 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:44,704 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/338F87B5E80049FEBBFCA95CCA141791/DE68B792E7D240D6965DF721EDD92C3B/.tez/application_1452787724377_0001
2016-01-14 16:08:44,704 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] stopping all jobs
2016-01-14 16:08:44,705 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] stopping: (1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:44,708 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] stopped all jobs
2016-01-14 16:08:44,709 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  completed in: 00:00.353
2016-01-14 16:08:44,709 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:44,731 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:44,731 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:44,764 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.009
2016-01-14 16:08:44,771 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.016
2016-01-14 16:08:44,772 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:44,772 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:44,772 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:44,785 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:44,786 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:44,796 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting
2016-01-14 16:08:44,797 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:44,797 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_ALL"]
2016-01-14 16:08:44,797 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  parallel execution of steps is enabled: false
2016-01-14 16:08:44,797 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  executing total steps: 1
2016-01-14 16:08:44,797 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  allocating management threads: 1
2016-01-14 16:08:44,799 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting step: (1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:44,799 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [each.each] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:44,813 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tez session mode enabled: true
2016-01-14 16:08:44,817 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:44,818 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:44,818 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:44,827 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6150BF80CFA84CF287CDEE4CDCBC3313/D2A078625C93487B9F83D749D4515E1E/.tez/application_1452787724817_0001 doesn't exist and is created
2016-01-14 16:08:44,847 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:44,847 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:44,848 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6150BF80CFA84CF287CDEE4CDCBC3313/D2A078625C93487B9F83D749D4515E1E/.tez/application_1452787724817_0001
2016-01-14 16:08:44,852 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787724817_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:44,865 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:44,865 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:44,867 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:44,867 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:44,867 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6150BF80CFA84CF287CDEE4CDCBC3313/D2A078625C93487B9F83D749D4515E1E/.tez/application_1452787724817_0001/localmode-log-dir
2016-01-14 16:08:44,867 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6150BF80CFA84CF287CDEE4CDCBC3313/D2A078625C93487B9F83D749D4515E1E/.tez/application_1452787724817_0001/localmode-log-dir/history.txt.appattempt_1452787724817_0001_000000, maxErrors=10
2016-01-14 16:08:44,867 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:44,868 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787724817_0001_000000, appSubmitTime=1452787724851, launchTime=1452787724851
2016-01-14 16:08:44,872 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:44,874 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:44,877 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:44,877 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:43569
2016-01-14 16:08:44,880 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:44,881 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:44,884 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787724817_0001_000000, startTime=1452787724883
2016-01-14 16:08:44,884 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:44,884 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:44,948 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:44,948 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:44,948 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.-1_VALUES_ALL, applicationId=application_1452787724817_0001, dagName=[6150BF80CFA84CF287CDEE4CDCBC3313/D2A078625C93487B9F83D749D4515E1E] each.each/(1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:44,967 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [6150BF80CFA84CF287CDEE4CDCBC3313/D2A078625C93487B9F83D749D4515E1E] each.each/(1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:44,969 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787724817_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6150BF80CFA84CF287CDEE4CDCBC3313/D2A078625C93487B9F83D749D4515E1E/.tez/application_1452787724817_0001/localmode-log-dir/dag_1452787724817_0001_1.dot
2016-01-14 16:08:44,969 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6150BF80CFA84CF287CDEE4CDCBC3313/D2A078625C93487B9F83D749D4515E1E/.tez/application_1452787724817_0001/localmode-log-dir/dag_1452787724817_0001_1-tez-dag.pb.txt
2016-01-14 16:08:44,975 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787724817_0001_1
2016-01-14 16:08:44,975 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:44,975 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [6150BF80CFA84CF287CDEE4CDCBC3313/D2A078625C93487B9F83D749D4515E1E] each.each/(1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:44 Running Dag: dag_1452787724817_0001_1
2016-01-14 16:08:44,988 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724817_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787724817_0001_1, submitTime=1452787724967
2016-01-14 16:08:44,988 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:44,989 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex C0F7CE218C3645139A2A4A6A8545FF49
2016-01-14 16:08:44,989 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:44,989 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724817_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787724817_0001_1, initTime=1452787724988
2016-01-14 16:08:44,990 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787724817_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:44,990 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724817_0001_1][Event:DAG_STARTED]: dagID=dag_1452787724817_0001_1, startTime=1452787724990
2016-01-14 16:08:44,990 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:44,990 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787724817_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:44,990 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: C0F7CE218C3645139A2A4A6A8545FF49 : {2483C1CEC2734EA28CCFF96BBE3EAE41={InputName=2483C1CEC2734EA28CCFF96BBE3EAE41}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:44,990 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 2483C1CEC2734EA28CCFF96BBE3EAE41, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:44,990 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49]
2016-01-14 16:08:44,991 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:44,991 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49]
2016-01-14 16:08:44,991 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49]
2016-01-14 16:08:44,991 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49]. Starting root input initializers: 1
2016-01-14 16:08:44,991 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:44,991 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 2483C1CEC2734EA28CCFF96BBE3EAE41 on vertex vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49]
2016-01-14 16:08:44,991 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:44,992 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.-1_VALUES_ALL, applicationId=application_1452787724817_0001, dagName=[6150BF80CFA84CF287CDEE4CDCBC3313/D2A078625C93487B9F83D749D4515E1E] each.each/(1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:44,993 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:44,993 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 2483C1CEC2734EA28CCFF96BBE3EAE41 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:44,993 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:44,994 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:44,995 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:44,995 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 2483C1CEC2734EA28CCFF96BBE3EAE41 on vertex vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49]
2016-01-14 16:08:44,995 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:44,996 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {2483C1CEC2734EA28CCFF96BBE3EAE41=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:44,996 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49] parallelism set to 1
2016-01-14 16:08:44,996 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:44,996 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724817_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787724817_0001_1_00, eventCount=1
2016-01-14 16:08:44,996 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49]
2016-01-14 16:08:44,997 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=0CF68EDC8EC646F0B851CA58264DCF9F, vertexId=vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:44,997 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=0CF68EDC8EC646F0B851CA58264DCF9F, vertexId=vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49]
2016-01-14 16:08:44,998 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=0CF68EDC8EC646F0B851CA58264DCF9F, vertexName=C0F7CE218C3645139A2A4A6A8545FF49, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:44,999 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=0CF68EDC8EC646F0B851CA58264DCF9F, vertexId=vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49]
2016-01-14 16:08:45,000 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:45,001 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724817_0001_1][Event:VERTEX_INITIALIZED]: vertexName=C0F7CE218C3645139A2A4A6A8545FF49, vertexId=vertex_1452787724817_0001_1_00, initRequestedTime=1452787724990, initedTime=1452787725000, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:45,001 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49] with distanceFromRoot: 0
2016-01-14 16:08:45,001 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:45,001 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in C0F7CE218C3645139A2A4A6A8545FF49
2016-01-14 16:08:45,001 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49]
2016-01-14 16:08:45,002 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:45,002 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724817_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787724817_0001_1_00, startRequestedTime=1452787725001, startedTime=1452787725001
2016-01-14 16:08:45,002 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:45,002 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:45,003 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724817_0001_1][Event:TASK_STARTED]: vertexName=C0F7CE218C3645139A2A4A6A8545FF49, taskId=task_1452787724817_0001_1_00_000000, scheduledTime=1452787725002, launchTime=1452787725002
2016-01-14 16:08:45,003 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787724817_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:45,003 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49]
2016-01-14 16:08:45,003 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [6150BF80CFA84CF287CDEE4CDCBC3313/D2A078625C93487B9F83D749D4515E1E] each.each/(1/1) ...ld'_RESULTS.-1_VALUES_ALL, VertexName: C0F7CE218C3645139A2A4A6A8545FF49, VertexParallelism: 1, TaskAttemptID:attempt_1452787724817_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=2483C1CEC2734EA28CCFF96BBE3EAE41, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=0CF68EDC8EC646F0B851CA58264DCF9F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:45,004 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787724817_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:45,004 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:45,012 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:45,012 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:45,012 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:45,013 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] submitted tez dag to app master: application_1452787724817_0001, with dag id: dag_1452787724817_0001_1
2016-01-14 16:08:45,013 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787724817_0001_00_000001
2016-01-14 16:08:45,013 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787724817_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:45,015 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787724817_0001_00_000001
2016-01-14 16:08:45,015 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:45,016 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787724817_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:45,016 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:45,017 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724817_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787724817_0001_00_000001, launchTime=1452787725016
2016-01-14 16:08:45,017 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787724817_0001_00_000001
2016-01-14 16:08:45,019 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787724817_0001_1_00_000000_0] to container: [container_1452787724817_0001_00_000001]
2016-01-14 16:08:45,019 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787724817_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:45,021 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787724817_0001_1_00_000000_0] started. Is using containerId: [container_1452787724817_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:45,021 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724817_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=C0F7CE218C3645139A2A4A6A8545FF49, taskAttemptId=attempt_1452787724817_0001_1_00_000000_0, startTime=1452787725021, containerId=container_1452787724817_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787724817_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:45,021 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:45,021 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787724817_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:45,021 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787724817_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:45,021 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787724817_0001_00_000001 given task: attempt_1452787724817_0001_1_00_000000_0
2016-01-14 16:08:45,022 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787724817_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787724817_0001_1_00_000000_0
2016-01-14 16:08:45 Starting to run new task attempt: attempt_1452787724817_0001_1_00_000000_0
2016-01-14 16:08:45,023 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787724817_0001_1_00_000000_0
2016-01-14 16:08:45,023 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:45,023 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:45,025 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:45,025 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:45,025 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:45,025 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:45,025 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [6150BF80CFA84CF287CDEE4CDCBC3313/D2A078625C93487B9F83D749D4515E1E] each.each/(1/1) ...ld'_RESULTS.-1_VALUES_ALL, VertexName: C0F7CE218C3645139A2A4A6A8545FF49, VertexParallelism: 1, TaskAttemptID:attempt_1452787724817_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=2483C1CEC2734EA28CCFF96BBE3EAE41, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=0CF68EDC8EC646F0B851CA58264DCF9F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:45,026 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:45,026 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787724817_0001_1_00_000000_0
2016-01-14 16:08:45,027 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:45,027 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:45,028 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=2483C1CEC2734EA28CCFF96BBE3EAE41, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:45,030 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:45,030 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 2483C1CEC2734EA28CCFF96BBE3EAE41
2016-01-14 16:08:45,030 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 2483C1CEC2734EA28CCFF96BBE3EAE41
2016-01-14 16:08:45,029 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=0CF68EDC8EC646F0B851CA58264DCF9F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:45,029 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787724817_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:45,028 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:45,033 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:45,032 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:45,035 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 0CF68EDC8EC646F0B851CA58264DCF9F
2016-01-14 16:08:45,035 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:45,034 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 2483C1CEC2734EA28CCFF96BBE3EAE41
2016-01-14 16:08:45,035 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 2483C1CEC2734EA28CCFF96BBE3EAE41
2016-01-14 16:08:45,036 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 0CF68EDC8EC646F0B851CA58264DCF9F
2016-01-14 16:08:45,037 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:45,049 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:45,049 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 0CF68EDC8EC646F0B851CA58264DCF9F
2016-01-14 16:08:45,051 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: C0F7CE218C3645139A2A4A6A8545FF49, ordinal: 0
2016-01-14 16:08:45,051 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C0F7CE218C3645139A2A4A6A8545FF49, mem on start (mb), free: 268, total: 378, max: 672
2016-01-14 16:08:45,051 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:45,052 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:45,052 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:45,053 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:45,053 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:45,054 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:45,054 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:45,054 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:45,054 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:45,056 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:45,056 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:45,056 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 2483C1CEC2734EA28CCFF96BBE3EAE41, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:45,056 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 0CF68EDC8EC646F0B851CA58264DCF9F, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:45,056 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:45,057 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 2483C1CEC2734EA28CCFF96BBE3EAE41
2016-01-14 16:08:45,057 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:45,057 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 2483C1CEC2734EA28CCFF96BBE3EAE41
2016-01-14 16:08:45,057 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 2483C1CEC2734EA28CCFF96BBE3EAE41 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:45,058 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:45,058 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:45,058 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:45,059 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787724817_0001_1_00_000000_0
2016-01-14 16:08:45,060 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:45,061 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@4b35baa7
2016-01-14 16:08:45,061 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:45,062 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 2483C1CEC2734EA28CCFF96BBE3EAE41
2016-01-14 16:08:45,062 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_ALL"], id: 0CF68EDC8EC646F0B851CA58264DCF9F
2016-01-14 16:08:45,063 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@4b35baa7
2016-01-14 16:08:45,063 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:45,063 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:45,063 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_ALL"]
2016-01-14 16:08:45,064 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:45,064 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:45,064 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: C0F7CE218C3645139A2A4A6A8545FF49, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:45,065 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:45,066 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:45,072 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:45,076 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:45,076 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:45,077 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787724817_0001_1_00_000000_0
2016-01-14 16:08:45,078 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787724817_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:45,079 INFO  task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452787724817_0001_1_00_000000_0
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:45,088 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:45,088 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724817_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=C0F7CE218C3645139A2A4A6A8545FF49, taskAttemptId=attempt_1452787724817_0001_1_00_000000_0, startTime=1452787725021, finishTime=1452787725087, timeTaken=66, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=396886016, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452787725064, Process_Duration=15, Process_End_Time=1452787725079, Read_Duration=1, Tuples_Read=1, cascading.flow.StepCounters, Tuples_Read=1
2016-01-14 16:08:45,088 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787724817_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 16:08:45,088 INFO  impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452787724817_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 16:08:45,089 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:45,089 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724817_0001_1][Event:TASK_FINISHED]: vertexName=C0F7CE218C3645139A2A4A6A8545FF49, taskId=task_1452787724817_0001_1_00_000000, startTime=1452787725021, finishTime=1452787725088, timeTaken=67, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-01-14 16:08:45,089 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787724817_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 16:08:45,089 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49] : 1
2016-01-14 16:08:45,089 INFO  impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49] because task failed: task_1452787724817_0001_1_00_000000
2016-01-14 16:08:45,089 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49] due to trigger: OWN_TASK_FAILURE
2016-01-14 16:08:45,090 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 16:08:45,090 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49]
2016-01-14 16:08:45,090 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 19 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=396886016, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452787725064, Process_Duration=15, Process_End_Time=1452787725079, Read_Duration=1, Tuples_Read=1][cascading.flow.StepCounters Tuples_Read=1]]
2016-01-14 16:08:45,090 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:45,090 INFO  impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=0CF68EDC8EC646F0B851CA58264DCF9F, vertexId=vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49]
2016-01-14 16:08:45,094 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:45,094 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724817_0001_1][Event:VERTEX_FINISHED]: vertexName=C0F7CE218C3645139A2A4A6A8545FF49, vertexId=vertex_1452787724817_0001_1_00, initRequestedTime=1452787724990, initedTime=1452787725000, startRequestedTime=1452787725001, startedTime=1452787725001, finishTime=1452787725093, timeTaken=92, status=FAILED, diagnostics=Task failed, taskId=task_1452787724817_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452787725021, firstTasksToStart=[ task_1452787724817_0001_1_00_000000 ], lastTaskFinishTime=1452787725087, lastTasksToFinish=[ task_1452787724817_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 16:08:45,094 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 16:08:45,094 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 16:08:45,095 INFO  impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 16:08:45,095 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787724817_0001_1
2016-01-14 16:08:45,095 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: 0CF68EDC8EC646F0B851CA58264DCF9F for vertex: vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49]
2016-01-14 16:08:45,096 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787724817_0001_1, queueSize=0
2016-01-14 16:08:45,096 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:45,096 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724817_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787724817_0001_1, startTime=1452787724990, finishTime=1452787725095, timeTaken=105, status=FAILED, diagnostics=Vertex failed, vertexName=C0F7CE218C3645139A2A4A6A8545FF49, vertexId=vertex_1452787724817_0001_1_00, diagnostics=[Task failed, taskId=task_1452787724817_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452787724817_0001_1_00 [C0F7CE218C3645139A2A4A6A8545FF49] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 16:08:45,096 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787724817_0001_1 finished with state: FAILED
2016-01-14 16:08:45,096 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787724817_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:45,097 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787724817_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787724817_0001_00_000001, stoppedTime=1452787725097, exitStatus=0
2016-01-14 16:08:45,097 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787724817_0001_00_000001 transitioned from RUNNING to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:45,097 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452787724817_0001_1_00_000000_0 failed: true container: container_1452787724817_0001_00_000001 numFailedTAs: 0
2016-01-14 16:08:45 Completed Dag: dag_1452787724817_0001_1
2016-01-14 16:08:45,098 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787724817_0001_1, dagState=FAILED
2016-01-14 16:08:45,098 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787724817_0001_1_post
2016-01-14 16:08:45,098 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:45,098 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:45,090 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C0F7CE218C3645139A2A4A6A8545FF49, mem on close (mb), free: 265, total: 378, max: 672
2016-01-14 16:08:45,098 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=C0F7CE218C3645139A2A4A6A8545FF49, index=0
2016-01-14 16:08:45,098 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=C0F7CE218C3645139A2A4A6A8545FF49, sourceVertex=2483C1CEC2734EA28CCFF96BBE3EAE41
2016-01-14 16:08:45,098 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=C0F7CE218C3645139A2A4A6A8545FF49, sourceVertex=0CF68EDC8EC646F0B851CA58264DCF9F
2016-01-14 16:08:45,097 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:45,099 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787724817_0001_00_000001
2016-01-14 16:08:45,099 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787724817_0001_00_000001
2016-01-14 16:08:45,100 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1452787724817_0001_00_000001. Relying on regular task shutdown for it to end
2016-01-14 16:08:45,101 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787724817_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 16:08:45,102 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787724817_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 16:08:45,103 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452787724817_0001_00_000001 completed but with errors
2016-01-14 16:08:45,103 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(1033)) - Container container_1452787724817_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 16:08:45,104 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787724817_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 16:08:45,104 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787724817_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 16:08:45,104 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ld'_RESULTS.-1_VALUES_ALL, applicationId=application_1452787724817_0001
2016-01-14 16:08:45,108 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:45,108 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:45,108 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:45,108 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:45,109 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:45,109 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:45,109 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:45,109 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:45,110 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:45,110 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:45,110 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:45,110 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:45,111 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:45,118 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6150BF80CFA84CF287CDEE4CDCBC3313/D2A078625C93487B9F83D749D4515E1E/.tez/application_1452787724817_0001
2016-01-14 16:08:45,118 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] stopping all jobs
2016-01-14 16:08:45,119 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] stopping: (1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:45,119 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] stopped all jobs
2016-01-14 16:08:45,120 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  completed in: 00:00.323
2016-01-14 16:08:45,120 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:45,146 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:45,146 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:45,172 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:45,172 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:45,177 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.007
2016-01-14 16:08:45,179 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.009
2016-01-14 16:08:45,179 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:45,180 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:45,180 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.-1_ARGS_'field2'
2016-01-14 16:08:45,216 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:45,216 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:45,251 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.011
2016-01-14 16:08:45,262 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-01-14 16:08:45,263 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:45,263 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:45,264 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:45,285 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:45,286 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:45,297 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting
2016-01-14 16:08:45,297 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:45,297 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_ARGS_RESULTS"]
2016-01-14 16:08:45,297 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  parallel execution of steps is enabled: false
2016-01-14 16:08:45,297 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  executing total steps: 1
2016-01-14 16:08:45,297 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  allocating management threads: 1
2016-01-14 16:08:45,300 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting step: (1/1) ...'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:45,300 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [each.each] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:45,316 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tez session mode enabled: true
2016-01-14 16:08:45,320 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:45,321 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:45,321 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:45,330 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6BA361947ED445F09C1D7294DB613F60/CFF5E259C9D84BAA9A1654B89CD83E37/.tez/application_1452787725320_0001 doesn't exist and is created
2016-01-14 16:08:45,348 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:45,348 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:45,348 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6BA361947ED445F09C1D7294DB613F60/CFF5E259C9D84BAA9A1654B89CD83E37/.tez/application_1452787725320_0001
2016-01-14 16:08:45,353 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787725320_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:45,368 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:45,369 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:45,372 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:45,372 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:45,372 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6BA361947ED445F09C1D7294DB613F60/CFF5E259C9D84BAA9A1654B89CD83E37/.tez/application_1452787725320_0001/localmode-log-dir
2016-01-14 16:08:45,372 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6BA361947ED445F09C1D7294DB613F60/CFF5E259C9D84BAA9A1654B89CD83E37/.tez/application_1452787725320_0001/localmode-log-dir/history.txt.appattempt_1452787725320_0001_000000, maxErrors=10
2016-01-14 16:08:45,373 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:45,373 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787725320_0001_000000, appSubmitTime=1452787725352, launchTime=1452787725352
2016-01-14 16:08:45,377 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:45,380 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:45,382 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:45,382 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:40650
2016-01-14 16:08:45,383 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:45,384 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:45,388 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787725320_0001_000000, startTime=1452787725388
2016-01-14 16:08:45,388 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:45,388 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:45,448 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:45,448 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:45,448 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...'_RESULTS.-1_ARGS_RESULTS, applicationId=application_1452787725320_0001, dagName=[6BA361947ED445F09C1D7294DB613F60/CFF5E259C9D84BAA9A1654B89CD83E37] each.each/(1/1) ...'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:45,465 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [6BA361947ED445F09C1D7294DB613F60/CFF5E259C9D84BAA9A1654B89CD83E37] each.each/(1/1) ...'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:45,466 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787725320_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6BA361947ED445F09C1D7294DB613F60/CFF5E259C9D84BAA9A1654B89CD83E37/.tez/application_1452787725320_0001/localmode-log-dir/dag_1452787725320_0001_1.dot
2016-01-14 16:08:45,467 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6BA361947ED445F09C1D7294DB613F60/CFF5E259C9D84BAA9A1654B89CD83E37/.tez/application_1452787725320_0001/localmode-log-dir/dag_1452787725320_0001_1-tez-dag.pb.txt
2016-01-14 16:08:45,472 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787725320_0001_1
2016-01-14 16:08:45,472 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:45,472 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [6BA361947ED445F09C1D7294DB613F60/CFF5E259C9D84BAA9A1654B89CD83E37] each.each/(1/1) ...'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:45 Running Dag: dag_1452787725320_0001_1
2016-01-14 16:08:45,483 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725320_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787725320_0001_1, submitTime=1452787725465
2016-01-14 16:08:45,483 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:45,484 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex A9C5D80F412B4A9FBBF86F826789A2AB
2016-01-14 16:08:45,485 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:45,485 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:45,486 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725320_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787725320_0001_1, initTime=1452787725484
2016-01-14 16:08:45,487 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787725320_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:45,487 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725320_0001_1][Event:DAG_STARTED]: dagID=dag_1452787725320_0001_1, startTime=1452787725487
2016-01-14 16:08:45,488 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:45,488 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787725320_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:45,488 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: A9C5D80F412B4A9FBBF86F826789A2AB : {50F5C50D900E4D0DAC88C2F8F52A71D5={InputName=50F5C50D900E4D0DAC88C2F8F52A71D5}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:45,488 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:45,488 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 50F5C50D900E4D0DAC88C2F8F52A71D5, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:45,488 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB]
2016-01-14 16:08:45,488 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...'_RESULTS.-1_ARGS_RESULTS, applicationId=application_1452787725320_0001, dagName=[6BA361947ED445F09C1D7294DB613F60/CFF5E259C9D84BAA9A1654B89CD83E37] each.each/(1/1) ...'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:45,488 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB]
2016-01-14 16:08:45,489 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB]
2016-01-14 16:08:45,489 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB]. Starting root input initializers: 1
2016-01-14 16:08:45,490 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:45,490 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 50F5C50D900E4D0DAC88C2F8F52A71D5 on vertex vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB]
2016-01-14 16:08:45,492 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:45,492 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 50F5C50D900E4D0DAC88C2F8F52A71D5 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:45,493 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:45,493 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:45,495 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:45,496 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 50F5C50D900E4D0DAC88C2F8F52A71D5 on vertex vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB]
2016-01-14 16:08:45,496 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:45,497 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {50F5C50D900E4D0DAC88C2F8F52A71D5=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:45,497 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB] parallelism set to 1
2016-01-14 16:08:45,497 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:45,497 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725320_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787725320_0001_1_00, eventCount=1
2016-01-14 16:08:45,497 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB]
2016-01-14 16:08:45,497 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=8890C8271A15401BAEDB4A540B14AEAF, vertexId=vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:45,497 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=8890C8271A15401BAEDB4A540B14AEAF, vertexId=vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB]
2016-01-14 16:08:45,500 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=8890C8271A15401BAEDB4A540B14AEAF, vertexName=A9C5D80F412B4A9FBBF86F826789A2AB, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:45,500 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=8890C8271A15401BAEDB4A540B14AEAF, vertexId=vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB]
2016-01-14 16:08:45,501 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725320_0001_1][Event:VERTEX_INITIALIZED]: vertexName=A9C5D80F412B4A9FBBF86F826789A2AB, vertexId=vertex_1452787725320_0001_1_00, initRequestedTime=1452787725488, initedTime=1452787725501, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:45,501 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB] with distanceFromRoot: 0
2016-01-14 16:08:45,501 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:45,501 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:45,502 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in A9C5D80F412B4A9FBBF86F826789A2AB
2016-01-14 16:08:45,502 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB]
2016-01-14 16:08:45,502 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725320_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787725320_0001_1_00, startRequestedTime=1452787725502, startedTime=1452787725502
2016-01-14 16:08:45,502 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:45,503 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:45,504 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:45,504 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725320_0001_1][Event:TASK_STARTED]: vertexName=A9C5D80F412B4A9FBBF86F826789A2AB, taskId=task_1452787725320_0001_1_00_000000, scheduledTime=1452787725504, launchTime=1452787725504
2016-01-14 16:08:45,504 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787725320_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:45,505 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB]
2016-01-14 16:08:45,505 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [6BA361947ED445F09C1D7294DB613F60/CFF5E259C9D84BAA9A1654B89CD83E37] each.each/(1/1) ...'_RESULTS.-1_ARGS_RESULTS, VertexName: A9C5D80F412B4A9FBBF86F826789A2AB, VertexParallelism: 1, TaskAttemptID:attempt_1452787725320_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=50F5C50D900E4D0DAC88C2F8F52A71D5, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=8890C8271A15401BAEDB4A540B14AEAF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:45,505 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] submitted tez dag to app master: application_1452787725320_0001, with dag id: dag_1452787725320_0001_1
2016-01-14 16:08:45,506 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787725320_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:45,506 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:45,507 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:45,507 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:45,508 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:45,510 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787725320_0001_00_000001
2016-01-14 16:08:45,510 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787725320_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:45,512 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787725320_0001_00_000001
2016-01-14 16:08:45,512 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:45,513 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787725320_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:45,513 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:45,513 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725320_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787725320_0001_00_000001, launchTime=1452787725512
2016-01-14 16:08:45,514 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787725320_0001_00_000001
2016-01-14 16:08:45,514 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787725320_0001_1_00_000000_0] to container: [container_1452787725320_0001_00_000001]
2016-01-14 16:08:45,515 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787725320_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:45,515 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787725320_0001_00_000001 given task: attempt_1452787725320_0001_1_00_000000_0
2016-01-14 16:08:45,515 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787725320_0001_1_00_000000_0] started. Is using containerId: [container_1452787725320_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:45,515 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787725320_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787725320_0001_1_00_000000_0
2016-01-14 16:08:45,516 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725320_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=A9C5D80F412B4A9FBBF86F826789A2AB, taskAttemptId=attempt_1452787725320_0001_1_00_000000_0, startTime=1452787725515, containerId=container_1452787725320_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787725320_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:45,516 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:45,516 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787725320_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:45 Starting to run new task attempt: attempt_1452787725320_0001_1_00_000000_0
2016-01-14 16:08:45,517 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787725320_0001_1_00_000000_0
2016-01-14 16:08:45,517 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:45,517 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:45,517 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:45,517 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:45,517 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:45,518 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:45,518 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [6BA361947ED445F09C1D7294DB613F60/CFF5E259C9D84BAA9A1654B89CD83E37] each.each/(1/1) ...'_RESULTS.-1_ARGS_RESULTS, VertexName: A9C5D80F412B4A9FBBF86F826789A2AB, VertexParallelism: 1, TaskAttemptID:attempt_1452787725320_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=50F5C50D900E4D0DAC88C2F8F52A71D5, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=8890C8271A15401BAEDB4A540B14AEAF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:45,517 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787725320_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:45,518 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:45,519 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787725320_0001_1_00_000000_0
2016-01-14 16:08:45,519 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:45,519 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:45,520 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787725320_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:45,520 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=50F5C50D900E4D0DAC88C2F8F52A71D5, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:45,520 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=8890C8271A15401BAEDB4A540B14AEAF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:45,520 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:45,521 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:45,521 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 8890C8271A15401BAEDB4A540B14AEAF
2016-01-14 16:08:45,521 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:45,521 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 8890C8271A15401BAEDB4A540B14AEAF
2016-01-14 16:08:45,521 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:45,522 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 50F5C50D900E4D0DAC88C2F8F52A71D5
2016-01-14 16:08:45,522 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 50F5C50D900E4D0DAC88C2F8F52A71D5
2016-01-14 16:08:45,527 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:45,528 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 50F5C50D900E4D0DAC88C2F8F52A71D5
2016-01-14 16:08:45,528 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 50F5C50D900E4D0DAC88C2F8F52A71D5
2016-01-14 16:08:45,527 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:45,536 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: A9C5D80F412B4A9FBBF86F826789A2AB, ordinal: 0
2016-01-14 16:08:45,536 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A9C5D80F412B4A9FBBF86F826789A2AB, mem on start (mb), free: 191, total: 378, max: 672
2016-01-14 16:08:45,536 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:45,537 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:45,537 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:45,537 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:45,538 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 8890C8271A15401BAEDB4A540B14AEAF
2016-01-14 16:08:45,539 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:45,539 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:45,539 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:45,539 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:45,541 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:45,541 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:45,541 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:45,541 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:45,541 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 8890C8271A15401BAEDB4A540B14AEAF, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:45,542 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 50F5C50D900E4D0DAC88C2F8F52A71D5, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:45,542 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:45,542 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 50F5C50D900E4D0DAC88C2F8F52A71D5 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:45,542 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 50F5C50D900E4D0DAC88C2F8F52A71D5
2016-01-14 16:08:45,544 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:45,544 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 50F5C50D900E4D0DAC88C2F8F52A71D5
2016-01-14 16:08:45,545 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:45,545 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:45,545 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:45,546 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787725320_0001_1_00_000000_0
2016-01-14 16:08:45,546 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:45,547 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@5c4bae93
2016-01-14 16:08:45,548 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@5c4bae93
2016-01-14 16:08:45,548 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:45,550 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:45,552 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:45,552 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 50F5C50D900E4D0DAC88C2F8F52A71D5
2016-01-14 16:08:45,552 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_ARGS_RESULTS"], id: 8890C8271A15401BAEDB4A540B14AEAF
2016-01-14 16:08:45,553 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.-1_ARGS_RESULTS"]
2016-01-14 16:08:45,553 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:45,554 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:45,554 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: A9C5D80F412B4A9FBBF86F826789A2AB, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:45,557 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:45,558 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:45,560 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787725320_0001_1_00_000000_0
2016-01-14 16:08:45,560 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787725320_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:45,561 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787725320_0001_1_00_000000_0
2016-01-14 16:08:45,562 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A9C5D80F412B4A9FBBF86F826789A2AB, mem on close (mb), free: 190, total: 378, max: 672
2016-01-14 16:08:45 Completed running task attempt: attempt_1452787725320_0001_1_00_000000_0
2016-01-14 16:08:45,563 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787725320_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:45,565 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=396886016, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787725554, Process_Duration=7, Process_End_Time=1452787725561, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:45,565 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:45,565 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725320_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=A9C5D80F412B4A9FBBF86F826789A2AB, taskAttemptId=attempt_1452787725320_0001_1_00_000000_0, startTime=1452787725515, finishTime=1452787725565, timeTaken=50, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=396886016, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787725554, Process_Duration=7, Process_End_Time=1452787725561, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:45,566 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787725320_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:45,566 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787725320_0001_1_00_000000_0
2016-01-14 16:08:45,566 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:45,566 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:45,569 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787725320_0001_00_000001
2016-01-14 16:08:45,570 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:45,570 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:45,570 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725320_0001_1][Event:TASK_FINISHED]: vertexName=A9C5D80F412B4A9FBBF86F826789A2AB, taskId=task_1452787725320_0001_1_00_000000, startTime=1452787725515, finishTime=1452787725566, timeTaken=51, status=SUCCEEDED, successfulAttemptID=attempt_1452787725320_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=396886016, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787725554, Process_Duration=7, Process_End_Time=1452787725561, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:45,571 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787725320_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:45,571 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB] : 1
2016-01-14 16:08:45,571 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB]
2016-01-14 16:08:45,572 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:45,573 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725320_0001_1][Event:VERTEX_FINISHED]: vertexName=A9C5D80F412B4A9FBBF86F826789A2AB, vertexId=vertex_1452787725320_0001_1_00, initRequestedTime=1452787725488, initedTime=1452787725501, startRequestedTime=1452787725502, startedTime=1452787725502, finishTime=1452787725571, timeTaken=69, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=396886016, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787725554, Process_Duration=7, Process_End_Time=1452787725561, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787725515, firstTasksToStart=[ task_1452787725320_0001_1_00_000000 ], lastTaskFinishTime=1452787725565, lastTasksToFinish=[ task_1452787725320_0001_1_00_000000 ], minTaskDuration=50, maxTaskDuration=50, avgTaskDuration=50.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787725320_0001_1_00_000000 ], longestDurationTasks=[ task_1452787725320_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:45,573 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:45,574 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787725320_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:45,574 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:45,574 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725320_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787725320_0001_00_000001, stoppedTime=1452787725574, exitStatus=0
2016-01-14 16:08:45,574 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787725320_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:45,577 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:45,577 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787725320_0001_1
2016-01-14 16:08:45,578 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725320_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787725320_0001_1
2016-01-14 16:08:45,578 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 8890C8271A15401BAEDB4A540B14AEAF for vertex: vertex_1452787725320_0001_1_00 [A9C5D80F412B4A9FBBF86F826789A2AB]
2016-01-14 16:08:45,580 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787725320_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:45,580 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787725320_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:45,580 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787725320_0001_00_000001, Exiting
2016-01-14 16:08:45,580 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787725320_0001_00_000001
2016-01-14 16:08:45,580 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787725320_0001_00_000001
2016-01-14 16:08:45,583 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787725320_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:45,583 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787725320_0001_00_000001 completed successfully
2016-01-14 16:08:45,588 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787725320_0001_1, queueSize=0
2016-01-14 16:08:45,589 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:45,589 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725320_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787725320_0001_1, startTime=1452787725487, finishTime=1452787725587, timeTaken=100, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=396886016, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787725554, Process_Duration=7, Process_End_Time=1452787725561, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:45,589 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787725320_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:45,589 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787725320_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:45,589 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787725320_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:45,589 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787725320_0001_00_000001
2016-01-14 16:08:45 Completed Dag: dag_1452787725320_0001_1
2016-01-14 16:08:45,590 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787725320_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:45,590 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787725320_0001_1_post
2016-01-14 16:08:45,590 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:45,590 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:45,596 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...'_RESULTS.-1_ARGS_RESULTS, applicationId=application_1452787725320_0001
2016-01-14 16:08:45,598 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:45,598 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:45,598 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:45,598 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:45,598 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:45,598 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:45,599 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:45,599 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:45,599 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:45,600 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:45,600 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:45,600 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:45,601 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:45,604 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6BA361947ED445F09C1D7294DB613F60/CFF5E259C9D84BAA9A1654B89CD83E37/.tez/application_1452787725320_0001
2016-01-14 16:08:45,605 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  completed in: 00:00.307
2016-01-14 16:08:45,671 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:45,691 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:45,692 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:45,719 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.004
2016-01-14 16:08:45,721 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.006
2016-01-14 16:08:45,721 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:45,721 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:45,721 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.-1_ARGS_ALL
2016-01-14 16:08:45,742 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:45,742 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:45,751 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:45,751 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:45,780 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.013
2016-01-14 16:08:45,788 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-01-14 16:08:45,789 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:45,789 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:45,790 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:45,810 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:45,811 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_-1
2016-01-14 16:08:45,846 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting
2016-01-14 16:08:45,847 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:45,847 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_-1"]
2016-01-14 16:08:45,848 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  parallel execution of steps is enabled: false
2016-01-14 16:08:45,848 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  executing total steps: 1
2016-01-14 16:08:45,848 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  allocating management threads: 1
2016-01-14 16:08:45,849 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting step: (1/1) ...ld'_RESULTS.0_'field2'_-1
2016-01-14 16:08:45,850 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [each.each] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:45,869 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tez session mode enabled: true
2016-01-14 16:08:45,875 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:45,875 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:45,875 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:45,887 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/81E8671FCD0044C5BB64732E5A620279/E45A9F2D2765451EBC9BA2AFD6441BAA/.tez/application_1452787725875_0001 doesn't exist and is created
2016-01-14 16:08:45,907 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:45,907 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:45,908 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/81E8671FCD0044C5BB64732E5A620279/E45A9F2D2765451EBC9BA2AFD6441BAA/.tez/application_1452787725875_0001
2016-01-14 16:08:45,912 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787725875_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:45,926 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:45,927 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:45,928 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:45,928 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:45,928 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/81E8671FCD0044C5BB64732E5A620279/E45A9F2D2765451EBC9BA2AFD6441BAA/.tez/application_1452787725875_0001/localmode-log-dir
2016-01-14 16:08:45,929 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/81E8671FCD0044C5BB64732E5A620279/E45A9F2D2765451EBC9BA2AFD6441BAA/.tez/application_1452787725875_0001/localmode-log-dir/history.txt.appattempt_1452787725875_0001_000000, maxErrors=10
2016-01-14 16:08:45,929 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:45,929 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787725875_0001_000000, appSubmitTime=1452787725911, launchTime=1452787725911
2016-01-14 16:08:45,933 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:45,937 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:45,938 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:50849
2016-01-14 16:08:45,940 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:45,940 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:45,941 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:45,943 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787725875_0001_000000, startTime=1452787725943
2016-01-14 16:08:45,943 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:45,943 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:46,008 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:46,008 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:46,008 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.0_'field2'_-1, applicationId=application_1452787725875_0001, dagName=[81E8671FCD0044C5BB64732E5A620279/E45A9F2D2765451EBC9BA2AFD6441BAA] each.each/(1/1) ...ld'_RESULTS.0_'field2'_-1
2016-01-14 16:08:46,023 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [81E8671FCD0044C5BB64732E5A620279/E45A9F2D2765451EBC9BA2AFD6441BAA] each.each/(1/1) ...ld'_RESULTS.0_'field2'_-1
2016-01-14 16:08:46,024 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787725875_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/81E8671FCD0044C5BB64732E5A620279/E45A9F2D2765451EBC9BA2AFD6441BAA/.tez/application_1452787725875_0001/localmode-log-dir/dag_1452787725875_0001_1.dot
2016-01-14 16:08:46,025 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/81E8671FCD0044C5BB64732E5A620279/E45A9F2D2765451EBC9BA2AFD6441BAA/.tez/application_1452787725875_0001/localmode-log-dir/dag_1452787725875_0001_1-tez-dag.pb.txt
2016-01-14 16:08:46,030 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787725875_0001_1
2016-01-14 16:08:46,030 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:46,030 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [81E8671FCD0044C5BB64732E5A620279/E45A9F2D2765451EBC9BA2AFD6441BAA] each.each/(1/1) ...ld'_RESULTS.0_'field2'_-1
2016-01-14 16:08:46 Running Dag: dag_1452787725875_0001_1
2016-01-14 16:08:46,042 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725875_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787725875_0001_1, submitTime=1452787726023
2016-01-14 16:08:46,042 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:46,042 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex A62B54B704084AD99246501973103BCB
2016-01-14 16:08:46,043 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:46,043 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:46,043 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725875_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787725875_0001_1, initTime=1452787726042
2016-01-14 16:08:46,044 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787725875_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:46,044 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725875_0001_1][Event:DAG_STARTED]: dagID=dag_1452787725875_0001_1, startTime=1452787726044
2016-01-14 16:08:46,045 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:46,045 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787725875_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:46,045 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.0_'field2'_-1, applicationId=application_1452787725875_0001, dagName=[81E8671FCD0044C5BB64732E5A620279/E45A9F2D2765451EBC9BA2AFD6441BAA] each.each/(1/1) ...ld'_RESULTS.0_'field2'_-1
2016-01-14 16:08:46,044 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:46,045 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: A62B54B704084AD99246501973103BCB : {1667D7D6A2B245A48A5BB66B6C1ED77C={InputName=1667D7D6A2B245A48A5BB66B6C1ED77C}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:46,045 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 1667D7D6A2B245A48A5BB66B6C1ED77C, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:46,045 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB]
2016-01-14 16:08:46,046 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB]
2016-01-14 16:08:46,046 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB]
2016-01-14 16:08:46,046 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB]. Starting root input initializers: 1
2016-01-14 16:08:46,046 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:46,047 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 1667D7D6A2B245A48A5BB66B6C1ED77C on vertex vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB]
2016-01-14 16:08:46,048 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:46,048 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 1667D7D6A2B245A48A5BB66B6C1ED77C asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:46,049 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:46,049 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:46,050 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:46,050 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 1667D7D6A2B245A48A5BB66B6C1ED77C on vertex vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB]
2016-01-14 16:08:46,051 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:46,051 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {1667D7D6A2B245A48A5BB66B6C1ED77C=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:46,051 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB] parallelism set to 1
2016-01-14 16:08:46,051 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:46,051 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725875_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787725875_0001_1_00, eventCount=1
2016-01-14 16:08:46,052 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB]
2016-01-14 16:08:46,052 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=25647654514B44BB95E740F13C938661, vertexId=vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:46,052 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=25647654514B44BB95E740F13C938661, vertexId=vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB]
2016-01-14 16:08:46,053 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=25647654514B44BB95E740F13C938661, vertexName=A62B54B704084AD99246501973103BCB, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:46,054 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=25647654514B44BB95E740F13C938661, vertexId=vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB]
2016-01-14 16:08:46,055 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:46,055 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725875_0001_1][Event:VERTEX_INITIALIZED]: vertexName=A62B54B704084AD99246501973103BCB, vertexId=vertex_1452787725875_0001_1_00, initRequestedTime=1452787726045, initedTime=1452787726055, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:46,055 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB] with distanceFromRoot: 0
2016-01-14 16:08:46,055 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:46,055 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in A62B54B704084AD99246501973103BCB
2016-01-14 16:08:46,056 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB]
2016-01-14 16:08:46,056 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:46,056 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725875_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787725875_0001_1_00, startRequestedTime=1452787726055, startedTime=1452787726055
2016-01-14 16:08:46,056 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:46,057 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:46,057 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725875_0001_1][Event:TASK_STARTED]: vertexName=A62B54B704084AD99246501973103BCB, taskId=task_1452787725875_0001_1_00_000000, scheduledTime=1452787726057, launchTime=1452787726057
2016-01-14 16:08:46,057 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787725875_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:46,057 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB]
2016-01-14 16:08:46,058 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [81E8671FCD0044C5BB64732E5A620279/E45A9F2D2765451EBC9BA2AFD6441BAA] each.each/(1/1) ...ld'_RESULTS.0_'field2'_-1, VertexName: A62B54B704084AD99246501973103BCB, VertexParallelism: 1, TaskAttemptID:attempt_1452787725875_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=1667D7D6A2B245A48A5BB66B6C1ED77C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=25647654514B44BB95E740F13C938661, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:46,058 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787725875_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:46,058 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:46,059 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:46,060 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:46,060 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:46,060 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787725875_0001_00_000001
2016-01-14 16:08:46,060 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787725875_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:46,062 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787725875_0001_00_000001
2016-01-14 16:08:46,062 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:46,063 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] submitted tez dag to app master: application_1452787725875_0001, with dag id: dag_1452787725875_0001_1
2016-01-14 16:08:46,066 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787725875_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:46,066 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:46,067 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725875_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787725875_0001_00_000001, launchTime=1452787726066
2016-01-14 16:08:46,069 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787725875_0001_00_000001
2016-01-14 16:08:46,070 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787725875_0001_1_00_000000_0] to container: [container_1452787725875_0001_00_000001]
2016-01-14 16:08:46,070 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787725875_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:46,070 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787725875_0001_00_000001 given task: attempt_1452787725875_0001_1_00_000000_0
2016-01-14 16:08:46,070 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787725875_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787725875_0001_1_00_000000_0
2016-01-14 16:08:46,071 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787725875_0001_1_00_000000_0] started. Is using containerId: [container_1452787725875_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:46,071 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725875_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=A62B54B704084AD99246501973103BCB, taskAttemptId=attempt_1452787725875_0001_1_00_000000_0, startTime=1452787726070, containerId=container_1452787725875_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787725875_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:46 Starting to run new task attempt: attempt_1452787725875_0001_1_00_000000_0
2016-01-14 16:08:46,071 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787725875_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:46,071 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787725875_0001_1_00_000000_0
2016-01-14 16:08:46,071 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:46,071 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787725875_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:46,071 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:46,071 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:46,072 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:46,072 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:46,072 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:46,072 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:46,072 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [81E8671FCD0044C5BB64732E5A620279/E45A9F2D2765451EBC9BA2AFD6441BAA] each.each/(1/1) ...ld'_RESULTS.0_'field2'_-1, VertexName: A62B54B704084AD99246501973103BCB, VertexParallelism: 1, TaskAttemptID:attempt_1452787725875_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=1667D7D6A2B245A48A5BB66B6C1ED77C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=25647654514B44BB95E740F13C938661, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:46,072 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:46,073 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787725875_0001_1_00_000000_0
2016-01-14 16:08:46,073 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:46,073 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:46,076 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=1667D7D6A2B245A48A5BB66B6C1ED77C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:46,076 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=25647654514B44BB95E740F13C938661, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:46,077 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787725875_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:46,077 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:46,077 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 1667D7D6A2B245A48A5BB66B6C1ED77C
2016-01-14 16:08:46,078 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 1667D7D6A2B245A48A5BB66B6C1ED77C
2016-01-14 16:08:46,076 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:46,077 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:46,079 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 25647654514B44BB95E740F13C938661
2016-01-14 16:08:46,079 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:46,079 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 25647654514B44BB95E740F13C938661
2016-01-14 16:08:46,081 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:46,082 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 1667D7D6A2B245A48A5BB66B6C1ED77C
2016-01-14 16:08:46,082 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 1667D7D6A2B245A48A5BB66B6C1ED77C
2016-01-14 16:08:46,082 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:46,090 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:46,091 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 25647654514B44BB95E740F13C938661
2016-01-14 16:08:46,092 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: A62B54B704084AD99246501973103BCB, ordinal: 0
2016-01-14 16:08:46,092 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A62B54B704084AD99246501973103BCB, mem on start (mb), free: 311, total: 385, max: 672
2016-01-14 16:08:46,092 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:46,093 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:46,093 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:46,093 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:46,093 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:46,094 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:46,094 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:46,094 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:46,095 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:46,095 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:46,095 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:46,095 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 1667D7D6A2B245A48A5BB66B6C1ED77C, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:46,096 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 25647654514B44BB95E740F13C938661, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:46,096 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:46,096 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 1667D7D6A2B245A48A5BB66B6C1ED77C
2016-01-14 16:08:46,096 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:46,096 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 1667D7D6A2B245A48A5BB66B6C1ED77C
2016-01-14 16:08:46,097 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 1667D7D6A2B245A48A5BB66B6C1ED77C being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:46,097 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:46,097 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:46,098 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:46,098 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787725875_0001_1_00_000000_0
2016-01-14 16:08:46,098 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:46,100 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@21795a46
2016-01-14 16:08:46,101 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@21795a46
2016-01-14 16:08:46,102 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:46,102 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:46,102 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:46,103 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 1667D7D6A2B245A48A5BB66B6C1ED77C
2016-01-14 16:08:46,103 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_-1"], id: 25647654514B44BB95E740F13C938661
2016-01-14 16:08:46,103 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_-1"]
2016-01-14 16:08:46,104 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:46,104 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:46,104 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: A62B54B704084AD99246501973103BCB, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:46,107 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:46,107 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:46,108 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787725875_0001_1_00_000000_0
2016-01-14 16:08:46,108 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787725875_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:46,109 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787725875_0001_1_00_000000_0
2016-01-14 16:08:46,109 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A62B54B704084AD99246501973103BCB, mem on close (mb), free: 309, total: 385, max: 672
2016-01-14 16:08:46 Completed running task attempt: attempt_1452787725875_0001_1_00_000000_0
2016-01-14 16:08:46,110 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787725875_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:46,113 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787726104, Process_Duration=5, Process_End_Time=1452787726109, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:46,114 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725875_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=A62B54B704084AD99246501973103BCB, taskAttemptId=attempt_1452787725875_0001_1_00_000000_0, startTime=1452787726070, finishTime=1452787726113, timeTaken=43, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787726104, Process_Duration=5, Process_End_Time=1452787726109, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:46,114 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:46,115 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787725875_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:46,115 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787725875_0001_1_00_000000_0
2016-01-14 16:08:46,114 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:46,115 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:46,115 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:46,115 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:46,115 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725875_0001_1][Event:TASK_FINISHED]: vertexName=A62B54B704084AD99246501973103BCB, taskId=task_1452787725875_0001_1_00_000000, startTime=1452787726070, finishTime=1452787726115, timeTaken=45, status=SUCCEEDED, successfulAttemptID=attempt_1452787725875_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787726104, Process_Duration=5, Process_End_Time=1452787726109, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:46,115 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787725875_0001_00_000001
2016-01-14 16:08:46,116 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787725875_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:46,116 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB] : 1
2016-01-14 16:08:46,116 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB]
2016-01-14 16:08:46,117 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:46,117 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725875_0001_1][Event:VERTEX_FINISHED]: vertexName=A62B54B704084AD99246501973103BCB, vertexId=vertex_1452787725875_0001_1_00, initRequestedTime=1452787726045, initedTime=1452787726055, startRequestedTime=1452787726055, startedTime=1452787726055, finishTime=1452787726116, timeTaken=61, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787726104, Process_Duration=5, Process_End_Time=1452787726109, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787726070, firstTasksToStart=[ task_1452787725875_0001_1_00_000000 ], lastTaskFinishTime=1452787726113, lastTasksToFinish=[ task_1452787725875_0001_1_00_000000 ], minTaskDuration=43, maxTaskDuration=43, avgTaskDuration=43.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787725875_0001_1_00_000000 ], longestDurationTasks=[ task_1452787725875_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:46,118 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:46,118 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787725875_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:46,118 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725875_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787725875_0001_00_000001, stoppedTime=1452787726118, exitStatus=0
2016-01-14 16:08:46,118 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787725875_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:46,118 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:46,118 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:46,118 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787725875_0001_1
2016-01-14 16:08:46,118 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725875_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787725875_0001_1
2016-01-14 16:08:46,118 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 25647654514B44BB95E740F13C938661 for vertex: vertex_1452787725875_0001_1_00 [A62B54B704084AD99246501973103BCB]
2016-01-14 16:08:46,126 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787725875_0001_1, queueSize=0
2016-01-14 16:08:46,126 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787725875_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:46,126 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787725875_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:46,126 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787725875_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787725875_0001_1, startTime=1452787726044, finishTime=1452787726125, timeTaken=81, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787726104, Process_Duration=5, Process_End_Time=1452787726109, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:46,126 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787725875_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:46,126 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787725875_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:46,127 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1452787725875_0001_00_000001. Relying on regular task shutdown for it to end
2016-01-14 16:08:46 Completed Dag: dag_1452787725875_0001_1
2016-01-14 16:08:46,127 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787725875_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:46,127 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787725875_0001_1_post
2016-01-14 16:08:46,127 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:46,127 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:46,127 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787725875_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 16:08:46,126 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:46,126 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787725875_0001_00_000001, Exiting
2016-01-14 16:08:46,128 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787725875_0001_00_000001
2016-01-14 16:08:46,128 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787725875_0001_00_000001
2016-01-14 16:08:46,130 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787725875_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:46,131 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787725875_0001_00_000001 completed successfully
2016-01-14 16:08:46,131 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787725875_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 16:08:46,135 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ld'_RESULTS.0_'field2'_-1, applicationId=application_1452787725875_0001
2016-01-14 16:08:46,136 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:46,136 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:46,136 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:46,136 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:46,136 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:46,137 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:46,137 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:46,138 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:46,138 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:46,138 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:46,138 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:46,139 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:46,139 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:46,143 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/81E8671FCD0044C5BB64732E5A620279/E45A9F2D2765451EBC9BA2AFD6441BAA/.tez/application_1452787725875_0001
2016-01-14 16:08:46,144 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  completed in: 00:00.297
2016-01-14 16:08:46,212 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.0_'field2'_-1
2016-01-14 16:08:46,237 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:46,237 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:46,286 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.011
2016-01-14 16:08:46,291 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 16:08:46,291 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:46,292 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:46,292 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:46,305 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:46,305 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_'field2'
2016-01-14 16:08:46,306 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:46,307 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:46,315 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting
2016-01-14 16:08:46,315 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:46,315 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_'field2'"]
2016-01-14 16:08:46,316 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  parallel execution of steps is enabled: false
2016-01-14 16:08:46,316 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  executing total steps: 1
2016-01-14 16:08:46,316 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  allocating management threads: 1
2016-01-14 16:08:46,316 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting step: (1/1) ...SULTS.0_'field2'_'field2'
2016-01-14 16:08:46,317 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [each.each] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:46,328 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tez session mode enabled: true
2016-01-14 16:08:46,332 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:46,332 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:46,332 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:46,341 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1AE16414F56F433EA612D43F6C1FE603/C5A070540D3242D4A5511C152F3C5303/.tez/application_1452787726332_0001 doesn't exist and is created
2016-01-14 16:08:46,356 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:46,356 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:46,356 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1AE16414F56F433EA612D43F6C1FE603/C5A070540D3242D4A5511C152F3C5303/.tez/application_1452787726332_0001
2016-01-14 16:08:46,359 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787726332_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:46,369 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:46,369 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:46,371 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:46,371 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:46,371 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1AE16414F56F433EA612D43F6C1FE603/C5A070540D3242D4A5511C152F3C5303/.tez/application_1452787726332_0001/localmode-log-dir
2016-01-14 16:08:46,372 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1AE16414F56F433EA612D43F6C1FE603/C5A070540D3242D4A5511C152F3C5303/.tez/application_1452787726332_0001/localmode-log-dir/history.txt.appattempt_1452787726332_0001_000000, maxErrors=10
2016-01-14 16:08:46,372 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:46,372 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787726332_0001_000000, appSubmitTime=1452787726358, launchTime=1452787726358
2016-01-14 16:08:46,376 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:46,377 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:46,378 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:46,378 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:46,379 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:51223
2016-01-14 16:08:46,383 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:46,385 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787726332_0001_000000, startTime=1452787726385
2016-01-14 16:08:46,385 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:46,385 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:46,456 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:46,456 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:46,456 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...SULTS.0_'field2'_'field2', applicationId=application_1452787726332_0001, dagName=[1AE16414F56F433EA612D43F6C1FE603/C5A070540D3242D4A5511C152F3C5303] each.each/(1/1) ...SULTS.0_'field2'_'field2'
2016-01-14 16:08:46,471 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [1AE16414F56F433EA612D43F6C1FE603/C5A070540D3242D4A5511C152F3C5303] each.each/(1/1) ...SULTS.0_'field2'_'field2'
2016-01-14 16:08:46,474 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787726332_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1AE16414F56F433EA612D43F6C1FE603/C5A070540D3242D4A5511C152F3C5303/.tez/application_1452787726332_0001/localmode-log-dir/dag_1452787726332_0001_1.dot
2016-01-14 16:08:46,475 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1AE16414F56F433EA612D43F6C1FE603/C5A070540D3242D4A5511C152F3C5303/.tez/application_1452787726332_0001/localmode-log-dir/dag_1452787726332_0001_1-tez-dag.pb.txt
2016-01-14 16:08:46,481 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787726332_0001_1
2016-01-14 16:08:46,481 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:46,481 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [1AE16414F56F433EA612D43F6C1FE603/C5A070540D3242D4A5511C152F3C5303] each.each/(1/1) ...SULTS.0_'field2'_'field2'
2016-01-14 16:08:46 Running Dag: dag_1452787726332_0001_1
2016-01-14 16:08:46,493 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726332_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787726332_0001_1, submitTime=1452787726471
2016-01-14 16:08:46,493 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:46,494 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex B84FEB4E3EB34911BA8A8431CABBF79B
2016-01-14 16:08:46,494 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:46,496 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726332_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787726332_0001_1, initTime=1452787726493
2016-01-14 16:08:46,496 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:46,496 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787726332_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:46,497 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726332_0001_1][Event:DAG_STARTED]: dagID=dag_1452787726332_0001_1, startTime=1452787726496
2016-01-14 16:08:46,497 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:46,497 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:46,498 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787726332_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:46,498 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...SULTS.0_'field2'_'field2', applicationId=application_1452787726332_0001, dagName=[1AE16414F56F433EA612D43F6C1FE603/C5A070540D3242D4A5511C152F3C5303] each.each/(1/1) ...SULTS.0_'field2'_'field2'
2016-01-14 16:08:46,498 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: B84FEB4E3EB34911BA8A8431CABBF79B : {04DA8011FF5B402B90ACF0BBC300B6B2={InputName=04DA8011FF5B402B90ACF0BBC300B6B2}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:46,498 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 04DA8011FF5B402B90ACF0BBC300B6B2, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:46,498 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B]
2016-01-14 16:08:46,499 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B]
2016-01-14 16:08:46,499 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B]
2016-01-14 16:08:46,499 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B]. Starting root input initializers: 1
2016-01-14 16:08:46,499 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:46,501 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 04DA8011FF5B402B90ACF0BBC300B6B2 on vertex vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B]
2016-01-14 16:08:46,502 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:46,503 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 04DA8011FF5B402B90ACF0BBC300B6B2 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:46,503 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:46,504 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:46,505 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:46,506 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 04DA8011FF5B402B90ACF0BBC300B6B2 on vertex vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B]
2016-01-14 16:08:46,506 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:46,506 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {04DA8011FF5B402B90ACF0BBC300B6B2=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:46,506 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B] parallelism set to 1
2016-01-14 16:08:46,507 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:46,507 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726332_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787726332_0001_1_00, eventCount=1
2016-01-14 16:08:46,507 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B]
2016-01-14 16:08:46,507 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=3A6FB6121E9C42859F090EB9C2DD6353, vertexId=vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:46,507 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=3A6FB6121E9C42859F090EB9C2DD6353, vertexId=vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B]
2016-01-14 16:08:46,509 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=3A6FB6121E9C42859F090EB9C2DD6353, vertexName=B84FEB4E3EB34911BA8A8431CABBF79B, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:46,509 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=3A6FB6121E9C42859F090EB9C2DD6353, vertexId=vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B]
2016-01-14 16:08:46,511 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:46,511 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726332_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B84FEB4E3EB34911BA8A8431CABBF79B, vertexId=vertex_1452787726332_0001_1_00, initRequestedTime=1452787726498, initedTime=1452787726510, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:46,511 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B] with distanceFromRoot: 0
2016-01-14 16:08:46,511 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:46,511 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in B84FEB4E3EB34911BA8A8431CABBF79B
2016-01-14 16:08:46,512 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B]
2016-01-14 16:08:46,512 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:46,512 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726332_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787726332_0001_1_00, startRequestedTime=1452787726511, startedTime=1452787726511
2016-01-14 16:08:46,513 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:46,513 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:46,514 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726332_0001_1][Event:TASK_STARTED]: vertexName=B84FEB4E3EB34911BA8A8431CABBF79B, taskId=task_1452787726332_0001_1_00_000000, scheduledTime=1452787726513, launchTime=1452787726513
2016-01-14 16:08:46,514 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787726332_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:46,514 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B]
2016-01-14 16:08:46,515 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [1AE16414F56F433EA612D43F6C1FE603/C5A070540D3242D4A5511C152F3C5303] each.each/(1/1) ...SULTS.0_'field2'_'field2', VertexName: B84FEB4E3EB34911BA8A8431CABBF79B, VertexParallelism: 1, TaskAttemptID:attempt_1452787726332_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=04DA8011FF5B402B90ACF0BBC300B6B2, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=3A6FB6121E9C42859F090EB9C2DD6353, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:46,515 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787726332_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:46,515 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] submitted tez dag to app master: application_1452787726332_0001, with dag id: dag_1452787726332_0001_1
2016-01-14 16:08:46,515 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:46,516 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:46,517 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:46,517 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:46,517 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787726332_0001_00_000001
2016-01-14 16:08:46,518 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787726332_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:46,519 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787726332_0001_00_000001
2016-01-14 16:08:46,519 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:46,520 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787726332_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:46,520 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:46,520 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726332_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787726332_0001_00_000001, launchTime=1452787726520
2016-01-14 16:08:46,521 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787726332_0001_00_000001
2016-01-14 16:08:46,522 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787726332_0001_1_00_000000_0] to container: [container_1452787726332_0001_00_000001]
2016-01-14 16:08:46,522 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787726332_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:46,522 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787726332_0001_00_000001 given task: attempt_1452787726332_0001_1_00_000000_0
2016-01-14 16:08:46,522 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787726332_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787726332_0001_1_00_000000_0
2016-01-14 16:08:46,522 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787726332_0001_1_00_000000_0] started. Is using containerId: [container_1452787726332_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:46,522 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:46 Starting to run new task attempt: attempt_1452787726332_0001_1_00_000000_0
2016-01-14 16:08:46,522 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726332_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B84FEB4E3EB34911BA8A8431CABBF79B, taskAttemptId=attempt_1452787726332_0001_1_00_000000_0, startTime=1452787726522, containerId=container_1452787726332_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787726332_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:46,523 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787726332_0001_1_00_000000_0
2016-01-14 16:08:46,523 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787726332_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:46,523 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:46,523 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787726332_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:46,523 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:46,523 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:46,523 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:46,524 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:46,524 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:46,524 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [1AE16414F56F433EA612D43F6C1FE603/C5A070540D3242D4A5511C152F3C5303] each.each/(1/1) ...SULTS.0_'field2'_'field2', VertexName: B84FEB4E3EB34911BA8A8431CABBF79B, VertexParallelism: 1, TaskAttemptID:attempt_1452787726332_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=04DA8011FF5B402B90ACF0BBC300B6B2, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=3A6FB6121E9C42859F090EB9C2DD6353, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:46,524 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:46,524 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787726332_0001_1_00_000000_0
2016-01-14 16:08:46,525 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:46,525 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:46,525 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787726332_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:46,526 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:46,527 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=04DA8011FF5B402B90ACF0BBC300B6B2, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:46,527 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=3A6FB6121E9C42859F090EB9C2DD6353, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:46,527 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:46,528 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:46,528 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 04DA8011FF5B402B90ACF0BBC300B6B2
2016-01-14 16:08:46,528 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:46,529 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 04DA8011FF5B402B90ACF0BBC300B6B2
2016-01-14 16:08:46,528 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 3A6FB6121E9C42859F090EB9C2DD6353
2016-01-14 16:08:46,529 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:46,529 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 3A6FB6121E9C42859F090EB9C2DD6353
2016-01-14 16:08:46,532 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:46,532 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 04DA8011FF5B402B90ACF0BBC300B6B2
2016-01-14 16:08:46,532 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 04DA8011FF5B402B90ACF0BBC300B6B2
2016-01-14 16:08:46,542 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B84FEB4E3EB34911BA8A8431CABBF79B, ordinal: 0
2016-01-14 16:08:46,542 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B84FEB4E3EB34911BA8A8431CABBF79B, mem on start (mb), free: 236, total: 385, max: 672
2016-01-14 16:08:46,543 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:46,543 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:46,543 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:46,544 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:46,544 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 3A6FB6121E9C42859F090EB9C2DD6353
2016-01-14 16:08:46,544 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:46,544 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:46,545 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:46,545 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:46,545 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:46,545 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:46,546 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:46,546 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:46,546 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 04DA8011FF5B402B90ACF0BBC300B6B2, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:46,546 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 3A6FB6121E9C42859F090EB9C2DD6353, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:46,547 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:46,547 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 04DA8011FF5B402B90ACF0BBC300B6B2 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:46,547 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:46,547 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:46,547 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 04DA8011FF5B402B90ACF0BBC300B6B2
2016-01-14 16:08:46,548 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:46,548 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 04DA8011FF5B402B90ACF0BBC300B6B2
2016-01-14 16:08:46,548 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:46,548 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787726332_0001_1_00_000000_0
2016-01-14 16:08:46,548 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:46,549 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@d279be9
2016-01-14 16:08:46,550 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@d279be9
2016-01-14 16:08:46,550 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:46,550 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:46,551 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:46,552 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 04DA8011FF5B402B90ACF0BBC300B6B2
2016-01-14 16:08:46,552 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_'field2'"], id: 3A6FB6121E9C42859F090EB9C2DD6353
2016-01-14 16:08:46,552 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_'field2'"]
2016-01-14 16:08:46,553 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:46,553 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:46,553 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B84FEB4E3EB34911BA8A8431CABBF79B, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:46,555 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:46,556 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:46,556 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787726332_0001_1_00_000000_0
2016-01-14 16:08:46,556 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787726332_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:46,557 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787726332_0001_1_00_000000_0
2016-01-14 16:08:46,557 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B84FEB4E3EB34911BA8A8431CABBF79B, mem on close (mb), free: 234, total: 385, max: 672
2016-01-14 16:08:46 Completed running task attempt: attempt_1452787726332_0001_1_00_000000_0
2016-01-14 16:08:46,558 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787726332_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:46,559 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787726553, Process_Duration=4, Process_End_Time=1452787726557, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:46,559 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:46,560 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:46,560 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726332_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B84FEB4E3EB34911BA8A8431CABBF79B, taskAttemptId=attempt_1452787726332_0001_1_00_000000_0, startTime=1452787726522, finishTime=1452787726559, timeTaken=37, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787726553, Process_Duration=4, Process_End_Time=1452787726557, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:46,560 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787726332_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:46,560 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:46,560 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787726332_0001_1_00_000000_0
2016-01-14 16:08:46,560 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787726332_0001_00_000001
2016-01-14 16:08:46,561 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726332_0001_1][Event:TASK_FINISHED]: vertexName=B84FEB4E3EB34911BA8A8431CABBF79B, taskId=task_1452787726332_0001_1_00_000000, startTime=1452787726522, finishTime=1452787726560, timeTaken=38, status=SUCCEEDED, successfulAttemptID=attempt_1452787726332_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787726553, Process_Duration=4, Process_End_Time=1452787726557, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:46,561 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787726332_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:46,561 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:46,561 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B] : 1
2016-01-14 16:08:46,561 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B]
2016-01-14 16:08:46,561 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:46,563 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:46,563 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726332_0001_1][Event:VERTEX_FINISHED]: vertexName=B84FEB4E3EB34911BA8A8431CABBF79B, vertexId=vertex_1452787726332_0001_1_00, initRequestedTime=1452787726498, initedTime=1452787726510, startRequestedTime=1452787726511, startedTime=1452787726511, finishTime=1452787726561, timeTaken=50, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787726553, Process_Duration=4, Process_End_Time=1452787726557, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787726522, firstTasksToStart=[ task_1452787726332_0001_1_00_000000 ], lastTaskFinishTime=1452787726559, lastTasksToFinish=[ task_1452787726332_0001_1_00_000000 ], minTaskDuration=37, maxTaskDuration=37, avgTaskDuration=37.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787726332_0001_1_00_000000 ], longestDurationTasks=[ task_1452787726332_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:46,563 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:46,563 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787726332_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:46,564 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726332_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787726332_0001_00_000001, stoppedTime=1452787726564, exitStatus=0
2016-01-14 16:08:46,564 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:46,564 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787726332_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:46,564 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:46,564 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787726332_0001_1
2016-01-14 16:08:46,564 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726332_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787726332_0001_1
2016-01-14 16:08:46,564 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 3A6FB6121E9C42859F090EB9C2DD6353 for vertex: vertex_1452787726332_0001_1_00 [B84FEB4E3EB34911BA8A8431CABBF79B]
2016-01-14 16:08:46,574 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787726332_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:46,574 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787726332_0001_00_000001: 14 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:46,574 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787726332_0001_00_000001, Exiting
2016-01-14 16:08:46,574 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787726332_0001_00_000001
2016-01-14 16:08:46,574 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787726332_0001_00_000001
2016-01-14 16:08:46,578 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787726332_0001_1, queueSize=0
2016-01-14 16:08:46,578 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:46,578 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726332_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787726332_0001_1, startTime=1452787726496, finishTime=1452787726577, timeTaken=81, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787726553, Process_Duration=4, Process_End_Time=1452787726557, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:46,578 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787726332_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:46,579 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787726332_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:46,579 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787726332_0001_00_000001
2016-01-14 16:08:46 Completed Dag: dag_1452787726332_0001_1
2016-01-14 16:08:46,579 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787726332_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:46,579 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787726332_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:46,579 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787726332_0001_00_000001 completed successfully
2016-01-14 16:08:46,579 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787726332_0001_1_post
2016-01-14 16:08:46,580 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:46,580 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:46,580 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787726332_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 16:08:46,580 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787726332_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 16:08:46,586 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...SULTS.0_'field2'_'field2', applicationId=application_1452787726332_0001
2016-01-14 16:08:46,587 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:46,587 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:46,587 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:46,588 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:46,588 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:46,588 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:46,588 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:46,590 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:46,590 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:46,590 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:46,590 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:46,591 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:46,591 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:46,594 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1AE16414F56F433EA612D43F6C1FE603/C5A070540D3242D4A5511C152F3C5303/.tez/application_1452787726332_0001
2016-01-14 16:08:46,595 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  completed in: 00:00.280
2016-01-14 16:08:46,660 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.0_'field2'_'field2'
2016-01-14 16:08:46,684 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:46,685 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:46,718 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.011
2016-01-14 16:08:46,726 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 16:08:46,726 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:46,727 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:46,727 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:46,741 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:46,741 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_RESULTS
2016-01-14 16:08:46,751 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting
2016-01-14 16:08:46,751 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:46,752 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_RESULTS"]
2016-01-14 16:08:46,752 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  parallel execution of steps is enabled: false
2016-01-14 16:08:46,752 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  executing total steps: 1
2016-01-14 16:08:46,752 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  allocating management threads: 1
2016-01-14 16:08:46,753 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting step: (1/1) ...ESULTS.0_'field2'_RESULTS
2016-01-14 16:08:46,753 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [each.each] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:46,765 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tez session mode enabled: true
2016-01-14 16:08:46,770 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:46,770 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:46,770 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:46,781 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/B0CA1A75702F4D2EA643214AD64D0DA8/B442FC2E575B4023B56FC46346143764/.tez/application_1452787726770_0001 doesn't exist and is created
2016-01-14 16:08:46,796 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:46,796 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:46,796 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/B0CA1A75702F4D2EA643214AD64D0DA8/B442FC2E575B4023B56FC46346143764/.tez/application_1452787726770_0001
2016-01-14 16:08:46,799 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787726770_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:46,808 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:46,810 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:46,812 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:46,812 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:46,813 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/B0CA1A75702F4D2EA643214AD64D0DA8/B442FC2E575B4023B56FC46346143764/.tez/application_1452787726770_0001/localmode-log-dir
2016-01-14 16:08:46,813 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/B0CA1A75702F4D2EA643214AD64D0DA8/B442FC2E575B4023B56FC46346143764/.tez/application_1452787726770_0001/localmode-log-dir/history.txt.appattempt_1452787726770_0001_000000, maxErrors=10
2016-01-14 16:08:46,813 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:46,814 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787726770_0001_000000, appSubmitTime=1452787726798, launchTime=1452787726798
2016-01-14 16:08:46,817 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:46,819 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:46,821 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:46,821 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:46,824 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:47159
2016-01-14 16:08:46,828 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:46,832 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:46,832 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787726770_0001_000000, startTime=1452787726832
2016-01-14 16:08:46,832 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:46,896 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:46,896 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:46,896 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ESULTS.0_'field2'_RESULTS, applicationId=application_1452787726770_0001, dagName=[B0CA1A75702F4D2EA643214AD64D0DA8/B442FC2E575B4023B56FC46346143764] each.each/(1/1) ...ESULTS.0_'field2'_RESULTS
2016-01-14 16:08:46,912 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [B0CA1A75702F4D2EA643214AD64D0DA8/B442FC2E575B4023B56FC46346143764] each.each/(1/1) ...ESULTS.0_'field2'_RESULTS
2016-01-14 16:08:46,913 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787726770_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/B0CA1A75702F4D2EA643214AD64D0DA8/B442FC2E575B4023B56FC46346143764/.tez/application_1452787726770_0001/localmode-log-dir/dag_1452787726770_0001_1.dot
2016-01-14 16:08:46,914 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/B0CA1A75702F4D2EA643214AD64D0DA8/B442FC2E575B4023B56FC46346143764/.tez/application_1452787726770_0001/localmode-log-dir/dag_1452787726770_0001_1-tez-dag.pb.txt
2016-01-14 16:08:46,927 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787726770_0001_1
2016-01-14 16:08:46,927 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:46,927 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [B0CA1A75702F4D2EA643214AD64D0DA8/B442FC2E575B4023B56FC46346143764] each.each/(1/1) ...ESULTS.0_'field2'_RESULTS
2016-01-14 16:08:46 Running Dag: dag_1452787726770_0001_1
2016-01-14 16:08:46,937 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726770_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787726770_0001_1, submitTime=1452787726912
2016-01-14 16:08:46,937 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:46,938 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex AF2F39CA4568414D9E31BFEB5A2D4032
2016-01-14 16:08:46,938 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:46,939 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726770_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787726770_0001_1, initTime=1452787726938
2016-01-14 16:08:46,939 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:46,939 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787726770_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:46,940 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726770_0001_1][Event:DAG_STARTED]: dagID=dag_1452787726770_0001_1, startTime=1452787726940
2016-01-14 16:08:46,940 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:46,940 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787726770_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:46,941 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: AF2F39CA4568414D9E31BFEB5A2D4032 : {8D627E4BF96D422290C91206D0C81113={InputName=8D627E4BF96D422290C91206D0C81113}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:46,941 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 8D627E4BF96D422290C91206D0C81113, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:46,941 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:46,941 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032]
2016-01-14 16:08:46,941 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032]
2016-01-14 16:08:46,942 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032]
2016-01-14 16:08:46,942 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032]. Starting root input initializers: 1
2016-01-14 16:08:46,943 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:46,943 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 8D627E4BF96D422290C91206D0C81113 on vertex vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032]
2016-01-14 16:08:46,944 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ESULTS.0_'field2'_RESULTS, applicationId=application_1452787726770_0001, dagName=[B0CA1A75702F4D2EA643214AD64D0DA8/B442FC2E575B4023B56FC46346143764] each.each/(1/1) ...ESULTS.0_'field2'_RESULTS
2016-01-14 16:08:46,945 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:46,945 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 8D627E4BF96D422290C91206D0C81113 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:46,945 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:46,945 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:46,947 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:46,947 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 8D627E4BF96D422290C91206D0C81113 on vertex vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032]
2016-01-14 16:08:46,947 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:46,947 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {8D627E4BF96D422290C91206D0C81113=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:46,947 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032] parallelism set to 1
2016-01-14 16:08:46,948 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:46,948 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726770_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787726770_0001_1_00, eventCount=1
2016-01-14 16:08:46,948 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032]
2016-01-14 16:08:46,948 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=DADE6087528C4560912B8AFBC7A62994, vertexId=vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:46,949 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=DADE6087528C4560912B8AFBC7A62994, vertexId=vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032]
2016-01-14 16:08:46,950 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:46,950 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:46,950 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=DADE6087528C4560912B8AFBC7A62994, vertexName=AF2F39CA4568414D9E31BFEB5A2D4032, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:46,950 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=DADE6087528C4560912B8AFBC7A62994, vertexId=vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032]
2016-01-14 16:08:46,951 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726770_0001_1][Event:VERTEX_INITIALIZED]: vertexName=AF2F39CA4568414D9E31BFEB5A2D4032, vertexId=vertex_1452787726770_0001_1_00, initRequestedTime=1452787726941, initedTime=1452787726951, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:46,951 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:46,951 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032] with distanceFromRoot: 0
2016-01-14 16:08:46,952 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:46,952 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in AF2F39CA4568414D9E31BFEB5A2D4032
2016-01-14 16:08:46,952 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032]
2016-01-14 16:08:46,952 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726770_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787726770_0001_1_00, startRequestedTime=1452787726952, startedTime=1452787726952
2016-01-14 16:08:46,952 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:46,952 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:46,953 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:46,953 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726770_0001_1][Event:TASK_STARTED]: vertexName=AF2F39CA4568414D9E31BFEB5A2D4032, taskId=task_1452787726770_0001_1_00_000000, scheduledTime=1452787726953, launchTime=1452787726953
2016-01-14 16:08:46,953 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787726770_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:46,953 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032]
2016-01-14 16:08:46,954 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [B0CA1A75702F4D2EA643214AD64D0DA8/B442FC2E575B4023B56FC46346143764] each.each/(1/1) ...ESULTS.0_'field2'_RESULTS, VertexName: AF2F39CA4568414D9E31BFEB5A2D4032, VertexParallelism: 1, TaskAttemptID:attempt_1452787726770_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8D627E4BF96D422290C91206D0C81113, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=DADE6087528C4560912B8AFBC7A62994, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:46,954 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787726770_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:46,954 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:46,956 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:46,957 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:46,957 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:46,958 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787726770_0001_00_000001
2016-01-14 16:08:46,958 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787726770_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:46,960 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787726770_0001_00_000001
2016-01-14 16:08:46,960 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:46,961 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:46,961 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787726770_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:46,962 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726770_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787726770_0001_00_000001, launchTime=1452787726960
2016-01-14 16:08:46,962 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787726770_0001_00_000001
2016-01-14 16:08:46,964 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787726770_0001_1_00_000000_0] to container: [container_1452787726770_0001_00_000001]
2016-01-14 16:08:46,964 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787726770_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:46,964 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787726770_0001_00_000001 given task: attempt_1452787726770_0001_1_00_000000_0
2016-01-14 16:08:46,964 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787726770_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787726770_0001_1_00_000000_0
2016-01-14 16:08:46,964 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] submitted tez dag to app master: application_1452787726770_0001, with dag id: dag_1452787726770_0001_1
2016-01-14 16:08:46 Starting to run new task attempt: attempt_1452787726770_0001_1_00_000000_0
2016-01-14 16:08:46,965 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787726770_0001_1_00_000000_0
2016-01-14 16:08:46,965 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:46,965 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:46,965 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:46,965 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:46,965 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:46,966 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:46,966 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [B0CA1A75702F4D2EA643214AD64D0DA8/B442FC2E575B4023B56FC46346143764] each.each/(1/1) ...ESULTS.0_'field2'_RESULTS, VertexName: AF2F39CA4568414D9E31BFEB5A2D4032, VertexParallelism: 1, TaskAttemptID:attempt_1452787726770_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8D627E4BF96D422290C91206D0C81113, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=DADE6087528C4560912B8AFBC7A62994, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:46,966 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:46,967 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787726770_0001_1_00_000000_0] started. Is using containerId: [container_1452787726770_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:46,967 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:46,967 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726770_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=AF2F39CA4568414D9E31BFEB5A2D4032, taskAttemptId=attempt_1452787726770_0001_1_00_000000_0, startTime=1452787726964, containerId=container_1452787726770_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787726770_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:46,967 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787726770_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:46,967 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787726770_0001_1_00_000000_0
2016-01-14 16:08:46,967 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:46,967 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:46,968 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787726770_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:46,968 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787726770_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:46,970 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=8D627E4BF96D422290C91206D0C81113, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:46,970 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:46,971 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 8D627E4BF96D422290C91206D0C81113
2016-01-14 16:08:46,971 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 8D627E4BF96D422290C91206D0C81113
2016-01-14 16:08:46,970 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=DADE6087528C4560912B8AFBC7A62994, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:46,970 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:46,973 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:46,974 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: DADE6087528C4560912B8AFBC7A62994
2016-01-14 16:08:46,974 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:46,974 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: DADE6087528C4560912B8AFBC7A62994
2016-01-14 16:08:46,975 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:46,979 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:46,979 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 8D627E4BF96D422290C91206D0C81113
2016-01-14 16:08:46,979 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 8D627E4BF96D422290C91206D0C81113
2016-01-14 16:08:46,987 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: AF2F39CA4568414D9E31BFEB5A2D4032, ordinal: 0
2016-01-14 16:08:46,987 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:46,987 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: DADE6087528C4560912B8AFBC7A62994
2016-01-14 16:08:46,987 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AF2F39CA4568414D9E31BFEB5A2D4032, mem on start (mb), free: 161, total: 385, max: 672
2016-01-14 16:08:46,988 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:46,988 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:46,988 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:46,988 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:46,988 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:46,989 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:46,989 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:46,990 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:46,990 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:46,990 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:46,990 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:46,991 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 8D627E4BF96D422290C91206D0C81113, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:46,991 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, DADE6087528C4560912B8AFBC7A62994, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:46,991 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:46,991 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 8D627E4BF96D422290C91206D0C81113 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:46,991 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 8D627E4BF96D422290C91206D0C81113
2016-01-14 16:08:46,992 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:46,992 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 8D627E4BF96D422290C91206D0C81113
2016-01-14 16:08:46,991 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:46,992 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:46,993 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:46,993 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787726770_0001_1_00_000000_0
2016-01-14 16:08:46,993 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:46,995 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@4294cd2e
2016-01-14 16:08:46,995 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@4294cd2e
2016-01-14 16:08:46,995 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:46,996 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:46,997 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:46,998 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 8D627E4BF96D422290C91206D0C81113
2016-01-14 16:08:46,998 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_RESULTS"], id: DADE6087528C4560912B8AFBC7A62994
2016-01-14 16:08:46,998 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_RESULTS"]
2016-01-14 16:08:46,999 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:46,999 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:46,999 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: AF2F39CA4568414D9E31BFEB5A2D4032, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:47,002 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:47,003 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:47,003 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787726770_0001_1_00_000000_0
2016-01-14 16:08:47,004 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787726770_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:47,004 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787726770_0001_1_00_000000_0
2016-01-14 16:08:47,004 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AF2F39CA4568414D9E31BFEB5A2D4032, mem on close (mb), free: 159, total: 385, max: 672
2016-01-14 16:08:47 Completed running task attempt: attempt_1452787726770_0001_1_00_000000_0
2016-01-14 16:08:47,005 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787726770_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:47,007 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787726999, Process_Duration=5, Process_End_Time=1452787727004, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:47,007 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726770_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=AF2F39CA4568414D9E31BFEB5A2D4032, taskAttemptId=attempt_1452787726770_0001_1_00_000000_0, startTime=1452787726964, finishTime=1452787727006, timeTaken=42, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787726999, Process_Duration=5, Process_End_Time=1452787727004, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:47,007 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:47,008 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787726770_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:47,008 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:47,008 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:47,008 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787726770_0001_1_00_000000_0
2016-01-14 16:08:47,009 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726770_0001_1][Event:TASK_FINISHED]: vertexName=AF2F39CA4568414D9E31BFEB5A2D4032, taskId=task_1452787726770_0001_1_00_000000, startTime=1452787726964, finishTime=1452787727008, timeTaken=44, status=SUCCEEDED, successfulAttemptID=attempt_1452787726770_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787726999, Process_Duration=5, Process_End_Time=1452787727004, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:47,009 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787726770_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:47,009 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032] : 1
2016-01-14 16:08:47,009 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032]
2016-01-14 16:08:47,008 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:47,009 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:47,010 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787726770_0001_00_000001
2016-01-14 16:08:47,015 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:47,016 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726770_0001_1][Event:VERTEX_FINISHED]: vertexName=AF2F39CA4568414D9E31BFEB5A2D4032, vertexId=vertex_1452787726770_0001_1_00, initRequestedTime=1452787726941, initedTime=1452787726951, startRequestedTime=1452787726952, startedTime=1452787726952, finishTime=1452787727009, timeTaken=57, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787726999, Process_Duration=5, Process_End_Time=1452787727004, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787726964, firstTasksToStart=[ task_1452787726770_0001_1_00_000000 ], lastTaskFinishTime=1452787727006, lastTasksToFinish=[ task_1452787726770_0001_1_00_000000 ], minTaskDuration=42, maxTaskDuration=42, avgTaskDuration=42.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787726770_0001_1_00_000000 ], longestDurationTasks=[ task_1452787726770_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:47,016 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:47,016 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787726770_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:47,016 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726770_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787726770_0001_00_000001, stoppedTime=1452787727016, exitStatus=0
2016-01-14 16:08:47,017 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787726770_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:47,017 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:47,017 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:47,017 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787726770_0001_1
2016-01-14 16:08:47,018 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726770_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787726770_0001_1
2016-01-14 16:08:47,018 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: DADE6087528C4560912B8AFBC7A62994 for vertex: vertex_1452787726770_0001_1_00 [AF2F39CA4568414D9E31BFEB5A2D4032]
2016-01-14 16:08:47,022 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787726770_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:47,022 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787726770_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:47,023 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787726770_0001_00_000001, Exiting
2016-01-14 16:08:47,023 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787726770_0001_00_000001
2016-01-14 16:08:47,023 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787726770_0001_00_000001
2016-01-14 16:08:47,024 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787726770_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:47,024 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787726770_0001_00_000001 completed successfully
2016-01-14 16:08:47,028 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787726770_0001_1, queueSize=0
2016-01-14 16:08:47,028 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:47,028 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787726770_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787726770_0001_1, startTime=1452787726940, finishTime=1452787727027, timeTaken=87, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404226048, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787726999, Process_Duration=5, Process_End_Time=1452787727004, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:47,028 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787726770_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:47,029 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787726770_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:47,029 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787726770_0001_00_000001
2016-01-14 16:08:47,029 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787726770_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:47 Completed Dag: dag_1452787726770_0001_1
2016-01-14 16:08:47,030 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787726770_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:47,030 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787726770_0001_1_post
2016-01-14 16:08:47,031 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:47,032 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:47,035 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ESULTS.0_'field2'_RESULTS, applicationId=application_1452787726770_0001
2016-01-14 16:08:47,037 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:47,037 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:47,037 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:47,037 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:47,037 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:47,038 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:47,039 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:47,039 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:47,039 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:47,039 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:47,039 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:47,040 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:47,040 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:47,044 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/B0CA1A75702F4D2EA643214AD64D0DA8/B442FC2E575B4023B56FC46346143764/.tez/application_1452787726770_0001
2016-01-14 16:08:47,045 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  completed in: 00:00.293
2016-01-14 16:08:47,119 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.0_'field2'_RESULTS
2016-01-14 16:08:47,140 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:47,141 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:47,174 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.011
2016-01-14 16:08:47,180 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 16:08:47,180 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:47,180 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:47,181 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:47,194 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:47,195 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:47,205 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting
2016-01-14 16:08:47,205 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:47,205 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_ALL"]
2016-01-14 16:08:47,205 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  parallel execution of steps is enabled: false
2016-01-14 16:08:47,206 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  executing total steps: 1
2016-01-14 16:08:47,206 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  allocating management threads: 1
2016-01-14 16:08:47,207 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting step: (1/1) ...d'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:47,207 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [each.each] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:47,219 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tez session mode enabled: true
2016-01-14 16:08:47,224 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:47,224 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:47,224 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:47,233 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/C62105E921224D5CB50E2F2D9FE356B4/BE83D63B3715462881371F46E4D287F8/.tez/application_1452787727224_0001 doesn't exist and is created
2016-01-14 16:08:47,248 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:47,248 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:47,248 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/C62105E921224D5CB50E2F2D9FE356B4/BE83D63B3715462881371F46E4D287F8/.tez/application_1452787727224_0001
2016-01-14 16:08:47,251 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787727224_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:47,262 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:47,263 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:47,265 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:47,265 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:47,266 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/C62105E921224D5CB50E2F2D9FE356B4/BE83D63B3715462881371F46E4D287F8/.tez/application_1452787727224_0001/localmode-log-dir
2016-01-14 16:08:47,266 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/C62105E921224D5CB50E2F2D9FE356B4/BE83D63B3715462881371F46E4D287F8/.tez/application_1452787727224_0001/localmode-log-dir/history.txt.appattempt_1452787727224_0001_000000, maxErrors=10
2016-01-14 16:08:47,266 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:47,268 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787727224_0001_000000, appSubmitTime=1452787727250, launchTime=1452787727251
2016-01-14 16:08:47,273 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:52096
2016-01-14 16:08:47,275 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:47,277 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:47,277 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:47,278 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:47,278 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:47,281 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787727224_0001_000000, startTime=1452787727281
2016-01-14 16:08:47,281 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:47,281 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:47,348 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:47,348 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:47,349 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...d'_RESULTS.0_'field2'_ALL, applicationId=application_1452787727224_0001, dagName=[C62105E921224D5CB50E2F2D9FE356B4/BE83D63B3715462881371F46E4D287F8] each.each/(1/1) ...d'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:47,371 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [C62105E921224D5CB50E2F2D9FE356B4/BE83D63B3715462881371F46E4D287F8] each.each/(1/1) ...d'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:47,372 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787727224_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/C62105E921224D5CB50E2F2D9FE356B4/BE83D63B3715462881371F46E4D287F8/.tez/application_1452787727224_0001/localmode-log-dir/dag_1452787727224_0001_1.dot
2016-01-14 16:08:47,372 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/C62105E921224D5CB50E2F2D9FE356B4/BE83D63B3715462881371F46E4D287F8/.tez/application_1452787727224_0001/localmode-log-dir/dag_1452787727224_0001_1-tez-dag.pb.txt
2016-01-14 16:08:47,381 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787727224_0001_1
2016-01-14 16:08:47,381 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:47,382 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [C62105E921224D5CB50E2F2D9FE356B4/BE83D63B3715462881371F46E4D287F8] each.each/(1/1) ...d'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:47 Running Dag: dag_1452787727224_0001_1
2016-01-14 16:08:47,393 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:47,394 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727224_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787727224_0001_1, submitTime=1452787727371
2016-01-14 16:08:47,394 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex DB60C000CB8A4EC987FD4693509E4E42
2016-01-14 16:08:47,395 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:47,396 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:47,396 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727224_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787727224_0001_1, initTime=1452787727394
2016-01-14 16:08:47,397 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787727224_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:47,397 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727224_0001_1][Event:DAG_STARTED]: dagID=dag_1452787727224_0001_1, startTime=1452787727397
2016-01-14 16:08:47,397 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:47,397 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:47,397 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787727224_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:47,397 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: DB60C000CB8A4EC987FD4693509E4E42 : {10E8A9D6C7AF4CCCAD6EF9C8B06DC433={InputName=10E8A9D6C7AF4CCCAD6EF9C8B06DC433}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:47,398 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 10E8A9D6C7AF4CCCAD6EF9C8B06DC433, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:47,398 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42]
2016-01-14 16:08:47,398 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42]
2016-01-14 16:08:47,398 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42]
2016-01-14 16:08:47,399 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42]. Starting root input initializers: 1
2016-01-14 16:08:47,399 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...d'_RESULTS.0_'field2'_ALL, applicationId=application_1452787727224_0001, dagName=[C62105E921224D5CB50E2F2D9FE356B4/BE83D63B3715462881371F46E4D287F8] each.each/(1/1) ...d'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:47,399 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:47,400 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 10E8A9D6C7AF4CCCAD6EF9C8B06DC433 on vertex vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42]
2016-01-14 16:08:47,401 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:47,401 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 10E8A9D6C7AF4CCCAD6EF9C8B06DC433 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:47,402 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:47,402 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:47,403 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:47,404 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 10E8A9D6C7AF4CCCAD6EF9C8B06DC433 on vertex vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42]
2016-01-14 16:08:47,404 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:47,404 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {10E8A9D6C7AF4CCCAD6EF9C8B06DC433=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:47,404 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42] parallelism set to 1
2016-01-14 16:08:47,405 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:47,405 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727224_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787727224_0001_1_00, eventCount=1
2016-01-14 16:08:47,405 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42]
2016-01-14 16:08:47,405 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=271BE851359E4FEBBD024EA48C0CC941, vertexId=vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:47,405 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=271BE851359E4FEBBD024EA48C0CC941, vertexId=vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42]
2016-01-14 16:08:47,407 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=271BE851359E4FEBBD024EA48C0CC941, vertexName=DB60C000CB8A4EC987FD4693509E4E42, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:47,407 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=271BE851359E4FEBBD024EA48C0CC941, vertexId=vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42]
2016-01-14 16:08:47,408 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727224_0001_1][Event:VERTEX_INITIALIZED]: vertexName=DB60C000CB8A4EC987FD4693509E4E42, vertexId=vertex_1452787727224_0001_1_00, initRequestedTime=1452787727397, initedTime=1452787727408, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:47,409 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42] with distanceFromRoot: 0
2016-01-14 16:08:47,409 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:47,409 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:47,409 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in DB60C000CB8A4EC987FD4693509E4E42
2016-01-14 16:08:47,410 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42]
2016-01-14 16:08:47,410 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727224_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787727224_0001_1_00, startRequestedTime=1452787727409, startedTime=1452787727409
2016-01-14 16:08:47,410 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:47,410 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:47,411 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:47,411 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727224_0001_1][Event:TASK_STARTED]: vertexName=DB60C000CB8A4EC987FD4693509E4E42, taskId=task_1452787727224_0001_1_00_000000, scheduledTime=1452787727411, launchTime=1452787727411
2016-01-14 16:08:47,411 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787727224_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:47,412 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42]
2016-01-14 16:08:47,412 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [C62105E921224D5CB50E2F2D9FE356B4/BE83D63B3715462881371F46E4D287F8] each.each/(1/1) ...d'_RESULTS.0_'field2'_ALL, VertexName: DB60C000CB8A4EC987FD4693509E4E42, VertexParallelism: 1, TaskAttemptID:attempt_1452787727224_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=10E8A9D6C7AF4CCCAD6EF9C8B06DC433, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=271BE851359E4FEBBD024EA48C0CC941, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:47,412 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787727224_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:47,413 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:47,413 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:47,414 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] submitted tez dag to app master: application_1452787727224_0001, with dag id: dag_1452787727224_0001_1
2016-01-14 16:08:47,414 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:47,414 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:47,415 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787727224_0001_00_000001
2016-01-14 16:08:47,415 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787727224_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:47,417 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787727224_0001_00_000001
2016-01-14 16:08:47,417 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:47,418 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787727224_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:47,418 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:47,419 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727224_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787727224_0001_00_000001, launchTime=1452787727418
2016-01-14 16:08:47,419 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787727224_0001_00_000001
2016-01-14 16:08:47,420 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787727224_0001_1_00_000000_0] to container: [container_1452787727224_0001_00_000001]
2016-01-14 16:08:47,420 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787727224_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:47,421 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787727224_0001_1_00_000000_0] started. Is using containerId: [container_1452787727224_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:47,421 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727224_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=DB60C000CB8A4EC987FD4693509E4E42, taskAttemptId=attempt_1452787727224_0001_1_00_000000_0, startTime=1452787727421, containerId=container_1452787727224_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787727224_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:47,421 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787727224_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:47,421 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787727224_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:47,422 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:47,422 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787727224_0001_00_000001 given task: attempt_1452787727224_0001_1_00_000000_0
2016-01-14 16:08:47,422 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787727224_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787727224_0001_1_00_000000_0
2016-01-14 16:08:47 Starting to run new task attempt: attempt_1452787727224_0001_1_00_000000_0
2016-01-14 16:08:47,423 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787727224_0001_1_00_000000_0
2016-01-14 16:08:47,423 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:47,423 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:47,423 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:47,423 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:47,423 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:47,423 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:47,424 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [C62105E921224D5CB50E2F2D9FE356B4/BE83D63B3715462881371F46E4D287F8] each.each/(1/1) ...d'_RESULTS.0_'field2'_ALL, VertexName: DB60C000CB8A4EC987FD4693509E4E42, VertexParallelism: 1, TaskAttemptID:attempt_1452787727224_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=10E8A9D6C7AF4CCCAD6EF9C8B06DC433, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=271BE851359E4FEBBD024EA48C0CC941, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:47,424 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:47,424 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787727224_0001_1_00_000000_0
2016-01-14 16:08:47,425 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:47,425 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:47,425 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787727224_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:47,426 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=10E8A9D6C7AF4CCCAD6EF9C8B06DC433, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:47,426 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=271BE851359E4FEBBD024EA48C0CC941, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:47,426 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:47,427 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:47,426 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:47,427 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 271BE851359E4FEBBD024EA48C0CC941
2016-01-14 16:08:47,428 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:47,427 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 10E8A9D6C7AF4CCCAD6EF9C8B06DC433
2016-01-14 16:08:47,428 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 271BE851359E4FEBBD024EA48C0CC941
2016-01-14 16:08:47,428 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 10E8A9D6C7AF4CCCAD6EF9C8B06DC433
2016-01-14 16:08:47,431 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:47,432 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 10E8A9D6C7AF4CCCAD6EF9C8B06DC433
2016-01-14 16:08:47,432 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 10E8A9D6C7AF4CCCAD6EF9C8B06DC433
2016-01-14 16:08:47,432 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:47,441 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: DB60C000CB8A4EC987FD4693509E4E42, ordinal: 0
2016-01-14 16:08:47,441 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DB60C000CB8A4EC987FD4693509E4E42, mem on start (mb), free: 276, total: 372, max: 672
2016-01-14 16:08:47,441 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:47,441 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:47,441 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:47,445 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:47,445 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 271BE851359E4FEBBD024EA48C0CC941
2016-01-14 16:08:47,445 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:47,445 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:47,445 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:47,446 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:47,446 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:47,446 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:47,447 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:47,447 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:47,447 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 271BE851359E4FEBBD024EA48C0CC941, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:47,447 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 10E8A9D6C7AF4CCCAD6EF9C8B06DC433, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:47,449 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:47,449 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 10E8A9D6C7AF4CCCAD6EF9C8B06DC433 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:47,449 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 10E8A9D6C7AF4CCCAD6EF9C8B06DC433
2016-01-14 16:08:47,449 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:47,449 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 10E8A9D6C7AF4CCCAD6EF9C8B06DC433
2016-01-14 16:08:47,449 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:47,449 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:47,450 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:47,450 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787727224_0001_1_00_000000_0
2016-01-14 16:08:47,450 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:47,451 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@78df4239
2016-01-14 16:08:47,452 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@78df4239
2016-01-14 16:08:47,452 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:47,452 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:47,454 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:47,454 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 10E8A9D6C7AF4CCCAD6EF9C8B06DC433
2016-01-14 16:08:47,454 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_ALL"], id: 271BE851359E4FEBBD024EA48C0CC941
2016-01-14 16:08:47,455 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_ALL"]
2016-01-14 16:08:47,455 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:47,455 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:47,455 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: DB60C000CB8A4EC987FD4693509E4E42, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:47,458 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:47,458 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:47,459 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787727224_0001_1_00_000000_0
2016-01-14 16:08:47,459 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787727224_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:47,460 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787727224_0001_1_00_000000_0
2016-01-14 16:08:47,460 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DB60C000CB8A4EC987FD4693509E4E42, mem on close (mb), free: 275, total: 372, max: 672
2016-01-14 16:08:47 Completed running task attempt: attempt_1452787727224_0001_1_00_000000_0
2016-01-14 16:08:47,461 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787727224_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:47,462 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:47,462 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727224_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=DB60C000CB8A4EC987FD4693509E4E42, taskAttemptId=attempt_1452787727224_0001_1_00_000000_0, startTime=1452787727421, finishTime=1452787727462, timeTaken=41, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=390594560, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787727456, Process_Duration=4, Process_End_Time=1452787727460, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:47,463 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787727224_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:47,463 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787727224_0001_1_00_000000_0
2016-01-14 16:08:47,463 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:47,463 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:47,464 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727224_0001_1][Event:TASK_FINISHED]: vertexName=DB60C000CB8A4EC987FD4693509E4E42, taskId=task_1452787727224_0001_1_00_000000, startTime=1452787727421, finishTime=1452787727463, timeTaken=42, status=SUCCEEDED, successfulAttemptID=attempt_1452787727224_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=390594560, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787727456, Process_Duration=4, Process_End_Time=1452787727460, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:47,464 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787727224_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:47,464 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42] : 1
2016-01-14 16:08:47,464 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42]
2016-01-14 16:08:47,465 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:47,465 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727224_0001_1][Event:VERTEX_FINISHED]: vertexName=DB60C000CB8A4EC987FD4693509E4E42, vertexId=vertex_1452787727224_0001_1_00, initRequestedTime=1452787727397, initedTime=1452787727408, startRequestedTime=1452787727409, startedTime=1452787727409, finishTime=1452787727464, timeTaken=55, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=390594560, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787727456, Process_Duration=4, Process_End_Time=1452787727460, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787727421, firstTasksToStart=[ task_1452787727224_0001_1_00_000000 ], lastTaskFinishTime=1452787727462, lastTasksToFinish=[ task_1452787727224_0001_1_00_000000 ], minTaskDuration=41, maxTaskDuration=41, avgTaskDuration=41.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787727224_0001_1_00_000000 ], longestDurationTasks=[ task_1452787727224_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:47,465 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:47,466 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787727224_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:47,466 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=390594560, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787727456, Process_Duration=4, Process_End_Time=1452787727460, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:47,466 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727224_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787727224_0001_00_000001, stoppedTime=1452787727466, exitStatus=0
2016-01-14 16:08:47,466 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:47,466 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787727224_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:47,467 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:47,466 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:47,467 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:47,467 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787727224_0001_00_000001
2016-01-14 16:08:47,467 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787727224_0001_1
2016-01-14 16:08:47,467 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787727224_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:47,467 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727224_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787727224_0001_1
2016-01-14 16:08:47,467 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787727224_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:47,468 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 271BE851359E4FEBBD024EA48C0CC941 for vertex: vertex_1452787727224_0001_1_00 [DB60C000CB8A4EC987FD4693509E4E42]
2016-01-14 16:08:47,469 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787727224_0001_00_000001, Exiting
2016-01-14 16:08:47,470 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787727224_0001_00_000001
2016-01-14 16:08:47,470 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787727224_0001_00_000001
2016-01-14 16:08:47,471 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787727224_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:47,471 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787727224_0001_00_000001 completed successfully
2016-01-14 16:08:47,476 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787727224_0001_1, queueSize=0
2016-01-14 16:08:47,477 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:47,477 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727224_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787727224_0001_1, startTime=1452787727397, finishTime=1452787727475, timeTaken=78, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=390594560, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787727456, Process_Duration=4, Process_End_Time=1452787727460, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:47,477 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787727224_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:47,477 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787727224_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:47,478 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787727224_0001_00_000001
2016-01-14 16:08:47,478 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787727224_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:47 Completed Dag: dag_1452787727224_0001_1
2016-01-14 16:08:47,478 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787727224_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:47,479 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787727224_0001_1_post
2016-01-14 16:08:47,479 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:47,479 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:47,484 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...d'_RESULTS.0_'field2'_ALL, applicationId=application_1452787727224_0001
2016-01-14 16:08:47,485 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:47,485 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:47,485 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:47,485 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:47,486 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:47,486 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:47,486 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:47,487 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:47,487 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:47,487 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:47,487 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:47,488 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:47,488 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:47,491 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/C62105E921224D5CB50E2F2D9FE356B4/BE83D63B3715462881371F46E4D287F8/.tez/application_1452787727224_0001
2016-01-14 16:08:47,492 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  completed in: 00:00.287
2016-01-14 16:08:47,555 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/eacheachpipeassemblyplatform//-1_'field'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:47,577 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:47,578 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:47,614 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.012
2016-01-14 16:08:47,614 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.013
2016-01-14 16:08:47,614 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:47,614 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:47,615 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:47,637 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:47,637 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_-1
2016-01-14 16:08:47,650 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting
2016-01-14 16:08:47,651 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:47,651 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/eacheachpipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_-1"]
2016-01-14 16:08:47,651 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  parallel execution of steps is enabled: false
2016-01-14 16:08:47,651 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  executing total steps: 1
2016-01-14 16:08:47,651 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each]  allocating management threads: 1
2016-01-14 16:08:47,652 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] starting step: (1/1) ...eld'_RESULTS.0_UNKNOWN_-1
2016-01-14 16:08:47,652 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [each.each] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:47,664 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [each.each] tez session mode enabled: true
2016-01-14 16:08:47,668 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:47,668 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:47,668 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:47,673 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:47,674 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:47,677 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/A98EFB34FC024DC79C5CC748C83D20CC/C74347B5E1394851B5832414BBC52940/.tez/application_1452787727668_0001 doesn't exist and is created
2016-01-14 16:08:47,694 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:47,694 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:47,694 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/A98EFB34FC024DC79C5CC748C83D20CC/C74347B5E1394851B5832414BBC52940/.tez/application_1452787727668_0001
2016-01-14 16:08:47,697 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787727668_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:47,710 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:47,710 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:47,712 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:47,712 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:47,712 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/A98EFB34FC024DC79C5CC748C83D20CC/C74347B5E1394851B5832414BBC52940/.tez/application_1452787727668_0001/localmode-log-dir
2016-01-14 16:08:47,712 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/A98EFB34FC024DC79C5CC748C83D20CC/C74347B5E1394851B5832414BBC52940/.tez/application_1452787727668_0001/localmode-log-dir/history.txt.appattempt_1452787727668_0001_000000, maxErrors=10
2016-01-14 16:08:47,713 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:47,713 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787727668_0001_000000, appSubmitTime=1452787727697, launchTime=1452787727697
2016-01-14 16:08:47,717 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:47,720 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:47,720 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:47,720 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:47,725 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:53841
2016-01-14 16:08:47,726 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:47,730 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787727668_0001_000000, startTime=1452787727730
2016-01-14 16:08:47,730 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:47,730 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:47,794 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:47,794 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:47,795 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...eld'_RESULTS.0_UNKNOWN_-1, applicationId=application_1452787727668_0001, dagName=[A98EFB34FC024DC79C5CC748C83D20CC/C74347B5E1394851B5832414BBC52940] each.each/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1
2016-01-14 16:08:47,810 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [A98EFB34FC024DC79C5CC748C83D20CC/C74347B5E1394851B5832414BBC52940] each.each/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1
2016-01-14 16:08:47,814 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787727668_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/A98EFB34FC024DC79C5CC748C83D20CC/C74347B5E1394851B5832414BBC52940/.tez/application_1452787727668_0001/localmode-log-dir/dag_1452787727668_0001_1.dot
2016-01-14 16:08:47,819 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/A98EFB34FC024DC79C5CC748C83D20CC/C74347B5E1394851B5832414BBC52940/.tez/application_1452787727668_0001/localmode-log-dir/dag_1452787727668_0001_1-tez-dag.pb.txt
2016-01-14 16:08:47,825 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787727668_0001_1
2016-01-14 16:08:47,825 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:47,826 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [A98EFB34FC024DC79C5CC748C83D20CC/C74347B5E1394851B5832414BBC52940] each.each/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1
2016-01-14 16:08:47 Running Dag: dag_1452787727668_0001_1
2016-01-14 16:08:47,842 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727668_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787727668_0001_1, submitTime=1452787727811
2016-01-14 16:08:47,842 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:47,843 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex C4471A71DA9A40ADBB308EBA7FEDA365
2016-01-14 16:08:47,843 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:47,844 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:47,845 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727668_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787727668_0001_1, initTime=1452787727843
2016-01-14 16:08:47,845 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787727668_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:47,845 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727668_0001_1][Event:DAG_STARTED]: dagID=dag_1452787727668_0001_1, startTime=1452787727845
2016-01-14 16:08:47,846 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:47,846 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787727668_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:47,846 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: C4471A71DA9A40ADBB308EBA7FEDA365 : {8E51C8210EA54CB2AFB0E4220B9F8E4F={InputName=8E51C8210EA54CB2AFB0E4220B9F8E4F}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:47,846 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 8E51C8210EA54CB2AFB0E4220B9F8E4F, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:47,846 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787727668_0001_1_00 [C4471A71DA9A40ADBB308EBA7FEDA365]
2016-01-14 16:08:47,846 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787727668_0001_1_00 [C4471A71DA9A40ADBB308EBA7FEDA365]
2016-01-14 16:08:47,846 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787727668_0001_1_00 [C4471A71DA9A40ADBB308EBA7FEDA365]
2016-01-14 16:08:47,847 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787727668_0001_1_00 [C4471A71DA9A40ADBB308EBA7FEDA365]. Starting root input initializers: 1
2016-01-14 16:08:47,847 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:47,847 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787727668_0001_1_00 [C4471A71DA9A40ADBB308EBA7FEDA365] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:47,850 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 8E51C8210EA54CB2AFB0E4220B9F8E4F on vertex vertex_1452787727668_0001_1_00 [C4471A71DA9A40ADBB308EBA7FEDA365]
2016-01-14 16:08:47,852 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...eld'_RESULTS.0_UNKNOWN_-1, applicationId=application_1452787727668_0001, dagName=[A98EFB34FC024DC79C5CC748C83D20CC/C74347B5E1394851B5832414BBC52940] each.each/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1
2016-01-14 16:08:47,852 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:47,852 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 8E51C8210EA54CB2AFB0E4220B9F8E4F asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:47,853 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:47,853 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:47,855 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:47,855 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 8E51C8210EA54CB2AFB0E4220B9F8E4F on vertex vertex_1452787727668_0001_1_00 [C4471A71DA9A40ADBB308EBA7FEDA365]
2016-01-14 16:08:47,856 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787727668_0001_1_00 [C4471A71DA9A40ADBB308EBA7FEDA365] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:47,856 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {8E51C8210EA54CB2AFB0E4220B9F8E4F=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:47,856 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787727668_0001_1_00 [C4471A71DA9A40ADBB308EBA7FEDA365] parallelism set to 1
2016-01-14 16:08:47,856 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787727668_0001_1_00 [C4471A71DA9A40ADBB308EBA7FEDA365] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:47,857 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727668_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787727668_0001_1_00, eventCount=1
2016-01-14 16:08:47,857 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787727668_0001_1_00 [C4471A71DA9A40ADBB308EBA7FEDA365]
2016-01-14 16:08:47,857 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=0C6C3855FE9945959B25FE25FB936A67, vertexId=vertex_1452787727668_0001_1_00 [C4471A71DA9A40ADBB308EBA7FEDA365], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:47,857 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=0C6C3855FE9945959B25FE25FB936A67, vertexId=vertex_1452787727668_0001_1_00 [C4471A71DA9A40ADBB308EBA7FEDA365]
2016-01-14 16:08:47,859 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=0C6C3855FE9945959B25FE25FB936A67, vertexName=C4471A71DA9A40ADBB308EBA7FEDA365, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:47,859 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=0C6C3855FE9945959B25FE25FB936A67, vertexId=vertex_1452787727668_0001_1_00 [C4471A71DA9A40ADBB308EBA7FEDA365]
2016-01-14 16:08:47,861 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727668_0001_1][Event:VERTEX_INITIALIZED]: vertexName=C4471A71DA9A40ADBB308EBA7FEDA365, vertexId=vertex_1452787727668_0001_1_00, initRequestedTime=1452787727846, initedTime=1452787727860, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:47,861 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787727668_0001_1_00 [C4471A71DA9A40ADBB308EBA7FEDA365] with distanceFromRoot: 0
2016-01-14 16:08:47,861 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:47,862 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787727668_0001_1_00 [C4471A71DA9A40ADBB308EBA7FEDA365] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:47,862 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in C4471A71DA9A40ADBB308EBA7FEDA365
2016-01-14 16:08:47,862 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787727668_0001_1_00 [C4471A71DA9A40ADBB308EBA7FEDA365]
2016-01-14 16:08:47,863 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727668_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787727668_0001_1_00, startRequestedTime=1452787727862, startedTime=1452787727862
2016-01-14 16:08:47,863 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:47,863 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787727668_0001_1_00 [C4471A71DA9A40ADBB308EBA7FEDA365] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:47,864 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:47,864 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727668_0001_1][Event:TASK_STARTED]: vertexName=C4471A71DA9A40ADBB308EBA7FEDA365, taskId=task_1452787727668_0001_1_00_000000, scheduledTime=1452787727864, launchTime=1452787727864
2016-01-14 16:08:47,865 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787727668_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:47,865 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787727668_0001_1_00 [C4471A71DA9A40ADBB308EBA7FEDA365]
2016-01-14 16:08:47,865 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [A98EFB34FC024DC79C5CC748C83D20CC/C74347B5E1394851B5832414BBC52940] each.each/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1, VertexName: C4471A71DA9A40ADBB308EBA7FEDA365, VertexParallelism: 1, TaskAttemptID:attempt_1452787727668_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8E51C8210EA54CB2AFB0E4220B9F8E4F, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=0C6C3855FE9945959B25FE25FB936A67, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:47,866 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787727668_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:47,866 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:47,867 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:47,868 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:47,868 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:47,868 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787727668_0001_00_000001
2016-01-14 16:08:47,868 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787727668_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:47,870 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787727668_0001_00_000001
2016-01-14 16:08:47,870 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:47,871 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787727668_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:47,871 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:47,872 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787727668_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787727668_0001_00_000001, launchTime=1452787727871
2016-01-14 16:08:47,873 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787727668_0001_00_000001
2016-01-14 16:08:47,873 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigne