Class cascading.cascade.RiffleCascadePlatformTest

7

tests

0

failures

0

ignored

7.644s

duration

100%

successful

Tests

Test Duration Result
testProcessFlowFlowListenerExceptionHandlingInComplete 0.004s passed
testProcessFlowFlowListenerExceptionHandlingInStart 0.004s passed
testProcessFlowFlowListenerExceptionHandlingInStop 0.017s passed
testProcessFlowWithChildCounters 0.863s passed
testProcessFlowWithCounters 0.006s passed
testSimpleRiffle 4.540s passed
testSimpleRiffleCascade 2.210s passed

Standard output

2016-05-17 22:22:40,144 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(197)) - found 1 test platforms from classpath
2016-05-17 22:22:40,175 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(246)) - adding test: cascading.cascade.RiffleCascadePlatformTest, with platform: hadoop2-tez
2016-05-17 22:22:40,209 INFO  tez.Hadoop2TezPlatform (Hadoop2TezPlatform.java:setUp(136)) - not using cluster
2016-05-17 22:22:40,587 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-05-17 22:22:40,932 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(75)) - platform property overrides: 
2016-05-17 22:22:41,002 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 0AEA692B78FC4653959C079FFA259900
2016-05-17 22:22:41,068 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testProcessFlowWithChildCounters/children/first
2016-05-17 22:22:41,088 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testProcessFlowFlowListenerExceptionHandlingInStop/stopException/first
2016-05-17 22:22:41,236 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:22:41,237 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:22:41,508 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.074
2016-05-17 22:22:41,521 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.088
2016-05-17 22:22:41,523 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:22:41,523 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:22:41,525 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:22:41,645 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/ips.20.txt
2016-05-17 22:22:41,650 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first
2016-05-17 22:22:41,901 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:22:41,902 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:22:41,981 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.028
2016-05-17 22:22:42,002 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.049
2016-05-17 22:22:42,003 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:22:42,004 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:22:42,004 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:22:42,031 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first
2016-05-17 22:22:42,033 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second
2016-05-17 22:22:42,142 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:22:42,142 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:22:42,207 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-05-17 22:22:42,222 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.036
2016-05-17 22:22:42,223 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:22:42,224 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:22:42,224 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:22:42,244 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second
2016-05-17 22:22:42,245 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third
2016-05-17 22:22:42,326 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:22:42,326 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:22:42,384 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-05-17 22:22:42,403 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.041
2016-05-17 22:22:42,404 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:22:42,404 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:22:42,405 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:22:42,430 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third
2016-05-17 22:22:42,431 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/fourth
2016-05-17 22:22:42,525 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.1.0
2016-05-17 22:22:42,526 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] starting
2016-05-17 22:22:42,529 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first]  source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/ips.20.txt"]
2016-05-17 22:22:42,529 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first]  sink: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first"]
2016-05-17 22:22:42,529 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first]  parallel execution of steps is enabled: false
2016-05-17 22:22:42,529 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first]  executing total steps: 1
2016-05-17 22:22:42,530 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first]  allocating management threads: 1
2016-05-17 22:22:42,531 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] starting step: (1/1) ...pleRiffle/perpetual/first
2016-05-17 22:22:42,531 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [first] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:22:42,554 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] tez session mode enabled: true
2016-05-17 22:22:42,714 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:22:42,723 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:22:42,725 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-17 22:22:42,786 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/54AF7AD4866E439280F2A3ECFD5B7515/D2062DE820B5465883EFEFD5DF30F133/.tez/application_1463523762722_0001 doesn't exist and is created
2016-05-17 22:22:42,848 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:22:42,849 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:22:42,849 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/54AF7AD4866E439280F2A3ECFD5B7515/D2062DE820B5465883EFEFD5DF30F133/.tez/application_1463523762722_0001
2016-05-17 22:22:42,879 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463523762722_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:22:42,934 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:22:42,949 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: NEW
2016-05-17 22:22:42,949 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(238)) - DAGAppMaster is not started wait for 100ms...
2016-05-17 22:22:42,950 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:22:42,952 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:22:42,977 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:22:42,981 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:22:42,985 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/54AF7AD4866E439280F2A3ECFD5B7515/D2062DE820B5465883EFEFD5DF30F133/.tez/application_1463523762722_0001/localmode-log-dir
2016-05-17 22:22:42,985 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/54AF7AD4866E439280F2A3ECFD5B7515/D2062DE820B5465883EFEFD5DF30F133/.tez/application_1463523762722_0001/localmode-log-dir/history.txt.appattempt_1463523762722_0001_000000, maxErrors=10
2016-05-17 22:22:42,985 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:22:42,988 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463523762722_0001_000000, appSubmitTime=1463523762865, launchTime=1463523762878
2016-05-17 22:22:42,995 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:22:42,996 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:22:42,999 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:22:42,999 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:22:43,050 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-05-17 22:22:43,050 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-05-17 22:22:43,050 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:22:43,082 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:43602
2016-05-17 22:22:43,120 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:22:43,150 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-05-17 22:22:43,151 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-05-17 22:22:43,151 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:22:43,185 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:22:43,185 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463523762722_0001_000000, startTime=1463523763185
2016-05-17 22:22:43,185 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:22:43,251 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:22:43,266 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:22:43,267 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...pleRiffle/perpetual/first, applicationId=application_1463523762722_0001, dagName=[54AF7AD4866E439280F2A3ECFD5B7515/D2062DE820B5465883EFEFD5DF30F133] first/(1/1) ...pleRiffle/perpetual/first
2016-05-17 22:22:43,462 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [54AF7AD4866E439280F2A3ECFD5B7515/D2062DE820B5465883EFEFD5DF30F133] first/(1/1) ...pleRiffle/perpetual/first
2016-05-17 22:22:43,555 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463523762722_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/54AF7AD4866E439280F2A3ECFD5B7515/D2062DE820B5465883EFEFD5DF30F133/.tez/application_1463523762722_0001/localmode-log-dir/dag_1463523762722_0001_1.dot
2016-05-17 22:22:43,558 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/54AF7AD4866E439280F2A3ECFD5B7515/D2062DE820B5465883EFEFD5DF30F133/.tez/application_1463523762722_0001/localmode-log-dir/dag_1463523762722_0001_1-tez-dag.pb.txt
2016-05-17 22:22:43,636 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463523762722_0001_1
2016-05-17 22:22:43,636 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:43,637 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [54AF7AD4866E439280F2A3ECFD5B7515/D2062DE820B5465883EFEFD5DF30F133] first/(1/1) ...pleRiffle/perpetual/first
2016-05-17 22:22:43 Running Dag: dag_1463523762722_0001_1
2016-05-17 22:22:43,667 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:22:43,667 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523762722_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463523762722_0001_1, submitTime=1463523763462
2016-05-17 22:22:43,695 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex B2265D3995B74E2EAA695BE2A609B6A1
2016-05-17 22:22:43,697 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:22:43,699 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:22:43,699 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523762722_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463523762722_0001_1, initTime=1463523763668
2016-05-17 22:22:43,700 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523762722_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:22:43,703 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:22:43,703 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523762722_0001_1][Event:DAG_STARTED]: dagID=dag_1463523762722_0001_1, startTime=1463523763702
2016-05-17 22:22:43,703 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:22:43,705 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523762722_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:22:43,705 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: B2265D3995B74E2EAA695BE2A609B6A1 : {E9E7D45439FB4C84806EA57C87F85962={InputName=E9E7D45439FB4C84806EA57C87F85962}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:22:43,706 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: E9E7D45439FB4C84806EA57C87F85962, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:22:43,706 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1]
2016-05-17 22:22:43,714 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1]
2016-05-17 22:22:43,714 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...pleRiffle/perpetual/first, applicationId=application_1463523762722_0001, dagName=[54AF7AD4866E439280F2A3ECFD5B7515/D2062DE820B5465883EFEFD5DF30F133] first/(1/1) ...pleRiffle/perpetual/first
2016-05-17 22:22:43,715 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1]
2016-05-17 22:22:43,717 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1]. Starting root input initializers: 1
2016-05-17 22:22:43,728 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: E9E7D45439FB4C84806EA57C87F85962 on vertex vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1]
2016-05-17 22:22:43,744 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:22:43,745 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:22:43,748 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input E9E7D45439FB4C84806EA57C87F85962 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:22:43,750 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:22:43,750 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:22:43,758 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] submitted tez dag to app master: application_1463523762722_0001, with dag id: dag_1463523762722_0001_1
2016-05-17 22:22:43,801 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 402
2016-05-17 22:22:43,804 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: E9E7D45439FB4C84806EA57C87F85962 on vertex vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1]
2016-05-17 22:22:43,805 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:22:43,805 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {E9E7D45439FB4C84806EA57C87F85962=forAllWorkUnits=true, update=[1]}
2016-05-17 22:22:43,823 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1] parallelism set to 1
2016-05-17 22:22:43,823 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:22:43,835 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523762722_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463523762722_0001_1_00, eventCount=1
2016-05-17 22:22:43,839 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1]
2016-05-17 22:22:43,839 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=6CF5571F44E049AF8822B424B2AC2BCB, vertexId=vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:22:43,843 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=6CF5571F44E049AF8822B424B2AC2BCB, vertexId=vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1]
2016-05-17 22:22:43,856 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=6CF5571F44E049AF8822B424B2AC2BCB, vertexName=B2265D3995B74E2EAA695BE2A609B6A1, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:22:43,868 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=6CF5571F44E049AF8822B424B2AC2BCB, vertexId=vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1]
2016-05-17 22:22:43,874 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:22:43,875 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523762722_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B2265D3995B74E2EAA695BE2A609B6A1, vertexId=vertex_1463523762722_0001_1_00, initRequestedTime=1463523763705, initedTime=1463523763870, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:22:43,875 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1] with distanceFromRoot: 0
2016-05-17 22:22:43,876 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:22:43,877 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in B2265D3995B74E2EAA695BE2A609B6A1
2016-05-17 22:22:43,878 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1]
2016-05-17 22:22:43,879 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:22:43,880 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523762722_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463523762722_0001_1_00, startRequestedTime=1463523763877, startedTime=1463523763877
2016-05-17 22:22:43,881 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:22:43,912 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:22:43,913 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523762722_0001_1][Event:TASK_STARTED]: vertexName=B2265D3995B74E2EAA695BE2A609B6A1, taskId=task_1463523762722_0001_1_00_000000, scheduledTime=1463523763912, launchTime=1463523763912
2016-05-17 22:22:43,913 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523762722_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:22:43,916 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1]
2016-05-17 22:22:43,919 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [54AF7AD4866E439280F2A3ECFD5B7515/D2062DE820B5465883EFEFD5DF30F133] first/(1/1) ...pleRiffle/perpetual/first, VertexName: B2265D3995B74E2EAA695BE2A609B6A1, VertexParallelism: 1, TaskAttemptID:attempt_1463523762722_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=E9E7D45439FB4C84806EA57C87F85962, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6CF5571F44E049AF8822B424B2AC2BCB, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:22:43,921 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523762722_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:22:43,921 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:22:43,963 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:22:43,966 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:22:43,967 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:22:43,971 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463523762722_0001_00_000001
2016-05-17 22:22:43,971 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523762722_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:22:43,978 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1463523762722_0001_00_000001
2016-05-17 22:22:43,978 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:22:43,982 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523762722_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:22:43,983 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:22:43,983 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523762722_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463523762722_0001_00_000001, launchTime=1463523763982
2016-05-17 22:22:43,987 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463523762722_0001_00_000001
2016-05-17 22:22:43,990 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463523762722_0001_1_00_000000_0] to container: [container_1463523762722_0001_00_000001]
2016-05-17 22:22:43,990 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523762722_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:22:43,991 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463523762722_0001_00_000001 given task: attempt_1463523762722_0001_1_00_000000_0
2016-05-17 22:22:43,993 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463523762722_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463523762722_0001_1_00_000000_0
2016-05-17 22:22:43,993 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463523762722_0001_1_00_000000_0] started. Is using containerId: [container_1463523762722_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:22:43 Starting to run new task attempt: attempt_1463523762722_0001_1_00_000000_0
2016-05-17 22:22:43,995 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463523762722_0001_1_00_000000_0
2016-05-17 22:22:43,995 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:43,997 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:22:43,998 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523762722_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B2265D3995B74E2EAA695BE2A609B6A1, taskAttemptId=attempt_1463523762722_0001_1_00_000000_0, startTime=1463523763991, containerId=container_1463523762722_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463523762722_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:22:43,998 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523762722_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:22:43,999 INFO  counters.Limits (Limits.java:ensureInitialized(59)) - Counter limits initialized with parameters:  GROUP_NAME_MAX=128, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200
2016-05-17 22:22:43,996 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:22:43,999 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:22:44,000 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:22:44,008 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:22:44,010 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523762722_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:22:44,031 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:22:44,031 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [54AF7AD4866E439280F2A3ECFD5B7515/D2062DE820B5465883EFEFD5DF30F133] first/(1/1) ...pleRiffle/perpetual/first, VertexName: B2265D3995B74E2EAA695BE2A609B6A1, VertexParallelism: 1, TaskAttemptID:attempt_1463523762722_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=E9E7D45439FB4C84806EA57C87F85962, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6CF5571F44E049AF8822B424B2AC2BCB, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:22:44,036 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:22:44,041 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463523762722_0001_1_00_000000_0
2016-05-17 22:22:44,045 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:22:44,046 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:44,050 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463523762722_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:22:44,053 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=E9E7D45439FB4C84806EA57C87F85962, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:22:44,055 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:44,055 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=6CF5571F44E049AF8822B424B2AC2BCB, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:22:44,055 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:22:44,056 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: E9E7D45439FB4C84806EA57C87F85962
2016-05-17 22:22:44,056 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:22:44,057 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 6CF5571F44E049AF8822B424B2AC2BCB
2016-05-17 22:22:44,057 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:22:44,061 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 6CF5571F44E049AF8822B424B2AC2BCB
2016-05-17 22:22:44,069 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:22:44,076 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: E9E7D45439FB4C84806EA57C87F85962
2016-05-17 22:22:44,085 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:22:44,086 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: E9E7D45439FB4C84806EA57C87F85962
2016-05-17 22:22:44,086 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: E9E7D45439FB4C84806EA57C87F85962
2016-05-17 22:22:44,093 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B2265D3995B74E2EAA695BE2A609B6A1, ordinal: 0
2016-05-17 22:22:44,094 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B2265D3995B74E2EAA695BE2A609B6A1, mem on start (mb), free: 199, total: 281, max: 672
2016-05-17 22:22:44,094 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:44,094 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:22:44,094 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:22:44,104 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:22:44,105 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 6CF5571F44E049AF8822B424B2AC2BCB
2016-05-17 22:22:44,105 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:22:44,106 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:22:44,114 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:22:44,116 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:22:44,116 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:22:44,116 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:22:44,116 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:22:44,117 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:22:44,117 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 6CF5571F44E049AF8822B424B2AC2BCB, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:22:44,117 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, E9E7D45439FB4C84806EA57C87F85962, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:22:44,117 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:22:44,119 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: E9E7D45439FB4C84806EA57C87F85962 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:22:44,119 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: E9E7D45439FB4C84806EA57C87F85962
2016-05-17 22:22:44,120 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:22:44,120 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: E9E7D45439FB4C84806EA57C87F85962
2016-05-17 22:22:44,119 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:22:44,121 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:22:44,121 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:22:44,122 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463523762722_0001_1_00_000000_0
2016-05-17 22:22:44,124 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:22:44,133 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@7126317a
2016-05-17 22:22:44,142 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@7126317a
2016-05-17 22:22:44,143 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:22:44,143 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:22:44,156 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/ips.20.txt"]
2016-05-17 22:22:44,171 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/ips.20.txt"] streamed: true, id: E9E7D45439FB4C84806EA57C87F85962
2016-05-17 22:22:44,171 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first"], id: 6CF5571F44E049AF8822B424B2AC2BCB
2016-05-17 22:22:44,172 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first"]
2016-05-17 22:22:44,174 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/ips.20.txt"]
2016-05-17 22:22:44,175 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:22:44,176 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B2265D3995B74E2EAA695BE2A609B6A1, all 1 inputs ready in: 00:00:00.001
2016-05-17 22:22:44,186 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:22:44,187 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:22:44,187 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463523762722_0001_1_00_000000_0
2016-05-17 22:22:44,188 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463523762722_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:22:44,189 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463523762722_0001_1_00_000000_0
2016-05-17 22:22:44,189 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B2265D3995B74E2EAA695BE2A609B6A1, mem on close (mb), free: 192, total: 281, max: 672
2016-05-17 22:22:44 Completed running task attempt: attempt_1463523762722_0001_1_00_000000_0
2016-05-17 22:22:44,200 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463523762722_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:22:44,203 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:22:44,215 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523762722_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B2265D3995B74E2EAA695BE2A609B6A1, taskAttemptId=attempt_1463523762722_0001_1_00_000000_0, startTime=1463523763991, finishTime=1463523764201, timeTaken=210, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=413, FILE_BYTES_WRITTEN=807, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523764177, Process_Duration=12, Process_End_Time=1463523764189, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:44,216 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523762722_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:22:44,216 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:22:44,221 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=413, FILE_BYTES_WRITTEN=807, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1463523764177, Process_Duration=12, Process_End_Time=1463523764189, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-05-17 22:22:44,222 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-05-17 22:22:44,222 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:44,223 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463523762722_0001_00_000001
2016-05-17 22:22:44,224 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463523762722_0001_1_00_000000_0
2016-05-17 22:22:44,228 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:22:44,230 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523762722_0001_1][Event:TASK_FINISHED]: vertexName=B2265D3995B74E2EAA695BE2A609B6A1, taskId=task_1463523762722_0001_1_00_000000, startTime=1463523763991, finishTime=1463523764226, timeTaken=235, status=SUCCEEDED, successfulAttemptID=attempt_1463523762722_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=413, FILE_BYTES_WRITTEN=807, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523764177, Process_Duration=12, Process_End_Time=1463523764189, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:44,235 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523762722_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:22:44,236 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523762722_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:22:44,237 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:22:44,238 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523762722_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463523762722_0001_00_000001, stoppedTime=1463523764237, exitStatus=0
2016-05-17 22:22:44,239 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523762722_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:22:44,239 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1] : 1
2016-05-17 22:22:44,240 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1]
2016-05-17 22:22:44,246 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:22:44,249 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523762722_0001_1][Event:VERTEX_FINISHED]: vertexName=B2265D3995B74E2EAA695BE2A609B6A1, vertexId=vertex_1463523762722_0001_1_00, initRequestedTime=1463523763705, initedTime=1463523763870, startRequestedTime=1463523763877, startedTime=1463523763877, finishTime=1463523764240, timeTaken=363, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=413, FILE_BYTES_WRITTEN=807, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523764177, Process_Duration=12, Process_End_Time=1463523764189, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1463523763991, firstTasksToStart=[ task_1463523762722_0001_1_00_000000 ], lastTaskFinishTime=1463523764201, lastTasksToFinish=[ task_1463523762722_0001_1_00_000000 ], minTaskDuration=210, maxTaskDuration=210, avgTaskDuration=210.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463523762722_0001_1_00_000000 ], longestDurationTasks=[ task_1463523762722_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:22:44,250 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:22:44,251 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1463523762722_0001_00_000001. Relying on regular task shutdown for it to end
2016-05-17 22:22:44,251 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:22:44,253 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463523762722_0001_1
2016-05-17 22:22:44,255 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463523762722_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:22:44,255 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463523762722_0001_00_000001: 30 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:22:44,255 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463523762722_0001_00_000001, Exiting
2016-05-17 22:22:44,255 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463523762722_0001_00_000001
2016-05-17 22:22:44,256 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463523762722_0001_00_000001
2016-05-17 22:22:44,259 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463523762722_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:22:44,260 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463523762722_0001_00_000001 completed successfully
2016-05-17 22:22:44,261 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523762722_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463523762722_0001_1
2016-05-17 22:22:44,262 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 6CF5571F44E049AF8822B424B2AC2BCB for vertex: vertex_1463523762722_0001_1_00 [B2265D3995B74E2EAA695BE2A609B6A1]
2016-05-17 22:22:44,281 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463523762722_0001_1, queueSize=0
2016-05-17 22:22:44,282 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:22:44,283 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523762722_0001_1][Event:DAG_FINISHED]: dagId=dag_1463523762722_0001_1, startTime=1463523763702, finishTime=1463523764275, timeTaken=573, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=413, FILE_BYTES_WRITTEN=807, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523764177, Process_Duration=12, Process_End_Time=1463523764189, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:44,284 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463523762722_0001_1 finished with state: SUCCEEDED
2016-05-17 22:22:44,285 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523762722_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:22:44,286 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523762722_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-05-17 22:22:44,286 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523762722_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-05-17 22:22:44 Completed Dag: dag_1463523762722_0001_1
2016-05-17 22:22:44,291 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463523762722_0001_1, dagState=SUCCEEDED
2016-05-17 22:22:44,291 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463523762722_0001_1_post
2016-05-17 22:22:44,291 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:44,292 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:22:44,298 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...pleRiffle/perpetual/first, applicationId=application_1463523762722_0001
2016-05-17 22:22:44,302 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:22:44,302 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:22:44,302 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:22:44,302 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:22:44,302 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:22:44,303 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:22:44,305 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:22:44,306 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:22:44,306 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:22:44,306 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:22:44,307 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:22:44,308 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:22:44,308 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:22:44,313 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/54AF7AD4866E439280F2A3ECFD5B7515/D2062DE820B5465883EFEFD5DF30F133/.tez/application_1463523762722_0001
2016-05-17 22:22:44,314 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first/_temporary
2016-05-17 22:22:44,315 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first]  completed in: 00:01.787
2016-05-17 22:22:44,317 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] starting
2016-05-17 22:22:44,318 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second]  source: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first"]
2016-05-17 22:22:44,318 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second"]
2016-05-17 22:22:44,318 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second]  parallel execution of steps is enabled: false
2016-05-17 22:22:44,318 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second]  executing total steps: 1
2016-05-17 22:22:44,319 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second]  allocating management threads: 1
2016-05-17 22:22:44,319 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] starting step: (1/1) ...leRiffle/perpetual/second
2016-05-17 22:22:44,319 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [second] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:22:44,337 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] tez session mode enabled: true
2016-05-17 22:22:44,342 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:22:44,343 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:22:44,343 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-17 22:22:44,354 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/F59A78B15D7444E09E018E685513D777/CF7750C255204BD19440238A5D78A820/.tez/application_1463523764342_0001 doesn't exist and is created
2016-05-17 22:22:44,378 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:22:44,378 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:22:44,380 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/F59A78B15D7444E09E018E685513D777/CF7750C255204BD19440238A5D78A820/.tez/application_1463523764342_0001
2016-05-17 22:22:44,386 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463523764342_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:22:44,405 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:22:44,407 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:22:44,410 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:22:44,410 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:22:44,411 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/F59A78B15D7444E09E018E685513D777/CF7750C255204BD19440238A5D78A820/.tez/application_1463523764342_0001/localmode-log-dir
2016-05-17 22:22:44,411 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/F59A78B15D7444E09E018E685513D777/CF7750C255204BD19440238A5D78A820/.tez/application_1463523764342_0001/localmode-log-dir/history.txt.appattempt_1463523764342_0001_000000, maxErrors=10
2016-05-17 22:22:44,412 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:22:44,412 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463523764342_0001_000000, appSubmitTime=1463523764385, launchTime=1463523764386
2016-05-17 22:22:44,417 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:22:44,421 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:22:44,424 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:53934
2016-05-17 22:22:44,426 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:22:44,426 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:22:44,431 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:22:44,435 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:22:44,435 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463523764342_0001_000000, startTime=1463523764435
2016-05-17 22:22:44,435 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:22:44,478 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:22:44,478 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:22:44,478 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...leRiffle/perpetual/second, applicationId=application_1463523764342_0001, dagName=[F59A78B15D7444E09E018E685513D777/CF7750C255204BD19440238A5D78A820] second/(1/1) ...leRiffle/perpetual/second
2016-05-17 22:22:44,503 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [F59A78B15D7444E09E018E685513D777/CF7750C255204BD19440238A5D78A820] second/(1/1) ...leRiffle/perpetual/second
2016-05-17 22:22:44,505 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463523764342_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/F59A78B15D7444E09E018E685513D777/CF7750C255204BD19440238A5D78A820/.tez/application_1463523764342_0001/localmode-log-dir/dag_1463523764342_0001_1.dot
2016-05-17 22:22:44,506 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/F59A78B15D7444E09E018E685513D777/CF7750C255204BD19440238A5D78A820/.tez/application_1463523764342_0001/localmode-log-dir/dag_1463523764342_0001_1-tez-dag.pb.txt
2016-05-17 22:22:44,535 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463523764342_0001_1
2016-05-17 22:22:44,536 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:44,536 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [F59A78B15D7444E09E018E685513D777/CF7750C255204BD19440238A5D78A820] second/(1/1) ...leRiffle/perpetual/second
2016-05-17 22:22:44 Running Dag: dag_1463523764342_0001_1
2016-05-17 22:22:44,553 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:22:44,553 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764342_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463523764342_0001_1, submitTime=1463523764503
2016-05-17 22:22:44,556 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E862B3E371C949368F96113CF66B3336
2016-05-17 22:22:44,556 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:22:44,556 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:22:44,556 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764342_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463523764342_0001_1, initTime=1463523764555
2016-05-17 22:22:44,558 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523764342_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:22:44,559 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764342_0001_1][Event:DAG_STARTED]: dagID=dag_1463523764342_0001_1, startTime=1463523764558
2016-05-17 22:22:44,559 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:22:44,559 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523764342_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:22:44,559 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E862B3E371C949368F96113CF66B3336 : {6CF5571F44E049AF8822B424B2AC2BCB={InputName=6CF5571F44E049AF8822B424B2AC2BCB}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:22:44,559 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 6CF5571F44E049AF8822B424B2AC2BCB, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:22:44,560 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336]
2016-05-17 22:22:44,560 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336]
2016-05-17 22:22:44,560 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336]
2016-05-17 22:22:44,560 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336]. Starting root input initializers: 1
2016-05-17 22:22:44,561 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...leRiffle/perpetual/second, applicationId=application_1463523764342_0001, dagName=[F59A78B15D7444E09E018E685513D777/CF7750C255204BD19440238A5D78A820] second/(1/1) ...leRiffle/perpetual/second
2016-05-17 22:22:44,561 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:22:44,562 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:22:44,563 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 6CF5571F44E049AF8822B424B2AC2BCB on vertex vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336]
2016-05-17 22:22:44,568 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:22:44,569 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 6CF5571F44E049AF8822B424B2AC2BCB asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:22:44,573 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:22:44,573 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:22:44,591 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] submitted tez dag to app master: application_1463523764342_0001, with dag id: dag_1463523764342_0001_1
2016-05-17 22:22:44,597 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 546
2016-05-17 22:22:44,598 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 6CF5571F44E049AF8822B424B2AC2BCB on vertex vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336]
2016-05-17 22:22:44,598 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:22:44,598 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {6CF5571F44E049AF8822B424B2AC2BCB=forAllWorkUnits=true, update=[1]}
2016-05-17 22:22:44,599 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336] parallelism set to 1
2016-05-17 22:22:44,599 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:22:44,600 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764342_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463523764342_0001_1_00, eventCount=1
2016-05-17 22:22:44,600 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336]
2016-05-17 22:22:44,600 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=60116B294BCA45518241B219E9FFC0B1, vertexId=vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:22:44,601 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=60116B294BCA45518241B219E9FFC0B1, vertexId=vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336]
2016-05-17 22:22:44,634 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=60116B294BCA45518241B219E9FFC0B1, vertexName=E862B3E371C949368F96113CF66B3336, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:22:44,639 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=60116B294BCA45518241B219E9FFC0B1, vertexId=vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336]
2016-05-17 22:22:44,642 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:22:44,642 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764342_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E862B3E371C949368F96113CF66B3336, vertexId=vertex_1463523764342_0001_1_00, initRequestedTime=1463523764559, initedTime=1463523764641, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:22:44,643 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336] with distanceFromRoot: 0
2016-05-17 22:22:44,643 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:22:44,643 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E862B3E371C949368F96113CF66B3336
2016-05-17 22:22:44,643 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336]
2016-05-17 22:22:44,645 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:22:44,646 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764342_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463523764342_0001_1_00, startRequestedTime=1463523764643, startedTime=1463523764643
2016-05-17 22:22:44,647 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:22:44,649 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:22:44,649 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764342_0001_1][Event:TASK_STARTED]: vertexName=E862B3E371C949368F96113CF66B3336, taskId=task_1463523764342_0001_1_00_000000, scheduledTime=1463523764648, launchTime=1463523764648
2016-05-17 22:22:44,650 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523764342_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:22:44,650 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336]
2016-05-17 22:22:44,652 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [F59A78B15D7444E09E018E685513D777/CF7750C255204BD19440238A5D78A820] second/(1/1) ...leRiffle/perpetual/second, VertexName: E862B3E371C949368F96113CF66B3336, VertexParallelism: 1, TaskAttemptID:attempt_1463523764342_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=6CF5571F44E049AF8822B424B2AC2BCB, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=60116B294BCA45518241B219E9FFC0B1, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:22:44,653 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523764342_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:22:44,653 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:22:44,654 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:22:44,655 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:22:44,656 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:22:44,656 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463523764342_0001_00_000001
2016-05-17 22:22:44,657 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523764342_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:22:44,661 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1463523764342_0001_00_000001
2016-05-17 22:22:44,661 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:22:44,662 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523764342_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:22:44,662 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:22:44,662 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764342_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463523764342_0001_00_000001, launchTime=1463523764661
2016-05-17 22:22:44,662 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463523764342_0001_00_000001
2016-05-17 22:22:44,663 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463523764342_0001_1_00_000000_0] to container: [container_1463523764342_0001_00_000001]
2016-05-17 22:22:44,663 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523764342_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:22:44,664 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463523764342_0001_1_00_000000_0] started. Is using containerId: [container_1463523764342_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:22:44,664 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764342_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E862B3E371C949368F96113CF66B3336, taskAttemptId=attempt_1463523764342_0001_1_00_000000_0, startTime=1463523764664, containerId=container_1463523764342_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463523764342_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:22:44,665 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523764342_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:22:44,665 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523764342_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:22:44,665 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:22:44,666 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463523764342_0001_00_000001 given task: attempt_1463523764342_0001_1_00_000000_0
2016-05-17 22:22:44,667 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463523764342_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463523764342_0001_1_00_000000_0
2016-05-17 22:22:44 Starting to run new task attempt: attempt_1463523764342_0001_1_00_000000_0
2016-05-17 22:22:44,668 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463523764342_0001_1_00_000000_0
2016-05-17 22:22:44,668 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:44,668 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:22:44,669 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:22:44,669 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:22:44,669 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:22:44,669 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:22:44,670 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [F59A78B15D7444E09E018E685513D777/CF7750C255204BD19440238A5D78A820] second/(1/1) ...leRiffle/perpetual/second, VertexName: E862B3E371C949368F96113CF66B3336, VertexParallelism: 1, TaskAttemptID:attempt_1463523764342_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=6CF5571F44E049AF8822B424B2AC2BCB, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=60116B294BCA45518241B219E9FFC0B1, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:22:44,670 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:22:44,671 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463523764342_0001_1_00_000000_0
2016-05-17 22:22:44,672 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:22:44,672 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463523764342_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:22:44,672 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:44,674 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=6CF5571F44E049AF8822B424B2AC2BCB, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:22:44,674 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:22:44,675 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 6CF5571F44E049AF8822B424B2AC2BCB
2016-05-17 22:22:44,675 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=60116B294BCA45518241B219E9FFC0B1, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:22:44,675 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 6CF5571F44E049AF8822B424B2AC2BCB
2016-05-17 22:22:44,675 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:44,682 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:22:44,682 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 60116B294BCA45518241B219E9FFC0B1
2016-05-17 22:22:44,683 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:22:44,682 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:22:44,686 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:22:44,687 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 6CF5571F44E049AF8822B424B2AC2BCB
2016-05-17 22:22:44,687 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 6CF5571F44E049AF8822B424B2AC2BCB
2016-05-17 22:22:44,686 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 60116B294BCA45518241B219E9FFC0B1
2016-05-17 22:22:44,700 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:22:44,700 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 60116B294BCA45518241B219E9FFC0B1
2016-05-17 22:22:44,701 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E862B3E371C949368F96113CF66B3336, ordinal: 0
2016-05-17 22:22:44,701 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E862B3E371C949368F96113CF66B3336, mem on start (mb), free: 363, total: 397, max: 672
2016-05-17 22:22:44,702 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:44,702 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:22:44,702 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:22:44,702 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:22:44,703 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:22:44,703 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:22:44,704 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:22:44,704 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:22:44,704 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:22:44,704 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:22:44,704 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:22:44,705 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 6CF5571F44E049AF8822B424B2AC2BCB, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:22:44,705 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 60116B294BCA45518241B219E9FFC0B1, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:22:44,705 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:22:44,705 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 6CF5571F44E049AF8822B424B2AC2BCB being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:22:44,705 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 6CF5571F44E049AF8822B424B2AC2BCB
2016-05-17 22:22:44,705 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:22:44,707 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 6CF5571F44E049AF8822B424B2AC2BCB
2016-05-17 22:22:44,705 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:22:44,707 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:22:44,707 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:22:44,708 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463523764342_0001_1_00_000000_0
2016-05-17 22:22:44,710 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:22:44,711 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@7bd3c61b
2016-05-17 22:22:44,713 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@7bd3c61b
2016-05-17 22:22:44,713 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:22:44,713 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:22:44,714 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first"]
2016-05-17 22:22:44,715 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first"] streamed: true, id: 6CF5571F44E049AF8822B424B2AC2BCB
2016-05-17 22:22:44,715 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second"], id: 60116B294BCA45518241B219E9FFC0B1
2016-05-17 22:22:44,716 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second"]
2016-05-17 22:22:44,716 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first"]
2016-05-17 22:22:44,716 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:22:44,717 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E862B3E371C949368F96113CF66B3336, all 1 inputs ready in: 00:00:00.000
2016-05-17 22:22:44,723 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:22:44,723 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:22:44,724 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463523764342_0001_1_00_000000_0
2016-05-17 22:22:44,724 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463523764342_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:22:44,725 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463523764342_0001_1_00_000000_0
2016-05-17 22:22:44,726 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E862B3E371C949368F96113CF66B3336, mem on close (mb), free: 361, total: 397, max: 672
2016-05-17 22:22:44 Completed running task attempt: attempt_1463523764342_0001_1_00_000000_0
2016-05-17 22:22:44,727 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463523764342_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:22:44,728 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1463523764717, Process_Duration=8, Process_End_Time=1463523764725, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-05-17 22:22:44,731 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-05-17 22:22:44,731 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:44,730 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:22:44,731 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764342_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E862B3E371C949368F96113CF66B3336, taskAttemptId=attempt_1463523764342_0001_1_00_000000_0, startTime=1463523764664, finishTime=1463523764728, timeTaken=64, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523764717, Process_Duration=8, Process_End_Time=1463523764725, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:44,733 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523764342_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:22:44,732 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463523764342_0001_00_000001
2016-05-17 22:22:44,733 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:22:44,733 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463523764342_0001_1_00_000000_0
2016-05-17 22:22:44,736 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:22:44,736 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764342_0001_1][Event:TASK_FINISHED]: vertexName=E862B3E371C949368F96113CF66B3336, taskId=task_1463523764342_0001_1_00_000000, startTime=1463523764664, finishTime=1463523764735, timeTaken=71, status=SUCCEEDED, successfulAttemptID=attempt_1463523764342_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523764717, Process_Duration=8, Process_End_Time=1463523764725, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:44,736 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523764342_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:22:44,737 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336] : 1
2016-05-17 22:22:44,737 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336]
2016-05-17 22:22:44,739 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:22:44,739 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764342_0001_1][Event:VERTEX_FINISHED]: vertexName=E862B3E371C949368F96113CF66B3336, vertexId=vertex_1463523764342_0001_1_00, initRequestedTime=1463523764559, initedTime=1463523764641, startRequestedTime=1463523764643, startedTime=1463523764643, finishTime=1463523764737, timeTaken=94, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523764717, Process_Duration=8, Process_End_Time=1463523764725, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1463523764664, firstTasksToStart=[ task_1463523764342_0001_1_00_000000 ], lastTaskFinishTime=1463523764728, lastTasksToFinish=[ task_1463523764342_0001_1_00_000000 ], minTaskDuration=64, maxTaskDuration=64, avgTaskDuration=64.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463523764342_0001_1_00_000000 ], longestDurationTasks=[ task_1463523764342_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:22:44,740 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:22:44,740 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523764342_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:22:44,740 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764342_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463523764342_0001_00_000001, stoppedTime=1463523764740, exitStatus=0
2016-05-17 22:22:44,740 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523764342_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:22:44,741 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:22:44,741 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:22:44,741 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463523764342_0001_1
2016-05-17 22:22:44,743 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764342_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463523764342_0001_1
2016-05-17 22:22:44,743 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 60116B294BCA45518241B219E9FFC0B1 for vertex: vertex_1463523764342_0001_1_00 [E862B3E371C949368F96113CF66B3336]
2016-05-17 22:22:44,746 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463523764342_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:22:44,746 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463523764342_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:22:44,747 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463523764342_0001_00_000001, Exiting
2016-05-17 22:22:44,747 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463523764342_0001_00_000001
2016-05-17 22:22:44,747 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463523764342_0001_00_000001
2016-05-17 22:22:44,750 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463523764342_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:22:44,750 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463523764342_0001_00_000001 completed successfully
2016-05-17 22:22:44,758 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463523764342_0001_1, queueSize=0
2016-05-17 22:22:44,758 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:22:44,758 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764342_0001_1][Event:DAG_FINISHED]: dagId=dag_1463523764342_0001_1, startTime=1463523764558, finishTime=1463523764756, timeTaken=198, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523764717, Process_Duration=8, Process_End_Time=1463523764725, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:44,760 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463523764342_0001_1 finished with state: SUCCEEDED
2016-05-17 22:22:44,760 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523764342_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:22:44,761 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523764342_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:22:44,761 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463523764342_0001_00_000001
2016-05-17 22:22:44 Completed Dag: dag_1463523764342_0001_1
2016-05-17 22:22:44,763 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463523764342_0001_1, dagState=SUCCEEDED
2016-05-17 22:22:44,764 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463523764342_0001_1_post
2016-05-17 22:22:44,764 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:44,765 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:22:44,768 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...leRiffle/perpetual/second, applicationId=application_1463523764342_0001
2016-05-17 22:22:44,771 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:22:44,771 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:22:44,771 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:22:44,771 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:22:44,771 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:22:44,772 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:22:44,773 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:22:44,773 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:22:44,773 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:22:44,774 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:22:44,774 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:22:44,775 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:22:44,775 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:22:44,782 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/F59A78B15D7444E09E018E685513D777/CF7750C255204BD19440238A5D78A820/.tez/application_1463523764342_0001
2016-05-17 22:22:44,785 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second/_temporary
2016-05-17 22:22:44,786 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second]  completed in: 00:00.468
2016-05-17 22:22:44,788 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] starting
2016-05-17 22:22:44,789 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second"]
2016-05-17 22:22:44,789 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third]  sink: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third"]
2016-05-17 22:22:44,789 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third]  parallel execution of steps is enabled: false
2016-05-17 22:22:44,790 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third]  executing total steps: 1
2016-05-17 22:22:44,790 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third]  allocating management threads: 1
2016-05-17 22:22:44,790 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] starting step: (1/1) ...pleRiffle/perpetual/third
2016-05-17 22:22:44,791 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [third] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:22:44,807 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] tez session mode enabled: true
2016-05-17 22:22:44,813 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:22:44,813 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:22:44,813 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-17 22:22:44,824 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/14AB3D213925478A9A08BB2007DA53E2/E85D5B9F924C4B76B5A539D83E07E571/.tez/application_1463523764813_0001 doesn't exist and is created
2016-05-17 22:22:44,843 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:22:44,844 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:22:44,845 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/14AB3D213925478A9A08BB2007DA53E2/E85D5B9F924C4B76B5A539D83E07E571/.tez/application_1463523764813_0001
2016-05-17 22:22:44,849 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463523764813_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:22:44,861 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:22:44,862 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:22:44,865 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:22:44,866 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:22:44,866 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/14AB3D213925478A9A08BB2007DA53E2/E85D5B9F924C4B76B5A539D83E07E571/.tez/application_1463523764813_0001/localmode-log-dir
2016-05-17 22:22:44,867 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/14AB3D213925478A9A08BB2007DA53E2/E85D5B9F924C4B76B5A539D83E07E571/.tez/application_1463523764813_0001/localmode-log-dir/history.txt.appattempt_1463523764813_0001_000000, maxErrors=10
2016-05-17 22:22:44,867 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:22:44,868 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463523764813_0001_000000, appSubmitTime=1463523764848, launchTime=1463523764848
2016-05-17 22:22:44,874 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:22:44,877 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:22:44,878 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:22:44,878 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:22:44,879 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:38306
2016-05-17 22:22:44,882 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:22:44,885 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:22:44,885 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463523764813_0001_000000, startTime=1463523764885
2016-05-17 22:22:44,885 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:22:44,944 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:22:44,945 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:22:44,945 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...pleRiffle/perpetual/third, applicationId=application_1463523764813_0001, dagName=[14AB3D213925478A9A08BB2007DA53E2/E85D5B9F924C4B76B5A539D83E07E571] third/(1/1) ...pleRiffle/perpetual/third
2016-05-17 22:22:44,963 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [14AB3D213925478A9A08BB2007DA53E2/E85D5B9F924C4B76B5A539D83E07E571] third/(1/1) ...pleRiffle/perpetual/third
2016-05-17 22:22:44,965 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463523764813_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/14AB3D213925478A9A08BB2007DA53E2/E85D5B9F924C4B76B5A539D83E07E571/.tez/application_1463523764813_0001/localmode-log-dir/dag_1463523764813_0001_1.dot
2016-05-17 22:22:44,966 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/14AB3D213925478A9A08BB2007DA53E2/E85D5B9F924C4B76B5A539D83E07E571/.tez/application_1463523764813_0001/localmode-log-dir/dag_1463523764813_0001_1-tez-dag.pb.txt
2016-05-17 22:22:44,989 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463523764813_0001_1
2016-05-17 22:22:44,989 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:44,989 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [14AB3D213925478A9A08BB2007DA53E2/E85D5B9F924C4B76B5A539D83E07E571] third/(1/1) ...pleRiffle/perpetual/third
2016-05-17 22:22:44 Running Dag: dag_1463523764813_0001_1
2016-05-17 22:22:45,003 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764813_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463523764813_0001_1, submitTime=1463523764963
2016-05-17 22:22:45,003 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:22:45,004 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex FA1252DC201848F99F075196BB2E120B
2016-05-17 22:22:45,004 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:22:45,004 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:22:45,004 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764813_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463523764813_0001_1, initTime=1463523765003
2016-05-17 22:22:45,006 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523764813_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:22:45,006 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764813_0001_1][Event:DAG_STARTED]: dagID=dag_1463523764813_0001_1, startTime=1463523765006
2016-05-17 22:22:45,006 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:22:45,006 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:22:45,007 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...pleRiffle/perpetual/third, applicationId=application_1463523764813_0001, dagName=[14AB3D213925478A9A08BB2007DA53E2/E85D5B9F924C4B76B5A539D83E07E571] third/(1/1) ...pleRiffle/perpetual/third
2016-05-17 22:22:45,007 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523764813_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:22:45,008 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: FA1252DC201848F99F075196BB2E120B : {60116B294BCA45518241B219E9FFC0B1={InputName=60116B294BCA45518241B219E9FFC0B1}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:22:45,008 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 60116B294BCA45518241B219E9FFC0B1, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:22:45,008 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B]
2016-05-17 22:22:45,008 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B]
2016-05-17 22:22:45,009 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B]
2016-05-17 22:22:45,009 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B]. Starting root input initializers: 1
2016-05-17 22:22:45,010 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:22:45,011 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 60116B294BCA45518241B219E9FFC0B1 on vertex vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B]
2016-05-17 22:22:45,012 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:22:45,013 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 60116B294BCA45518241B219E9FFC0B1 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:22:45,014 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:22:45,014 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:22:45,027 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 548
2016-05-17 22:22:45,028 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 60116B294BCA45518241B219E9FFC0B1 on vertex vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B]
2016-05-17 22:22:45,028 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:22:45,028 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {60116B294BCA45518241B219E9FFC0B1=forAllWorkUnits=true, update=[1]}
2016-05-17 22:22:45,029 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] submitted tez dag to app master: application_1463523764813_0001, with dag id: dag_1463523764813_0001_1
2016-05-17 22:22:45,029 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B] parallelism set to 1
2016-05-17 22:22:45,029 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:22:45,030 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764813_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463523764813_0001_1_00, eventCount=1
2016-05-17 22:22:45,030 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B]
2016-05-17 22:22:45,031 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=2DC065473E344E00B90730F3C188EC17, vertexId=vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:22:45,031 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=2DC065473E344E00B90730F3C188EC17, vertexId=vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B]
2016-05-17 22:22:45,033 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=2DC065473E344E00B90730F3C188EC17, vertexName=FA1252DC201848F99F075196BB2E120B, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:22:45,033 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=2DC065473E344E00B90730F3C188EC17, vertexId=vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B]
2016-05-17 22:22:45,035 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:22:45,035 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764813_0001_1][Event:VERTEX_INITIALIZED]: vertexName=FA1252DC201848F99F075196BB2E120B, vertexId=vertex_1463523764813_0001_1_00, initRequestedTime=1463523765008, initedTime=1463523765034, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:22:45,036 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B] with distanceFromRoot: 0
2016-05-17 22:22:45,036 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:22:45,037 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in FA1252DC201848F99F075196BB2E120B
2016-05-17 22:22:45,037 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B]
2016-05-17 22:22:45,038 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:22:45,038 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764813_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463523764813_0001_1_00, startRequestedTime=1463523765037, startedTime=1463523765037
2016-05-17 22:22:45,039 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:22:45,040 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:22:45,040 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764813_0001_1][Event:TASK_STARTED]: vertexName=FA1252DC201848F99F075196BB2E120B, taskId=task_1463523764813_0001_1_00_000000, scheduledTime=1463523765040, launchTime=1463523765040
2016-05-17 22:22:45,042 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523764813_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:22:45,043 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B]
2016-05-17 22:22:45,044 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [14AB3D213925478A9A08BB2007DA53E2/E85D5B9F924C4B76B5A539D83E07E571] third/(1/1) ...pleRiffle/perpetual/third, VertexName: FA1252DC201848F99F075196BB2E120B, VertexParallelism: 1, TaskAttemptID:attempt_1463523764813_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=60116B294BCA45518241B219E9FFC0B1, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=2DC065473E344E00B90730F3C188EC17, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:22:45,049 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523764813_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:22:45,050 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:22:45,051 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:22:45,052 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:22:45,052 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:22:45,053 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463523764813_0001_00_000001
2016-05-17 22:22:45,053 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523764813_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:22:45,055 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1463523764813_0001_00_000001
2016-05-17 22:22:45,055 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:22:45,056 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523764813_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:22:45,057 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:22:45,057 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764813_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463523764813_0001_00_000001, launchTime=1463523765057
2016-05-17 22:22:45,058 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463523764813_0001_00_000001
2016-05-17 22:22:45,059 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463523764813_0001_1_00_000000_0] to container: [container_1463523764813_0001_00_000001]
2016-05-17 22:22:45,060 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523764813_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:22:45,060 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463523764813_0001_00_000001 given task: attempt_1463523764813_0001_1_00_000000_0
2016-05-17 22:22:45,060 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463523764813_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463523764813_0001_1_00_000000_0
2016-05-17 22:22:45,061 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463523764813_0001_1_00_000000_0] started. Is using containerId: [container_1463523764813_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:22:45,061 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764813_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=FA1252DC201848F99F075196BB2E120B, taskAttemptId=attempt_1463523764813_0001_1_00_000000_0, startTime=1463523765060, containerId=container_1463523764813_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463523764813_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:22:45,061 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:22:45,061 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523764813_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:22:45,062 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523764813_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:22:45 Starting to run new task attempt: attempt_1463523764813_0001_1_00_000000_0
2016-05-17 22:22:45,063 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463523764813_0001_1_00_000000_0
2016-05-17 22:22:45,063 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:45,063 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:22:45,064 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:22:45,064 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:22:45,064 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:22:45,064 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:22:45,065 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [14AB3D213925478A9A08BB2007DA53E2/E85D5B9F924C4B76B5A539D83E07E571] third/(1/1) ...pleRiffle/perpetual/third, VertexName: FA1252DC201848F99F075196BB2E120B, VertexParallelism: 1, TaskAttemptID:attempt_1463523764813_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=60116B294BCA45518241B219E9FFC0B1, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=2DC065473E344E00B90730F3C188EC17, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:22:45,065 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:22:45,066 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463523764813_0001_1_00_000000_0
2016-05-17 22:22:45,069 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:22:45,069 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:45,071 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463523764813_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:22:45,073 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:45,073 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=2DC065473E344E00B90730F3C188EC17, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:22:45,073 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:22:45,074 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 2DC065473E344E00B90730F3C188EC17
2016-05-17 22:22:45,074 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:22:45,074 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 2DC065473E344E00B90730F3C188EC17
2016-05-17 22:22:45,077 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:22:45,081 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=60116B294BCA45518241B219E9FFC0B1, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:22:45,082 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:22:45,082 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 60116B294BCA45518241B219E9FFC0B1
2016-05-17 22:22:45,083 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 60116B294BCA45518241B219E9FFC0B1
2016-05-17 22:22:45,089 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:22:45,090 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 60116B294BCA45518241B219E9FFC0B1
2016-05-17 22:22:45,090 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 60116B294BCA45518241B219E9FFC0B1
2016-05-17 22:22:45,100 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: FA1252DC201848F99F075196BB2E120B, ordinal: 0
2016-05-17 22:22:45,100 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FA1252DC201848F99F075196BB2E120B, mem on start (mb), free: 314, total: 397, max: 672
2016-05-17 22:22:45,100 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:45,101 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:22:45,100 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:22:45,102 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 2DC065473E344E00B90730F3C188EC17
2016-05-17 22:22:45,102 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:22:45,103 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:22:45,104 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:22:45,104 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:22:45,105 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:22:45,105 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:22:45,105 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:22:45,106 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:22:45,106 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:22:45,106 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 2DC065473E344E00B90730F3C188EC17, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:22:45,106 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 60116B294BCA45518241B219E9FFC0B1, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:22:45,107 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:22:45,107 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 60116B294BCA45518241B219E9FFC0B1
2016-05-17 22:22:45,107 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:22:45,107 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 60116B294BCA45518241B219E9FFC0B1
2016-05-17 22:22:45,108 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 60116B294BCA45518241B219E9FFC0B1 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:22:45,108 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:22:45,109 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:22:45,109 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:22:45,110 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463523764813_0001_1_00_000000_0
2016-05-17 22:22:45,112 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:22:45,113 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second"]
2016-05-17 22:22:45,115 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second"] streamed: true, id: 60116B294BCA45518241B219E9FFC0B1
2016-05-17 22:22:45,115 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third"], id: 2DC065473E344E00B90730F3C188EC17
2016-05-17 22:22:45,118 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third"]
2016-05-17 22:22:45,119 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@13105282
2016-05-17 22:22:45,119 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second"]
2016-05-17 22:22:45,120 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:22:45,121 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@13105282
2016-05-17 22:22:45,121 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:22:45,121 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:22:45,122 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: FA1252DC201848F99F075196BB2E120B, all 1 inputs ready in: 00:00:00.000
2016-05-17 22:22:45,126 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:22:45,126 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:22:45,127 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463523764813_0001_1_00_000000_0
2016-05-17 22:22:45,127 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463523764813_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:22:45,128 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463523764813_0001_1_00_000000_0
2016-05-17 22:22:45,129 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FA1252DC201848F99F075196BB2E120B, mem on close (mb), free: 313, total: 397, max: 672
2016-05-17 22:22:45 Completed running task attempt: attempt_1463523764813_0001_1_00_000000_0
2016-05-17 22:22:45,132 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463523764813_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:22:45,133 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1463523765122, Process_Duration=6, Process_End_Time=1463523765128, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-05-17 22:22:45,133 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:22:45,134 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-05-17 22:22:45,135 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:45,134 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764813_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=FA1252DC201848F99F075196BB2E120B, taskAttemptId=attempt_1463523764813_0001_1_00_000000_0, startTime=1463523765060, finishTime=1463523765133, timeTaken=73, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523765122, Process_Duration=6, Process_End_Time=1463523765128, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:45,135 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463523764813_0001_00_000001
2016-05-17 22:22:45,135 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523764813_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:22:45,137 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463523764813_0001_1_00_000000_0
2016-05-17 22:22:45,137 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:22:45,137 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:22:45,137 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764813_0001_1][Event:TASK_FINISHED]: vertexName=FA1252DC201848F99F075196BB2E120B, taskId=task_1463523764813_0001_1_00_000000, startTime=1463523765060, finishTime=1463523765137, timeTaken=77, status=SUCCEEDED, successfulAttemptID=attempt_1463523764813_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523765122, Process_Duration=6, Process_End_Time=1463523765128, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:45,138 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523764813_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:22:45,138 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B] : 1
2016-05-17 22:22:45,138 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B]
2016-05-17 22:22:45,140 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:22:45,140 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764813_0001_1][Event:VERTEX_FINISHED]: vertexName=FA1252DC201848F99F075196BB2E120B, vertexId=vertex_1463523764813_0001_1_00, initRequestedTime=1463523765008, initedTime=1463523765034, startRequestedTime=1463523765037, startedTime=1463523765037, finishTime=1463523765138, timeTaken=101, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523765122, Process_Duration=6, Process_End_Time=1463523765128, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1463523765060, firstTasksToStart=[ task_1463523764813_0001_1_00_000000 ], lastTaskFinishTime=1463523765133, lastTasksToFinish=[ task_1463523764813_0001_1_00_000000 ], minTaskDuration=73, maxTaskDuration=73, avgTaskDuration=73.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463523764813_0001_1_00_000000 ], longestDurationTasks=[ task_1463523764813_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:22:45,141 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:22:45,141 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523764813_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:22:45,141 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764813_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463523764813_0001_00_000001, stoppedTime=1463523765141, exitStatus=0
2016-05-17 22:22:45,141 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523764813_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:22:45,142 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:22:45,142 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463523764813_0001_1
2016-05-17 22:22:45,142 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764813_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463523764813_0001_1
2016-05-17 22:22:45,144 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 2DC065473E344E00B90730F3C188EC17 for vertex: vertex_1463523764813_0001_1_00 [FA1252DC201848F99F075196BB2E120B]
2016-05-17 22:22:45,142 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:22:45,147 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463523764813_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:22:45,147 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463523764813_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:22:45,147 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463523764813_0001_00_000001, Exiting
2016-05-17 22:22:45,148 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463523764813_0001_00_000001
2016-05-17 22:22:45,148 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463523764813_0001_00_000001
2016-05-17 22:22:45,151 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463523764813_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:22:45,151 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463523764813_0001_00_000001 completed successfully
2016-05-17 22:22:45,162 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463523764813_0001_1, queueSize=0
2016-05-17 22:22:45,163 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:22:45,165 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523764813_0001_1][Event:DAG_FINISHED]: dagId=dag_1463523764813_0001_1, startTime=1463523765006, finishTime=1463523765161, timeTaken=155, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523765122, Process_Duration=6, Process_End_Time=1463523765128, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:45,165 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463523764813_0001_1 finished with state: SUCCEEDED
2016-05-17 22:22:45,165 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523764813_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:22:45,165 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463523764813_0001_00_000001
2016-05-17 22:22:45,166 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523764813_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:22:45 Completed Dag: dag_1463523764813_0001_1
2016-05-17 22:22:45,166 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463523764813_0001_1, dagState=SUCCEEDED
2016-05-17 22:22:45,166 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463523764813_0001_1_post
2016-05-17 22:22:45,166 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:45,166 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:22:45,174 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...pleRiffle/perpetual/third, applicationId=application_1463523764813_0001
2016-05-17 22:22:45,177 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:22:45,177 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:22:45,177 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:22:45,177 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:22:45,178 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:22:45,178 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:22:45,180 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:22:45,180 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:22:45,180 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:22:45,181 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:22:45,181 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:22:45,183 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:22:45,184 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:22:45,190 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/14AB3D213925478A9A08BB2007DA53E2/E85D5B9F924C4B76B5A539D83E07E571/.tez/application_1463523764813_0001
2016-05-17 22:22:45,191 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third/_temporary
2016-05-17 22:22:45,191 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third]  completed in: 00:00.402
2016-05-17 22:22:45,193 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] starting
2016-05-17 22:22:45,194 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth]  source: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third"]
2016-05-17 22:22:45,194 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth]  sink: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/fourth"]
2016-05-17 22:22:45,194 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth]  parallel execution of steps is enabled: false
2016-05-17 22:22:45,194 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth]  executing total steps: 1
2016-05-17 22:22:45,194 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth]  allocating management threads: 1
2016-05-17 22:22:45,195 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] starting step: (1/1) ...leRiffle/perpetual/fourth
2016-05-17 22:22:45,195 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [fourth] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:22:45,210 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] tez session mode enabled: true
2016-05-17 22:22:45,215 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:22:45,215 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:22:45,216 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-17 22:22:45,225 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/029438B33CE0473C844D60479ACCCA45/C8E45378279D4E12838C88540BBD4727/.tez/application_1463523765215_0001 doesn't exist and is created
2016-05-17 22:22:45,245 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:22:45,245 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:22:45,246 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/029438B33CE0473C844D60479ACCCA45/C8E45378279D4E12838C88540BBD4727/.tez/application_1463523765215_0001
2016-05-17 22:22:45,250 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463523765215_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:22:45,263 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:22:45,264 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:22:45,266 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:22:45,266 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:22:45,267 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/029438B33CE0473C844D60479ACCCA45/C8E45378279D4E12838C88540BBD4727/.tez/application_1463523765215_0001/localmode-log-dir
2016-05-17 22:22:45,267 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/029438B33CE0473C844D60479ACCCA45/C8E45378279D4E12838C88540BBD4727/.tez/application_1463523765215_0001/localmode-log-dir/history.txt.appattempt_1463523765215_0001_000000, maxErrors=10
2016-05-17 22:22:45,267 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:22:45,267 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463523765215_0001_000000, appSubmitTime=1463523765250, launchTime=1463523765250
2016-05-17 22:22:45,274 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:22:45,276 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:22:45,281 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:22:45,282 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:43055
2016-05-17 22:22:45,281 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:22:45,285 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:22:45,287 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463523765215_0001_000000, startTime=1463523765287
2016-05-17 22:22:45,287 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:22:45,287 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:22:45,346 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:22:45,346 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:22:45,346 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...leRiffle/perpetual/fourth, applicationId=application_1463523765215_0001, dagName=[029438B33CE0473C844D60479ACCCA45/C8E45378279D4E12838C88540BBD4727] fourth/(1/1) ...leRiffle/perpetual/fourth
2016-05-17 22:22:45,366 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [029438B33CE0473C844D60479ACCCA45/C8E45378279D4E12838C88540BBD4727] fourth/(1/1) ...leRiffle/perpetual/fourth
2016-05-17 22:22:45,367 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463523765215_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/029438B33CE0473C844D60479ACCCA45/C8E45378279D4E12838C88540BBD4727/.tez/application_1463523765215_0001/localmode-log-dir/dag_1463523765215_0001_1.dot
2016-05-17 22:22:45,368 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/029438B33CE0473C844D60479ACCCA45/C8E45378279D4E12838C88540BBD4727/.tez/application_1463523765215_0001/localmode-log-dir/dag_1463523765215_0001_1-tez-dag.pb.txt
2016-05-17 22:22:45,404 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463523765215_0001_1
2016-05-17 22:22:45,405 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:45,405 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [029438B33CE0473C844D60479ACCCA45/C8E45378279D4E12838C88540BBD4727] fourth/(1/1) ...leRiffle/perpetual/fourth
2016-05-17 22:22:45 Running Dag: dag_1463523765215_0001_1
2016-05-17 22:22:45,425 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523765215_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463523765215_0001_1, submitTime=1463523765366
2016-05-17 22:22:45,425 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:22:45,426 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex D93C35B694CA4DFAA16DC4FC9075D145
2016-05-17 22:22:45,427 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:22:45,429 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:22:45,429 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523765215_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463523765215_0001_1, initTime=1463523765425
2016-05-17 22:22:45,430 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523765215_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:22:45,431 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:22:45,431 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523765215_0001_1][Event:DAG_STARTED]: dagID=dag_1463523765215_0001_1, startTime=1463523765431
2016-05-17 22:22:45,431 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:22:45,432 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523765215_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:22:45,432 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: D93C35B694CA4DFAA16DC4FC9075D145 : {2DC065473E344E00B90730F3C188EC17={InputName=2DC065473E344E00B90730F3C188EC17}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:22:45,432 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 2DC065473E344E00B90730F3C188EC17, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:22:45,432 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145]
2016-05-17 22:22:45,432 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145]
2016-05-17 22:22:45,432 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145]
2016-05-17 22:22:45,433 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145]. Starting root input initializers: 1
2016-05-17 22:22:45,433 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:22:45,433 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 2DC065473E344E00B90730F3C188EC17 on vertex vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145]
2016-05-17 22:22:45,434 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...leRiffle/perpetual/fourth, applicationId=application_1463523765215_0001, dagName=[029438B33CE0473C844D60479ACCCA45/C8E45378279D4E12838C88540BBD4727] fourth/(1/1) ...leRiffle/perpetual/fourth
2016-05-17 22:22:45,436 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:22:45,436 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 2DC065473E344E00B90730F3C188EC17 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:22:45,438 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:22:45,439 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:22:45,453 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 546
2016-05-17 22:22:45,453 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 2DC065473E344E00B90730F3C188EC17 on vertex vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145]
2016-05-17 22:22:45,454 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:22:45,454 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {2DC065473E344E00B90730F3C188EC17=forAllWorkUnits=true, update=[1]}
2016-05-17 22:22:45,454 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145] parallelism set to 1
2016-05-17 22:22:45,454 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:22:45,455 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523765215_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463523765215_0001_1_00, eventCount=1
2016-05-17 22:22:45,455 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145]
2016-05-17 22:22:45,455 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=ECD8C47222F146ADA0C0D32E0BF73505, vertexId=vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:22:45,456 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=ECD8C47222F146ADA0C0D32E0BF73505, vertexId=vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145]
2016-05-17 22:22:45,458 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=ECD8C47222F146ADA0C0D32E0BF73505, vertexName=D93C35B694CA4DFAA16DC4FC9075D145, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:22:45,458 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=ECD8C47222F146ADA0C0D32E0BF73505, vertexId=vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145]
2016-05-17 22:22:45,460 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:22:45,460 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523765215_0001_1][Event:VERTEX_INITIALIZED]: vertexName=D93C35B694CA4DFAA16DC4FC9075D145, vertexId=vertex_1463523765215_0001_1_00, initRequestedTime=1463523765432, initedTime=1463523765460, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:22:45,460 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145] with distanceFromRoot: 0
2016-05-17 22:22:45,464 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:22:45,465 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in D93C35B694CA4DFAA16DC4FC9075D145
2016-05-17 22:22:45,465 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145]
2016-05-17 22:22:45,466 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:22:45,464 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] submitted tez dag to app master: application_1463523765215_0001, with dag id: dag_1463523765215_0001_1
2016-05-17 22:22:45,466 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523765215_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463523765215_0001_1_00, startRequestedTime=1463523765465, startedTime=1463523765465
2016-05-17 22:22:45,466 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:22:45,468 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:22:45,468 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523765215_0001_1][Event:TASK_STARTED]: vertexName=D93C35B694CA4DFAA16DC4FC9075D145, taskId=task_1463523765215_0001_1_00_000000, scheduledTime=1463523765467, launchTime=1463523765467
2016-05-17 22:22:45,468 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523765215_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:22:45,469 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145]
2016-05-17 22:22:45,470 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [029438B33CE0473C844D60479ACCCA45/C8E45378279D4E12838C88540BBD4727] fourth/(1/1) ...leRiffle/perpetual/fourth, VertexName: D93C35B694CA4DFAA16DC4FC9075D145, VertexParallelism: 1, TaskAttemptID:attempt_1463523765215_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=2DC065473E344E00B90730F3C188EC17, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=ECD8C47222F146ADA0C0D32E0BF73505, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:22:45,471 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523765215_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:22:45,471 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:22:45,473 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:22:45,474 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:22:45,474 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:22:45,475 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463523765215_0001_00_000001
2016-05-17 22:22:45,476 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523765215_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:22:45,478 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1463523765215_0001_00_000001
2016-05-17 22:22:45,478 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:22:45,479 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523765215_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:22:45,479 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523765215_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463523765215_0001_00_000001, launchTime=1463523765479
2016-05-17 22:22:45,479 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:22:45,480 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463523765215_0001_00_000001
2016-05-17 22:22:45,481 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463523765215_0001_1_00_000000_0] to container: [container_1463523765215_0001_00_000001]
2016-05-17 22:22:45,481 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523765215_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:22:45,481 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463523765215_0001_00_000001 given task: attempt_1463523765215_0001_1_00_000000_0
2016-05-17 22:22:45,481 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463523765215_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463523765215_0001_1_00_000000_0
2016-05-17 22:22:45 Starting to run new task attempt: attempt_1463523765215_0001_1_00_000000_0
2016-05-17 22:22:45,482 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463523765215_0001_1_00_000000_0
2016-05-17 22:22:45,482 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:45,482 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:22:45,482 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:22:45,483 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:22:45,483 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:22:45,482 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463523765215_0001_1_00_000000_0] started. Is using containerId: [container_1463523765215_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:22:45,483 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:22:45,484 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:22:45,484 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [029438B33CE0473C844D60479ACCCA45/C8E45378279D4E12838C88540BBD4727] fourth/(1/1) ...leRiffle/perpetual/fourth, VertexName: D93C35B694CA4DFAA16DC4FC9075D145, VertexParallelism: 1, TaskAttemptID:attempt_1463523765215_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=2DC065473E344E00B90730F3C188EC17, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=ECD8C47222F146ADA0C0D32E0BF73505, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:22:45,484 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:22:45,484 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523765215_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=D93C35B694CA4DFAA16DC4FC9075D145, taskAttemptId=attempt_1463523765215_0001_1_00_000000_0, startTime=1463523765482, containerId=container_1463523765215_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463523765215_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:22:45,485 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523765215_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:22:45,485 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463523765215_0001_1_00_000000_0
2016-05-17 22:22:45,486 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:22:45,486 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:45,486 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463523765215_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:22:45,487 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:45,487 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=2DC065473E344E00B90730F3C188EC17, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:22:45,487 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523765215_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:22:45,489 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:22:45,489 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 2DC065473E344E00B90730F3C188EC17
2016-05-17 22:22:45,489 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 2DC065473E344E00B90730F3C188EC17
2016-05-17 22:22:45,487 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=ECD8C47222F146ADA0C0D32E0BF73505, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:22:45,490 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:22:45,491 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:22:45,492 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: ECD8C47222F146ADA0C0D32E0BF73505
2016-05-17 22:22:45,497 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:22:45,497 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: ECD8C47222F146ADA0C0D32E0BF73505
2016-05-17 22:22:45,500 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:22:45,500 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 2DC065473E344E00B90730F3C188EC17
2016-05-17 22:22:45,500 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 2DC065473E344E00B90730F3C188EC17
2016-05-17 22:22:45,508 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: D93C35B694CA4DFAA16DC4FC9075D145, ordinal: 0
2016-05-17 22:22:45,509 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D93C35B694CA4DFAA16DC4FC9075D145, mem on start (mb), free: 268, total: 397, max: 672
2016-05-17 22:22:45,509 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:45,509 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:22:45,509 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:22:45,511 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:22:45,511 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: ECD8C47222F146ADA0C0D32E0BF73505
2016-05-17 22:22:45,511 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:22:45,511 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:22:45,512 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:22:45,512 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:22:45,512 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:22:45,512 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:22:45,512 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:22:45,513 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:22:45,513 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 2DC065473E344E00B90730F3C188EC17, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:22:45,513 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, ECD8C47222F146ADA0C0D32E0BF73505, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:22:45,513 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:22:45,513 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 2DC065473E344E00B90730F3C188EC17 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:22:45,513 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:22:45,513 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:22:45,514 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 2DC065473E344E00B90730F3C188EC17
2016-05-17 22:22:45,514 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:22:45,514 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 2DC065473E344E00B90730F3C188EC17
2016-05-17 22:22:45,514 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:22:45,515 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463523765215_0001_1_00_000000_0
2016-05-17 22:22:45,516 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:22:45,517 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@6b3011f1
2016-05-17 22:22:45,518 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third"]
2016-05-17 22:22:45,518 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third"] streamed: true, id: 2DC065473E344E00B90730F3C188EC17
2016-05-17 22:22:45,519 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/fourth"], id: ECD8C47222F146ADA0C0D32E0BF73505
2016-05-17 22:22:45,520 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/fourth"]
2016-05-17 22:22:45,520 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third"]
2016-05-17 22:22:45,520 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:22:45,525 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@6b3011f1
2016-05-17 22:22:45,525 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:22:45,526 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:22:45,526 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: D93C35B694CA4DFAA16DC4FC9075D145, all 1 inputs ready in: 00:00:00.000
2016-05-17 22:22:45,530 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:22:45,531 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:22:45,536 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463523765215_0001_1_00_000000_0
2016-05-17 22:22:45,536 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463523765215_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:22:45,537 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463523765215_0001_1_00_000000_0
2016-05-17 22:22:45,537 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D93C35B694CA4DFAA16DC4FC9075D145, mem on close (mb), free: 267, total: 397, max: 672
2016-05-17 22:22:45 Completed running task attempt: attempt_1463523765215_0001_1_00_000000_0
2016-05-17 22:22:45,538 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463523765215_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:22:45,540 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=807, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1463523765526, Process_Duration=11, Process_End_Time=1463523765537, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-05-17 22:22:45,540 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:22:45,541 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523765215_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=D93C35B694CA4DFAA16DC4FC9075D145, taskAttemptId=attempt_1463523765215_0001_1_00_000000_0, startTime=1463523765482, finishTime=1463523765540, timeTaken=58, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=807, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523765526, Process_Duration=11, Process_End_Time=1463523765537, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:45,541 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-05-17 22:22:45,541 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523765215_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:22:45,541 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:45,542 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:22:45,542 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463523765215_0001_1_00_000000_0
2016-05-17 22:22:45,544 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:22:45,544 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523765215_0001_1][Event:TASK_FINISHED]: vertexName=D93C35B694CA4DFAA16DC4FC9075D145, taskId=task_1463523765215_0001_1_00_000000, startTime=1463523765482, finishTime=1463523765544, timeTaken=62, status=SUCCEEDED, successfulAttemptID=attempt_1463523765215_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=807, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523765526, Process_Duration=11, Process_End_Time=1463523765537, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:45,545 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463523765215_0001_00_000001
2016-05-17 22:22:45,545 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523765215_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:22:45,546 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145] : 1
2016-05-17 22:22:45,546 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145]
2016-05-17 22:22:45,547 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:22:45,548 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523765215_0001_1][Event:VERTEX_FINISHED]: vertexName=D93C35B694CA4DFAA16DC4FC9075D145, vertexId=vertex_1463523765215_0001_1_00, initRequestedTime=1463523765432, initedTime=1463523765460, startRequestedTime=1463523765465, startedTime=1463523765465, finishTime=1463523765546, timeTaken=81, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=807, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523765526, Process_Duration=11, Process_End_Time=1463523765537, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1463523765482, firstTasksToStart=[ task_1463523765215_0001_1_00_000000 ], lastTaskFinishTime=1463523765540, lastTasksToFinish=[ task_1463523765215_0001_1_00_000000 ], minTaskDuration=58, maxTaskDuration=58, avgTaskDuration=58.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463523765215_0001_1_00_000000 ], longestDurationTasks=[ task_1463523765215_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:22:45,548 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:22:45,548 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523765215_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:22:45,548 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523765215_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463523765215_0001_00_000001, stoppedTime=1463523765548, exitStatus=0
2016-05-17 22:22:45,548 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:22:45,549 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523765215_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:22:45,549 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:22:45,549 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463523765215_0001_1
2016-05-17 22:22:45,550 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523765215_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463523765215_0001_1
2016-05-17 22:22:45,550 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: ECD8C47222F146ADA0C0D32E0BF73505 for vertex: vertex_1463523765215_0001_1_00 [D93C35B694CA4DFAA16DC4FC9075D145]
2016-05-17 22:22:45,556 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463523765215_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:22:45,556 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463523765215_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:22:45,556 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463523765215_0001_00_000001, Exiting
2016-05-17 22:22:45,557 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463523765215_0001_00_000001
2016-05-17 22:22:45,557 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463523765215_0001_00_000001
2016-05-17 22:22:45,559 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463523765215_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:22:45,560 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463523765215_0001_00_000001 completed successfully
2016-05-17 22:22:45,560 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463523765215_0001_1, queueSize=0
2016-05-17 22:22:45,561 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:22:45,561 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523765215_0001_1][Event:DAG_FINISHED]: dagId=dag_1463523765215_0001_1, startTime=1463523765431, finishTime=1463523765559, timeTaken=128, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=807, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523765526, Process_Duration=11, Process_End_Time=1463523765537, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:45,561 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463523765215_0001_1 finished with state: SUCCEEDED
2016-05-17 22:22:45,561 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523765215_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:22:45,563 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463523765215_0001_00_000001
2016-05-17 22:22:45,564 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523765215_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:22:45 Completed Dag: dag_1463523765215_0001_1
2016-05-17 22:22:45,565 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463523765215_0001_1, dagState=SUCCEEDED
2016-05-17 22:22:45,566 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463523765215_0001_1_post
2016-05-17 22:22:45,566 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:45,566 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:22:45,570 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...leRiffle/perpetual/fourth, applicationId=application_1463523765215_0001
2016-05-17 22:22:45,574 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:22:45,574 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:22:45,574 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:22:45,574 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:22:45,574 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:22:45,574 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:22:45,575 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:22:45,576 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:22:45,576 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:22:45,576 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:22:45,577 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:22:45,577 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:22:45,578 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:22:45,582 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/029438B33CE0473C844D60479ACCCA45/C8E45378279D4E12838C88540BBD4727/.tez/application_1463523765215_0001
2016-05-17 22:22:45,582 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/fourth/_temporary
2016-05-17 22:22:45,583 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth]  completed in: 00:00.389
2016-05-17 22:22:45,629 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third
2016-05-17 22:22:45,629 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first
2016-05-17 22:22:45,630 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/fourth
2016-05-17 22:22:45,630 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second
2016-05-17 22:22:45,657 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:22:45,657 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:22:45,706 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-05-17 22:22:45,718 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.032
2016-05-17 22:22:45,719 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:22:45,719 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:22:45,719 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:22:45,740 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/ips.20.txt
2016-05-17 22:22:45,741 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first
2016-05-17 22:22:45,790 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:22:45,790 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:22:45,850 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-05-17 22:22:45,864 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.032
2016-05-17 22:22:45,865 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:22:45,865 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:22:45,866 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:22:45,888 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first
2016-05-17 22:22:45,889 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second
2016-05-17 22:22:45,942 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:22:45,943 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:22:46,001 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-05-17 22:22:46,018 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.036
2016-05-17 22:22:46,019 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:22:46,019 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:22:46,020 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:22:46,042 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second
2016-05-17 22:22:46,042 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third
2016-05-17 22:22:46,089 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:22:46,089 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:22:46,149 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-05-17 22:22:46,164 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.033
2016-05-17 22:22:46,165 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:22:46,165 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:22:46,166 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:22:46,188 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third
2016-05-17 22:22:46,189 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/fourth
2016-05-17 22:22:46,222 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third] starting
2016-05-17 22:22:46,223 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third]  parallel execution of flows is enabled: false
2016-05-17 22:22:46,224 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third]  executing total flows: 4
2016-05-17 22:22:46,224 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third]  allocating management threads: 1
2016-05-17 22:22:46,225 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third] starting flow: first
2016-05-17 22:22:46,225 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] at least one sink is marked for delete
2016-05-17 22:22:46,228 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-17 22:22:46,232 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] starting
2016-05-17 22:22:46,232 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first]  source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/ips.20.txt"]
2016-05-17 22:22:46,233 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first]  sink: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first"]
2016-05-17 22:22:46,233 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first]  parallel execution of steps is enabled: false
2016-05-17 22:22:46,233 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first]  executing total steps: 1
2016-05-17 22:22:46,234 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first]  allocating management threads: 1
2016-05-17 22:22:46,235 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] starting step: (1/1) ...de/perpetualcascade/first
2016-05-17 22:22:46,235 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [first] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:22:46,257 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] tez session mode enabled: true
2016-05-17 22:22:46,262 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:22:46,262 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:22:46,262 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-17 22:22:46,272 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/21C245ED49CF4428B97116D12CE165A6/E079CC30B34142CFB52F113DB9CC22F5/.tez/application_1463523766262_0001 doesn't exist and is created
2016-05-17 22:22:46,291 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:22:46,291 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:22:46,292 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/21C245ED49CF4428B97116D12CE165A6/E079CC30B34142CFB52F113DB9CC22F5/.tez/application_1463523766262_0001
2016-05-17 22:22:46,296 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463523766262_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:22:46,313 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:22:46,314 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:22:46,316 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:22:46,316 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:22:46,316 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/21C245ED49CF4428B97116D12CE165A6/E079CC30B34142CFB52F113DB9CC22F5/.tez/application_1463523766262_0001/localmode-log-dir
2016-05-17 22:22:46,317 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/21C245ED49CF4428B97116D12CE165A6/E079CC30B34142CFB52F113DB9CC22F5/.tez/application_1463523766262_0001/localmode-log-dir/history.txt.appattempt_1463523766262_0001_000000, maxErrors=10
2016-05-17 22:22:46,317 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:22:46,317 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463523766262_0001_000000, appSubmitTime=1463523766296, launchTime=1463523766296
2016-05-17 22:22:46,322 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:22:46,327 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:22:46,331 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:43934
2016-05-17 22:22:46,331 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:22:46,332 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:22:46,333 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:22:46,336 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:22:46,336 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463523766262_0001_000000, startTime=1463523766336
2016-05-17 22:22:46,336 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:22:46,391 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:22:46,392 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:22:46,392 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...de/perpetualcascade/first, applicationId=application_1463523766262_0001, dagName=[21C245ED49CF4428B97116D12CE165A6/E079CC30B34142CFB52F113DB9CC22F5] first/(1/1) ...de/perpetualcascade/first
2016-05-17 22:22:46,450 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [21C245ED49CF4428B97116D12CE165A6/E079CC30B34142CFB52F113DB9CC22F5] first/(1/1) ...de/perpetualcascade/first
2016-05-17 22:22:46,452 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463523766262_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/21C245ED49CF4428B97116D12CE165A6/E079CC30B34142CFB52F113DB9CC22F5/.tez/application_1463523766262_0001/localmode-log-dir/dag_1463523766262_0001_1.dot
2016-05-17 22:22:46,453 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/21C245ED49CF4428B97116D12CE165A6/E079CC30B34142CFB52F113DB9CC22F5/.tez/application_1463523766262_0001/localmode-log-dir/dag_1463523766262_0001_1-tez-dag.pb.txt
2016-05-17 22:22:46,473 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463523766262_0001_1
2016-05-17 22:22:46,474 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:46,474 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [21C245ED49CF4428B97116D12CE165A6/E079CC30B34142CFB52F113DB9CC22F5] first/(1/1) ...de/perpetualcascade/first
2016-05-17 22:22:46 Running Dag: dag_1463523766262_0001_1
2016-05-17 22:22:46,489 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766262_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463523766262_0001_1, submitTime=1463523766450
2016-05-17 22:22:46,489 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:22:46,490 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E255CADD020D4FC88499303A33C03BB3
2016-05-17 22:22:46,490 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:22:46,490 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766262_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463523766262_0001_1, initTime=1463523766490
2016-05-17 22:22:46,492 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523766262_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:22:46,492 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:22:46,493 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766262_0001_1][Event:DAG_STARTED]: dagID=dag_1463523766262_0001_1, startTime=1463523766493
2016-05-17 22:22:46,493 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:22:46,493 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523766262_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:22:46,494 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E255CADD020D4FC88499303A33C03BB3 : {5ABDBE85F1CB4B19A9EC12E5E2231588={InputName=5ABDBE85F1CB4B19A9EC12E5E2231588}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:22:46,494 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 5ABDBE85F1CB4B19A9EC12E5E2231588, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:22:46,494 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3]
2016-05-17 22:22:46,494 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3]
2016-05-17 22:22:46,494 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3]
2016-05-17 22:22:46,495 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3]. Starting root input initializers: 1
2016-05-17 22:22:46,495 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...de/perpetualcascade/first, applicationId=application_1463523766262_0001, dagName=[21C245ED49CF4428B97116D12CE165A6/E079CC30B34142CFB52F113DB9CC22F5] first/(1/1) ...de/perpetualcascade/first
2016-05-17 22:22:46,493 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:22:46,497 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:22:46,497 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 5ABDBE85F1CB4B19A9EC12E5E2231588 on vertex vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3]
2016-05-17 22:22:46,499 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:22:46,500 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 5ABDBE85F1CB4B19A9EC12E5E2231588 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:22:46,501 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:22:46,501 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:22:46,504 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 402
2016-05-17 22:22:46,505 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 5ABDBE85F1CB4B19A9EC12E5E2231588 on vertex vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3]
2016-05-17 22:22:46,505 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:22:46,506 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {5ABDBE85F1CB4B19A9EC12E5E2231588=forAllWorkUnits=true, update=[1]}
2016-05-17 22:22:46,506 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3] parallelism set to 1
2016-05-17 22:22:46,506 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:22:46,506 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766262_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463523766262_0001_1_00, eventCount=1
2016-05-17 22:22:46,507 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3]
2016-05-17 22:22:46,507 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=2679735EAF3F40308C810D6416F1CDCD, vertexId=vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:22:46,508 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=2679735EAF3F40308C810D6416F1CDCD, vertexId=vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3]
2016-05-17 22:22:46,510 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=2679735EAF3F40308C810D6416F1CDCD, vertexName=E255CADD020D4FC88499303A33C03BB3, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:22:46,510 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=2679735EAF3F40308C810D6416F1CDCD, vertexId=vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3]
2016-05-17 22:22:46,513 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:22:46,513 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766262_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E255CADD020D4FC88499303A33C03BB3, vertexId=vertex_1463523766262_0001_1_00, initRequestedTime=1463523766494, initedTime=1463523766512, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:22:46,513 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3] with distanceFromRoot: 0
2016-05-17 22:22:46,514 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:22:46,514 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E255CADD020D4FC88499303A33C03BB3
2016-05-17 22:22:46,514 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3]
2016-05-17 22:22:46,515 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:22:46,515 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766262_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463523766262_0001_1_00, startRequestedTime=1463523766514, startedTime=1463523766514
2016-05-17 22:22:46,516 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:22:46,516 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:22:46,517 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766262_0001_1][Event:TASK_STARTED]: vertexName=E255CADD020D4FC88499303A33C03BB3, taskId=task_1463523766262_0001_1_00_000000, scheduledTime=1463523766516, launchTime=1463523766516
2016-05-17 22:22:46,517 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523766262_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:22:46,518 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3]
2016-05-17 22:22:46,518 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [21C245ED49CF4428B97116D12CE165A6/E079CC30B34142CFB52F113DB9CC22F5] first/(1/1) ...de/perpetualcascade/first, VertexName: E255CADD020D4FC88499303A33C03BB3, VertexParallelism: 1, TaskAttemptID:attempt_1463523766262_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=5ABDBE85F1CB4B19A9EC12E5E2231588, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=2679735EAF3F40308C810D6416F1CDCD, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:22:46,518 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first] submitted tez dag to app master: application_1463523766262_0001, with dag id: dag_1463523766262_0001_1
2016-05-17 22:22:46,519 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523766262_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:22:46,524 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:22:46,525 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:22:46,528 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:22:46,528 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:22:46,529 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463523766262_0001_00_000001
2016-05-17 22:22:46,529 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523766262_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:22:46,531 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1463523766262_0001_00_000001
2016-05-17 22:22:46,531 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:22:46,532 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523766262_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:22:46,532 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:22:46,533 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766262_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463523766262_0001_00_000001, launchTime=1463523766532
2016-05-17 22:22:46,533 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463523766262_0001_00_000001
2016-05-17 22:22:46,535 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463523766262_0001_1_00_000000_0] to container: [container_1463523766262_0001_00_000001]
2016-05-17 22:22:46,535 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523766262_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:22:46,536 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463523766262_0001_1_00_000000_0] started. Is using containerId: [container_1463523766262_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:22:46,536 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:22:46,536 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766262_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E255CADD020D4FC88499303A33C03BB3, taskAttemptId=attempt_1463523766262_0001_1_00_000000_0, startTime=1463523766535, containerId=container_1463523766262_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463523766262_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:22:46,537 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523766262_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:22:46,537 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523766262_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:22:46,537 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463523766262_0001_00_000001 given task: attempt_1463523766262_0001_1_00_000000_0
2016-05-17 22:22:46,537 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463523766262_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463523766262_0001_1_00_000000_0
2016-05-17 22:22:46 Starting to run new task attempt: attempt_1463523766262_0001_1_00_000000_0
2016-05-17 22:22:46,538 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463523766262_0001_1_00_000000_0
2016-05-17 22:22:46,538 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:46,539 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:22:46,539 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:22:46,539 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:22:46,539 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:22:46,539 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:22:46,539 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [21C245ED49CF4428B97116D12CE165A6/E079CC30B34142CFB52F113DB9CC22F5] first/(1/1) ...de/perpetualcascade/first, VertexName: E255CADD020D4FC88499303A33C03BB3, VertexParallelism: 1, TaskAttemptID:attempt_1463523766262_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=5ABDBE85F1CB4B19A9EC12E5E2231588, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=2679735EAF3F40308C810D6416F1CDCD, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:22:46,540 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:22:46,540 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463523766262_0001_1_00_000000_0
2016-05-17 22:22:46,541 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:22:46,541 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:46,541 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:46,544 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=5ABDBE85F1CB4B19A9EC12E5E2231588, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:22:46,544 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463523766262_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:22:46,544 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:22:46,544 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 5ABDBE85F1CB4B19A9EC12E5E2231588
2016-05-17 22:22:46,544 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 5ABDBE85F1CB4B19A9EC12E5E2231588
2016-05-17 22:22:46,548 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:22:46,548 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 5ABDBE85F1CB4B19A9EC12E5E2231588
2016-05-17 22:22:46,548 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=2679735EAF3F40308C810D6416F1CDCD, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:22:46,548 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 5ABDBE85F1CB4B19A9EC12E5E2231588
2016-05-17 22:22:46,550 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:22:46,550 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 2679735EAF3F40308C810D6416F1CDCD
2016-05-17 22:22:46,550 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:22:46,550 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 2679735EAF3F40308C810D6416F1CDCD
2016-05-17 22:22:46,550 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:22:46,561 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E255CADD020D4FC88499303A33C03BB3, ordinal: 0
2016-05-17 22:22:46,562 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E255CADD020D4FC88499303A33C03BB3, mem on start (mb), free: 339, total: 397, max: 672
2016-05-17 22:22:46,562 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:46,562 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:22:46,562 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:22:46,565 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:22:46,565 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 2679735EAF3F40308C810D6416F1CDCD
2016-05-17 22:22:46,565 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:22:46,565 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:22:46,566 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:22:46,566 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:22:46,566 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:22:46,567 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:22:46,567 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:22:46,567 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:22:46,567 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 5ABDBE85F1CB4B19A9EC12E5E2231588, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:22:46,568 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 2679735EAF3F40308C810D6416F1CDCD, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:22:46,568 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:22:46,568 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 5ABDBE85F1CB4B19A9EC12E5E2231588 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:22:46,568 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 5ABDBE85F1CB4B19A9EC12E5E2231588
2016-05-17 22:22:46,569 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:22:46,569 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 5ABDBE85F1CB4B19A9EC12E5E2231588
2016-05-17 22:22:46,569 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:22:46,569 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:22:46,570 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:22:46,570 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463523766262_0001_1_00_000000_0
2016-05-17 22:22:46,570 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:22:46,571 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@aa8d715
2016-05-17 22:22:46,572 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@aa8d715
2016-05-17 22:22:46,572 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:22:46,572 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:22:46,574 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/ips.20.txt"]
2016-05-17 22:22:46,575 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/ips.20.txt"] streamed: true, id: 5ABDBE85F1CB4B19A9EC12E5E2231588
2016-05-17 22:22:46,575 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first"], id: 2679735EAF3F40308C810D6416F1CDCD
2016-05-17 22:22:46,575 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first"]
2016-05-17 22:22:46,578 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/ips.20.txt"]
2016-05-17 22:22:46,579 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:22:46,579 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E255CADD020D4FC88499303A33C03BB3, all 1 inputs ready in: 00:00:00.000
2016-05-17 22:22:46,582 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:22:46,582 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:22:46,583 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463523766262_0001_1_00_000000_0
2016-05-17 22:22:46,583 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463523766262_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:22:46,584 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463523766262_0001_1_00_000000_0
2016-05-17 22:22:46,584 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E255CADD020D4FC88499303A33C03BB3, mem on close (mb), free: 337, total: 397, max: 672
2016-05-17 22:22:46 Completed running task attempt: attempt_1463523766262_0001_1_00_000000_0
2016-05-17 22:22:46,585 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463523766262_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:22:46,586 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:22:46,587 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766262_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E255CADD020D4FC88499303A33C03BB3, taskAttemptId=attempt_1463523766262_0001_1_00_000000_0, startTime=1463523766535, finishTime=1463523766586, timeTaken=51, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=413, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523766579, Process_Duration=5, Process_End_Time=1463523766584, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:46,587 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523766262_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:22:46,587 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:22:46,587 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463523766262_0001_1_00_000000_0
2016-05-17 22:22:46,588 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:22:46,588 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766262_0001_1][Event:TASK_FINISHED]: vertexName=E255CADD020D4FC88499303A33C03BB3, taskId=task_1463523766262_0001_1_00_000000, startTime=1463523766535, finishTime=1463523766588, timeTaken=53, status=SUCCEEDED, successfulAttemptID=attempt_1463523766262_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=413, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523766579, Process_Duration=5, Process_End_Time=1463523766584, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:46,589 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523766262_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:22:46,589 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3] : 1
2016-05-17 22:22:46,589 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3]
2016-05-17 22:22:46,590 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=413, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1463523766579, Process_Duration=5, Process_End_Time=1463523766584, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-05-17 22:22:46,590 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766262_0001_1][Event:VERTEX_FINISHED]: vertexName=E255CADD020D4FC88499303A33C03BB3, vertexId=vertex_1463523766262_0001_1_00, initRequestedTime=1463523766494, initedTime=1463523766512, startRequestedTime=1463523766514, startedTime=1463523766514, finishTime=1463523766589, timeTaken=75, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=413, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523766579, Process_Duration=5, Process_End_Time=1463523766584, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1463523766535, firstTasksToStart=[ task_1463523766262_0001_1_00_000000 ], lastTaskFinishTime=1463523766586, lastTasksToFinish=[ task_1463523766262_0001_1_00_000000 ], minTaskDuration=51, maxTaskDuration=51, avgTaskDuration=51.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463523766262_0001_1_00_000000 ], longestDurationTasks=[ task_1463523766262_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:22:46,591 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:22:46,591 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523766262_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:22:46,592 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766262_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463523766262_0001_00_000001, stoppedTime=1463523766591, exitStatus=0
2016-05-17 22:22:46,592 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523766262_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:22:46,592 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:22:46,592 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463523766262_0001_1
2016-05-17 22:22:46,592 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766262_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463523766262_0001_1
2016-05-17 22:22:46,592 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 2679735EAF3F40308C810D6416F1CDCD for vertex: vertex_1463523766262_0001_1_00 [E255CADD020D4FC88499303A33C03BB3]
2016-05-17 22:22:46,590 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:22:46,591 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-05-17 22:22:46,594 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:46,595 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:22:46,595 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463523766262_0001_00_000001
2016-05-17 22:22:46,596 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463523766262_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:22:46,596 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463523766262_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:22:46,596 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463523766262_0001_00_000001, Exiting
2016-05-17 22:22:46,597 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463523766262_0001_00_000001
2016-05-17 22:22:46,597 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463523766262_0001_00_000001
2016-05-17 22:22:46,599 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463523766262_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:22:46,600 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463523766262_0001_00_000001 completed successfully
2016-05-17 22:22:46,603 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463523766262_0001_1, queueSize=0
2016-05-17 22:22:46,604 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:22:46,604 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766262_0001_1][Event:DAG_FINISHED]: dagId=dag_1463523766262_0001_1, startTime=1463523766493, finishTime=1463523766602, timeTaken=109, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=413, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523766579, Process_Duration=5, Process_End_Time=1463523766584, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:46,604 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463523766262_0001_1 finished with state: SUCCEEDED
2016-05-17 22:22:46,604 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523766262_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:22:46,604 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523766262_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:22:46,604 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463523766262_0001_00_000001
2016-05-17 22:22:46 Completed Dag: dag_1463523766262_0001_1
2016-05-17 22:22:46,605 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463523766262_0001_1, dagState=SUCCEEDED
2016-05-17 22:22:46,605 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463523766262_0001_1_post
2016-05-17 22:22:46,605 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:46,605 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:22:46,613 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...de/perpetualcascade/first, applicationId=application_1463523766262_0001
2016-05-17 22:22:46,615 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:22:46,615 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:22:46,615 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:22:46,615 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:22:46,616 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:22:46,616 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:22:46,616 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:22:46,617 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:22:46,617 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:22:46,617 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:22:46,618 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:22:46,618 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:22:46,619 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:22:46,623 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/21C245ED49CF4428B97116D12CE165A6/E079CC30B34142CFB52F113DB9CC22F5/.tez/application_1463523766262_0001
2016-05-17 22:22:46,624 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first/_temporary
2016-05-17 22:22:46,624 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first]  completed in: 00:00.391
2016-05-17 22:22:46,624 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third] completed flow: first
2016-05-17 22:22:46,625 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third] starting flow: second
2016-05-17 22:22:46,625 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] at least one sink is marked for delete
2016-05-17 22:22:46,625 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-17 22:22:46,629 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] starting
2016-05-17 22:22:46,629 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second]  source: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first"]
2016-05-17 22:22:46,629 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second"]
2016-05-17 22:22:46,629 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second]  parallel execution of steps is enabled: false
2016-05-17 22:22:46,629 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second]  executing total steps: 1
2016-05-17 22:22:46,630 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second]  allocating management threads: 1
2016-05-17 22:22:46,630 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] starting step: (1/1) ...e/perpetualcascade/second
2016-05-17 22:22:46,631 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [second] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:22:46,644 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] tez session mode enabled: true
2016-05-17 22:22:46,649 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:22:46,649 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:22:46,650 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-17 22:22:46,659 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/69FF36362C544D29BEC3F6401182EC8B/D7132EDBBD854FF0B77AB09A72B1842E/.tez/application_1463523766649_0001 doesn't exist and is created
2016-05-17 22:22:46,675 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:22:46,676 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:22:46,676 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/69FF36362C544D29BEC3F6401182EC8B/D7132EDBBD854FF0B77AB09A72B1842E/.tez/application_1463523766649_0001
2016-05-17 22:22:46,680 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463523766649_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:22:46,697 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:22:46,698 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:22:46,700 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:22:46,700 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:22:46,701 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/69FF36362C544D29BEC3F6401182EC8B/D7132EDBBD854FF0B77AB09A72B1842E/.tez/application_1463523766649_0001/localmode-log-dir
2016-05-17 22:22:46,701 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/69FF36362C544D29BEC3F6401182EC8B/D7132EDBBD854FF0B77AB09A72B1842E/.tez/application_1463523766649_0001/localmode-log-dir/history.txt.appattempt_1463523766649_0001_000000, maxErrors=10
2016-05-17 22:22:46,701 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:22:46,702 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463523766649_0001_000000, appSubmitTime=1463523766680, launchTime=1463523766680
2016-05-17 22:22:46,707 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:22:46,713 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:22:46,716 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:22:46,716 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:22:46,716 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:41542
2016-05-17 22:22:46,719 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:22:46,722 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463523766649_0001_000000, startTime=1463523766722
2016-05-17 22:22:46,722 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:22:46,722 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:22:46,776 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:22:46,776 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:22:46,776 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...e/perpetualcascade/second, applicationId=application_1463523766649_0001, dagName=[69FF36362C544D29BEC3F6401182EC8B/D7132EDBBD854FF0B77AB09A72B1842E] second/(1/1) ...e/perpetualcascade/second
2016-05-17 22:22:46,795 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [69FF36362C544D29BEC3F6401182EC8B/D7132EDBBD854FF0B77AB09A72B1842E] second/(1/1) ...e/perpetualcascade/second
2016-05-17 22:22:46,797 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463523766649_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/69FF36362C544D29BEC3F6401182EC8B/D7132EDBBD854FF0B77AB09A72B1842E/.tez/application_1463523766649_0001/localmode-log-dir/dag_1463523766649_0001_1.dot
2016-05-17 22:22:46,798 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/69FF36362C544D29BEC3F6401182EC8B/D7132EDBBD854FF0B77AB09A72B1842E/.tez/application_1463523766649_0001/localmode-log-dir/dag_1463523766649_0001_1-tez-dag.pb.txt
2016-05-17 22:22:46,824 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463523766649_0001_1
2016-05-17 22:22:46,824 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:46,824 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [69FF36362C544D29BEC3F6401182EC8B/D7132EDBBD854FF0B77AB09A72B1842E] second/(1/1) ...e/perpetualcascade/second
2016-05-17 22:22:46 Running Dag: dag_1463523766649_0001_1
2016-05-17 22:22:46,843 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766649_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463523766649_0001_1, submitTime=1463523766795
2016-05-17 22:22:46,843 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:22:46,843 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex CC494F3AA9B04BC0864DDABB729AE7B6
2016-05-17 22:22:46,844 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:22:46,844 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766649_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463523766649_0001_1, initTime=1463523766843
2016-05-17 22:22:46,844 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523766649_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:22:46,845 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:22:46,847 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766649_0001_1][Event:DAG_STARTED]: dagID=dag_1463523766649_0001_1, startTime=1463523766847
2016-05-17 22:22:46,847 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:22:46,847 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523766649_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:22:46,847 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: CC494F3AA9B04BC0864DDABB729AE7B6 : {2679735EAF3F40308C810D6416F1CDCD={InputName=2679735EAF3F40308C810D6416F1CDCD}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:22:46,847 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 2679735EAF3F40308C810D6416F1CDCD, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:22:46,847 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...e/perpetualcascade/second, applicationId=application_1463523766649_0001, dagName=[69FF36362C544D29BEC3F6401182EC8B/D7132EDBBD854FF0B77AB09A72B1842E] second/(1/1) ...e/perpetualcascade/second
2016-05-17 22:22:46,848 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:22:46,848 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6]
2016-05-17 22:22:46,848 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6]
2016-05-17 22:22:46,848 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6]
2016-05-17 22:22:46,848 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6]. Starting root input initializers: 1
2016-05-17 22:22:46,851 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:22:46,851 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 2679735EAF3F40308C810D6416F1CDCD on vertex vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6]
2016-05-17 22:22:46,855 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:22:46,855 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 2679735EAF3F40308C810D6416F1CDCD asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:22:46,858 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:22:46,858 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:22:46,872 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second] submitted tez dag to app master: application_1463523766649_0001, with dag id: dag_1463523766649_0001_1
2016-05-17 22:22:46,881 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 574
2016-05-17 22:22:46,881 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 2679735EAF3F40308C810D6416F1CDCD on vertex vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6]
2016-05-17 22:22:46,882 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:22:46,882 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {2679735EAF3F40308C810D6416F1CDCD=forAllWorkUnits=true, update=[1]}
2016-05-17 22:22:46,882 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6] parallelism set to 1
2016-05-17 22:22:46,883 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:22:46,883 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766649_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463523766649_0001_1_00, eventCount=1
2016-05-17 22:22:46,883 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6]
2016-05-17 22:22:46,883 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=8DAB41B9EFB44D82B2A5672EB70786CF, vertexId=vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:22:46,883 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=8DAB41B9EFB44D82B2A5672EB70786CF, vertexId=vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6]
2016-05-17 22:22:46,886 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=8DAB41B9EFB44D82B2A5672EB70786CF, vertexName=CC494F3AA9B04BC0864DDABB729AE7B6, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:22:46,886 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=8DAB41B9EFB44D82B2A5672EB70786CF, vertexId=vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6]
2016-05-17 22:22:46,887 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:22:46,888 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766649_0001_1][Event:VERTEX_INITIALIZED]: vertexName=CC494F3AA9B04BC0864DDABB729AE7B6, vertexId=vertex_1463523766649_0001_1_00, initRequestedTime=1463523766847, initedTime=1463523766887, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:22:46,888 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6] with distanceFromRoot: 0
2016-05-17 22:22:46,888 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:22:46,889 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in CC494F3AA9B04BC0864DDABB729AE7B6
2016-05-17 22:22:46,889 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6]
2016-05-17 22:22:46,889 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:22:46,889 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766649_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463523766649_0001_1_00, startRequestedTime=1463523766889, startedTime=1463523766889
2016-05-17 22:22:46,890 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:22:46,890 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:22:46,891 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766649_0001_1][Event:TASK_STARTED]: vertexName=CC494F3AA9B04BC0864DDABB729AE7B6, taskId=task_1463523766649_0001_1_00_000000, scheduledTime=1463523766890, launchTime=1463523766890
2016-05-17 22:22:46,891 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523766649_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:22:46,891 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6]
2016-05-17 22:22:46,891 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [69FF36362C544D29BEC3F6401182EC8B/D7132EDBBD854FF0B77AB09A72B1842E] second/(1/1) ...e/perpetualcascade/second, VertexName: CC494F3AA9B04BC0864DDABB729AE7B6, VertexParallelism: 1, TaskAttemptID:attempt_1463523766649_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=2679735EAF3F40308C810D6416F1CDCD, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=8DAB41B9EFB44D82B2A5672EB70786CF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:22:46,891 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523766649_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:22:46,891 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:22:46,894 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:22:46,894 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:22:46,894 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:22:46,895 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463523766649_0001_00_000001
2016-05-17 22:22:46,895 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523766649_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:22:46,897 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1463523766649_0001_00_000001
2016-05-17 22:22:46,897 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:22:46,900 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523766649_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:22:46,900 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:22:46,900 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766649_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463523766649_0001_00_000001, launchTime=1463523766900
2016-05-17 22:22:46,901 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463523766649_0001_00_000001
2016-05-17 22:22:46,902 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463523766649_0001_1_00_000000_0] to container: [container_1463523766649_0001_00_000001]
2016-05-17 22:22:46,902 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523766649_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:22:46,903 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463523766649_0001_1_00_000000_0] started. Is using containerId: [container_1463523766649_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:22:46,903 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766649_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=CC494F3AA9B04BC0864DDABB729AE7B6, taskAttemptId=attempt_1463523766649_0001_1_00_000000_0, startTime=1463523766902, containerId=container_1463523766649_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463523766649_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:22:46,903 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523766649_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:22:46,903 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:22:46,903 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523766649_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:22:46,904 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463523766649_0001_00_000001 given task: attempt_1463523766649_0001_1_00_000000_0
2016-05-17 22:22:46,904 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463523766649_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463523766649_0001_1_00_000000_0
2016-05-17 22:22:46 Starting to run new task attempt: attempt_1463523766649_0001_1_00_000000_0
2016-05-17 22:22:46,905 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463523766649_0001_1_00_000000_0
2016-05-17 22:22:46,905 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:46,905 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:22:46,905 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:22:46,905 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:22:46,905 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:22:46,905 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:22:46,905 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [69FF36362C544D29BEC3F6401182EC8B/D7132EDBBD854FF0B77AB09A72B1842E] second/(1/1) ...e/perpetualcascade/second, VertexName: CC494F3AA9B04BC0864DDABB729AE7B6, VertexParallelism: 1, TaskAttemptID:attempt_1463523766649_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=2679735EAF3F40308C810D6416F1CDCD, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=8DAB41B9EFB44D82B2A5672EB70786CF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:22:46,906 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:22:46,908 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463523766649_0001_1_00_000000_0
2016-05-17 22:22:46,912 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:22:46,912 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:46,913 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=2679735EAF3F40308C810D6416F1CDCD, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:22:46,914 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:22:46,914 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 2679735EAF3F40308C810D6416F1CDCD
2016-05-17 22:22:46,914 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 2679735EAF3F40308C810D6416F1CDCD
2016-05-17 22:22:46,915 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:46,916 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=8DAB41B9EFB44D82B2A5672EB70786CF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:22:46,916 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:22:46,916 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 8DAB41B9EFB44D82B2A5672EB70786CF
2016-05-17 22:22:46,916 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:22:46,916 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 8DAB41B9EFB44D82B2A5672EB70786CF
2016-05-17 22:22:46,921 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:22:46,921 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463523766649_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:22:46,925 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:22:46,925 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 2679735EAF3F40308C810D6416F1CDCD
2016-05-17 22:22:46,925 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 2679735EAF3F40308C810D6416F1CDCD
2016-05-17 22:22:46,937 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: CC494F3AA9B04BC0864DDABB729AE7B6, ordinal: 0
2016-05-17 22:22:46,937 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: CC494F3AA9B04BC0864DDABB729AE7B6, mem on start (mb), free: 294, total: 397, max: 672
2016-05-17 22:22:46,937 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:46,938 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:22:46,938 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:22:46,946 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:22:46,946 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 8DAB41B9EFB44D82B2A5672EB70786CF
2016-05-17 22:22:46,947 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:22:46,947 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:22:46,947 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:22:46,947 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:22:46,947 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:22:46,947 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:22:46,948 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:22:46,948 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:22:46,948 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 2679735EAF3F40308C810D6416F1CDCD, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:22:46,948 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 8DAB41B9EFB44D82B2A5672EB70786CF, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:22:46,948 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:22:46,948 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 2679735EAF3F40308C810D6416F1CDCD being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:22:46,948 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:22:46,949 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:22:46,949 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 2679735EAF3F40308C810D6416F1CDCD
2016-05-17 22:22:46,949 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:22:46,949 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 2679735EAF3F40308C810D6416F1CDCD
2016-05-17 22:22:46,949 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:22:46,951 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463523766649_0001_1_00_000000_0
2016-05-17 22:22:46,954 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first"]
2016-05-17 22:22:46,955 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first"] streamed: true, id: 2679735EAF3F40308C810D6416F1CDCD
2016-05-17 22:22:46,955 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second"], id: 8DAB41B9EFB44D82B2A5672EB70786CF
2016-05-17 22:22:46,955 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second"]
2016-05-17 22:22:46,956 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first"]
2016-05-17 22:22:46,956 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:22:46,956 INFO  input.MRInput (MRInput.java:checkAndAwaitRecordReaderInitialization(597)) - Awaiting RecordReader initialization
2016-05-17 22:22:46,956 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:22:46,959 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@407b88e6
2016-05-17 22:22:46,961 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@407b88e6
2016-05-17 22:22:46,961 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:22:46,961 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:22:46,962 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: CC494F3AA9B04BC0864DDABB729AE7B6, all 1 inputs ready in: 00:00:00.000
2016-05-17 22:22:46,968 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:22:46,968 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:22:46,969 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463523766649_0001_1_00_000000_0
2016-05-17 22:22:46,970 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463523766649_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:22:46,971 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463523766649_0001_1_00_000000_0
2016-05-17 22:22:46,972 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: CC494F3AA9B04BC0864DDABB729AE7B6, mem on close (mb), free: 292, total: 397, max: 672
2016-05-17 22:22:46 Completed running task attempt: attempt_1463523766649_0001_1_00_000000_0
2016-05-17 22:22:46,973 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463523766649_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:22:46,981 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766649_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=CC494F3AA9B04BC0864DDABB729AE7B6, taskAttemptId=attempt_1463523766649_0001_1_00_000000_0, startTime=1463523766902, finishTime=1463523766980, timeTaken=78, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523766962, Process_Duration=9, Process_End_Time=1463523766971, Read_Duration=3, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:46,981 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:22:46,981 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523766649_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:22:46,982 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:22:46,982 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463523766649_0001_1_00_000000_0
2016-05-17 22:22:46,983 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766649_0001_1][Event:TASK_FINISHED]: vertexName=CC494F3AA9B04BC0864DDABB729AE7B6, taskId=task_1463523766649_0001_1_00_000000, startTime=1463523766902, finishTime=1463523766983, timeTaken=81, status=SUCCEEDED, successfulAttemptID=attempt_1463523766649_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523766962, Process_Duration=9, Process_End_Time=1463523766971, Read_Duration=3, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:46,984 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523766649_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:22:46,984 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:22:46,987 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6] : 1
2016-05-17 22:22:46,987 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6]
2016-05-17 22:22:46,989 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1463523766962, Process_Duration=9, Process_End_Time=1463523766971, Read_Duration=3, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-05-17 22:22:46,990 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:22:46,990 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-05-17 22:22:46,992 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:46,992 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463523766649_0001_00_000001
2016-05-17 22:22:46,990 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766649_0001_1][Event:VERTEX_FINISHED]: vertexName=CC494F3AA9B04BC0864DDABB729AE7B6, vertexId=vertex_1463523766649_0001_1_00, initRequestedTime=1463523766847, initedTime=1463523766887, startRequestedTime=1463523766889, startedTime=1463523766889, finishTime=1463523766987, timeTaken=98, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523766962, Process_Duration=9, Process_End_Time=1463523766971, Read_Duration=3, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1463523766902, firstTasksToStart=[ task_1463523766649_0001_1_00_000000 ], lastTaskFinishTime=1463523766980, lastTasksToFinish=[ task_1463523766649_0001_1_00_000000 ], minTaskDuration=78, maxTaskDuration=78, avgTaskDuration=78.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463523766649_0001_1_00_000000 ], longestDurationTasks=[ task_1463523766649_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:22:46,993 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:22:46,993 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523766649_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:22:46,994 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766649_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463523766649_0001_00_000001, stoppedTime=1463523766994, exitStatus=0
2016-05-17 22:22:46,994 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523766649_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:22:46,995 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:22:46,995 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463523766649_0001_1
2016-05-17 22:22:46,996 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766649_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463523766649_0001_1
2016-05-17 22:22:46,996 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 8DAB41B9EFB44D82B2A5672EB70786CF for vertex: vertex_1463523766649_0001_1_00 [CC494F3AA9B04BC0864DDABB729AE7B6]
2016-05-17 22:22:46,994 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:22:47,002 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463523766649_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:22:47,003 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463523766649_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:22:47,003 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463523766649_0001_00_000001, Exiting
2016-05-17 22:22:47,003 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463523766649_0001_00_000001
2016-05-17 22:22:47,003 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463523766649_0001_00_000001
2016-05-17 22:22:47,007 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463523766649_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:22:47,008 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463523766649_0001_00_000001 completed successfully
2016-05-17 22:22:47,013 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463523766649_0001_1, queueSize=0
2016-05-17 22:22:47,014 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:22:47,014 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523766649_0001_1][Event:DAG_FINISHED]: dagId=dag_1463523766649_0001_1, startTime=1463523766847, finishTime=1463523767012, timeTaken=165, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523766962, Process_Duration=9, Process_End_Time=1463523766971, Read_Duration=3, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:47,014 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463523766649_0001_1 finished with state: SUCCEEDED
2016-05-17 22:22:47,014 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523766649_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:22:47,015 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463523766649_0001_00_000001
2016-05-17 22:22:47,015 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523766649_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:22:47 Completed Dag: dag_1463523766649_0001_1
2016-05-17 22:22:47,018 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463523766649_0001_1, dagState=SUCCEEDED
2016-05-17 22:22:47,018 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463523766649_0001_1_post
2016-05-17 22:22:47,019 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:47,019 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:22:47,024 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...e/perpetualcascade/second, applicationId=application_1463523766649_0001
2016-05-17 22:22:47,028 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:22:47,028 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:22:47,028 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:22:47,028 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:22:47,028 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:22:47,029 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:22:47,030 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:22:47,030 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:22:47,031 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:22:47,031 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:22:47,032 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:22:47,033 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:22:47,033 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:22:47,040 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/69FF36362C544D29BEC3F6401182EC8B/D7132EDBBD854FF0B77AB09A72B1842E/.tez/application_1463523766649_0001
2016-05-17 22:22:47,041 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second/_temporary
2016-05-17 22:22:47,041 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second]  completed in: 00:00.411
2016-05-17 22:22:47,042 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third] completed flow: second
2016-05-17 22:22:47,042 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third] starting flow: third
2016-05-17 22:22:47,042 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] at least one sink is marked for delete
2016-05-17 22:22:47,042 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-17 22:22:47,047 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] starting
2016-05-17 22:22:47,048 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second"]
2016-05-17 22:22:47,048 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third]  sink: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third"]
2016-05-17 22:22:47,049 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third]  parallel execution of steps is enabled: false
2016-05-17 22:22:47,049 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third]  executing total steps: 1
2016-05-17 22:22:47,050 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third]  allocating management threads: 1
2016-05-17 22:22:47,051 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] starting step: (1/1) ...de/perpetualcascade/third
2016-05-17 22:22:47,051 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [third] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:22:47,072 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] tez session mode enabled: true
2016-05-17 22:22:47,077 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:22:47,078 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:22:47,078 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-17 22:22:47,089 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/156FF5E0C5474361825598D6DE331432/CBE3834D04DB426E866C7A8D5E902511/.tez/application_1463523767078_0001 doesn't exist and is created
2016-05-17 22:22:47,107 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:22:47,107 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:22:47,108 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/156FF5E0C5474361825598D6DE331432/CBE3834D04DB426E866C7A8D5E902511/.tez/application_1463523767078_0001
2016-05-17 22:22:47,112 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463523767078_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:22:47,125 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:22:47,126 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:22:47,128 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:22:47,128 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:22:47,129 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/156FF5E0C5474361825598D6DE331432/CBE3834D04DB426E866C7A8D5E902511/.tez/application_1463523767078_0001/localmode-log-dir
2016-05-17 22:22:47,129 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/156FF5E0C5474361825598D6DE331432/CBE3834D04DB426E866C7A8D5E902511/.tez/application_1463523767078_0001/localmode-log-dir/history.txt.appattempt_1463523767078_0001_000000, maxErrors=10
2016-05-17 22:22:47,129 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:22:47,130 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463523767078_0001_000000, appSubmitTime=1463523767111, launchTime=1463523767111
2016-05-17 22:22:47,134 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:22:47,135 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:22:47,138 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:22:47,138 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:22:47,143 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:52268
2016-05-17 22:22:47,144 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:22:47,147 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463523767078_0001_000000, startTime=1463523767147
2016-05-17 22:22:47,147 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:22:47,147 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:22:47,207 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:22:47,208 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:22:47,208 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...de/perpetualcascade/third, applicationId=application_1463523767078_0001, dagName=[156FF5E0C5474361825598D6DE331432/CBE3834D04DB426E866C7A8D5E902511] third/(1/1) ...de/perpetualcascade/third
2016-05-17 22:22:47,228 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [156FF5E0C5474361825598D6DE331432/CBE3834D04DB426E866C7A8D5E902511] third/(1/1) ...de/perpetualcascade/third
2016-05-17 22:22:47,230 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463523767078_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/156FF5E0C5474361825598D6DE331432/CBE3834D04DB426E866C7A8D5E902511/.tez/application_1463523767078_0001/localmode-log-dir/dag_1463523767078_0001_1.dot
2016-05-17 22:22:47,231 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/156FF5E0C5474361825598D6DE331432/CBE3834D04DB426E866C7A8D5E902511/.tez/application_1463523767078_0001/localmode-log-dir/dag_1463523767078_0001_1-tez-dag.pb.txt
2016-05-17 22:22:47,247 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463523767078_0001_1
2016-05-17 22:22:47,248 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:47,248 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [156FF5E0C5474361825598D6DE331432/CBE3834D04DB426E866C7A8D5E902511] third/(1/1) ...de/perpetualcascade/third
2016-05-17 22:22:47 Running Dag: dag_1463523767078_0001_1
2016-05-17 22:22:47,263 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767078_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463523767078_0001_1, submitTime=1463523767229
2016-05-17 22:22:47,263 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:22:47,264 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex F3447422128147E49C788829848D41AF
2016-05-17 22:22:47,264 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:22:47,265 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767078_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463523767078_0001_1, initTime=1463523767264
2016-05-17 22:22:47,266 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:22:47,266 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523767078_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:22:47,266 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767078_0001_1][Event:DAG_STARTED]: dagID=dag_1463523767078_0001_1, startTime=1463523767266
2016-05-17 22:22:47,266 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:22:47,267 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523767078_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:22:47,267 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: F3447422128147E49C788829848D41AF : {8DAB41B9EFB44D82B2A5672EB70786CF={InputName=8DAB41B9EFB44D82B2A5672EB70786CF}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:22:47,267 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 8DAB41B9EFB44D82B2A5672EB70786CF, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:22:47,267 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF]
2016-05-17 22:22:47,267 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF]
2016-05-17 22:22:47,268 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF]
2016-05-17 22:22:47,268 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF]. Starting root input initializers: 1
2016-05-17 22:22:47,266 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:22:47,270 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:22:47,276 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...de/perpetualcascade/third, applicationId=application_1463523767078_0001, dagName=[156FF5E0C5474361825598D6DE331432/CBE3834D04DB426E866C7A8D5E902511] third/(1/1) ...de/perpetualcascade/third
2016-05-17 22:22:47,285 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 8DAB41B9EFB44D82B2A5672EB70786CF on vertex vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF]
2016-05-17 22:22:47,286 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:22:47,286 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 8DAB41B9EFB44D82B2A5672EB70786CF asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:22:47,293 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:22:47,293 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:22:47,296 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third] submitted tez dag to app master: application_1463523767078_0001, with dag id: dag_1463523767078_0001_1
2016-05-17 22:22:47,313 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 576
2016-05-17 22:22:47,314 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 8DAB41B9EFB44D82B2A5672EB70786CF on vertex vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF]
2016-05-17 22:22:47,314 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:22:47,314 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {8DAB41B9EFB44D82B2A5672EB70786CF=forAllWorkUnits=true, update=[1]}
2016-05-17 22:22:47,314 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF] parallelism set to 1
2016-05-17 22:22:47,315 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:22:47,315 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767078_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463523767078_0001_1_00, eventCount=1
2016-05-17 22:22:47,315 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF]
2016-05-17 22:22:47,315 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=967FB7FC98B24BB9A0BD2C9D3121670F, vertexId=vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:22:47,316 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=967FB7FC98B24BB9A0BD2C9D3121670F, vertexId=vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF]
2016-05-17 22:22:47,319 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=967FB7FC98B24BB9A0BD2C9D3121670F, vertexName=F3447422128147E49C788829848D41AF, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:22:47,319 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=967FB7FC98B24BB9A0BD2C9D3121670F, vertexId=vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF]
2016-05-17 22:22:47,322 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767078_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F3447422128147E49C788829848D41AF, vertexId=vertex_1463523767078_0001_1_00, initRequestedTime=1463523767267, initedTime=1463523767322, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:22:47,322 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF] with distanceFromRoot: 0
2016-05-17 22:22:47,322 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:22:47,322 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:22:47,323 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in F3447422128147E49C788829848D41AF
2016-05-17 22:22:47,323 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF]
2016-05-17 22:22:47,324 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:22:47,325 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767078_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463523767078_0001_1_00, startRequestedTime=1463523767323, startedTime=1463523767323
2016-05-17 22:22:47,325 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:22:47,326 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:22:47,327 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767078_0001_1][Event:TASK_STARTED]: vertexName=F3447422128147E49C788829848D41AF, taskId=task_1463523767078_0001_1_00_000000, scheduledTime=1463523767326, launchTime=1463523767326
2016-05-17 22:22:47,327 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523767078_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:22:47,327 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF]
2016-05-17 22:22:47,327 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [156FF5E0C5474361825598D6DE331432/CBE3834D04DB426E866C7A8D5E902511] third/(1/1) ...de/perpetualcascade/third, VertexName: F3447422128147E49C788829848D41AF, VertexParallelism: 1, TaskAttemptID:attempt_1463523767078_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8DAB41B9EFB44D82B2A5672EB70786CF, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=967FB7FC98B24BB9A0BD2C9D3121670F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:22:47,328 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523767078_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:22:47,328 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:22:47,329 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:22:47,329 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:22:47,329 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:22:47,330 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463523767078_0001_00_000001
2016-05-17 22:22:47,330 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523767078_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:22:47,332 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1463523767078_0001_00_000001
2016-05-17 22:22:47,333 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:22:47,333 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523767078_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:22:47,334 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:22:47,334 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767078_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463523767078_0001_00_000001, launchTime=1463523767334
2016-05-17 22:22:47,335 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463523767078_0001_00_000001
2016-05-17 22:22:47,336 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463523767078_0001_1_00_000000_0] to container: [container_1463523767078_0001_00_000001]
2016-05-17 22:22:47,336 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523767078_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:22:47,338 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463523767078_0001_1_00_000000_0] started. Is using containerId: [container_1463523767078_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:22:47,338 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767078_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F3447422128147E49C788829848D41AF, taskAttemptId=attempt_1463523767078_0001_1_00_000000_0, startTime=1463523767338, containerId=container_1463523767078_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463523767078_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:22:47,338 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523767078_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:22:47,339 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523767078_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:22:47,339 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:22:47,340 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463523767078_0001_00_000001 given task: attempt_1463523767078_0001_1_00_000000_0
2016-05-17 22:22:47,340 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463523767078_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463523767078_0001_1_00_000000_0
2016-05-17 22:22:47 Starting to run new task attempt: attempt_1463523767078_0001_1_00_000000_0
2016-05-17 22:22:47,341 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463523767078_0001_1_00_000000_0
2016-05-17 22:22:47,341 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:47,341 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:22:47,341 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:22:47,342 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:22:47,342 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:22:47,342 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:22:47,342 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [156FF5E0C5474361825598D6DE331432/CBE3834D04DB426E866C7A8D5E902511] third/(1/1) ...de/perpetualcascade/third, VertexName: F3447422128147E49C788829848D41AF, VertexParallelism: 1, TaskAttemptID:attempt_1463523767078_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8DAB41B9EFB44D82B2A5672EB70786CF, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=967FB7FC98B24BB9A0BD2C9D3121670F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:22:47,342 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:22:47,347 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463523767078_0001_1_00_000000_0
2016-05-17 22:22:47,348 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:22:47,348 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463523767078_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:22:47,348 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:47,350 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:47,350 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=8DAB41B9EFB44D82B2A5672EB70786CF, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:22:47,351 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:22:47,351 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 8DAB41B9EFB44D82B2A5672EB70786CF
2016-05-17 22:22:47,351 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 8DAB41B9EFB44D82B2A5672EB70786CF
2016-05-17 22:22:47,353 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:22:47,359 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:22:47,360 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 8DAB41B9EFB44D82B2A5672EB70786CF
2016-05-17 22:22:47,361 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 8DAB41B9EFB44D82B2A5672EB70786CF
2016-05-17 22:22:47,366 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=967FB7FC98B24BB9A0BD2C9D3121670F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:22:47,368 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:22:47,368 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 967FB7FC98B24BB9A0BD2C9D3121670F
2016-05-17 22:22:47,368 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:22:47,368 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 967FB7FC98B24BB9A0BD2C9D3121670F
2016-05-17 22:22:47,376 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F3447422128147E49C788829848D41AF, ordinal: 0
2016-05-17 22:22:47,376 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F3447422128147E49C788829848D41AF, mem on start (mb), free: 251, total: 397, max: 672
2016-05-17 22:22:47,376 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:47,376 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:22:47,377 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:22:47,382 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:22:47,382 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 967FB7FC98B24BB9A0BD2C9D3121670F
2016-05-17 22:22:47,383 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:22:47,383 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:22:47,383 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:22:47,383 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:22:47,383 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:22:47,383 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:22:47,383 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:22:47,384 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:22:47,384 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 8DAB41B9EFB44D82B2A5672EB70786CF, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:22:47,384 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 967FB7FC98B24BB9A0BD2C9D3121670F, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:22:47,384 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:22:47,384 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 8DAB41B9EFB44D82B2A5672EB70786CF being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:22:47,384 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 8DAB41B9EFB44D82B2A5672EB70786CF
2016-05-17 22:22:47,384 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:22:47,384 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 8DAB41B9EFB44D82B2A5672EB70786CF
2016-05-17 22:22:47,384 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:22:47,388 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:22:47,388 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:22:47,388 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463523767078_0001_1_00_000000_0
2016-05-17 22:22:47,391 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second"]
2016-05-17 22:22:47,392 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second"] streamed: true, id: 8DAB41B9EFB44D82B2A5672EB70786CF
2016-05-17 22:22:47,392 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third"], id: 967FB7FC98B24BB9A0BD2C9D3121670F
2016-05-17 22:22:47,392 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third"]
2016-05-17 22:22:47,393 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second"]
2016-05-17 22:22:47,393 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:22:47,393 INFO  input.MRInput (MRInput.java:checkAndAwaitRecordReaderInitialization(597)) - Awaiting RecordReader initialization
2016-05-17 22:22:47,393 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:22:47,394 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@57da29fb
2016-05-17 22:22:47,395 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@57da29fb
2016-05-17 22:22:47,395 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:22:47,395 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:22:47,396 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F3447422128147E49C788829848D41AF, all 1 inputs ready in: 00:00:00.001
2016-05-17 22:22:47,400 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:22:47,400 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:22:47,401 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463523767078_0001_1_00_000000_0
2016-05-17 22:22:47,401 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463523767078_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:22:47,403 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463523767078_0001_1_00_000000_0
2016-05-17 22:22:47,403 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F3447422128147E49C788829848D41AF, mem on close (mb), free: 249, total: 397, max: 672
2016-05-17 22:22:47 Completed running task attempt: attempt_1463523767078_0001_1_00_000000_0
2016-05-17 22:22:47,405 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463523767078_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:22:47,407 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1463523767396, Process_Duration=7, Process_End_Time=1463523767403, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-05-17 22:22:47,408 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767078_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F3447422128147E49C788829848D41AF, taskAttemptId=attempt_1463523767078_0001_1_00_000000_0, startTime=1463523767338, finishTime=1463523767407, timeTaken=69, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523767396, Process_Duration=7, Process_End_Time=1463523767403, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:47,408 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-05-17 22:22:47,409 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:47,409 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463523767078_0001_00_000001
2016-05-17 22:22:47,409 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:22:47,410 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523767078_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:22:47,410 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463523767078_0001_1_00_000000_0
2016-05-17 22:22:47,410 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:22:47,411 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767078_0001_1][Event:TASK_FINISHED]: vertexName=F3447422128147E49C788829848D41AF, taskId=task_1463523767078_0001_1_00_000000, startTime=1463523767338, finishTime=1463523767410, timeTaken=72, status=SUCCEEDED, successfulAttemptID=attempt_1463523767078_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523767396, Process_Duration=7, Process_End_Time=1463523767403, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:47,411 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:22:47,411 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523767078_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:22:47,411 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF] : 1
2016-05-17 22:22:47,411 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF]
2016-05-17 22:22:47,414 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767078_0001_1][Event:VERTEX_FINISHED]: vertexName=F3447422128147E49C788829848D41AF, vertexId=vertex_1463523767078_0001_1_00, initRequestedTime=1463523767267, initedTime=1463523767322, startRequestedTime=1463523767323, startedTime=1463523767323, finishTime=1463523767411, timeTaken=88, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523767396, Process_Duration=7, Process_End_Time=1463523767403, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1463523767338, firstTasksToStart=[ task_1463523767078_0001_1_00_000000 ], lastTaskFinishTime=1463523767407, lastTasksToFinish=[ task_1463523767078_0001_1_00_000000 ], minTaskDuration=69, maxTaskDuration=69, avgTaskDuration=69.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463523767078_0001_1_00_000000 ], longestDurationTasks=[ task_1463523767078_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:22:47,415 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:22:47,415 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523767078_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:22:47,415 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767078_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463523767078_0001_00_000001, stoppedTime=1463523767415, exitStatus=0
2016-05-17 22:22:47,415 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523767078_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:22:47,415 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:22:47,416 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463523767078_0001_1
2016-05-17 22:22:47,414 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:22:47,417 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:22:47,418 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767078_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463523767078_0001_1
2016-05-17 22:22:47,419 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 967FB7FC98B24BB9A0BD2C9D3121670F for vertex: vertex_1463523767078_0001_1_00 [F3447422128147E49C788829848D41AF]
2016-05-17 22:22:47,422 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463523767078_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:22:47,422 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463523767078_0001_00_000001: 13 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:22:47,422 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463523767078_0001_00_000001, Exiting
2016-05-17 22:22:47,422 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463523767078_0001_00_000001
2016-05-17 22:22:47,422 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463523767078_0001_00_000001
2016-05-17 22:22:47,426 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463523767078_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:22:47,426 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463523767078_0001_00_000001 completed successfully
2016-05-17 22:22:47,433 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463523767078_0001_1, queueSize=0
2016-05-17 22:22:47,433 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:22:47,434 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767078_0001_1][Event:DAG_FINISHED]: dagId=dag_1463523767078_0001_1, startTime=1463523767266, finishTime=1463523767432, timeTaken=166, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523767396, Process_Duration=7, Process_End_Time=1463523767403, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:47,434 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463523767078_0001_1 finished with state: SUCCEEDED
2016-05-17 22:22:47,434 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523767078_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:22:47,434 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523767078_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:22:47,434 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463523767078_0001_00_000001
2016-05-17 22:22:47 Completed Dag: dag_1463523767078_0001_1
2016-05-17 22:22:47,435 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463523767078_0001_1, dagState=SUCCEEDED
2016-05-17 22:22:47,435 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463523767078_0001_1_post
2016-05-17 22:22:47,435 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:47,435 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:22:47,444 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...de/perpetualcascade/third, applicationId=application_1463523767078_0001
2016-05-17 22:22:47,448 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:22:47,448 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:22:47,448 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:22:47,448 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:22:47,449 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:22:47,449 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:22:47,450 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:22:47,450 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:22:47,450 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:22:47,450 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:22:47,451 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:22:47,451 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:22:47,451 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:22:47,456 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/156FF5E0C5474361825598D6DE331432/CBE3834D04DB426E866C7A8D5E902511/.tez/application_1463523767078_0001
2016-05-17 22:22:47,456 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third/_temporary
2016-05-17 22:22:47,457 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third]  completed in: 00:00.409
2016-05-17 22:22:47,457 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third] completed flow: third
2016-05-17 22:22:47,458 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third] starting flow: fourth
2016-05-17 22:22:47,458 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] at least one sink is marked for delete
2016-05-17 22:22:47,459 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-17 22:22:47,464 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] starting
2016-05-17 22:22:47,464 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth]  source: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third"]
2016-05-17 22:22:47,465 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth]  sink: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/fourth"]
2016-05-17 22:22:47,465 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth]  parallel execution of steps is enabled: false
2016-05-17 22:22:47,465 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth]  executing total steps: 1
2016-05-17 22:22:47,465 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth]  allocating management threads: 1
2016-05-17 22:22:47,466 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] starting step: (1/1) ...e/perpetualcascade/fourth
2016-05-17 22:22:47,466 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [fourth] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:22:47,486 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] tez session mode enabled: true
2016-05-17 22:22:47,492 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:22:47,493 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:22:47,493 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-17 22:22:47,506 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/991F5E851ED04AC9869962053E2F69C6/E4B23ED94C284127BDAC80191086AFD2/.tez/application_1463523767492_0001 doesn't exist and is created
2016-05-17 22:22:47,530 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:22:47,530 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:22:47,531 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/991F5E851ED04AC9869962053E2F69C6/E4B23ED94C284127BDAC80191086AFD2/.tez/application_1463523767492_0001
2016-05-17 22:22:47,538 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463523767492_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:22:47,557 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:22:47,558 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:22:47,561 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:22:47,561 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:22:47,561 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/991F5E851ED04AC9869962053E2F69C6/E4B23ED94C284127BDAC80191086AFD2/.tez/application_1463523767492_0001/localmode-log-dir
2016-05-17 22:22:47,562 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/991F5E851ED04AC9869962053E2F69C6/E4B23ED94C284127BDAC80191086AFD2/.tez/application_1463523767492_0001/localmode-log-dir/history.txt.appattempt_1463523767492_0001_000000, maxErrors=10
2016-05-17 22:22:47,562 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:22:47,564 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463523767492_0001_000000, appSubmitTime=1463523767537, launchTime=1463523767537
2016-05-17 22:22:47,572 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:22:47,577 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:22:47,578 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:36324
2016-05-17 22:22:47,583 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:22:47,586 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:22:47,588 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:22:47,590 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463523767492_0001_000000, startTime=1463523767590
2016-05-17 22:22:47,590 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:22:47,590 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:22:47,630 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:22:47,631 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:22:47,631 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...e/perpetualcascade/fourth, applicationId=application_1463523767492_0001, dagName=[991F5E851ED04AC9869962053E2F69C6/E4B23ED94C284127BDAC80191086AFD2] fourth/(1/1) ...e/perpetualcascade/fourth
2016-05-17 22:22:47,649 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [991F5E851ED04AC9869962053E2F69C6/E4B23ED94C284127BDAC80191086AFD2] fourth/(1/1) ...e/perpetualcascade/fourth
2016-05-17 22:22:47,650 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463523767492_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/991F5E851ED04AC9869962053E2F69C6/E4B23ED94C284127BDAC80191086AFD2/.tez/application_1463523767492_0001/localmode-log-dir/dag_1463523767492_0001_1.dot
2016-05-17 22:22:47,651 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/991F5E851ED04AC9869962053E2F69C6/E4B23ED94C284127BDAC80191086AFD2/.tez/application_1463523767492_0001/localmode-log-dir/dag_1463523767492_0001_1-tez-dag.pb.txt
2016-05-17 22:22:47,666 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463523767492_0001_1
2016-05-17 22:22:47,666 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:47,666 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [991F5E851ED04AC9869962053E2F69C6/E4B23ED94C284127BDAC80191086AFD2] fourth/(1/1) ...e/perpetualcascade/fourth
2016-05-17 22:22:47 Running Dag: dag_1463523767492_0001_1
2016-05-17 22:22:47,680 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767492_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463523767492_0001_1, submitTime=1463523767649
2016-05-17 22:22:47,680 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:22:47,681 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex ABB98ED9653F41BE91D8998130133F5F
2016-05-17 22:22:47,682 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:22:47,683 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767492_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463523767492_0001_1, initTime=1463523767681
2016-05-17 22:22:47,683 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:22:47,684 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523767492_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:22:47,685 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767492_0001_1][Event:DAG_STARTED]: dagID=dag_1463523767492_0001_1, startTime=1463523767684
2016-05-17 22:22:47,685 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:22:47,685 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:22:47,685 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523767492_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:22:47,685 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: ABB98ED9653F41BE91D8998130133F5F : {967FB7FC98B24BB9A0BD2C9D3121670F={InputName=967FB7FC98B24BB9A0BD2C9D3121670F}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:22:47,685 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 967FB7FC98B24BB9A0BD2C9D3121670F, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:22:47,685 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F]
2016-05-17 22:22:47,686 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F]
2016-05-17 22:22:47,686 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F]
2016-05-17 22:22:47,686 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F]. Starting root input initializers: 1
2016-05-17 22:22:47,686 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:22:47,686 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...e/perpetualcascade/fourth, applicationId=application_1463523767492_0001, dagName=[991F5E851ED04AC9869962053E2F69C6/E4B23ED94C284127BDAC80191086AFD2] fourth/(1/1) ...e/perpetualcascade/fourth
2016-05-17 22:22:47,687 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 967FB7FC98B24BB9A0BD2C9D3121670F on vertex vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F]
2016-05-17 22:22:47,689 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:22:47,689 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 967FB7FC98B24BB9A0BD2C9D3121670F asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:22:47,689 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:22:47,690 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:22:47,705 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth] submitted tez dag to app master: application_1463523767492_0001, with dag id: dag_1463523767492_0001_1
2016-05-17 22:22:47,706 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 574
2016-05-17 22:22:47,707 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 967FB7FC98B24BB9A0BD2C9D3121670F on vertex vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F]
2016-05-17 22:22:47,707 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:22:47,707 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {967FB7FC98B24BB9A0BD2C9D3121670F=forAllWorkUnits=true, update=[1]}
2016-05-17 22:22:47,707 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F] parallelism set to 1
2016-05-17 22:22:47,707 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:22:47,708 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767492_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463523767492_0001_1_00, eventCount=1
2016-05-17 22:22:47,708 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F]
2016-05-17 22:22:47,708 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=A706375903B74E3B80EA03E8AB9F1FED, vertexId=vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:22:47,708 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=A706375903B74E3B80EA03E8AB9F1FED, vertexId=vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F]
2016-05-17 22:22:47,710 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=A706375903B74E3B80EA03E8AB9F1FED, vertexName=ABB98ED9653F41BE91D8998130133F5F, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:22:47,710 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=A706375903B74E3B80EA03E8AB9F1FED, vertexId=vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F]
2016-05-17 22:22:47,712 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767492_0001_1][Event:VERTEX_INITIALIZED]: vertexName=ABB98ED9653F41BE91D8998130133F5F, vertexId=vertex_1463523767492_0001_1_00, initRequestedTime=1463523767685, initedTime=1463523767712, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:22:47,712 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:22:47,712 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F] with distanceFromRoot: 0
2016-05-17 22:22:47,713 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:22:47,714 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in ABB98ED9653F41BE91D8998130133F5F
2016-05-17 22:22:47,714 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F]
2016-05-17 22:22:47,714 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:22:47,714 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767492_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463523767492_0001_1_00, startRequestedTime=1463523767713, startedTime=1463523767713
2016-05-17 22:22:47,715 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:22:47,715 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:22:47,716 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767492_0001_1][Event:TASK_STARTED]: vertexName=ABB98ED9653F41BE91D8998130133F5F, taskId=task_1463523767492_0001_1_00_000000, scheduledTime=1463523767715, launchTime=1463523767715
2016-05-17 22:22:47,716 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523767492_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:22:47,716 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F]
2016-05-17 22:22:47,717 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [991F5E851ED04AC9869962053E2F69C6/E4B23ED94C284127BDAC80191086AFD2] fourth/(1/1) ...e/perpetualcascade/fourth, VertexName: ABB98ED9653F41BE91D8998130133F5F, VertexParallelism: 1, TaskAttemptID:attempt_1463523767492_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=967FB7FC98B24BB9A0BD2C9D3121670F, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=A706375903B74E3B80EA03E8AB9F1FED, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:22:47,717 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523767492_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:22:47,717 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:22:47,718 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:22:47,718 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:22:47,719 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:22:47,719 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463523767492_0001_00_000001
2016-05-17 22:22:47,720 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523767492_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:22:47,721 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1463523767492_0001_00_000001
2016-05-17 22:22:47,721 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:22:47,722 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523767492_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:22:47,722 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:22:47,722 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767492_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463523767492_0001_00_000001, launchTime=1463523767722
2016-05-17 22:22:47,723 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463523767492_0001_00_000001
2016-05-17 22:22:47,724 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463523767492_0001_1_00_000000_0] to container: [container_1463523767492_0001_00_000001]
2016-05-17 22:22:47,724 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523767492_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:22:47,724 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463523767492_0001_00_000001 given task: attempt_1463523767492_0001_1_00_000000_0
2016-05-17 22:22:47,724 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463523767492_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463523767492_0001_1_00_000000_0
2016-05-17 22:22:47,725 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463523767492_0001_1_00_000000_0] started. Is using containerId: [container_1463523767492_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:22:47 Starting to run new task attempt: attempt_1463523767492_0001_1_00_000000_0
2016-05-17 22:22:47,725 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463523767492_0001_1_00_000000_0
2016-05-17 22:22:47,725 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:47,725 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:22:47,725 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767492_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=ABB98ED9653F41BE91D8998130133F5F, taskAttemptId=attempt_1463523767492_0001_1_00_000000_0, startTime=1463523767724, containerId=container_1463523767492_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463523767492_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:22:47,726 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523767492_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:22:47,726 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:22:47,726 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523767492_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:22:47,726 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:22:47,726 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:22:47,727 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:22:47,727 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:22:47,727 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [991F5E851ED04AC9869962053E2F69C6/E4B23ED94C284127BDAC80191086AFD2] fourth/(1/1) ...e/perpetualcascade/fourth, VertexName: ABB98ED9653F41BE91D8998130133F5F, VertexParallelism: 1, TaskAttemptID:attempt_1463523767492_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=967FB7FC98B24BB9A0BD2C9D3121670F, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=A706375903B74E3B80EA03E8AB9F1FED, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:22:47,728 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:22:47,728 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463523767492_0001_1_00_000000_0
2016-05-17 22:22:47,729 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:22:47,729 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463523767492_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:22:47,729 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:47,731 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:47,731 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=967FB7FC98B24BB9A0BD2C9D3121670F, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:22:47,731 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:22:47,732 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 967FB7FC98B24BB9A0BD2C9D3121670F
2016-05-17 22:22:47,732 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=A706375903B74E3B80EA03E8AB9F1FED, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:22:47,732 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 967FB7FC98B24BB9A0BD2C9D3121670F
2016-05-17 22:22:47,732 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:22:47,733 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: A706375903B74E3B80EA03E8AB9F1FED
2016-05-17 22:22:47,733 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:22:47,733 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: A706375903B74E3B80EA03E8AB9F1FED
2016-05-17 22:22:47,737 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:22:47,737 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:22:47,738 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 967FB7FC98B24BB9A0BD2C9D3121670F
2016-05-17 22:22:47,738 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 967FB7FC98B24BB9A0BD2C9D3121670F
2016-05-17 22:22:47,746 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:22:47,746 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: A706375903B74E3B80EA03E8AB9F1FED
2016-05-17 22:22:47,746 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: ABB98ED9653F41BE91D8998130133F5F, ordinal: 0
2016-05-17 22:22:47,746 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: ABB98ED9653F41BE91D8998130133F5F, mem on start (mb), free: 207, total: 397, max: 672
2016-05-17 22:22:47,747 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:22:47,747 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:22:47,747 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:22:47,747 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:22:47,747 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:22:47,748 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:22:47,748 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:22:47,748 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:22:47,748 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:22:47,748 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:22:47,748 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:22:47,749 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 967FB7FC98B24BB9A0BD2C9D3121670F, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:22:47,749 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, A706375903B74E3B80EA03E8AB9F1FED, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:22:47,749 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:22:47,749 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 967FB7FC98B24BB9A0BD2C9D3121670F being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:22:47,749 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 967FB7FC98B24BB9A0BD2C9D3121670F
2016-05-17 22:22:47,749 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:22:47,749 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 967FB7FC98B24BB9A0BD2C9D3121670F
2016-05-17 22:22:47,749 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:22:47,750 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:22:47,750 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:22:47,750 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463523767492_0001_1_00_000000_0
2016-05-17 22:22:47,751 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:22:47,752 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third"]
2016-05-17 22:22:47,753 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@5b9a4e8e
2016-05-17 22:22:47,753 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third"] streamed: true, id: 967FB7FC98B24BB9A0BD2C9D3121670F
2016-05-17 22:22:47,753 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/fourth"], id: A706375903B74E3B80EA03E8AB9F1FED
2016-05-17 22:22:47,753 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/fourth"]
2016-05-17 22:22:47,754 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third"]
2016-05-17 22:22:47,754 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:22:47,755 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@5b9a4e8e
2016-05-17 22:22:47,756 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:22:47,756 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:22:47,756 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: ABB98ED9653F41BE91D8998130133F5F, all 1 inputs ready in: 00:00:00.000
2016-05-17 22:22:47,759 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:22:47,760 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:22:47,760 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463523767492_0001_1_00_000000_0
2016-05-17 22:22:47,760 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463523767492_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:22:47,761 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463523767492_0001_1_00_000000_0
2016-05-17 22:22:47,761 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: ABB98ED9653F41BE91D8998130133F5F, mem on close (mb), free: 206, total: 397, max: 672
2016-05-17 22:22:47 Completed running task attempt: attempt_1463523767492_0001_1_00_000000_0
2016-05-17 22:22:47,763 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463523767492_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:22:47,764 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=807, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1463523767757, Process_Duration=4, Process_End_Time=1463523767761, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-05-17 22:22:47,764 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767492_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=ABB98ED9653F41BE91D8998130133F5F, taskAttemptId=attempt_1463523767492_0001_1_00_000000_0, startTime=1463523767724, finishTime=1463523767764, timeTaken=40, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=807, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523767757, Process_Duration=4, Process_End_Time=1463523767761, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:47,765 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463523767492_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:22:47,765 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:22:47,764 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:22:47,765 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463523767492_0001_1_00_000000_0
2016-05-17 22:22:47,766 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-05-17 22:22:47,766 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:47,767 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463523767492_0001_00_000001
2016-05-17 22:22:47,767 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767492_0001_1][Event:TASK_FINISHED]: vertexName=ABB98ED9653F41BE91D8998130133F5F, taskId=task_1463523767492_0001_1_00_000000, startTime=1463523767724, finishTime=1463523767766, timeTaken=42, status=SUCCEEDED, successfulAttemptID=attempt_1463523767492_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=807, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523767757, Process_Duration=4, Process_End_Time=1463523767761, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:47,767 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:22:47,767 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463523767492_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:22:47,767 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F] : 1
2016-05-17 22:22:47,767 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F]
2016-05-17 22:22:47,769 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767492_0001_1][Event:VERTEX_FINISHED]: vertexName=ABB98ED9653F41BE91D8998130133F5F, vertexId=vertex_1463523767492_0001_1_00, initRequestedTime=1463523767685, initedTime=1463523767712, startRequestedTime=1463523767713, startedTime=1463523767713, finishTime=1463523767767, timeTaken=54, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=807, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523767757, Process_Duration=4, Process_End_Time=1463523767761, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1463523767724, firstTasksToStart=[ task_1463523767492_0001_1_00_000000 ], lastTaskFinishTime=1463523767764, lastTasksToFinish=[ task_1463523767492_0001_1_00_000000 ], minTaskDuration=40, maxTaskDuration=40, avgTaskDuration=40.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463523767492_0001_1_00_000000 ], longestDurationTasks=[ task_1463523767492_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:22:47,769 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:22:47,769 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523767492_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:22:47,769 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:22:47,770 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767492_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463523767492_0001_00_000001, stoppedTime=1463523767770, exitStatus=0
2016-05-17 22:22:47,770 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523767492_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:22:47,770 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:22:47,770 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463523767492_0001_1
2016-05-17 22:22:47,770 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767492_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463523767492_0001_1
2016-05-17 22:22:47,770 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:22:47,770 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: A706375903B74E3B80EA03E8AB9F1FED for vertex: vertex_1463523767492_0001_1_00 [ABB98ED9653F41BE91D8998130133F5F]
2016-05-17 22:22:47,777 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463523767492_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:22:47,777 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463523767492_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:22:47,778 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463523767492_0001_00_000001, Exiting
2016-05-17 22:22:47,778 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463523767492_0001_00_000001
2016-05-17 22:22:47,778 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463523767492_0001_00_000001
2016-05-17 22:22:47,781 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463523767492_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:22:47,781 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463523767492_0001_00_000001 completed successfully
2016-05-17 22:22:47,783 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463523767492_0001_1, queueSize=0
2016-05-17 22:22:47,783 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:22:47,783 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463523767492_0001_1][Event:DAG_FINISHED]: dagId=dag_1463523767492_0001_1, startTime=1463523767684, finishTime=1463523767782, timeTaken=98, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=807, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1463523767757, Process_Duration=4, Process_End_Time=1463523767761, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-05-17 22:22:47,784 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463523767492_0001_1 finished with state: SUCCEEDED
2016-05-17 22:22:47,784 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463523767492_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:22:47,784 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463523767492_0001_00_000001
2016-05-17 22:22:47,784 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463523767492_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:22:47 Completed Dag: dag_1463523767492_0001_1
2016-05-17 22:22:47,785 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463523767492_0001_1, dagState=SUCCEEDED
2016-05-17 22:22:47,785 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463523767492_0001_1_post
2016-05-17 22:22:47,785 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:22:47,785 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:22:47,791 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...e/perpetualcascade/fourth, applicationId=application_1463523767492_0001
2016-05-17 22:22:47,793 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:22:47,793 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:22:47,793 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:22:47,793 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:22:47,793 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:22:47,793 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:22:47,794 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:22:47,794 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:22:47,794 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:22:47,795 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:22:47,795 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:22:47,795 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:22:47,796 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:22:47,800 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/991F5E851ED04AC9869962053E2F69C6/E4B23ED94C284127BDAC80191086AFD2/.tez/application_1463523767492_0001
2016-05-17 22:22:47,801 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/fourth/_temporary
2016-05-17 22:22:47,801 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [fourth]  completed in: 00:00.336
2016-05-17 22:22:47,801 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third] completed flow: fourth
2016-05-17 22:22:47,838 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third
2016-05-17 22:22:47,838 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/fourth
2016-05-17 22:22:47,839 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second
2016-05-17 22:22:47,839 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first
2016-05-17 22:22:47,846 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testProcessFlowWithCounters/counter/first
2016-05-17 22:22:47,850 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testProcessFlowFlowListenerExceptionHandlingInComplete/completeException/first
2016-05-17 22:22:47,855 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testProcessFlowFlowListenerExceptionHandlingInStart/startException/first

Standard error

2016-05-17 22:22:43 Running Dag: dag_1463523762722_0001_1
2016-05-17 22:22:43 Starting to run new task attempt: attempt_1463523762722_0001_1_00_000000_0
2016-05-17 22:22:44 Completed running task attempt: attempt_1463523762722_0001_1_00_000000_0
2016-05-17 22:22:44 Completed Dag: dag_1463523762722_0001_1
2016-05-17 22:22:44 Running Dag: dag_1463523764342_0001_1
2016-05-17 22:22:44 Starting to run new task attempt: attempt_1463523764342_0001_1_00_000000_0
2016-05-17 22:22:44 Completed running task attempt: attempt_1463523764342_0001_1_00_000000_0
2016-05-17 22:22:44 Completed Dag: dag_1463523764342_0001_1
2016-05-17 22:22:44 Running Dag: dag_1463523764813_0001_1
2016-05-17 22:22:45 Starting to run new task attempt: attempt_1463523764813_0001_1_00_000000_0
2016-05-17 22:22:45 Completed running task attempt: attempt_1463523764813_0001_1_00_000000_0
2016-05-17 22:22:45 Completed Dag: dag_1463523764813_0001_1
2016-05-17 22:22:45 Running Dag: dag_1463523765215_0001_1
2016-05-17 22:22:45 Starting to run new task attempt: attempt_1463523765215_0001_1_00_000000_0
2016-05-17 22:22:45 Completed running task attempt: attempt_1463523765215_0001_1_00_000000_0
2016-05-17 22:22:45 Completed Dag: dag_1463523765215_0001_1
2016-05-17 22:22:46 Running Dag: dag_1463523766262_0001_1
2016-05-17 22:22:46 Starting to run new task attempt: attempt_1463523766262_0001_1_00_000000_0
2016-05-17 22:22:46 Completed running task attempt: attempt_1463523766262_0001_1_00_000000_0
2016-05-17 22:22:46 Completed Dag: dag_1463523766262_0001_1
2016-05-17 22:22:46 Running Dag: dag_1463523766649_0001_1
2016-05-17 22:22:46 Starting to run new task attempt: attempt_1463523766649_0001_1_00_000000_0
2016-05-17 22:22:46 Completed running task attempt: attempt_1463523766649_0001_1_00_000000_0
2016-05-17 22:22:47 Completed Dag: dag_1463523766649_0001_1
2016-05-17 22:22:47 Running Dag: dag_1463523767078_0001_1
2016-05-17 22:22:47 Starting to run new task attempt: attempt_1463523767078_0001_1_00_000000_0
2016-05-17 22:22:47 Completed running task attempt: attempt_1463523767078_0001_1_00_000000_0
2016-05-17 22:22:47 Completed Dag: dag_1463523767078_0001_1
2016-05-17 22:22:47 Running Dag: dag_1463523767492_0001_1
2016-05-17 22:22:47 Starting to run new task attempt: attempt_1463523767492_0001_1_00_000000_0
2016-05-17 22:22:47 Completed running task attempt: attempt_1463523767492_0001_1_00_000000_0
2016-05-17 22:22:47 Completed Dag: dag_1463523767492_0001_1