Class cascading.cascade.RiffleCascadePlatformTest

7

tests

0

failures

0

ignored

7.591s

duration

100%

successful

Tests

Test Duration Result
testProcessFlowFlowListenerExceptionHandlingInComplete 0.004s passed
testProcessFlowFlowListenerExceptionHandlingInStart 0.004s passed
testProcessFlowFlowListenerExceptionHandlingInStop 0.011s passed
testProcessFlowWithChildCounters 0.821s passed
testProcessFlowWithCounters 0.006s passed
testSimpleRiffle 4.560s passed
testSimpleRiffleCascade 2.185s passed

Standard output

2016-01-14 17:01:18,945 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 17:01:18,967 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.cascade.RiffleCascadePlatformTest, with platform: hadoop2-tez
2016-01-14 17:01:18,994 INFO  tez.Hadoop2TezPlatform (Hadoop2TezPlatform.java:setUp(136)) - not using cluster
2016-01-14 17:01:19,388 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-01-14 17:01:19,714 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides: 
2016-01-14 17:01:19,766 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 20AD3C3EEAB644E2BA2C6BDCC768F687
2016-01-14 17:01:19,812 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testProcessFlowWithChildCounters/children/first
2016-01-14 17:01:19,826 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testProcessFlowFlowListenerExceptionHandlingInStop/stopException/first
2016-01-14 17:01:19,970 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:01:19,971 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 17:01:20,268 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.061
2016-01-14 17:01:20,280 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.074
2016-01-14 17:01:20,281 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:01:20,281 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:01:20,282 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:01:20,417 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/ips.20.txt
2016-01-14 17:01:20,422 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first
2016-01-14 17:01:20,644 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:01:20,644 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 17:01:20,728 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.042
2016-01-14 17:01:20,729 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.043
2016-01-14 17:01:20,731 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:01:20,731 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:01:20,731 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:01:20,758 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first
2016-01-14 17:01:20,759 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second
2016-01-14 17:01:20,863 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:01:20,863 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 17:01:20,926 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-01-14 17:01:20,940 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.033
2016-01-14 17:01:20,940 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:01:20,941 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:01:20,941 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:01:20,961 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second
2016-01-14 17:01:20,962 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third
2016-01-14 17:01:21,041 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:01:21,041 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 17:01:21,115 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.026
2016-01-14 17:01:21,145 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.056
2016-01-14 17:01:21,146 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:01:21,146 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:01:21,147 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:01:21,181 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third
2016-01-14 17:01:21,182 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/fourth
2016-01-14 17:01:21,276 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 17:01:21,277 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-14 17:01:21,278 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/ips.20.txt"]
2016-01-14 17:01:21,278 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  sink: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first"]
2016-01-14 17:01:21,278 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  parallel execution of steps is enabled: false
2016-01-14 17:01:21,279 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  executing total steps: 1
2016-01-14 17:01:21,280 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  allocating management threads: 1
2016-01-14 17:01:21,280 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) ...pleRiffle/perpetual/first
2016-01-14 17:01:21,281 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [first] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 17:01:21,303 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tez session mode enabled: true
2016-01-14 17:01:21,488 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:01:21,498 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 17:01:21,499 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 17:01:21,560 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/BBACA9C8FA334A04B49EA0B34849FB97/BFEBA5BB1F934E24BE6FE82B506C9368/.tez/application_1452790881498_0001 doesn't exist and is created
2016-01-14 17:01:21,628 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 17:01:21,629 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:01:21,629 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/BBACA9C8FA334A04B49EA0B34849FB97/BFEBA5BB1F934E24BE6FE82B506C9368/.tez/application_1452790881498_0001
2016-01-14 17:01:21,661 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452790881498_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:01:21,703 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 17:01:21,722 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 17:01:21,729 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: NEW
2016-01-14 17:01:21,730 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(238)) - DAGAppMaster is not started wait for 100ms...
2016-01-14 17:01:21,730 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:01:21,747 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 17:01:21,751 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 17:01:21,754 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/BBACA9C8FA334A04B49EA0B34849FB97/BFEBA5BB1F934E24BE6FE82B506C9368/.tez/application_1452790881498_0001/localmode-log-dir
2016-01-14 17:01:21,755 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/BBACA9C8FA334A04B49EA0B34849FB97/BFEBA5BB1F934E24BE6FE82B506C9368/.tez/application_1452790881498_0001/localmode-log-dir/history.txt.appattempt_1452790881498_0001_000000, maxErrors=10
2016-01-14 17:01:21,755 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 17:01:21,757 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452790881498_0001_000000, appSubmitTime=1452790881647, launchTime=1452790881660
2016-01-14 17:01:21,766 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 17:01:21,767 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 17:01:21,769 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 17:01:21,770 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 17:01:21,831 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-01-14 17:01:21,831 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-01-14 17:01:21,832 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:01:21,840 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:43005
2016-01-14 17:01:21,912 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 17:01:21,932 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-01-14 17:01:21,932 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-01-14 17:01:21,932 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:01:21,979 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 17:01:21,979 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452790881498_0001_000000, startTime=1452790881978
2016-01-14 17:01:21,980 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 17:01:22,033 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 17:01:22,048 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 17:01:22,048 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...pleRiffle/perpetual/first, applicationId=application_1452790881498_0001, dagName=[BBACA9C8FA334A04B49EA0B34849FB97/BFEBA5BB1F934E24BE6FE82B506C9368] first/(1/1) ...pleRiffle/perpetual/first
2016-01-14 17:01:22,243 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [BBACA9C8FA334A04B49EA0B34849FB97/BFEBA5BB1F934E24BE6FE82B506C9368] first/(1/1) ...pleRiffle/perpetual/first
2016-01-14 17:01:22,331 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452790881498_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/BBACA9C8FA334A04B49EA0B34849FB97/BFEBA5BB1F934E24BE6FE82B506C9368/.tez/application_1452790881498_0001/localmode-log-dir/dag_1452790881498_0001_1.dot
2016-01-14 17:01:22,334 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/BBACA9C8FA334A04B49EA0B34849FB97/BFEBA5BB1F934E24BE6FE82B506C9368/.tez/application_1452790881498_0001/localmode-log-dir/dag_1452790881498_0001_1-tez-dag.pb.txt
2016-01-14 17:01:22,409 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452790881498_0001_1
2016-01-14 17:01:22,409 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:22,409 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [BBACA9C8FA334A04B49EA0B34849FB97/BFEBA5BB1F934E24BE6FE82B506C9368] first/(1/1) ...pleRiffle/perpetual/first
2016-01-14 17:01:22 Running Dag: dag_1452790881498_0001_1
2016-01-14 17:01:22,440 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 17:01:22,440 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790881498_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452790881498_0001_1, submitTime=1452790882243
2016-01-14 17:01:22,470 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex F9B81439E1FA4B8FA737A7769ADD09FE
2016-01-14 17:01:22,471 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 17:01:22,474 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790881498_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452790881498_0001_1, initTime=1452790882441
2016-01-14 17:01:22,474 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790881498_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 17:01:22,474 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 17:01:22,476 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790881498_0001_1][Event:DAG_STARTED]: dagID=dag_1452790881498_0001_1, startTime=1452790882476
2016-01-14 17:01:22,477 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 17:01:22,477 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 17:01:22,479 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790881498_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 17:01:22,479 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: F9B81439E1FA4B8FA737A7769ADD09FE : {0FA936923CA645119E6A9E35EE131156={InputName=0FA936923CA645119E6A9E35EE131156}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 17:01:22,481 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 0FA936923CA645119E6A9E35EE131156, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 17:01:22,482 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE]
2016-01-14 17:01:22,486 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...pleRiffle/perpetual/first, applicationId=application_1452790881498_0001, dagName=[BBACA9C8FA334A04B49EA0B34849FB97/BFEBA5BB1F934E24BE6FE82B506C9368] first/(1/1) ...pleRiffle/perpetual/first
2016-01-14 17:01:22,490 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE]
2016-01-14 17:01:22,490 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE]
2016-01-14 17:01:22,492 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE]. Starting root input initializers: 1
2016-01-14 17:01:22,497 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 0FA936923CA645119E6A9E35EE131156 on vertex vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE]
2016-01-14 17:01:22,507 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 17:01:22,514 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 17:01:22,517 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 0FA936923CA645119E6A9E35EE131156 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 17:01:22,517 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted tez dag to app master: application_1452790881498_0001, with dag id: dag_1452790881498_0001_1
2016-01-14 17:01:22,519 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 17:01:22,520 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 17:01:22,571 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 402
2016-01-14 17:01:22,573 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 0FA936923CA645119E6A9E35EE131156 on vertex vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE]
2016-01-14 17:01:22,574 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:01:22,575 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {0FA936923CA645119E6A9E35EE131156=forAllWorkUnits=true, update=[1]}
2016-01-14 17:01:22,594 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE] parallelism set to 1
2016-01-14 17:01:22,594 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:01:22,605 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790881498_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452790881498_0001_1_00, eventCount=1
2016-01-14 17:01:22,608 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE]
2016-01-14 17:01:22,608 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=0C609AFFD847443E81265B6640AAB836, vertexId=vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 17:01:22,612 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=0C609AFFD847443E81265B6640AAB836, vertexId=vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE]
2016-01-14 17:01:22,625 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=0C609AFFD847443E81265B6640AAB836, vertexName=F9B81439E1FA4B8FA737A7769ADD09FE, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 17:01:22,636 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=0C609AFFD847443E81265B6640AAB836, vertexId=vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE]
2016-01-14 17:01:22,641 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 17:01:22,641 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790881498_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F9B81439E1FA4B8FA737A7769ADD09FE, vertexId=vertex_1452790881498_0001_1_00, initRequestedTime=1452790882479, initedTime=1452790882640, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 17:01:22,641 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE] with distanceFromRoot: 0
2016-01-14 17:01:22,642 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 17:01:22,644 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in F9B81439E1FA4B8FA737A7769ADD09FE
2016-01-14 17:01:22,644 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE]
2016-01-14 17:01:22,646 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 17:01:22,646 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790881498_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452790881498_0001_1_00, startRequestedTime=1452790882643, startedTime=1452790882643
2016-01-14 17:01:22,647 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE] transitioned from INITED to RUNNING due to event V_START
2016-01-14 17:01:22,672 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 17:01:22,673 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790881498_0001_1][Event:TASK_STARTED]: vertexName=F9B81439E1FA4B8FA737A7769ADD09FE, taskId=task_1452790881498_0001_1_00_000000, scheduledTime=1452790882672, launchTime=1452790882672
2016-01-14 17:01:22,673 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790881498_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 17:01:22,675 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE]
2016-01-14 17:01:22,677 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [BBACA9C8FA334A04B49EA0B34849FB97/BFEBA5BB1F934E24BE6FE82B506C9368] first/(1/1) ...pleRiffle/perpetual/first, VertexName: F9B81439E1FA4B8FA737A7769ADD09FE, VertexParallelism: 1, TaskAttemptID:attempt_1452790881498_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0FA936923CA645119E6A9E35EE131156, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=0C609AFFD847443E81265B6640AAB836, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:01:22,679 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790881498_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 17:01:22,680 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 17:01:22,719 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 17:01:22,722 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 17:01:22,722 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 17:01:22,726 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452790881498_0001_00_000001
2016-01-14 17:01:22,726 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790881498_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 17:01:22,732 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452790881498_0001_00_000001
2016-01-14 17:01:22,733 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-01-14 17:01:22,737 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790881498_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 17:01:22,737 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 17:01:22,740 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790881498_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452790881498_0001_00_000001, launchTime=1452790882737
2016-01-14 17:01:22,743 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452790881498_0001_00_000001
2016-01-14 17:01:22,747 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452790881498_0001_1_00_000000_0] to container: [container_1452790881498_0001_00_000001]
2016-01-14 17:01:22,747 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790881498_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 17:01:22,749 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452790881498_0001_00_000001 given task: attempt_1452790881498_0001_1_00_000000_0
2016-01-14 17:01:22,749 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452790881498_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452790881498_0001_1_00_000000_0
2016-01-14 17:01:22,750 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452790881498_0001_1_00_000000_0] started. Is using containerId: [container_1452790881498_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 17:01:22 Starting to run new task attempt: attempt_1452790881498_0001_1_00_000000_0
2016-01-14 17:01:22,750 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452790881498_0001_1_00_000000_0
2016-01-14 17:01:22,750 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:22,750 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790881498_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F9B81439E1FA4B8FA737A7769ADD09FE, taskAttemptId=attempt_1452790881498_0001_1_00_000000_0, startTime=1452790882748, containerId=container_1452790881498_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452790881498_0001_00_000001/teamcity, completedLogs=
2016-01-14 17:01:22,750 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 17:01:22,753 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790881498_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 17:01:22,753 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 17:01:22,753 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 17:01:22,754 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 17:01:22,755 INFO  counters.Limits (Limits.java:ensureInitialized(59)) - Counter limits initialized with parameters:  GROUP_NAME_MAX=128, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200
2016-01-14 17:01:22,757 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 17:01:22,760 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790881498_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 17:01:22,787 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 17:01:22,787 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [BBACA9C8FA334A04B49EA0B34849FB97/BFEBA5BB1F934E24BE6FE82B506C9368] first/(1/1) ...pleRiffle/perpetual/first, VertexName: F9B81439E1FA4B8FA737A7769ADD09FE, VertexParallelism: 1, TaskAttemptID:attempt_1452790881498_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0FA936923CA645119E6A9E35EE131156, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=0C609AFFD847443E81265B6640AAB836, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:01:22,790 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 17:01:22,794 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452790881498_0001_1_00_000000_0
2016-01-14 17:01:22,794 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 17:01:22,795 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:22,797 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452790881498_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 17:01:22,800 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=0FA936923CA645119E6A9E35EE131156, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 17:01:22,801 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:22,801 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=0C609AFFD847443E81265B6640AAB836, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 17:01:22,802 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 17:01:22,803 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 0FA936923CA645119E6A9E35EE131156
2016-01-14 17:01:22,803 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 17:01:22,804 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 0C609AFFD847443E81265B6640AAB836
2016-01-14 17:01:22,806 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 17:01:22,807 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 0C609AFFD847443E81265B6640AAB836
2016-01-14 17:01:22,807 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 0FA936923CA645119E6A9E35EE131156
2016-01-14 17:01:22,831 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 17:01:22,831 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 0FA936923CA645119E6A9E35EE131156
2016-01-14 17:01:22,832 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 0FA936923CA645119E6A9E35EE131156
2016-01-14 17:01:22,833 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 17:01:22,845 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F9B81439E1FA4B8FA737A7769ADD09FE, ordinal: 0
2016-01-14 17:01:22,845 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F9B81439E1FA4B8FA737A7769ADD09FE, mem on start (mb), free: 201, total: 281, max: 672
2016-01-14 17:01:22,846 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:22,846 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 17:01:22,846 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 17:01:22,854 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 17:01:22,854 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 0C609AFFD847443E81265B6640AAB836
2016-01-14 17:01:22,854 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 17:01:22,855 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 17:01:22,862 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 17:01:22,863 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:01:22,863 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 17:01:22,864 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:01:22,864 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 17:01:22,864 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 17:01:22,865 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 0C609AFFD847443E81265B6640AAB836, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 17:01:22,865 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 0FA936923CA645119E6A9E35EE131156, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 17:01:22,865 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 17:01:22,867 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 0FA936923CA645119E6A9E35EE131156 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 17:01:22,867 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 0FA936923CA645119E6A9E35EE131156
2016-01-14 17:01:22,867 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:01:22,867 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 0FA936923CA645119E6A9E35EE131156
2016-01-14 17:01:22,867 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 17:01:22,868 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 17:01:22,868 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 17:01:22,870 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452790881498_0001_1_00_000000_0
2016-01-14 17:01:22,871 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 17:01:22,881 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@4f0ab587
2016-01-14 17:01:22,892 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@4f0ab587
2016-01-14 17:01:22,893 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 17:01:22,893 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 17:01:22,908 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/ips.20.txt"]
2016-01-14 17:01:22,923 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/ips.20.txt"] streamed: true, id: 0FA936923CA645119E6A9E35EE131156
2016-01-14 17:01:22,924 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first"], id: 0C609AFFD847443E81265B6640AAB836
2016-01-14 17:01:22,924 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first"]
2016-01-14 17:01:22,926 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/ips.20.txt"]
2016-01-14 17:01:22,927 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:01:22,930 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F9B81439E1FA4B8FA737A7769ADD09FE, all 1 inputs ready in: 00:00:00.002
2016-01-14 17:01:22,938 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 17:01:22,939 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 17:01:22,940 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452790881498_0001_1_00_000000_0
2016-01-14 17:01:22,941 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452790881498_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 17:01:22,942 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452790881498_0001_1_00_000000_0
2016-01-14 17:01:22,942 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F9B81439E1FA4B8FA737A7769ADD09FE, mem on close (mb), free: 194, total: 281, max: 672
2016-01-14 17:01:22 Completed running task attempt: attempt_1452790881498_0001_1_00_000000_0
2016-01-14 17:01:22,948 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452790881498_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 17:01:22,950 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 17:01:22,961 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=413, FILE_BYTES_WRITTEN=325, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452790882930, Process_Duration=12, Process_End_Time=1452790882942, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 17:01:22,962 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 17:01:22,962 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790881498_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F9B81439E1FA4B8FA737A7769ADD09FE, taskAttemptId=attempt_1452790881498_0001_1_00_000000_0, startTime=1452790882748, finishTime=1452790882949, timeTaken=201, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=413, FILE_BYTES_WRITTEN=325, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790882930, Process_Duration=12, Process_End_Time=1452790882942, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:22,963 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:22,963 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452790881498_0001_00_000001
2016-01-14 17:01:22,965 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790881498_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 17:01:22,966 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 17:01:22,967 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452790881498_0001_1_00_000000_0
2016-01-14 17:01:22,970 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 17:01:22,978 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790881498_0001_1][Event:TASK_FINISHED]: vertexName=F9B81439E1FA4B8FA737A7769ADD09FE, taskId=task_1452790881498_0001_1_00_000000, startTime=1452790882748, finishTime=1452790882968, timeTaken=220, status=SUCCEEDED, successfulAttemptID=attempt_1452790881498_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=413, FILE_BYTES_WRITTEN=325, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790882930, Process_Duration=12, Process_End_Time=1452790882942, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:22,985 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790881498_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 17:01:22,986 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790881498_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 17:01:22,987 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE] : 1
2016-01-14 17:01:22,988 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE]
2016-01-14 17:01:23,002 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 17:01:23,006 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790881498_0001_1][Event:VERTEX_FINISHED]: vertexName=F9B81439E1FA4B8FA737A7769ADD09FE, vertexId=vertex_1452790881498_0001_1_00, initRequestedTime=1452790882479, initedTime=1452790882640, startRequestedTime=1452790882643, startedTime=1452790882643, finishTime=1452790882988, timeTaken=345, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=413, FILE_BYTES_WRITTEN=325, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790882930, Process_Duration=12, Process_End_Time=1452790882942, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452790882748, firstTasksToStart=[ task_1452790881498_0001_1_00_000000 ], lastTaskFinishTime=1452790882949, lastTasksToFinish=[ task_1452790881498_0001_1_00_000000 ], minTaskDuration=201, maxTaskDuration=201, avgTaskDuration=201.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452790881498_0001_1_00_000000 ], longestDurationTasks=[ task_1452790881498_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 17:01:23,007 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 17:01:23,008 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790881498_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452790881498_0001_00_000001, stoppedTime=1452790883008, exitStatus=0
2016-01-14 17:01:23,009 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790881498_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 17:01:23,009 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 17:01:23,010 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 17:01:23,011 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452790881498_0001_1
2016-01-14 17:01:23,012 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790881498_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452790881498_0001_1
2016-01-14 17:01:23,013 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 0C609AFFD847443E81265B6640AAB836 for vertex: vertex_1452790881498_0001_1_00 [F9B81439E1FA4B8FA737A7769ADD09FE]
2016-01-14 17:01:23,026 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452790881498_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 17:01:23,027 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452790881498_0001_00_000001: 61 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 17:01:23,027 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452790881498_0001_00_000001, Exiting
2016-01-14 17:01:23,027 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452790881498_0001_00_000001
2016-01-14 17:01:23,027 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452790881498_0001_00_000001
2016-01-14 17:01:23,030 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452790881498_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 17:01:23,031 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452790881498_0001_00_000001 completed successfully
2016-01-14 17:01:23,034 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452790881498_0001_1, queueSize=0
2016-01-14 17:01:23,037 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 17:01:23,040 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790881498_0001_1][Event:DAG_FINISHED]: dagId=dag_1452790881498_0001_1, startTime=1452790882476, finishTime=1452790883027, timeTaken=551, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=413, FILE_BYTES_WRITTEN=325, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790882930, Process_Duration=12, Process_End_Time=1452790882942, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:23,041 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452790881498_0001_1 finished with state: SUCCEEDED
2016-01-14 17:01:23,041 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790881498_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 17:01:23,042 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452790881498_0001_00_000001
2016-01-14 17:01:23,043 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790881498_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 17:01:23 Completed Dag: dag_1452790881498_0001_1
2016-01-14 17:01:23,045 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452790881498_0001_1, dagState=SUCCEEDED
2016-01-14 17:01:23,046 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452790881498_0001_1_post
2016-01-14 17:01:23,047 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:23,048 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 17:01:23,054 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...pleRiffle/perpetual/first, applicationId=application_1452790881498_0001
2016-01-14 17:01:23,058 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 17:01:23,058 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 17:01:23,059 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 17:01:23,059 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 17:01:23,059 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 17:01:23,060 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 17:01:23,063 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 17:01:23,063 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 17:01:23,064 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 17:01:23,064 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 17:01:23,064 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 17:01:23,065 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 17:01:23,065 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 17:01:23,069 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/BBACA9C8FA334A04B49EA0B34849FB97/BFEBA5BB1F934E24BE6FE82B506C9368/.tez/application_1452790881498_0001
2016-01-14 17:01:23,071 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  completed in: 00:01.793
2016-01-14 17:01:23,073 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting
2016-01-14 17:01:23,073 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second]  source: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first"]
2016-01-14 17:01:23,074 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second"]
2016-01-14 17:01:23,074 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second]  parallel execution of steps is enabled: false
2016-01-14 17:01:23,074 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second]  executing total steps: 1
2016-01-14 17:01:23,074 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second]  allocating management threads: 1
2016-01-14 17:01:23,075 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting step: (1/1) ...leRiffle/perpetual/second
2016-01-14 17:01:23,076 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [second] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 17:01:23,095 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tez session mode enabled: true
2016-01-14 17:01:23,100 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:01:23,101 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 17:01:23,101 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 17:01:23,112 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/2BE1D6197871422692E404A83BEBFB61/E7A1E08AC69B4EF8B2BFB6CFBB054EE7/.tez/application_1452790883100_0001 doesn't exist and is created
2016-01-14 17:01:23,141 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 17:01:23,142 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:01:23,143 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/2BE1D6197871422692E404A83BEBFB61/E7A1E08AC69B4EF8B2BFB6CFBB054EE7/.tez/application_1452790883100_0001
2016-01-14 17:01:23,150 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452790883100_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:01:23,168 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 17:01:23,170 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 17:01:23,173 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 17:01:23,174 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 17:01:23,175 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/2BE1D6197871422692E404A83BEBFB61/E7A1E08AC69B4EF8B2BFB6CFBB054EE7/.tez/application_1452790883100_0001/localmode-log-dir
2016-01-14 17:01:23,176 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/2BE1D6197871422692E404A83BEBFB61/E7A1E08AC69B4EF8B2BFB6CFBB054EE7/.tez/application_1452790883100_0001/localmode-log-dir/history.txt.appattempt_1452790883100_0001_000000, maxErrors=10
2016-01-14 17:01:23,177 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 17:01:23,177 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452790883100_0001_000000, appSubmitTime=1452790883150, launchTime=1452790883150
2016-01-14 17:01:23,186 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:37482
2016-01-14 17:01:23,186 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 17:01:23,189 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 17:01:23,190 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 17:01:23,191 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 17:01:23,194 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 17:01:23,197 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 17:01:23,197 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452790883100_0001_000000, startTime=1452790883197
2016-01-14 17:01:23,197 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 17:01:23,242 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 17:01:23,242 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 17:01:23,242 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...leRiffle/perpetual/second, applicationId=application_1452790883100_0001, dagName=[2BE1D6197871422692E404A83BEBFB61/E7A1E08AC69B4EF8B2BFB6CFBB054EE7] second/(1/1) ...leRiffle/perpetual/second
2016-01-14 17:01:23,278 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [2BE1D6197871422692E404A83BEBFB61/E7A1E08AC69B4EF8B2BFB6CFBB054EE7] second/(1/1) ...leRiffle/perpetual/second
2016-01-14 17:01:23,280 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452790883100_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/2BE1D6197871422692E404A83BEBFB61/E7A1E08AC69B4EF8B2BFB6CFBB054EE7/.tez/application_1452790883100_0001/localmode-log-dir/dag_1452790883100_0001_1.dot
2016-01-14 17:01:23,281 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/2BE1D6197871422692E404A83BEBFB61/E7A1E08AC69B4EF8B2BFB6CFBB054EE7/.tez/application_1452790883100_0001/localmode-log-dir/dag_1452790883100_0001_1-tez-dag.pb.txt
2016-01-14 17:01:23,308 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452790883100_0001_1
2016-01-14 17:01:23,308 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:23,309 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [2BE1D6197871422692E404A83BEBFB61/E7A1E08AC69B4EF8B2BFB6CFBB054EE7] second/(1/1) ...leRiffle/perpetual/second
2016-01-14 17:01:23 Running Dag: dag_1452790883100_0001_1
2016-01-14 17:01:23,325 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883100_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452790883100_0001_1, submitTime=1452790883278
2016-01-14 17:01:23,325 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 17:01:23,327 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex A75579C69D44492789D52718EBFB2DEF
2016-01-14 17:01:23,327 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 17:01:23,328 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 17:01:23,329 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883100_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452790883100_0001_1, initTime=1452790883326
2016-01-14 17:01:23,329 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790883100_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 17:01:23,330 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 17:01:23,330 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883100_0001_1][Event:DAG_STARTED]: dagID=dag_1452790883100_0001_1, startTime=1452790883329
2016-01-14 17:01:23,330 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 17:01:23,330 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790883100_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 17:01:23,330 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: A75579C69D44492789D52718EBFB2DEF : {0C609AFFD847443E81265B6640AAB836={InputName=0C609AFFD847443E81265B6640AAB836}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 17:01:23,331 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 0C609AFFD847443E81265B6640AAB836, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 17:01:23,331 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF]
2016-01-14 17:01:23,331 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF]
2016-01-14 17:01:23,331 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF]
2016-01-14 17:01:23,332 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF]. Starting root input initializers: 1
2016-01-14 17:01:23,333 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 17:01:23,333 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 0C609AFFD847443E81265B6640AAB836 on vertex vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF]
2016-01-14 17:01:23,334 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...leRiffle/perpetual/second, applicationId=application_1452790883100_0001, dagName=[2BE1D6197871422692E404A83BEBFB61/E7A1E08AC69B4EF8B2BFB6CFBB054EE7] second/(1/1) ...leRiffle/perpetual/second
2016-01-14 17:01:23,341 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 17:01:23,341 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 0C609AFFD847443E81265B6640AAB836 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 17:01:23,348 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 17:01:23,349 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 17:01:23,363 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] submitted tez dag to app master: application_1452790883100_0001, with dag id: dag_1452790883100_0001_1
2016-01-14 17:01:23,376 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 546
2016-01-14 17:01:23,377 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 0C609AFFD847443E81265B6640AAB836 on vertex vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF]
2016-01-14 17:01:23,377 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:01:23,377 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {0C609AFFD847443E81265B6640AAB836=forAllWorkUnits=true, update=[1]}
2016-01-14 17:01:23,378 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF] parallelism set to 1
2016-01-14 17:01:23,378 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:01:23,379 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883100_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452790883100_0001_1_00, eventCount=1
2016-01-14 17:01:23,379 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF]
2016-01-14 17:01:23,379 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=A73EEEA87D8E4AB69F050601209A7810, vertexId=vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 17:01:23,381 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=A73EEEA87D8E4AB69F050601209A7810, vertexId=vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF]
2016-01-14 17:01:23,386 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=A73EEEA87D8E4AB69F050601209A7810, vertexName=A75579C69D44492789D52718EBFB2DEF, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 17:01:23,386 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=A73EEEA87D8E4AB69F050601209A7810, vertexId=vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF]
2016-01-14 17:01:23,388 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 17:01:23,389 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883100_0001_1][Event:VERTEX_INITIALIZED]: vertexName=A75579C69D44492789D52718EBFB2DEF, vertexId=vertex_1452790883100_0001_1_00, initRequestedTime=1452790883330, initedTime=1452790883388, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 17:01:23,389 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF] with distanceFromRoot: 0
2016-01-14 17:01:23,390 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 17:01:23,390 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in A75579C69D44492789D52718EBFB2DEF
2016-01-14 17:01:23,392 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF]
2016-01-14 17:01:23,392 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 17:01:23,392 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883100_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452790883100_0001_1_00, startRequestedTime=1452790883390, startedTime=1452790883390
2016-01-14 17:01:23,393 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF] transitioned from INITED to RUNNING due to event V_START
2016-01-14 17:01:23,394 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 17:01:23,394 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883100_0001_1][Event:TASK_STARTED]: vertexName=A75579C69D44492789D52718EBFB2DEF, taskId=task_1452790883100_0001_1_00_000000, scheduledTime=1452790883394, launchTime=1452790883394
2016-01-14 17:01:23,394 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790883100_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 17:01:23,395 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF]
2016-01-14 17:01:23,395 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [2BE1D6197871422692E404A83BEBFB61/E7A1E08AC69B4EF8B2BFB6CFBB054EE7] second/(1/1) ...leRiffle/perpetual/second, VertexName: A75579C69D44492789D52718EBFB2DEF, VertexParallelism: 1, TaskAttemptID:attempt_1452790883100_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0C609AFFD847443E81265B6640AAB836, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=A73EEEA87D8E4AB69F050601209A7810, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:01:23,395 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790883100_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 17:01:23,396 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 17:01:23,396 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 17:01:23,397 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 17:01:23,397 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 17:01:23,398 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452790883100_0001_00_000001
2016-01-14 17:01:23,398 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790883100_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 17:01:23,402 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452790883100_0001_00_000001
2016-01-14 17:01:23,402 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-01-14 17:01:23,403 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790883100_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 17:01:23,403 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 17:01:23,404 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883100_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452790883100_0001_00_000001, launchTime=1452790883403
2016-01-14 17:01:23,434 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452790883100_0001_00_000001
2016-01-14 17:01:23,441 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452790883100_0001_1_00_000000_0] to container: [container_1452790883100_0001_00_000001]
2016-01-14 17:01:23,443 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790883100_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 17:01:23,444 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452790883100_0001_00_000001 given task: attempt_1452790883100_0001_1_00_000000_0
2016-01-14 17:01:23,444 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452790883100_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452790883100_0001_1_00_000000_0
2016-01-14 17:01:23,444 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452790883100_0001_1_00_000000_0] started. Is using containerId: [container_1452790883100_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 17:01:23,445 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 17:01:23,445 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883100_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=A75579C69D44492789D52718EBFB2DEF, taskAttemptId=attempt_1452790883100_0001_1_00_000000_0, startTime=1452790883444, containerId=container_1452790883100_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452790883100_0001_00_000001/teamcity, completedLogs=
2016-01-14 17:01:23,445 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790883100_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 17:01:23,445 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790883100_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 17:01:23 Starting to run new task attempt: attempt_1452790883100_0001_1_00_000000_0
2016-01-14 17:01:23,446 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452790883100_0001_1_00_000000_0
2016-01-14 17:01:23,446 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:23,447 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 17:01:23,447 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 17:01:23,447 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 17:01:23,447 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 17:01:23,447 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 17:01:23,448 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [2BE1D6197871422692E404A83BEBFB61/E7A1E08AC69B4EF8B2BFB6CFBB054EE7] second/(1/1) ...leRiffle/perpetual/second, VertexName: A75579C69D44492789D52718EBFB2DEF, VertexParallelism: 1, TaskAttemptID:attempt_1452790883100_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0C609AFFD847443E81265B6640AAB836, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=A73EEEA87D8E4AB69F050601209A7810, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:01:23,449 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 17:01:23,452 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452790883100_0001_1_00_000000_0
2016-01-14 17:01:23,453 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 17:01:23,453 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:23,453 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452790883100_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 17:01:23,454 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=0C609AFFD847443E81265B6640AAB836, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 17:01:23,454 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=A73EEEA87D8E4AB69F050601209A7810, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 17:01:23,454 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:23,455 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 17:01:23,456 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: A73EEEA87D8E4AB69F050601209A7810
2016-01-14 17:01:23,456 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 17:01:23,456 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: A73EEEA87D8E4AB69F050601209A7810
2016-01-14 17:01:23,459 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 17:01:23,460 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 0C609AFFD847443E81265B6640AAB836
2016-01-14 17:01:23,460 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 0C609AFFD847443E81265B6640AAB836
2016-01-14 17:01:23,459 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 17:01:23,471 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 17:01:23,472 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 0C609AFFD847443E81265B6640AAB836
2016-01-14 17:01:23,472 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 0C609AFFD847443E81265B6640AAB836
2016-01-14 17:01:23,479 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: A75579C69D44492789D52718EBFB2DEF, ordinal: 0
2016-01-14 17:01:23,479 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A75579C69D44492789D52718EBFB2DEF, mem on start (mb), free: 369, total: 397, max: 672
2016-01-14 17:01:23,479 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:23,479 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 17:01:23,479 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 17:01:23,484 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 17:01:23,484 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: A73EEEA87D8E4AB69F050601209A7810
2016-01-14 17:01:23,484 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 17:01:23,485 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 17:01:23,485 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 17:01:23,485 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:01:23,485 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 17:01:23,486 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:01:23,486 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 17:01:23,486 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 17:01:23,486 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, A73EEEA87D8E4AB69F050601209A7810, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 17:01:23,486 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 0C609AFFD847443E81265B6640AAB836, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 17:01:23,486 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 17:01:23,486 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 0C609AFFD847443E81265B6640AAB836 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 17:01:23,487 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 17:01:23,487 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 17:01:23,488 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 0C609AFFD847443E81265B6640AAB836
2016-01-14 17:01:23,488 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:01:23,488 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 0C609AFFD847443E81265B6640AAB836
2016-01-14 17:01:23,488 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 17:01:23,489 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452790883100_0001_1_00_000000_0
2016-01-14 17:01:23,490 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 17:01:23,492 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@36cae11e
2016-01-14 17:01:23,494 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@36cae11e
2016-01-14 17:01:23,495 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 17:01:23,495 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 17:01:23,495 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first"]
2016-01-14 17:01:23,496 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first"] streamed: true, id: 0C609AFFD847443E81265B6640AAB836
2016-01-14 17:01:23,496 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second"], id: A73EEEA87D8E4AB69F050601209A7810
2016-01-14 17:01:23,497 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second"]
2016-01-14 17:01:23,497 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first"]
2016-01-14 17:01:23,497 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:01:23,498 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: A75579C69D44492789D52718EBFB2DEF, all 1 inputs ready in: 00:00:00.001
2016-01-14 17:01:23,502 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 17:01:23,502 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 17:01:23,503 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452790883100_0001_1_00_000000_0
2016-01-14 17:01:23,505 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452790883100_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 17:01:23,505 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452790883100_0001_1_00_000000_0
2016-01-14 17:01:23,506 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A75579C69D44492789D52718EBFB2DEF, mem on close (mb), free: 367, total: 397, max: 672
2016-01-14 17:01:23 Completed running task attempt: attempt_1452790883100_0001_1_00_000000_0
2016-01-14 17:01:23,507 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452790883100_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 17:01:23,507 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452790883498, Process_Duration=7, Process_End_Time=1452790883505, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 17:01:23,508 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 17:01:23,508 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:23,508 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 17:01:23,509 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883100_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=A75579C69D44492789D52718EBFB2DEF, taskAttemptId=attempt_1452790883100_0001_1_00_000000_0, startTime=1452790883444, finishTime=1452790883507, timeTaken=63, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790883498, Process_Duration=7, Process_End_Time=1452790883505, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:23,510 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790883100_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 17:01:23,510 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452790883100_0001_00_000001
2016-01-14 17:01:23,510 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452790883100_0001_1_00_000000_0
2016-01-14 17:01:23,512 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 17:01:23,512 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883100_0001_1][Event:TASK_FINISHED]: vertexName=A75579C69D44492789D52718EBFB2DEF, taskId=task_1452790883100_0001_1_00_000000, startTime=1452790883444, finishTime=1452790883511, timeTaken=67, status=SUCCEEDED, successfulAttemptID=attempt_1452790883100_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790883498, Process_Duration=7, Process_End_Time=1452790883505, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:23,510 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 17:01:23,512 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790883100_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 17:01:23,513 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF] : 1
2016-01-14 17:01:23,514 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF]
2016-01-14 17:01:23,515 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 17:01:23,515 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883100_0001_1][Event:VERTEX_FINISHED]: vertexName=A75579C69D44492789D52718EBFB2DEF, vertexId=vertex_1452790883100_0001_1_00, initRequestedTime=1452790883330, initedTime=1452790883388, startRequestedTime=1452790883390, startedTime=1452790883390, finishTime=1452790883514, timeTaken=124, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790883498, Process_Duration=7, Process_End_Time=1452790883505, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452790883444, firstTasksToStart=[ task_1452790883100_0001_1_00_000000 ], lastTaskFinishTime=1452790883507, lastTasksToFinish=[ task_1452790883100_0001_1_00_000000 ], minTaskDuration=63, maxTaskDuration=63, avgTaskDuration=63.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452790883100_0001_1_00_000000 ], longestDurationTasks=[ task_1452790883100_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 17:01:23,516 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 17:01:23,516 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790883100_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 17:01:23,517 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883100_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452790883100_0001_00_000001, stoppedTime=1452790883517, exitStatus=0
2016-01-14 17:01:23,517 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790883100_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 17:01:23,517 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 17:01:23,517 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 17:01:23,518 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452790883100_0001_1
2016-01-14 17:01:23,518 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883100_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452790883100_0001_1
2016-01-14 17:01:23,519 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: A73EEEA87D8E4AB69F050601209A7810 for vertex: vertex_1452790883100_0001_1_00 [A75579C69D44492789D52718EBFB2DEF]
2016-01-14 17:01:23,520 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(221)) - No more tasks for container with id : container_1452790883100_0001_00_000001. Asking it to die
2016-01-14 17:01:23,520 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452790883100_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 17:01:23,522 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452790883100_0001_00_000001, Exiting
2016-01-14 17:01:23,522 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452790883100_0001_00_000001
2016-01-14 17:01:23,522 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452790883100_0001_00_000001
2016-01-14 17:01:23,524 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452790883100_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 17:01:23,524 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452790883100_0001_00_000001 completed successfully
2016-01-14 17:01:23,533 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452790883100_0001_1, queueSize=0
2016-01-14 17:01:23,533 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 17:01:23,535 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883100_0001_1][Event:DAG_FINISHED]: dagId=dag_1452790883100_0001_1, startTime=1452790883329, finishTime=1452790883531, timeTaken=202, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790883498, Process_Duration=7, Process_End_Time=1452790883505, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:23,535 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452790883100_0001_1 finished with state: SUCCEEDED
2016-01-14 17:01:23,535 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790883100_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 17:01:23,536 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452790883100_0001_00_000001
2016-01-14 17:01:23,536 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790883100_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 17:01:23 Completed Dag: dag_1452790883100_0001_1
2016-01-14 17:01:23,537 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452790883100_0001_1, dagState=SUCCEEDED
2016-01-14 17:01:23,537 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452790883100_0001_1_post
2016-01-14 17:01:23,538 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:23,538 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 17:01:23,543 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...leRiffle/perpetual/second, applicationId=application_1452790883100_0001
2016-01-14 17:01:23,546 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 17:01:23,546 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 17:01:23,546 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 17:01:23,546 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 17:01:23,546 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 17:01:23,547 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 17:01:23,549 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 17:01:23,550 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 17:01:23,550 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 17:01:23,551 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 17:01:23,551 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 17:01:23,553 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 17:01:23,553 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 17:01:23,558 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/2BE1D6197871422692E404A83BEBFB61/E7A1E08AC69B4EF8B2BFB6CFBB054EE7/.tez/application_1452790883100_0001
2016-01-14 17:01:23,559 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second]  completed in: 00:00.485
2016-01-14 17:01:23,561 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] starting
2016-01-14 17:01:23,561 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second"]
2016-01-14 17:01:23,562 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third]  sink: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third"]
2016-01-14 17:01:23,562 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third]  parallel execution of steps is enabled: false
2016-01-14 17:01:23,562 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third]  executing total steps: 1
2016-01-14 17:01:23,562 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third]  allocating management threads: 1
2016-01-14 17:01:23,563 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] starting step: (1/1) ...pleRiffle/perpetual/third
2016-01-14 17:01:23,563 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [third] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 17:01:23,581 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] tez session mode enabled: true
2016-01-14 17:01:23,586 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:01:23,586 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 17:01:23,586 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 17:01:23,597 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/510D1A85ABD042FFB0E3987A7E7E8E95/EE003359D9544776861C60254FE420E0/.tez/application_1452790883586_0001 doesn't exist and is created
2016-01-14 17:01:23,619 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 17:01:23,620 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:01:23,621 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/510D1A85ABD042FFB0E3987A7E7E8E95/EE003359D9544776861C60254FE420E0/.tez/application_1452790883586_0001
2016-01-14 17:01:23,625 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452790883586_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:01:23,638 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 17:01:23,639 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 17:01:23,641 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 17:01:23,642 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 17:01:23,642 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/510D1A85ABD042FFB0E3987A7E7E8E95/EE003359D9544776861C60254FE420E0/.tez/application_1452790883586_0001/localmode-log-dir
2016-01-14 17:01:23,642 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/510D1A85ABD042FFB0E3987A7E7E8E95/EE003359D9544776861C60254FE420E0/.tez/application_1452790883586_0001/localmode-log-dir/history.txt.appattempt_1452790883586_0001_000000, maxErrors=10
2016-01-14 17:01:23,643 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 17:01:23,643 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452790883586_0001_000000, appSubmitTime=1452790883624, launchTime=1452790883625
2016-01-14 17:01:23,652 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 17:01:23,653 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 17:01:23,657 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:36968
2016-01-14 17:01:23,661 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 17:01:23,662 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 17:01:23,663 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 17:01:23,666 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 17:01:23,666 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452790883586_0001_000000, startTime=1452790883666
2016-01-14 17:01:23,666 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 17:01:23,720 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 17:01:23,720 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 17:01:23,721 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...pleRiffle/perpetual/third, applicationId=application_1452790883586_0001, dagName=[510D1A85ABD042FFB0E3987A7E7E8E95/EE003359D9544776861C60254FE420E0] third/(1/1) ...pleRiffle/perpetual/third
2016-01-14 17:01:23,739 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [510D1A85ABD042FFB0E3987A7E7E8E95/EE003359D9544776861C60254FE420E0] third/(1/1) ...pleRiffle/perpetual/third
2016-01-14 17:01:23,741 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452790883586_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/510D1A85ABD042FFB0E3987A7E7E8E95/EE003359D9544776861C60254FE420E0/.tez/application_1452790883586_0001/localmode-log-dir/dag_1452790883586_0001_1.dot
2016-01-14 17:01:23,742 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/510D1A85ABD042FFB0E3987A7E7E8E95/EE003359D9544776861C60254FE420E0/.tez/application_1452790883586_0001/localmode-log-dir/dag_1452790883586_0001_1-tez-dag.pb.txt
2016-01-14 17:01:23,766 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452790883586_0001_1
2016-01-14 17:01:23,766 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:23,766 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [510D1A85ABD042FFB0E3987A7E7E8E95/EE003359D9544776861C60254FE420E0] third/(1/1) ...pleRiffle/perpetual/third
2016-01-14 17:01:23 Running Dag: dag_1452790883586_0001_1
2016-01-14 17:01:23,781 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883586_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452790883586_0001_1, submitTime=1452790883740
2016-01-14 17:01:23,781 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 17:01:23,782 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex DA76A4D22B3A46E19B649FB0B8B52A7D
2016-01-14 17:01:23,782 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 17:01:23,783 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 17:01:23,784 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883586_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452790883586_0001_1, initTime=1452790883781
2016-01-14 17:01:23,784 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790883586_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 17:01:23,785 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 17:01:23,785 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883586_0001_1][Event:DAG_STARTED]: dagID=dag_1452790883586_0001_1, startTime=1452790883784
2016-01-14 17:01:23,785 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 17:01:23,785 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790883586_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 17:01:23,786 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: DA76A4D22B3A46E19B649FB0B8B52A7D : {A73EEEA87D8E4AB69F050601209A7810={InputName=A73EEEA87D8E4AB69F050601209A7810}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 17:01:23,786 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: A73EEEA87D8E4AB69F050601209A7810, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 17:01:23,786 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D]
2016-01-14 17:01:23,786 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D]
2016-01-14 17:01:23,786 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D]
2016-01-14 17:01:23,786 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D]. Starting root input initializers: 1
2016-01-14 17:01:23,787 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 17:01:23,787 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: A73EEEA87D8E4AB69F050601209A7810 on vertex vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D]
2016-01-14 17:01:23,787 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...pleRiffle/perpetual/third, applicationId=application_1452790883586_0001, dagName=[510D1A85ABD042FFB0E3987A7E7E8E95/EE003359D9544776861C60254FE420E0] third/(1/1) ...pleRiffle/perpetual/third
2016-01-14 17:01:23,790 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 17:01:23,790 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input A73EEEA87D8E4AB69F050601209A7810 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 17:01:23,792 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 17:01:23,792 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 17:01:23,808 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 548
2016-01-14 17:01:23,808 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: A73EEEA87D8E4AB69F050601209A7810 on vertex vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D]
2016-01-14 17:01:23,809 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:01:23,809 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {A73EEEA87D8E4AB69F050601209A7810=forAllWorkUnits=true, update=[1]}
2016-01-14 17:01:23,809 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] submitted tez dag to app master: application_1452790883586_0001, with dag id: dag_1452790883586_0001_1
2016-01-14 17:01:23,809 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D] parallelism set to 1
2016-01-14 17:01:23,810 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:01:23,810 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883586_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452790883586_0001_1_00, eventCount=1
2016-01-14 17:01:23,810 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D]
2016-01-14 17:01:23,811 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=644BF50207884CDC924EE52C7A7C4AA5, vertexId=vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 17:01:23,811 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=644BF50207884CDC924EE52C7A7C4AA5, vertexId=vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D]
2016-01-14 17:01:23,813 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=644BF50207884CDC924EE52C7A7C4AA5, vertexName=DA76A4D22B3A46E19B649FB0B8B52A7D, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 17:01:23,814 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=644BF50207884CDC924EE52C7A7C4AA5, vertexId=vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D]
2016-01-14 17:01:23,816 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 17:01:23,816 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883586_0001_1][Event:VERTEX_INITIALIZED]: vertexName=DA76A4D22B3A46E19B649FB0B8B52A7D, vertexId=vertex_1452790883586_0001_1_00, initRequestedTime=1452790883785, initedTime=1452790883816, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 17:01:23,816 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D] with distanceFromRoot: 0
2016-01-14 17:01:23,817 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 17:01:23,817 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in DA76A4D22B3A46E19B649FB0B8B52A7D
2016-01-14 17:01:23,817 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D]
2016-01-14 17:01:23,818 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 17:01:23,818 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883586_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452790883586_0001_1_00, startRequestedTime=1452790883817, startedTime=1452790883817
2016-01-14 17:01:23,819 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D] transitioned from INITED to RUNNING due to event V_START
2016-01-14 17:01:23,820 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 17:01:23,820 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883586_0001_1][Event:TASK_STARTED]: vertexName=DA76A4D22B3A46E19B649FB0B8B52A7D, taskId=task_1452790883586_0001_1_00_000000, scheduledTime=1452790883819, launchTime=1452790883819
2016-01-14 17:01:23,821 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790883586_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 17:01:23,823 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D]
2016-01-14 17:01:23,827 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [510D1A85ABD042FFB0E3987A7E7E8E95/EE003359D9544776861C60254FE420E0] third/(1/1) ...pleRiffle/perpetual/third, VertexName: DA76A4D22B3A46E19B649FB0B8B52A7D, VertexParallelism: 1, TaskAttemptID:attempt_1452790883586_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=A73EEEA87D8E4AB69F050601209A7810, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=644BF50207884CDC924EE52C7A7C4AA5, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:01:23,828 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790883586_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 17:01:23,830 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 17:01:23,831 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 17:01:23,833 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 17:01:23,833 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 17:01:23,833 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452790883586_0001_00_000001
2016-01-14 17:01:23,833 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790883586_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 17:01:23,836 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452790883586_0001_00_000001
2016-01-14 17:01:23,836 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-01-14 17:01:23,837 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 17:01:23,837 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883586_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452790883586_0001_00_000001, launchTime=1452790883837
2016-01-14 17:01:23,838 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452790883586_0001_00_000001
2016-01-14 17:01:23,839 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790883586_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 17:01:23,840 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452790883586_0001_1_00_000000_0] to container: [container_1452790883586_0001_00_000001]
2016-01-14 17:01:23,841 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790883586_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 17:01:23,841 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452790883586_0001_00_000001 given task: attempt_1452790883586_0001_1_00_000000_0
2016-01-14 17:01:23,841 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452790883586_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452790883586_0001_1_00_000000_0
2016-01-14 17:01:23,842 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452790883586_0001_1_00_000000_0] started. Is using containerId: [container_1452790883586_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 17:01:23 Starting to run new task attempt: attempt_1452790883586_0001_1_00_000000_0
2016-01-14 17:01:23,842 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883586_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=DA76A4D22B3A46E19B649FB0B8B52A7D, taskAttemptId=attempt_1452790883586_0001_1_00_000000_0, startTime=1452790883841, containerId=container_1452790883586_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452790883586_0001_00_000001/teamcity, completedLogs=
2016-01-14 17:01:23,842 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452790883586_0001_1_00_000000_0
2016-01-14 17:01:23,842 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790883586_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 17:01:23,842 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 17:01:23,843 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790883586_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 17:01:23,843 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:23,843 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 17:01:23,843 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 17:01:23,843 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 17:01:23,844 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 17:01:23,844 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 17:01:23,844 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [510D1A85ABD042FFB0E3987A7E7E8E95/EE003359D9544776861C60254FE420E0] third/(1/1) ...pleRiffle/perpetual/third, VertexName: DA76A4D22B3A46E19B649FB0B8B52A7D, VertexParallelism: 1, TaskAttemptID:attempt_1452790883586_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=A73EEEA87D8E4AB69F050601209A7810, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=644BF50207884CDC924EE52C7A7C4AA5, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:01:23,844 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 17:01:23,845 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452790883586_0001_1_00_000000_0
2016-01-14 17:01:23,847 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 17:01:23,847 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:23,848 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:23,849 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=A73EEEA87D8E4AB69F050601209A7810, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 17:01:23,850 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 17:01:23,850 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: A73EEEA87D8E4AB69F050601209A7810
2016-01-14 17:01:23,851 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: A73EEEA87D8E4AB69F050601209A7810
2016-01-14 17:01:23,852 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 17:01:23,853 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452790883586_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 17:01:23,853 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=644BF50207884CDC924EE52C7A7C4AA5, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 17:01:23,856 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 17:01:23,856 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 644BF50207884CDC924EE52C7A7C4AA5
2016-01-14 17:01:23,857 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 17:01:23,857 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 644BF50207884CDC924EE52C7A7C4AA5
2016-01-14 17:01:23,857 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 17:01:23,859 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: A73EEEA87D8E4AB69F050601209A7810
2016-01-14 17:01:23,859 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: A73EEEA87D8E4AB69F050601209A7810
2016-01-14 17:01:23,871 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: DA76A4D22B3A46E19B649FB0B8B52A7D, ordinal: 0
2016-01-14 17:01:23,872 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DA76A4D22B3A46E19B649FB0B8B52A7D, mem on start (mb), free: 322, total: 397, max: 672
2016-01-14 17:01:23,872 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:23,872 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 17:01:23,872 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 17:01:23,874 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 17:01:23,874 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 644BF50207884CDC924EE52C7A7C4AA5
2016-01-14 17:01:23,874 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 17:01:23,874 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 17:01:23,875 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 17:01:23,875 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:01:23,875 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 17:01:23,875 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:01:23,876 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 17:01:23,876 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 17:01:23,876 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, A73EEEA87D8E4AB69F050601209A7810, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 17:01:23,876 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 644BF50207884CDC924EE52C7A7C4AA5, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 17:01:23,876 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 17:01:23,876 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: A73EEEA87D8E4AB69F050601209A7810
2016-01-14 17:01:23,877 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:01:23,877 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: A73EEEA87D8E4AB69F050601209A7810
2016-01-14 17:01:23,877 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: A73EEEA87D8E4AB69F050601209A7810 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 17:01:23,880 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 17:01:23,880 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 17:01:23,880 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 17:01:23,881 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452790883586_0001_1_00_000000_0
2016-01-14 17:01:23,885 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second"]
2016-01-14 17:01:23,886 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second"] streamed: true, id: A73EEEA87D8E4AB69F050601209A7810
2016-01-14 17:01:23,887 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third"], id: 644BF50207884CDC924EE52C7A7C4AA5
2016-01-14 17:01:23,886 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 17:01:23,887 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third"]
2016-01-14 17:01:23,888 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@7f19ea6c
2016-01-14 17:01:23,888 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second"]
2016-01-14 17:01:23,890 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:01:23,891 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@7f19ea6c
2016-01-14 17:01:23,892 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 17:01:23,892 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 17:01:23,892 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: DA76A4D22B3A46E19B649FB0B8B52A7D, all 1 inputs ready in: 00:00:00.000
2016-01-14 17:01:23,898 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 17:01:23,899 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 17:01:23,900 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452790883586_0001_1_00_000000_0
2016-01-14 17:01:23,900 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452790883586_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 17:01:23,901 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452790883586_0001_1_00_000000_0
2016-01-14 17:01:23,901 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DA76A4D22B3A46E19B649FB0B8B52A7D, mem on close (mb), free: 320, total: 397, max: 672
2016-01-14 17:01:23 Completed running task attempt: attempt_1452790883586_0001_1_00_000000_0
2016-01-14 17:01:23,903 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452790883586_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 17:01:23,904 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 17:01:23,906 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883586_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=DA76A4D22B3A46E19B649FB0B8B52A7D, taskAttemptId=attempt_1452790883586_0001_1_00_000000_0, startTime=1452790883841, finishTime=1452790883904, timeTaken=63, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790883892, Process_Duration=9, Process_End_Time=1452790883901, Read_Duration=3, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:23,906 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452790883892, Process_Duration=9, Process_End_Time=1452790883901, Read_Duration=3, Tuples_Read=20, Tuples_Written=20, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 17:01:23,906 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790883586_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 17:01:23,907 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452790883586_0001_1_00_000000_0
2016-01-14 17:01:23,908 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883586_0001_1][Event:TASK_FINISHED]: vertexName=DA76A4D22B3A46E19B649FB0B8B52A7D, taskId=task_1452790883586_0001_1_00_000000, startTime=1452790883841, finishTime=1452790883907, timeTaken=66, status=SUCCEEDED, successfulAttemptID=attempt_1452790883586_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790883892, Process_Duration=9, Process_End_Time=1452790883901, Read_Duration=3, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:23,908 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790883586_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 17:01:23,908 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 17:01:23,908 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D] : 1
2016-01-14 17:01:23,909 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D]
2016-01-14 17:01:23,911 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 17:01:23,911 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 17:01:23,911 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:23,912 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 17:01:23,912 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452790883586_0001_00_000001
2016-01-14 17:01:23,913 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883586_0001_1][Event:VERTEX_FINISHED]: vertexName=DA76A4D22B3A46E19B649FB0B8B52A7D, vertexId=vertex_1452790883586_0001_1_00, initRequestedTime=1452790883785, initedTime=1452790883816, startRequestedTime=1452790883817, startedTime=1452790883817, finishTime=1452790883909, timeTaken=92, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790883892, Process_Duration=9, Process_End_Time=1452790883901, Read_Duration=3, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452790883841, firstTasksToStart=[ task_1452790883586_0001_1_00_000000 ], lastTaskFinishTime=1452790883904, lastTasksToFinish=[ task_1452790883586_0001_1_00_000000 ], minTaskDuration=63, maxTaskDuration=63, avgTaskDuration=63.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452790883586_0001_1_00_000000 ], longestDurationTasks=[ task_1452790883586_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 17:01:23,913 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 17:01:23,914 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790883586_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 17:01:23,914 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883586_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452790883586_0001_00_000001, stoppedTime=1452790883914, exitStatus=0
2016-01-14 17:01:23,914 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790883586_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 17:01:23,914 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 17:01:23,914 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452790883586_0001_1
2016-01-14 17:01:23,914 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 17:01:23,916 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883586_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452790883586_0001_1
2016-01-14 17:01:23,916 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 644BF50207884CDC924EE52C7A7C4AA5 for vertex: vertex_1452790883586_0001_1_00 [DA76A4D22B3A46E19B649FB0B8B52A7D]
2016-01-14 17:01:23,926 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452790883586_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 17:01:23,926 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452790883586_0001_00_000001: 13 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 17:01:23,926 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452790883586_0001_00_000001, Exiting
2016-01-14 17:01:23,926 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452790883586_0001_00_000001
2016-01-14 17:01:23,926 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452790883586_0001_00_000001
2016-01-14 17:01:23,940 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452790883586_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 17:01:23,940 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452790883586_0001_00_000001 completed successfully
2016-01-14 17:01:23,941 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452790883586_0001_1, queueSize=0
2016-01-14 17:01:23,941 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 17:01:23,942 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883586_0001_1][Event:DAG_FINISHED]: dagId=dag_1452790883586_0001_1, startTime=1452790883784, finishTime=1452790883940, timeTaken=156, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790883892, Process_Duration=9, Process_End_Time=1452790883901, Read_Duration=3, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:23,942 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452790883586_0001_1 finished with state: SUCCEEDED
2016-01-14 17:01:23,942 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790883586_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 17:01:23,943 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452790883586_0001_00_000001
2016-01-14 17:01:23,943 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790883586_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 17:01:23 Completed Dag: dag_1452790883586_0001_1
2016-01-14 17:01:23,947 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452790883586_0001_1, dagState=SUCCEEDED
2016-01-14 17:01:23,947 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452790883586_0001_1_post
2016-01-14 17:01:23,947 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:23,948 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 17:01:23,953 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...pleRiffle/perpetual/third, applicationId=application_1452790883586_0001
2016-01-14 17:01:23,957 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 17:01:23,957 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 17:01:23,957 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 17:01:23,957 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 17:01:23,957 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 17:01:23,958 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 17:01:23,958 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 17:01:23,959 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 17:01:23,959 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 17:01:23,960 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 17:01:23,961 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 17:01:23,961 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 17:01:23,962 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 17:01:23,968 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/510D1A85ABD042FFB0E3987A7E7E8E95/EE003359D9544776861C60254FE420E0/.tez/application_1452790883586_0001
2016-01-14 17:01:23,968 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third]  completed in: 00:00.407
2016-01-14 17:01:23,971 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] starting
2016-01-14 17:01:23,971 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth]  source: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third"]
2016-01-14 17:01:23,971 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/fourth"]
2016-01-14 17:01:23,972 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth]  parallel execution of steps is enabled: false
2016-01-14 17:01:23,972 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth]  executing total steps: 1
2016-01-14 17:01:23,973 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth]  allocating management threads: 1
2016-01-14 17:01:23,973 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] starting step: (1/1) ...leRiffle/perpetual/fourth
2016-01-14 17:01:23,973 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [fourth] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 17:01:23,988 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] tez session mode enabled: true
2016-01-14 17:01:23,993 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:01:23,994 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 17:01:23,994 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 17:01:24,004 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8F67130CEAB499D9BB600A593035043/FF8A2E7010AA4EEDBA0A4924375EFAD3/.tez/application_1452790883993_0001 doesn't exist and is created
2016-01-14 17:01:24,022 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 17:01:24,022 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:01:24,023 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8F67130CEAB499D9BB600A593035043/FF8A2E7010AA4EEDBA0A4924375EFAD3/.tez/application_1452790883993_0001
2016-01-14 17:01:24,027 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452790883993_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:01:24,038 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 17:01:24,039 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 17:01:24,041 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 17:01:24,041 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 17:01:24,041 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8F67130CEAB499D9BB600A593035043/FF8A2E7010AA4EEDBA0A4924375EFAD3/.tez/application_1452790883993_0001/localmode-log-dir
2016-01-14 17:01:24,041 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8F67130CEAB499D9BB600A593035043/FF8A2E7010AA4EEDBA0A4924375EFAD3/.tez/application_1452790883993_0001/localmode-log-dir/history.txt.appattempt_1452790883993_0001_000000, maxErrors=10
2016-01-14 17:01:24,042 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 17:01:24,042 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452790883993_0001_000000, appSubmitTime=1452790884026, launchTime=1452790884026
2016-01-14 17:01:24,051 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 17:01:24,054 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:43008
2016-01-14 17:01:24,054 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 17:01:24,057 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 17:01:24,057 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 17:01:24,060 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 17:01:24,061 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 17:01:24,061 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452790883993_0001_000000, startTime=1452790884061
2016-01-14 17:01:24,061 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 17:01:24,122 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 17:01:24,123 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 17:01:24,123 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...leRiffle/perpetual/fourth, applicationId=application_1452790883993_0001, dagName=[E8F67130CEAB499D9BB600A593035043/FF8A2E7010AA4EEDBA0A4924375EFAD3] fourth/(1/1) ...leRiffle/perpetual/fourth
2016-01-14 17:01:24,146 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [E8F67130CEAB499D9BB600A593035043/FF8A2E7010AA4EEDBA0A4924375EFAD3] fourth/(1/1) ...leRiffle/perpetual/fourth
2016-01-14 17:01:24,148 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452790883993_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8F67130CEAB499D9BB600A593035043/FF8A2E7010AA4EEDBA0A4924375EFAD3/.tez/application_1452790883993_0001/localmode-log-dir/dag_1452790883993_0001_1.dot
2016-01-14 17:01:24,148 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8F67130CEAB499D9BB600A593035043/FF8A2E7010AA4EEDBA0A4924375EFAD3/.tez/application_1452790883993_0001/localmode-log-dir/dag_1452790883993_0001_1-tez-dag.pb.txt
2016-01-14 17:01:24,172 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452790883993_0001_1
2016-01-14 17:01:24,172 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:24,172 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [E8F67130CEAB499D9BB600A593035043/FF8A2E7010AA4EEDBA0A4924375EFAD3] fourth/(1/1) ...leRiffle/perpetual/fourth
2016-01-14 17:01:24 Running Dag: dag_1452790883993_0001_1
2016-01-14 17:01:24,186 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 17:01:24,187 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883993_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452790883993_0001_1, submitTime=1452790884146
2016-01-14 17:01:24,187 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex EFC1A0AE67224FE29CE9795C8E70FBA2
2016-01-14 17:01:24,188 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 17:01:24,190 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 17:01:24,190 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883993_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452790883993_0001_1, initTime=1452790884187
2016-01-14 17:01:24,191 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790883993_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 17:01:24,192 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883993_0001_1][Event:DAG_STARTED]: dagID=dag_1452790883993_0001_1, startTime=1452790884191
2016-01-14 17:01:24,192 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 17:01:24,192 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790883993_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 17:01:24,192 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: EFC1A0AE67224FE29CE9795C8E70FBA2 : {644BF50207884CDC924EE52C7A7C4AA5={InputName=644BF50207884CDC924EE52C7A7C4AA5}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 17:01:24,192 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 644BF50207884CDC924EE52C7A7C4AA5, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 17:01:24,192 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2]
2016-01-14 17:01:24,192 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2]
2016-01-14 17:01:24,192 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2]
2016-01-14 17:01:24,193 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2]. Starting root input initializers: 1
2016-01-14 17:01:24,193 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 17:01:24,193 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 17:01:24,194 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 644BF50207884CDC924EE52C7A7C4AA5 on vertex vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2]
2016-01-14 17:01:24,195 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...leRiffle/perpetual/fourth, applicationId=application_1452790883993_0001, dagName=[E8F67130CEAB499D9BB600A593035043/FF8A2E7010AA4EEDBA0A4924375EFAD3] fourth/(1/1) ...leRiffle/perpetual/fourth
2016-01-14 17:01:24,197 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 17:01:24,197 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 644BF50207884CDC924EE52C7A7C4AA5 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 17:01:24,201 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 17:01:24,202 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 17:01:24,217 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] submitted tez dag to app master: application_1452790883993_0001, with dag id: dag_1452790883993_0001_1
2016-01-14 17:01:24,219 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 546
2016-01-14 17:01:24,219 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 644BF50207884CDC924EE52C7A7C4AA5 on vertex vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2]
2016-01-14 17:01:24,220 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:01:24,220 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {644BF50207884CDC924EE52C7A7C4AA5=forAllWorkUnits=true, update=[1]}
2016-01-14 17:01:24,220 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2] parallelism set to 1
2016-01-14 17:01:24,220 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:01:24,222 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883993_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452790883993_0001_1_00, eventCount=1
2016-01-14 17:01:24,222 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2]
2016-01-14 17:01:24,222 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=2702E7077CB241E5B8F9D51BF46D57E5, vertexId=vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 17:01:24,222 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=2702E7077CB241E5B8F9D51BF46D57E5, vertexId=vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2]
2016-01-14 17:01:24,224 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=2702E7077CB241E5B8F9D51BF46D57E5, vertexName=EFC1A0AE67224FE29CE9795C8E70FBA2, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 17:01:24,225 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=2702E7077CB241E5B8F9D51BF46D57E5, vertexId=vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2]
2016-01-14 17:01:24,227 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 17:01:24,227 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883993_0001_1][Event:VERTEX_INITIALIZED]: vertexName=EFC1A0AE67224FE29CE9795C8E70FBA2, vertexId=vertex_1452790883993_0001_1_00, initRequestedTime=1452790884192, initedTime=1452790884226, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 17:01:24,227 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2] with distanceFromRoot: 0
2016-01-14 17:01:24,227 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 17:01:24,228 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in EFC1A0AE67224FE29CE9795C8E70FBA2
2016-01-14 17:01:24,228 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2]
2016-01-14 17:01:24,229 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 17:01:24,230 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883993_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452790883993_0001_1_00, startRequestedTime=1452790884228, startedTime=1452790884228
2016-01-14 17:01:24,230 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2] transitioned from INITED to RUNNING due to event V_START
2016-01-14 17:01:24,231 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 17:01:24,232 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883993_0001_1][Event:TASK_STARTED]: vertexName=EFC1A0AE67224FE29CE9795C8E70FBA2, taskId=task_1452790883993_0001_1_00_000000, scheduledTime=1452790884231, launchTime=1452790884231
2016-01-14 17:01:24,232 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790883993_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 17:01:24,233 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2]
2016-01-14 17:01:24,233 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [E8F67130CEAB499D9BB600A593035043/FF8A2E7010AA4EEDBA0A4924375EFAD3] fourth/(1/1) ...leRiffle/perpetual/fourth, VertexName: EFC1A0AE67224FE29CE9795C8E70FBA2, VertexParallelism: 1, TaskAttemptID:attempt_1452790883993_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=644BF50207884CDC924EE52C7A7C4AA5, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=2702E7077CB241E5B8F9D51BF46D57E5, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:01:24,234 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790883993_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 17:01:24,234 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 17:01:24,235 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 17:01:24,236 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 17:01:24,236 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 17:01:24,236 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452790883993_0001_00_000001
2016-01-14 17:01:24,236 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790883993_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 17:01:24,238 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452790883993_0001_00_000001
2016-01-14 17:01:24,239 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-01-14 17:01:24,239 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790883993_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 17:01:24,240 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883993_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452790883993_0001_00_000001, launchTime=1452790884239
2016-01-14 17:01:24,241 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 17:01:24,242 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452790883993_0001_00_000001
2016-01-14 17:01:24,242 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452790883993_0001_1_00_000000_0] to container: [container_1452790883993_0001_00_000001]
2016-01-14 17:01:24,243 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790883993_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 17:01:24,243 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452790883993_0001_00_000001 given task: attempt_1452790883993_0001_1_00_000000_0
2016-01-14 17:01:24,243 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452790883993_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452790883993_0001_1_00_000000_0
2016-01-14 17:01:24,243 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452790883993_0001_1_00_000000_0] started. Is using containerId: [container_1452790883993_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 17:01:24,244 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883993_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=EFC1A0AE67224FE29CE9795C8E70FBA2, taskAttemptId=attempt_1452790883993_0001_1_00_000000_0, startTime=1452790884243, containerId=container_1452790883993_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452790883993_0001_00_000001/teamcity, completedLogs=
2016-01-14 17:01:24,244 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790883993_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 17:01:24,244 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790883993_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 17:01:24,245 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 17:01:24 Starting to run new task attempt: attempt_1452790883993_0001_1_00_000000_0
2016-01-14 17:01:24,247 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452790883993_0001_1_00_000000_0
2016-01-14 17:01:24,247 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:24,247 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 17:01:24,247 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 17:01:24,248 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 17:01:24,248 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 17:01:24,248 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 17:01:24,249 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [E8F67130CEAB499D9BB600A593035043/FF8A2E7010AA4EEDBA0A4924375EFAD3] fourth/(1/1) ...leRiffle/perpetual/fourth, VertexName: EFC1A0AE67224FE29CE9795C8E70FBA2, VertexParallelism: 1, TaskAttemptID:attempt_1452790883993_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=644BF50207884CDC924EE52C7A7C4AA5, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=2702E7077CB241E5B8F9D51BF46D57E5, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:01:24,249 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 17:01:24,250 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452790883993_0001_1_00_000000_0
2016-01-14 17:01:24,250 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 17:01:24,250 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:24,251 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=644BF50207884CDC924EE52C7A7C4AA5, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 17:01:24,251 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:24,252 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452790883993_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 17:01:24,253 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=2702E7077CB241E5B8F9D51BF46D57E5, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 17:01:24,253 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 17:01:24,254 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 2702E7077CB241E5B8F9D51BF46D57E5
2016-01-14 17:01:24,254 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 17:01:24,254 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 2702E7077CB241E5B8F9D51BF46D57E5
2016-01-14 17:01:24,257 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 17:01:24,259 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 17:01:24,259 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 644BF50207884CDC924EE52C7A7C4AA5
2016-01-14 17:01:24,260 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 644BF50207884CDC924EE52C7A7C4AA5
2016-01-14 17:01:24,264 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 17:01:24,265 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 644BF50207884CDC924EE52C7A7C4AA5
2016-01-14 17:01:24,265 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 644BF50207884CDC924EE52C7A7C4AA5
2016-01-14 17:01:24,269 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: EFC1A0AE67224FE29CE9795C8E70FBA2, ordinal: 0
2016-01-14 17:01:24,269 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: EFC1A0AE67224FE29CE9795C8E70FBA2, mem on start (mb), free: 278, total: 397, max: 672
2016-01-14 17:01:24,269 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:24,269 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 17:01:24,269 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 17:01:24,272 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 17:01:24,272 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 2702E7077CB241E5B8F9D51BF46D57E5
2016-01-14 17:01:24,272 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 17:01:24,272 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 17:01:24,273 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 17:01:24,273 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:01:24,273 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 17:01:24,273 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:01:24,273 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 17:01:24,274 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 17:01:24,274 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 2702E7077CB241E5B8F9D51BF46D57E5, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 17:01:24,274 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 644BF50207884CDC924EE52C7A7C4AA5, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 17:01:24,274 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 17:01:24,274 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 644BF50207884CDC924EE52C7A7C4AA5 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 17:01:24,274 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 17:01:24,274 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 17:01:24,275 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 644BF50207884CDC924EE52C7A7C4AA5
2016-01-14 17:01:24,275 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:01:24,275 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 644BF50207884CDC924EE52C7A7C4AA5
2016-01-14 17:01:24,275 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 17:01:24,275 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452790883993_0001_1_00_000000_0
2016-01-14 17:01:24,278 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 17:01:24,278 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@4a0b0b20
2016-01-14 17:01:24,279 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third"]
2016-01-14 17:01:24,280 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third"] streamed: true, id: 644BF50207884CDC924EE52C7A7C4AA5
2016-01-14 17:01:24,280 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/fourth"], id: 2702E7077CB241E5B8F9D51BF46D57E5
2016-01-14 17:01:24,281 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/fourth"]
2016-01-14 17:01:24,281 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third"]
2016-01-14 17:01:24,281 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:01:24,282 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@4a0b0b20
2016-01-14 17:01:24,282 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 17:01:24,282 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 17:01:24,282 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: EFC1A0AE67224FE29CE9795C8E70FBA2, all 1 inputs ready in: 00:00:00.000
2016-01-14 17:01:24,286 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 17:01:24,287 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 17:01:24,287 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452790883993_0001_1_00_000000_0
2016-01-14 17:01:24,288 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452790883993_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 17:01:24,289 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452790883993_0001_1_00_000000_0
2016-01-14 17:01:24,289 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: EFC1A0AE67224FE29CE9795C8E70FBA2, mem on close (mb), free: 276, total: 397, max: 672
2016-01-14 17:01:24 Completed running task attempt: attempt_1452790883993_0001_1_00_000000_0
2016-01-14 17:01:24,290 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452790883993_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 17:01:24,292 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452790884282, Process_Duration=7, Process_End_Time=1452790884289, Read_Duration=3, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 17:01:24,292 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 17:01:24,292 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 17:01:24,293 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:24,293 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883993_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=EFC1A0AE67224FE29CE9795C8E70FBA2, taskAttemptId=attempt_1452790883993_0001_1_00_000000_0, startTime=1452790884243, finishTime=1452790884292, timeTaken=49, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790884282, Process_Duration=7, Process_End_Time=1452790884289, Read_Duration=3, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:24,293 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790883993_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 17:01:24,294 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 17:01:24,294 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452790883993_0001_1_00_000000_0
2016-01-14 17:01:24,295 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452790883993_0001_00_000001
2016-01-14 17:01:24,295 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 17:01:24,295 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883993_0001_1][Event:TASK_FINISHED]: vertexName=EFC1A0AE67224FE29CE9795C8E70FBA2, taskId=task_1452790883993_0001_1_00_000000, startTime=1452790884243, finishTime=1452790884294, timeTaken=51, status=SUCCEEDED, successfulAttemptID=attempt_1452790883993_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790884282, Process_Duration=7, Process_End_Time=1452790884289, Read_Duration=3, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:24,296 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790883993_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 17:01:24,296 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2] : 1
2016-01-14 17:01:24,296 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2]
2016-01-14 17:01:24,297 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 17:01:24,299 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883993_0001_1][Event:VERTEX_FINISHED]: vertexName=EFC1A0AE67224FE29CE9795C8E70FBA2, vertexId=vertex_1452790883993_0001_1_00, initRequestedTime=1452790884192, initedTime=1452790884226, startRequestedTime=1452790884228, startedTime=1452790884228, finishTime=1452790884296, timeTaken=68, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790884282, Process_Duration=7, Process_End_Time=1452790884289, Read_Duration=3, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452790884243, firstTasksToStart=[ task_1452790883993_0001_1_00_000000 ], lastTaskFinishTime=1452790884292, lastTasksToFinish=[ task_1452790883993_0001_1_00_000000 ], minTaskDuration=49, maxTaskDuration=49, avgTaskDuration=49.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452790883993_0001_1_00_000000 ], longestDurationTasks=[ task_1452790883993_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 17:01:24,299 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 17:01:24,300 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790883993_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 17:01:24,300 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883993_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452790883993_0001_00_000001, stoppedTime=1452790884300, exitStatus=0
2016-01-14 17:01:24,300 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 17:01:24,300 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790883993_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 17:01:24,301 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 17:01:24,301 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452790883993_0001_1
2016-01-14 17:01:24,301 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883993_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452790883993_0001_1
2016-01-14 17:01:24,301 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 2702E7077CB241E5B8F9D51BF46D57E5 for vertex: vertex_1452790883993_0001_1_00 [EFC1A0AE67224FE29CE9795C8E70FBA2]
2016-01-14 17:01:24,306 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452790883993_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 17:01:24,306 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452790883993_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 17:01:24,306 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452790883993_0001_00_000001, Exiting
2016-01-14 17:01:24,306 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452790883993_0001_00_000001
2016-01-14 17:01:24,307 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452790883993_0001_00_000001
2016-01-14 17:01:24,310 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452790883993_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 17:01:24,310 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452790883993_0001_00_000001 completed successfully
2016-01-14 17:01:24,315 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452790883993_0001_1, queueSize=0
2016-01-14 17:01:24,315 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 17:01:24,316 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790883993_0001_1][Event:DAG_FINISHED]: dagId=dag_1452790883993_0001_1, startTime=1452790884191, finishTime=1452790884314, timeTaken=123, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790884282, Process_Duration=7, Process_End_Time=1452790884289, Read_Duration=3, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:24,316 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452790883993_0001_1 finished with state: SUCCEEDED
2016-01-14 17:01:24,316 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790883993_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 17:01:24,317 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452790883993_0001_00_000001
2016-01-14 17:01:24,317 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790883993_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 17:01:24 Completed Dag: dag_1452790883993_0001_1
2016-01-14 17:01:24,317 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452790883993_0001_1, dagState=SUCCEEDED
2016-01-14 17:01:24,318 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452790883993_0001_1_post
2016-01-14 17:01:24,318 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:24,318 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 17:01:24,324 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...leRiffle/perpetual/fourth, applicationId=application_1452790883993_0001
2016-01-14 17:01:24,328 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 17:01:24,328 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 17:01:24,328 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 17:01:24,328 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 17:01:24,328 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 17:01:24,329 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 17:01:24,329 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 17:01:24,329 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 17:01:24,330 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 17:01:24,330 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 17:01:24,330 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 17:01:24,331 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 17:01:24,331 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 17:01:24,336 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8F67130CEAB499D9BB600A593035043/FF8A2E7010AA4EEDBA0A4924375EFAD3/.tez/application_1452790883993_0001
2016-01-14 17:01:24,337 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth]  completed in: 00:00.366
2016-01-14 17:01:24,387 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/first
2016-01-14 17:01:24,388 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/fourth
2016-01-14 17:01:24,388 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/second
2016-01-14 17:01:24,388 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testSimpleRiffle/perpetual/third
2016-01-14 17:01:24,418 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:01:24,418 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 17:01:24,468 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-01-14 17:01:24,476 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.028
2016-01-14 17:01:24,477 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:01:24,477 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:01:24,477 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:01:24,496 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/ips.20.txt
2016-01-14 17:01:24,497 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first
2016-01-14 17:01:24,547 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:01:24,548 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 17:01:24,611 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.015
2016-01-14 17:01:24,623 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.027
2016-01-14 17:01:24,623 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:01:24,624 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:01:24,624 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:01:24,646 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first
2016-01-14 17:01:24,647 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second
2016-01-14 17:01:24,694 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:01:24,694 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 17:01:24,751 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 17:01:24,760 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.026
2016-01-14 17:01:24,760 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:01:24,761 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:01:24,762 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:01:24,788 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second
2016-01-14 17:01:24,789 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third
2016-01-14 17:01:24,838 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:01:24,838 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 17:01:24,894 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.015
2016-01-14 17:01:24,904 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.027
2016-01-14 17:01:24,906 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:01:24,906 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:01:24,907 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:01:24,936 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third
2016-01-14 17:01:24,937 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/fourth
2016-01-14 17:01:24,969 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third] starting
2016-01-14 17:01:24,972 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third]  parallel execution of flows is enabled: false
2016-01-14 17:01:24,972 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third]  executing total flows: 4
2016-01-14 17:01:24,972 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third]  allocating management threads: 1
2016-01-14 17:01:24,973 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third] starting flow: first
2016-01-14 17:01:24,973 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] at least one sink is marked for delete
2016-01-14 17:01:24,977 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 17:01:24,980 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-14 17:01:24,981 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/ips.20.txt"]
2016-01-14 17:01:24,981 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  sink: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first"]
2016-01-14 17:01:24,981 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  parallel execution of steps is enabled: false
2016-01-14 17:01:24,981 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  executing total steps: 1
2016-01-14 17:01:24,982 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  allocating management threads: 1
2016-01-14 17:01:24,982 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) ...de/perpetualcascade/first
2016-01-14 17:01:24,982 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [first] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 17:01:25,003 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tez session mode enabled: true
2016-01-14 17:01:25,008 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:01:25,009 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 17:01:25,009 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 17:01:25,019 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/584D869171B54A148FD3400993B97ACB/D168A692DD6243D493D84E4A85F3B7D5/.tez/application_1452790885009_0001 doesn't exist and is created
2016-01-14 17:01:25,038 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 17:01:25,038 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:01:25,039 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/584D869171B54A148FD3400993B97ACB/D168A692DD6243D493D84E4A85F3B7D5/.tez/application_1452790885009_0001
2016-01-14 17:01:25,043 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452790885009_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:01:25,060 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 17:01:25,061 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 17:01:25,063 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 17:01:25,064 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 17:01:25,065 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/584D869171B54A148FD3400993B97ACB/D168A692DD6243D493D84E4A85F3B7D5/.tez/application_1452790885009_0001/localmode-log-dir
2016-01-14 17:01:25,065 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/584D869171B54A148FD3400993B97ACB/D168A692DD6243D493D84E4A85F3B7D5/.tez/application_1452790885009_0001/localmode-log-dir/history.txt.appattempt_1452790885009_0001_000000, maxErrors=10
2016-01-14 17:01:25,065 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 17:01:25,066 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452790885009_0001_000000, appSubmitTime=1452790885043, launchTime=1452790885043
2016-01-14 17:01:25,071 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 17:01:25,072 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 17:01:25,074 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 17:01:25,074 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 17:01:25,075 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:56828
2016-01-14 17:01:25,080 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 17:01:25,082 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452790885009_0001_000000, startTime=1452790885082
2016-01-14 17:01:25,082 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 17:01:25,083 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 17:01:25,139 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 17:01:25,139 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 17:01:25,139 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...de/perpetualcascade/first, applicationId=application_1452790885009_0001, dagName=[584D869171B54A148FD3400993B97ACB/D168A692DD6243D493D84E4A85F3B7D5] first/(1/1) ...de/perpetualcascade/first
2016-01-14 17:01:25,163 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [584D869171B54A148FD3400993B97ACB/D168A692DD6243D493D84E4A85F3B7D5] first/(1/1) ...de/perpetualcascade/first
2016-01-14 17:01:25,166 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452790885009_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/584D869171B54A148FD3400993B97ACB/D168A692DD6243D493D84E4A85F3B7D5/.tez/application_1452790885009_0001/localmode-log-dir/dag_1452790885009_0001_1.dot
2016-01-14 17:01:25,167 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/584D869171B54A148FD3400993B97ACB/D168A692DD6243D493D84E4A85F3B7D5/.tez/application_1452790885009_0001/localmode-log-dir/dag_1452790885009_0001_1-tez-dag.pb.txt
2016-01-14 17:01:25,188 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452790885009_0001_1
2016-01-14 17:01:25,188 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:25,188 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [584D869171B54A148FD3400993B97ACB/D168A692DD6243D493D84E4A85F3B7D5] first/(1/1) ...de/perpetualcascade/first
2016-01-14 17:01:25 Running Dag: dag_1452790885009_0001_1
2016-01-14 17:01:25,203 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885009_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452790885009_0001_1, submitTime=1452790885163
2016-01-14 17:01:25,203 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 17:01:25,203 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E0CBA6117DBD4FD48A2E7FF5627C755E
2016-01-14 17:01:25,204 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 17:01:25,204 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885009_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452790885009_0001_1, initTime=1452790885203
2016-01-14 17:01:25,204 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 17:01:25,205 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790885009_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 17:01:25,206 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885009_0001_1][Event:DAG_STARTED]: dagID=dag_1452790885009_0001_1, startTime=1452790885206
2016-01-14 17:01:25,206 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 17:01:25,206 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790885009_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 17:01:25,206 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 17:01:25,206 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E0CBA6117DBD4FD48A2E7FF5627C755E : {CA8C99775FCE484CB88FF3604D1B4945={InputName=CA8C99775FCE484CB88FF3604D1B4945}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 17:01:25,207 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: CA8C99775FCE484CB88FF3604D1B4945, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 17:01:25,207 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E]
2016-01-14 17:01:25,207 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E]
2016-01-14 17:01:25,207 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E]
2016-01-14 17:01:25,207 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E]. Starting root input initializers: 1
2016-01-14 17:01:25,207 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...de/perpetualcascade/first, applicationId=application_1452790885009_0001, dagName=[584D869171B54A148FD3400993B97ACB/D168A692DD6243D493D84E4A85F3B7D5] first/(1/1) ...de/perpetualcascade/first
2016-01-14 17:01:25,208 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 17:01:25,209 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: CA8C99775FCE484CB88FF3604D1B4945 on vertex vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E]
2016-01-14 17:01:25,212 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 17:01:25,212 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input CA8C99775FCE484CB88FF3604D1B4945 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 17:01:25,213 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 17:01:25,213 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 17:01:25,216 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 402
2016-01-14 17:01:25,216 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: CA8C99775FCE484CB88FF3604D1B4945 on vertex vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E]
2016-01-14 17:01:25,216 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:01:25,216 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {CA8C99775FCE484CB88FF3604D1B4945=forAllWorkUnits=true, update=[1]}
2016-01-14 17:01:25,217 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E] parallelism set to 1
2016-01-14 17:01:25,217 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:01:25,217 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885009_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452790885009_0001_1_00, eventCount=1
2016-01-14 17:01:25,217 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E]
2016-01-14 17:01:25,218 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=9BBE0D8D11E6456FAE557880B2EC9020, vertexId=vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 17:01:25,219 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=9BBE0D8D11E6456FAE557880B2EC9020, vertexId=vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E]
2016-01-14 17:01:25,221 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=9BBE0D8D11E6456FAE557880B2EC9020, vertexName=E0CBA6117DBD4FD48A2E7FF5627C755E, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 17:01:25,221 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=9BBE0D8D11E6456FAE557880B2EC9020, vertexId=vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E]
2016-01-14 17:01:25,249 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885009_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E0CBA6117DBD4FD48A2E7FF5627C755E, vertexId=vertex_1452790885009_0001_1_00, initRequestedTime=1452790885206, initedTime=1452790885249, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 17:01:25,249 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E] with distanceFromRoot: 0
2016-01-14 17:01:25,250 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 17:01:25,250 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 17:01:25,250 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E0CBA6117DBD4FD48A2E7FF5627C755E
2016-01-14 17:01:25,250 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E]
2016-01-14 17:01:25,250 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885009_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452790885009_0001_1_00, startRequestedTime=1452790885250, startedTime=1452790885250
2016-01-14 17:01:25,250 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E] transitioned from INITED to RUNNING due to event V_START
2016-01-14 17:01:25,251 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885009_0001_1][Event:TASK_STARTED]: vertexName=E0CBA6117DBD4FD48A2E7FF5627C755E, taskId=task_1452790885009_0001_1_00_000000, scheduledTime=1452790885251, launchTime=1452790885251
2016-01-14 17:01:25,251 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790885009_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 17:01:25,251 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 17:01:25,251 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 17:01:25,251 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E]
2016-01-14 17:01:25,253 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [584D869171B54A148FD3400993B97ACB/D168A692DD6243D493D84E4A85F3B7D5] first/(1/1) ...de/perpetualcascade/first, VertexName: E0CBA6117DBD4FD48A2E7FF5627C755E, VertexParallelism: 1, TaskAttemptID:attempt_1452790885009_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=CA8C99775FCE484CB88FF3604D1B4945, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=9BBE0D8D11E6456FAE557880B2EC9020, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:01:25,254 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790885009_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 17:01:25,254 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 17:01:25,256 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 17:01:25,258 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 17:01:25,258 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 17:01:25,258 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452790885009_0001_00_000001
2016-01-14 17:01:25,258 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790885009_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 17:01:25,260 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452790885009_0001_00_000001
2016-01-14 17:01:25,260 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-01-14 17:01:25,261 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790885009_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 17:01:25,261 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 17:01:25,262 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885009_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452790885009_0001_00_000001, launchTime=1452790885261
2016-01-14 17:01:25,262 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452790885009_0001_00_000001
2016-01-14 17:01:25,264 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452790885009_0001_1_00_000000_0] to container: [container_1452790885009_0001_00_000001]
2016-01-14 17:01:25,264 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted tez dag to app master: application_1452790885009_0001, with dag id: dag_1452790885009_0001_1
2016-01-14 17:01:25,264 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790885009_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 17:01:25,265 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452790885009_0001_00_000001 given task: attempt_1452790885009_0001_1_00_000000_0
2016-01-14 17:01:25,265 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452790885009_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452790885009_0001_1_00_000000_0
2016-01-14 17:01:25,265 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452790885009_0001_1_00_000000_0] started. Is using containerId: [container_1452790885009_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 17:01:25,266 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 17:01:25,266 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885009_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E0CBA6117DBD4FD48A2E7FF5627C755E, taskAttemptId=attempt_1452790885009_0001_1_00_000000_0, startTime=1452790885265, containerId=container_1452790885009_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452790885009_0001_00_000001/teamcity, completedLogs=
2016-01-14 17:01:25,266 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790885009_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 17:01:25,267 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790885009_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 17:01:25 Starting to run new task attempt: attempt_1452790885009_0001_1_00_000000_0
2016-01-14 17:01:25,267 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452790885009_0001_1_00_000000_0
2016-01-14 17:01:25,267 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:25,267 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 17:01:25,268 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 17:01:25,269 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 17:01:25,269 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 17:01:25,270 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 17:01:25,270 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [584D869171B54A148FD3400993B97ACB/D168A692DD6243D493D84E4A85F3B7D5] first/(1/1) ...de/perpetualcascade/first, VertexName: E0CBA6117DBD4FD48A2E7FF5627C755E, VertexParallelism: 1, TaskAttemptID:attempt_1452790885009_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=CA8C99775FCE484CB88FF3604D1B4945, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=9BBE0D8D11E6456FAE557880B2EC9020, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:01:25,271 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 17:01:25,271 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452790885009_0001_1_00_000000_0
2016-01-14 17:01:25,274 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 17:01:25,274 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:25,275 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452790885009_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 17:01:25,275 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=9BBE0D8D11E6456FAE557880B2EC9020, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 17:01:25,275 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:25,276 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 17:01:25,276 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 9BBE0D8D11E6456FAE557880B2EC9020
2016-01-14 17:01:25,276 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 17:01:25,277 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 9BBE0D8D11E6456FAE557880B2EC9020
2016-01-14 17:01:25,277 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=CA8C99775FCE484CB88FF3604D1B4945, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 17:01:25,278 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 17:01:25,278 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: CA8C99775FCE484CB88FF3604D1B4945
2016-01-14 17:01:25,278 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: CA8C99775FCE484CB88FF3604D1B4945
2016-01-14 17:01:25,280 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 17:01:25,282 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 17:01:25,282 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: CA8C99775FCE484CB88FF3604D1B4945
2016-01-14 17:01:25,282 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: CA8C99775FCE484CB88FF3604D1B4945
2016-01-14 17:01:25,291 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E0CBA6117DBD4FD48A2E7FF5627C755E, ordinal: 0
2016-01-14 17:01:25,291 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E0CBA6117DBD4FD48A2E7FF5627C755E, mem on start (mb), free: 359, total: 397, max: 672
2016-01-14 17:01:25,291 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 17:01:25,292 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 9BBE0D8D11E6456FAE557880B2EC9020
2016-01-14 17:01:25,292 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:25,292 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 17:01:25,292 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 17:01:25,293 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 17:01:25,293 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 17:01:25,293 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 17:01:25,293 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:01:25,293 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 17:01:25,294 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:01:25,294 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 17:01:25,294 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 17:01:25,294 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 9BBE0D8D11E6456FAE557880B2EC9020, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 17:01:25,295 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, CA8C99775FCE484CB88FF3604D1B4945, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 17:01:25,295 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 17:01:25,295 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: CA8C99775FCE484CB88FF3604D1B4945 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 17:01:25,295 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: CA8C99775FCE484CB88FF3604D1B4945
2016-01-14 17:01:25,296 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:01:25,296 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: CA8C99775FCE484CB88FF3604D1B4945
2016-01-14 17:01:25,296 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 17:01:25,297 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 17:01:25,297 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 17:01:25,297 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452790885009_0001_1_00_000000_0
2016-01-14 17:01:25,297 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 17:01:25,298 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@36ff26bd
2016-01-14 17:01:25,301 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/ips.20.txt"]
2016-01-14 17:01:25,302 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@36ff26bd
2016-01-14 17:01:25,302 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 17:01:25,302 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/ips.20.txt"] streamed: true, id: CA8C99775FCE484CB88FF3604D1B4945
2016-01-14 17:01:25,302 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first"], id: 9BBE0D8D11E6456FAE557880B2EC9020
2016-01-14 17:01:25,302 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 17:01:25,303 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first"]
2016-01-14 17:01:25,305 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/ips.20.txt"]
2016-01-14 17:01:25,305 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:01:25,305 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E0CBA6117DBD4FD48A2E7FF5627C755E, all 1 inputs ready in: 00:00:00.000
2016-01-14 17:01:25,308 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 17:01:25,308 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 17:01:25,309 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452790885009_0001_1_00_000000_0
2016-01-14 17:01:25,309 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452790885009_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 17:01:25,310 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452790885009_0001_1_00_000000_0
2016-01-14 17:01:25,310 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E0CBA6117DBD4FD48A2E7FF5627C755E, mem on close (mb), free: 357, total: 397, max: 672
2016-01-14 17:01:25 Completed running task attempt: attempt_1452790885009_0001_1_00_000000_0
2016-01-14 17:01:25,310 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452790885009_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 17:01:25,312 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=413, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452790885306, Process_Duration=4, Process_End_Time=1452790885310, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 17:01:25,312 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885009_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E0CBA6117DBD4FD48A2E7FF5627C755E, taskAttemptId=attempt_1452790885009_0001_1_00_000000_0, startTime=1452790885265, finishTime=1452790885311, timeTaken=46, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=413, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790885306, Process_Duration=4, Process_End_Time=1452790885310, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:25,312 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790885009_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 17:01:25,313 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 17:01:25,312 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 17:01:25,313 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 17:01:25,314 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:25,313 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452790885009_0001_1_00_000000_0
2016-01-14 17:01:25,314 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452790885009_0001_00_000001
2016-01-14 17:01:25,315 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 17:01:25,315 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885009_0001_1][Event:TASK_FINISHED]: vertexName=E0CBA6117DBD4FD48A2E7FF5627C755E, taskId=task_1452790885009_0001_1_00_000000, startTime=1452790885265, finishTime=1452790885314, timeTaken=49, status=SUCCEEDED, successfulAttemptID=attempt_1452790885009_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=413, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790885306, Process_Duration=4, Process_End_Time=1452790885310, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:25,315 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790885009_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 17:01:25,316 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E] : 1
2016-01-14 17:01:25,316 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E]
2016-01-14 17:01:25,317 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 17:01:25,318 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885009_0001_1][Event:VERTEX_FINISHED]: vertexName=E0CBA6117DBD4FD48A2E7FF5627C755E, vertexId=vertex_1452790885009_0001_1_00, initRequestedTime=1452790885206, initedTime=1452790885249, startRequestedTime=1452790885250, startedTime=1452790885250, finishTime=1452790885316, timeTaken=66, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=413, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790885306, Process_Duration=4, Process_End_Time=1452790885310, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452790885265, firstTasksToStart=[ task_1452790885009_0001_1_00_000000 ], lastTaskFinishTime=1452790885311, lastTasksToFinish=[ task_1452790885009_0001_1_00_000000 ], minTaskDuration=46, maxTaskDuration=46, avgTaskDuration=46.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452790885009_0001_1_00_000000 ], longestDurationTasks=[ task_1452790885009_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 17:01:25,318 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 17:01:25,318 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790885009_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 17:01:25,318 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 17:01:25,318 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885009_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452790885009_0001_00_000001, stoppedTime=1452790885318, exitStatus=0
2016-01-14 17:01:25,319 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790885009_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 17:01:25,319 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 17:01:25,319 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452790885009_0001_1
2016-01-14 17:01:25,319 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885009_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452790885009_0001_1
2016-01-14 17:01:25,320 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 9BBE0D8D11E6456FAE557880B2EC9020 for vertex: vertex_1452790885009_0001_1_00 [E0CBA6117DBD4FD48A2E7FF5627C755E]
2016-01-14 17:01:25,325 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452790885009_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 17:01:25,325 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452790885009_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 17:01:25,325 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452790885009_0001_00_000001, Exiting
2016-01-14 17:01:25,325 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452790885009_0001_00_000001
2016-01-14 17:01:25,325 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452790885009_0001_00_000001
2016-01-14 17:01:25,328 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452790885009_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 17:01:25,328 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452790885009_0001_00_000001 completed successfully
2016-01-14 17:01:25,331 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452790885009_0001_1, queueSize=0
2016-01-14 17:01:25,331 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 17:01:25,332 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885009_0001_1][Event:DAG_FINISHED]: dagId=dag_1452790885009_0001_1, startTime=1452790885206, finishTime=1452790885330, timeTaken=124, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=413, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790885306, Process_Duration=4, Process_End_Time=1452790885310, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:25,332 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452790885009_0001_1 finished with state: SUCCEEDED
2016-01-14 17:01:25,332 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790885009_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 17:01:25,332 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790885009_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 17:01:25,332 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452790885009_0001_00_000001
2016-01-14 17:01:25 Completed Dag: dag_1452790885009_0001_1
2016-01-14 17:01:25,333 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452790885009_0001_1, dagState=SUCCEEDED
2016-01-14 17:01:25,333 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452790885009_0001_1_post
2016-01-14 17:01:25,333 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:25,333 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 17:01:25,339 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...de/perpetualcascade/first, applicationId=application_1452790885009_0001
2016-01-14 17:01:25,341 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 17:01:25,341 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 17:01:25,341 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 17:01:25,341 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 17:01:25,342 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 17:01:25,342 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 17:01:25,342 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 17:01:25,344 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 17:01:25,344 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 17:01:25,344 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 17:01:25,344 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 17:01:25,346 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 17:01:25,346 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 17:01:25,351 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/584D869171B54A148FD3400993B97ACB/D168A692DD6243D493D84E4A85F3B7D5/.tez/application_1452790885009_0001
2016-01-14 17:01:25,352 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  completed in: 00:00.371
2016-01-14 17:01:25,352 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third] completed flow: first
2016-01-14 17:01:25,353 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third] starting flow: second
2016-01-14 17:01:25,353 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] at least one sink is marked for delete
2016-01-14 17:01:25,353 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 17:01:25,357 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting
2016-01-14 17:01:25,357 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second]  source: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first"]
2016-01-14 17:01:25,357 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second"]
2016-01-14 17:01:25,357 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second]  parallel execution of steps is enabled: false
2016-01-14 17:01:25,358 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second]  executing total steps: 1
2016-01-14 17:01:25,358 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second]  allocating management threads: 1
2016-01-14 17:01:25,358 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting step: (1/1) ...e/perpetualcascade/second
2016-01-14 17:01:25,359 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [second] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 17:01:25,373 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tez session mode enabled: true
2016-01-14 17:01:25,377 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:01:25,378 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 17:01:25,378 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 17:01:25,387 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4333AE0B1C2249C6879D6B694C1F7E06/B900D809D8734415A3384176BCE811E7/.tez/application_1452790885378_0001 doesn't exist and is created
2016-01-14 17:01:25,406 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 17:01:25,407 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:01:25,407 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4333AE0B1C2249C6879D6B694C1F7E06/B900D809D8734415A3384176BCE811E7/.tez/application_1452790885378_0001
2016-01-14 17:01:25,411 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452790885378_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:01:25,423 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 17:01:25,424 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 17:01:25,425 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 17:01:25,426 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 17:01:25,426 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4333AE0B1C2249C6879D6B694C1F7E06/B900D809D8734415A3384176BCE811E7/.tez/application_1452790885378_0001/localmode-log-dir
2016-01-14 17:01:25,426 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4333AE0B1C2249C6879D6B694C1F7E06/B900D809D8734415A3384176BCE811E7/.tez/application_1452790885378_0001/localmode-log-dir/history.txt.appattempt_1452790885378_0001_000000, maxErrors=10
2016-01-14 17:01:25,426 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 17:01:25,426 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452790885378_0001_000000, appSubmitTime=1452790885410, launchTime=1452790885410
2016-01-14 17:01:25,430 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 17:01:25,435 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 17:01:25,436 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 17:01:25,436 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 17:01:25,437 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:48403
2016-01-14 17:01:25,439 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 17:01:25,441 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452790885378_0001_000000, startTime=1452790885441
2016-01-14 17:01:25,441 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 17:01:25,441 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 17:01:25,507 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 17:01:25,507 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 17:01:25,508 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...e/perpetualcascade/second, applicationId=application_1452790885378_0001, dagName=[4333AE0B1C2249C6879D6B694C1F7E06/B900D809D8734415A3384176BCE811E7] second/(1/1) ...e/perpetualcascade/second
2016-01-14 17:01:25,527 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [4333AE0B1C2249C6879D6B694C1F7E06/B900D809D8734415A3384176BCE811E7] second/(1/1) ...e/perpetualcascade/second
2016-01-14 17:01:25,528 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452790885378_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4333AE0B1C2249C6879D6B694C1F7E06/B900D809D8734415A3384176BCE811E7/.tez/application_1452790885378_0001/localmode-log-dir/dag_1452790885378_0001_1.dot
2016-01-14 17:01:25,529 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4333AE0B1C2249C6879D6B694C1F7E06/B900D809D8734415A3384176BCE811E7/.tez/application_1452790885378_0001/localmode-log-dir/dag_1452790885378_0001_1-tez-dag.pb.txt
2016-01-14 17:01:25,555 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452790885378_0001_1
2016-01-14 17:01:25,555 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:25,555 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [4333AE0B1C2249C6879D6B694C1F7E06/B900D809D8734415A3384176BCE811E7] second/(1/1) ...e/perpetualcascade/second
2016-01-14 17:01:25 Running Dag: dag_1452790885378_0001_1
2016-01-14 17:01:25,575 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885378_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452790885378_0001_1, submitTime=1452790885527
2016-01-14 17:01:25,575 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 17:01:25,576 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex BDCD94B3F4A84E8DA2FDCECF20C99FE1
2016-01-14 17:01:25,576 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 17:01:25,577 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 17:01:25,578 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885378_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452790885378_0001_1, initTime=1452790885575
2016-01-14 17:01:25,578 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790885378_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 17:01:25,579 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885378_0001_1][Event:DAG_STARTED]: dagID=dag_1452790885378_0001_1, startTime=1452790885579
2016-01-14 17:01:25,579 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 17:01:25,579 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 17:01:25,579 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790885378_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 17:01:25,580 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: BDCD94B3F4A84E8DA2FDCECF20C99FE1 : {9BBE0D8D11E6456FAE557880B2EC9020={InputName=9BBE0D8D11E6456FAE557880B2EC9020}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 17:01:25,580 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 9BBE0D8D11E6456FAE557880B2EC9020, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 17:01:25,580 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1]
2016-01-14 17:01:25,580 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1]
2016-01-14 17:01:25,581 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1]
2016-01-14 17:01:25,581 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...e/perpetualcascade/second, applicationId=application_1452790885378_0001, dagName=[4333AE0B1C2249C6879D6B694C1F7E06/B900D809D8734415A3384176BCE811E7] second/(1/1) ...e/perpetualcascade/second
2016-01-14 17:01:25,581 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1]. Starting root input initializers: 1
2016-01-14 17:01:25,584 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 17:01:25,586 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 9BBE0D8D11E6456FAE557880B2EC9020 on vertex vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1]
2016-01-14 17:01:25,589 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 17:01:25,589 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 9BBE0D8D11E6456FAE557880B2EC9020 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 17:01:25,591 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 17:01:25,592 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 17:01:25,602 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] submitted tez dag to app master: application_1452790885378_0001, with dag id: dag_1452790885378_0001_1
2016-01-14 17:01:25,612 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 574
2016-01-14 17:01:25,613 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 9BBE0D8D11E6456FAE557880B2EC9020 on vertex vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1]
2016-01-14 17:01:25,613 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:01:25,613 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {9BBE0D8D11E6456FAE557880B2EC9020=forAllWorkUnits=true, update=[1]}
2016-01-14 17:01:25,613 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1] parallelism set to 1
2016-01-14 17:01:25,614 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:01:25,614 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885378_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452790885378_0001_1_00, eventCount=1
2016-01-14 17:01:25,614 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1]
2016-01-14 17:01:25,615 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=0264131D7DB64B5DAACEB3B148A74BBB, vertexId=vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 17:01:25,615 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=0264131D7DB64B5DAACEB3B148A74BBB, vertexId=vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1]
2016-01-14 17:01:25,618 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=0264131D7DB64B5DAACEB3B148A74BBB, vertexName=BDCD94B3F4A84E8DA2FDCECF20C99FE1, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 17:01:25,618 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=0264131D7DB64B5DAACEB3B148A74BBB, vertexId=vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1]
2016-01-14 17:01:25,620 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 17:01:25,621 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885378_0001_1][Event:VERTEX_INITIALIZED]: vertexName=BDCD94B3F4A84E8DA2FDCECF20C99FE1, vertexId=vertex_1452790885378_0001_1_00, initRequestedTime=1452790885580, initedTime=1452790885620, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 17:01:25,621 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1] with distanceFromRoot: 0
2016-01-14 17:01:25,621 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 17:01:25,621 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in BDCD94B3F4A84E8DA2FDCECF20C99FE1
2016-01-14 17:01:25,622 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1]
2016-01-14 17:01:25,622 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 17:01:25,622 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885378_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452790885378_0001_1_00, startRequestedTime=1452790885621, startedTime=1452790885621
2016-01-14 17:01:25,622 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1] transitioned from INITED to RUNNING due to event V_START
2016-01-14 17:01:25,623 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 17:01:25,624 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885378_0001_1][Event:TASK_STARTED]: vertexName=BDCD94B3F4A84E8DA2FDCECF20C99FE1, taskId=task_1452790885378_0001_1_00_000000, scheduledTime=1452790885623, launchTime=1452790885623
2016-01-14 17:01:25,624 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790885378_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 17:01:25,624 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1]
2016-01-14 17:01:25,624 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [4333AE0B1C2249C6879D6B694C1F7E06/B900D809D8734415A3384176BCE811E7] second/(1/1) ...e/perpetualcascade/second, VertexName: BDCD94B3F4A84E8DA2FDCECF20C99FE1, VertexParallelism: 1, TaskAttemptID:attempt_1452790885378_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=9BBE0D8D11E6456FAE557880B2EC9020, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=0264131D7DB64B5DAACEB3B148A74BBB, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:01:25,625 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790885378_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 17:01:25,625 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 17:01:25,626 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 17:01:25,628 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 17:01:25,628 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 17:01:25,629 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452790885378_0001_00_000001
2016-01-14 17:01:25,629 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790885378_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 17:01:25,631 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452790885378_0001_00_000001
2016-01-14 17:01:25,631 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-01-14 17:01:25,632 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790885378_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 17:01:25,632 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 17:01:25,636 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885378_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452790885378_0001_00_000001, launchTime=1452790885632
2016-01-14 17:01:25,637 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452790885378_0001_00_000001
2016-01-14 17:01:25,638 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452790885378_0001_1_00_000000_0] to container: [container_1452790885378_0001_00_000001]
2016-01-14 17:01:25,638 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790885378_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 17:01:25,639 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452790885378_0001_00_000001 given task: attempt_1452790885378_0001_1_00_000000_0
2016-01-14 17:01:25,640 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452790885378_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452790885378_0001_1_00_000000_0
2016-01-14 17:01:25,640 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452790885378_0001_1_00_000000_0] started. Is using containerId: [container_1452790885378_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 17:01:25,640 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 17:01:25,640 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885378_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=BDCD94B3F4A84E8DA2FDCECF20C99FE1, taskAttemptId=attempt_1452790885378_0001_1_00_000000_0, startTime=1452790885639, containerId=container_1452790885378_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452790885378_0001_00_000001/teamcity, completedLogs=
2016-01-14 17:01:25,641 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790885378_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 17:01:25,641 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790885378_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 17:01:25 Starting to run new task attempt: attempt_1452790885378_0001_1_00_000000_0
2016-01-14 17:01:25,642 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452790885378_0001_1_00_000000_0
2016-01-14 17:01:25,643 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:25,643 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 17:01:25,643 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 17:01:25,643 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 17:01:25,643 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 17:01:25,643 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 17:01:25,643 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [4333AE0B1C2249C6879D6B694C1F7E06/B900D809D8734415A3384176BCE811E7] second/(1/1) ...e/perpetualcascade/second, VertexName: BDCD94B3F4A84E8DA2FDCECF20C99FE1, VertexParallelism: 1, TaskAttemptID:attempt_1452790885378_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=9BBE0D8D11E6456FAE557880B2EC9020, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=0264131D7DB64B5DAACEB3B148A74BBB, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:01:25,644 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 17:01:25,644 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452790885378_0001_1_00_000000_0
2016-01-14 17:01:25,649 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 17:01:25,649 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:25,653 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:25,654 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=9BBE0D8D11E6456FAE557880B2EC9020, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 17:01:25,655 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 17:01:25,655 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452790885378_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 17:01:25,656 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=0264131D7DB64B5DAACEB3B148A74BBB, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 17:01:25,658 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 17:01:25,658 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 17:01:25,660 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 0264131D7DB64B5DAACEB3B148A74BBB
2016-01-14 17:01:25,660 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 17:01:25,661 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 0264131D7DB64B5DAACEB3B148A74BBB
2016-01-14 17:01:25,658 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 9BBE0D8D11E6456FAE557880B2EC9020
2016-01-14 17:01:25,664 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 9BBE0D8D11E6456FAE557880B2EC9020
2016-01-14 17:01:25,668 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 17:01:25,668 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 9BBE0D8D11E6456FAE557880B2EC9020
2016-01-14 17:01:25,668 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 9BBE0D8D11E6456FAE557880B2EC9020
2016-01-14 17:01:25,679 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: BDCD94B3F4A84E8DA2FDCECF20C99FE1, ordinal: 0
2016-01-14 17:01:25,680 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BDCD94B3F4A84E8DA2FDCECF20C99FE1, mem on start (mb), free: 316, total: 397, max: 672
2016-01-14 17:01:25,680 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:25,680 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 17:01:25,680 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 17:01:25,687 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 17:01:25,688 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 0264131D7DB64B5DAACEB3B148A74BBB
2016-01-14 17:01:25,688 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 17:01:25,688 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 17:01:25,688 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 17:01:25,688 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:01:25,689 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 17:01:25,689 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:01:25,689 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 17:01:25,689 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 17:01:25,689 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 0264131D7DB64B5DAACEB3B148A74BBB, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 17:01:25,689 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 9BBE0D8D11E6456FAE557880B2EC9020, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 17:01:25,689 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 17:01:25,690 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 9BBE0D8D11E6456FAE557880B2EC9020 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 17:01:25,690 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 17:01:25,690 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 17:01:25,690 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 9BBE0D8D11E6456FAE557880B2EC9020
2016-01-14 17:01:25,690 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:01:25,690 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 9BBE0D8D11E6456FAE557880B2EC9020
2016-01-14 17:01:25,693 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 17:01:25,693 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452790885378_0001_1_00_000000_0
2016-01-14 17:01:25,697 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 17:01:25,697 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first"]
2016-01-14 17:01:25,698 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first"] streamed: true, id: 9BBE0D8D11E6456FAE557880B2EC9020
2016-01-14 17:01:25,698 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second"], id: 0264131D7DB64B5DAACEB3B148A74BBB
2016-01-14 17:01:25,699 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second"]
2016-01-14 17:01:25,699 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@c10dc6c
2016-01-14 17:01:25,699 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first"]
2016-01-14 17:01:25,699 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:01:25,702 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@c10dc6c
2016-01-14 17:01:25,702 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 17:01:25,703 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 17:01:25,703 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: BDCD94B3F4A84E8DA2FDCECF20C99FE1, all 1 inputs ready in: 00:00:00.000
2016-01-14 17:01:25,709 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 17:01:25,709 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 17:01:25,710 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452790885378_0001_1_00_000000_0
2016-01-14 17:01:25,711 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452790885378_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 17:01:25,713 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452790885378_0001_1_00_000000_0
2016-01-14 17:01:25,713 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BDCD94B3F4A84E8DA2FDCECF20C99FE1, mem on close (mb), free: 314, total: 397, max: 672
2016-01-14 17:01:25 Completed running task attempt: attempt_1452790885378_0001_1_00_000000_0
2016-01-14 17:01:25,715 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452790885378_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 17:01:25,717 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 17:01:25,717 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885378_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=BDCD94B3F4A84E8DA2FDCECF20C99FE1, taskAttemptId=attempt_1452790885378_0001_1_00_000000_0, startTime=1452790885639, finishTime=1452790885717, timeTaken=78, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790885704, Process_Duration=9, Process_End_Time=1452790885713, Read_Duration=3, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:25,717 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790885378_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 17:01:25,718 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 17:01:25,718 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452790885378_0001_1_00_000000_0
2016-01-14 17:01:25,719 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 17:01:25,719 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885378_0001_1][Event:TASK_FINISHED]: vertexName=BDCD94B3F4A84E8DA2FDCECF20C99FE1, taskId=task_1452790885378_0001_1_00_000000, startTime=1452790885639, finishTime=1452790885718, timeTaken=79, status=SUCCEEDED, successfulAttemptID=attempt_1452790885378_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790885704, Process_Duration=9, Process_End_Time=1452790885713, Read_Duration=3, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:25,720 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790885378_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 17:01:25,720 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1] : 1
2016-01-14 17:01:25,720 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1]
2016-01-14 17:01:25,721 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 17:01:25,722 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885378_0001_1][Event:VERTEX_FINISHED]: vertexName=BDCD94B3F4A84E8DA2FDCECF20C99FE1, vertexId=vertex_1452790885378_0001_1_00, initRequestedTime=1452790885580, initedTime=1452790885620, startRequestedTime=1452790885621, startedTime=1452790885621, finishTime=1452790885720, timeTaken=99, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790885704, Process_Duration=9, Process_End_Time=1452790885713, Read_Duration=3, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452790885639, firstTasksToStart=[ task_1452790885378_0001_1_00_000000 ], lastTaskFinishTime=1452790885717, lastTasksToFinish=[ task_1452790885378_0001_1_00_000000 ], minTaskDuration=78, maxTaskDuration=78, avgTaskDuration=78.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452790885378_0001_1_00_000000 ], longestDurationTasks=[ task_1452790885378_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 17:01:25,722 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 17:01:25,722 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790885378_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 17:01:25,722 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885378_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452790885378_0001_00_000001, stoppedTime=1452790885722, exitStatus=0
2016-01-14 17:01:25,722 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 17:01:25,723 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790885378_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 17:01:25,724 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 17:01:25,724 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452790885378_0001_1
2016-01-14 17:01:25,725 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885378_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452790885378_0001_1
2016-01-14 17:01:25,726 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 0264131D7DB64B5DAACEB3B148A74BBB for vertex: vertex_1452790885378_0001_1_00 [BDCD94B3F4A84E8DA2FDCECF20C99FE1]
2016-01-14 17:01:25,723 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452790885704, Process_Duration=9, Process_End_Time=1452790885713, Read_Duration=3, Tuples_Read=20, Tuples_Written=20, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 17:01:25,729 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 17:01:25,730 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:25,730 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452790885378_0001_00_000001
2016-01-14 17:01:25,732 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452790885378_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 17:01:25,732 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452790885378_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 17:01:25,732 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452790885378_0001_00_000001, Exiting
2016-01-14 17:01:25,732 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452790885378_0001_00_000001
2016-01-14 17:01:25,732 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452790885378_0001_00_000001
2016-01-14 17:01:25,737 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452790885378_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 17:01:25,738 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452790885378_0001_00_000001 completed successfully
2016-01-14 17:01:25,745 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452790885378_0001_1, queueSize=0
2016-01-14 17:01:25,745 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885378_0001_1][Event:DAG_FINISHED]: dagId=dag_1452790885378_0001_1, startTime=1452790885579, finishTime=1452790885743, timeTaken=164, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790885704, Process_Duration=9, Process_End_Time=1452790885713, Read_Duration=3, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:25,746 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452790885378_0001_1 finished with state: SUCCEEDED
2016-01-14 17:01:25,746 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790885378_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 17:01:25,746 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790885378_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 17:01:25,746 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452790885378_0001_00_000001
2016-01-14 17:01:25 Completed Dag: dag_1452790885378_0001_1
2016-01-14 17:01:25,746 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452790885378_0001_1, dagState=SUCCEEDED
2016-01-14 17:01:25,747 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452790885378_0001_1_post
2016-01-14 17:01:25,747 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:25,747 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 17:01:25,747 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 17:01:25,755 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...e/perpetualcascade/second, applicationId=application_1452790885378_0001
2016-01-14 17:01:25,759 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 17:01:25,759 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 17:01:25,759 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 17:01:25,759 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 17:01:25,759 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 17:01:25,760 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 17:01:25,762 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 17:01:25,762 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 17:01:25,762 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 17:01:25,762 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 17:01:25,763 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 17:01:25,765 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 17:01:25,765 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 17:01:25,771 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4333AE0B1C2249C6879D6B694C1F7E06/B900D809D8734415A3384176BCE811E7/.tez/application_1452790885378_0001
2016-01-14 17:01:25,773 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second]  completed in: 00:00.415
2016-01-14 17:01:25,773 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third] completed flow: second
2016-01-14 17:01:25,774 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third] starting flow: third
2016-01-14 17:01:25,774 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] at least one sink is marked for delete
2016-01-14 17:01:25,774 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 17:01:25,778 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] starting
2016-01-14 17:01:25,778 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second"]
2016-01-14 17:01:25,778 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third]  sink: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third"]
2016-01-14 17:01:25,778 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third]  parallel execution of steps is enabled: false
2016-01-14 17:01:25,778 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third]  executing total steps: 1
2016-01-14 17:01:25,778 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third]  allocating management threads: 1
2016-01-14 17:01:25,779 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] starting step: (1/1) ...de/perpetualcascade/third
2016-01-14 17:01:25,779 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [third] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 17:01:25,793 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] tez session mode enabled: true
2016-01-14 17:01:25,798 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:01:25,799 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 17:01:25,799 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 17:01:25,809 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/5E752A4350F14C0ABE5B54B3A71E2AF3/C7BC8EA43F33438DBB723D095D3D0437/.tez/application_1452790885798_0001 doesn't exist and is created
2016-01-14 17:01:25,827 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 17:01:25,827 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:01:25,828 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/5E752A4350F14C0ABE5B54B3A71E2AF3/C7BC8EA43F33438DBB723D095D3D0437/.tez/application_1452790885798_0001
2016-01-14 17:01:25,832 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452790885798_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:01:25,844 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 17:01:25,846 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 17:01:25,848 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 17:01:25,848 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 17:01:25,848 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/5E752A4350F14C0ABE5B54B3A71E2AF3/C7BC8EA43F33438DBB723D095D3D0437/.tez/application_1452790885798_0001/localmode-log-dir
2016-01-14 17:01:25,849 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/5E752A4350F14C0ABE5B54B3A71E2AF3/C7BC8EA43F33438DBB723D095D3D0437/.tez/application_1452790885798_0001/localmode-log-dir/history.txt.appattempt_1452790885798_0001_000000, maxErrors=10
2016-01-14 17:01:25,849 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 17:01:25,849 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452790885798_0001_000000, appSubmitTime=1452790885832, launchTime=1452790885832
2016-01-14 17:01:25,855 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 17:01:25,858 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 17:01:25,859 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:36726
2016-01-14 17:01:25,863 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 17:01:25,863 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 17:01:25,864 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 17:01:25,866 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452790885798_0001_000000, startTime=1452790885866
2016-01-14 17:01:25,867 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 17:01:25,866 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 17:01:25,928 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 17:01:25,928 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 17:01:25,928 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...de/perpetualcascade/third, applicationId=application_1452790885798_0001, dagName=[5E752A4350F14C0ABE5B54B3A71E2AF3/C7BC8EA43F33438DBB723D095D3D0437] third/(1/1) ...de/perpetualcascade/third
2016-01-14 17:01:25,948 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [5E752A4350F14C0ABE5B54B3A71E2AF3/C7BC8EA43F33438DBB723D095D3D0437] third/(1/1) ...de/perpetualcascade/third
2016-01-14 17:01:25,950 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452790885798_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/5E752A4350F14C0ABE5B54B3A71E2AF3/C7BC8EA43F33438DBB723D095D3D0437/.tez/application_1452790885798_0001/localmode-log-dir/dag_1452790885798_0001_1.dot
2016-01-14 17:01:25,952 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/5E752A4350F14C0ABE5B54B3A71E2AF3/C7BC8EA43F33438DBB723D095D3D0437/.tez/application_1452790885798_0001/localmode-log-dir/dag_1452790885798_0001_1-tez-dag.pb.txt
2016-01-14 17:01:25,970 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452790885798_0001_1
2016-01-14 17:01:25,970 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:25,971 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [5E752A4350F14C0ABE5B54B3A71E2AF3/C7BC8EA43F33438DBB723D095D3D0437] third/(1/1) ...de/perpetualcascade/third
2016-01-14 17:01:25 Running Dag: dag_1452790885798_0001_1
2016-01-14 17:01:25,985 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 17:01:25,986 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885798_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452790885798_0001_1, submitTime=1452790885948
2016-01-14 17:01:25,987 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex F2A1E86FBB0B421BB8B28E24FE83056F
2016-01-14 17:01:25,987 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 17:01:25,988 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 17:01:25,989 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885798_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452790885798_0001_1, initTime=1452790885986
2016-01-14 17:01:25,989 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790885798_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 17:01:25,990 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885798_0001_1][Event:DAG_STARTED]: dagID=dag_1452790885798_0001_1, startTime=1452790885990
2016-01-14 17:01:25,990 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 17:01:25,990 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790885798_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 17:01:25,990 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: F2A1E86FBB0B421BB8B28E24FE83056F : {0264131D7DB64B5DAACEB3B148A74BBB={InputName=0264131D7DB64B5DAACEB3B148A74BBB}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 17:01:25,990 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 0264131D7DB64B5DAACEB3B148A74BBB, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 17:01:25,990 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F]
2016-01-14 17:01:25,991 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F]
2016-01-14 17:01:25,991 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F]
2016-01-14 17:01:25,991 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F]. Starting root input initializers: 1
2016-01-14 17:01:25,991 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 17:01:25,995 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 17:01:25,995 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 0264131D7DB64B5DAACEB3B148A74BBB on vertex vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F]
2016-01-14 17:01:25,996 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...de/perpetualcascade/third, applicationId=application_1452790885798_0001, dagName=[5E752A4350F14C0ABE5B54B3A71E2AF3/C7BC8EA43F33438DBB723D095D3D0437] third/(1/1) ...de/perpetualcascade/third
2016-01-14 17:01:25,998 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 17:01:25,998 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 0264131D7DB64B5DAACEB3B148A74BBB asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 17:01:25,999 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 17:01:26,000 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 17:01:26,018 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third] submitted tez dag to app master: application_1452790885798_0001, with dag id: dag_1452790885798_0001_1
2016-01-14 17:01:26,022 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 576
2016-01-14 17:01:26,023 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 0264131D7DB64B5DAACEB3B148A74BBB on vertex vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F]
2016-01-14 17:01:26,024 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:01:26,024 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {0264131D7DB64B5DAACEB3B148A74BBB=forAllWorkUnits=true, update=[1]}
2016-01-14 17:01:26,024 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F] parallelism set to 1
2016-01-14 17:01:26,024 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:01:26,025 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885798_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452790885798_0001_1_00, eventCount=1
2016-01-14 17:01:26,027 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F]
2016-01-14 17:01:26,028 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=6203DF62DFF5425F91A0EA85C6B31307, vertexId=vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 17:01:26,029 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=6203DF62DFF5425F91A0EA85C6B31307, vertexId=vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F]
2016-01-14 17:01:26,031 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=6203DF62DFF5425F91A0EA85C6B31307, vertexName=F2A1E86FBB0B421BB8B28E24FE83056F, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 17:01:26,031 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=6203DF62DFF5425F91A0EA85C6B31307, vertexId=vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F]
2016-01-14 17:01:26,033 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885798_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F2A1E86FBB0B421BB8B28E24FE83056F, vertexId=vertex_1452790885798_0001_1_00, initRequestedTime=1452790885990, initedTime=1452790886033, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 17:01:26,033 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F] with distanceFromRoot: 0
2016-01-14 17:01:26,034 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 17:01:26,033 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 17:01:26,035 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in F2A1E86FBB0B421BB8B28E24FE83056F
2016-01-14 17:01:26,035 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F]
2016-01-14 17:01:26,036 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 17:01:26,036 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885798_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452790885798_0001_1_00, startRequestedTime=1452790886035, startedTime=1452790886035
2016-01-14 17:01:26,036 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F] transitioned from INITED to RUNNING due to event V_START
2016-01-14 17:01:26,037 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 17:01:26,038 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885798_0001_1][Event:TASK_STARTED]: vertexName=F2A1E86FBB0B421BB8B28E24FE83056F, taskId=task_1452790885798_0001_1_00_000000, scheduledTime=1452790886037, launchTime=1452790886037
2016-01-14 17:01:26,038 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790885798_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 17:01:26,038 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F]
2016-01-14 17:01:26,039 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [5E752A4350F14C0ABE5B54B3A71E2AF3/C7BC8EA43F33438DBB723D095D3D0437] third/(1/1) ...de/perpetualcascade/third, VertexName: F2A1E86FBB0B421BB8B28E24FE83056F, VertexParallelism: 1, TaskAttemptID:attempt_1452790885798_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0264131D7DB64B5DAACEB3B148A74BBB, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6203DF62DFF5425F91A0EA85C6B31307, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:01:26,039 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790885798_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 17:01:26,040 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 17:01:26,043 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 17:01:26,044 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 17:01:26,044 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 17:01:26,045 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452790885798_0001_00_000001
2016-01-14 17:01:26,045 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790885798_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 17:01:26,046 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452790885798_0001_00_000001
2016-01-14 17:01:26,047 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-01-14 17:01:26,048 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790885798_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 17:01:26,049 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 17:01:26,049 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885798_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452790885798_0001_00_000001, launchTime=1452790886048
2016-01-14 17:01:26,050 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452790885798_0001_00_000001
2016-01-14 17:01:26,051 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452790885798_0001_1_00_000000_0] to container: [container_1452790885798_0001_00_000001]
2016-01-14 17:01:26,051 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790885798_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 17:01:26,052 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452790885798_0001_1_00_000000_0] started. Is using containerId: [container_1452790885798_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 17:01:26,052 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885798_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F2A1E86FBB0B421BB8B28E24FE83056F, taskAttemptId=attempt_1452790885798_0001_1_00_000000_0, startTime=1452790886051, containerId=container_1452790885798_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452790885798_0001_00_000001/teamcity, completedLogs=
2016-01-14 17:01:26,052 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790885798_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 17:01:26,052 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790885798_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 17:01:26,053 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 17:01:26,053 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452790885798_0001_00_000001 given task: attempt_1452790885798_0001_1_00_000000_0
2016-01-14 17:01:26,054 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452790885798_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452790885798_0001_1_00_000000_0
2016-01-14 17:01:26 Starting to run new task attempt: attempt_1452790885798_0001_1_00_000000_0
2016-01-14 17:01:26,054 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452790885798_0001_1_00_000000_0
2016-01-14 17:01:26,055 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:26,055 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 17:01:26,055 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 17:01:26,055 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 17:01:26,055 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 17:01:26,055 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 17:01:26,055 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [5E752A4350F14C0ABE5B54B3A71E2AF3/C7BC8EA43F33438DBB723D095D3D0437] third/(1/1) ...de/perpetualcascade/third, VertexName: F2A1E86FBB0B421BB8B28E24FE83056F, VertexParallelism: 1, TaskAttemptID:attempt_1452790885798_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0264131D7DB64B5DAACEB3B148A74BBB, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6203DF62DFF5425F91A0EA85C6B31307, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:01:26,056 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 17:01:26,058 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452790885798_0001_1_00_000000_0
2016-01-14 17:01:26,061 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 17:01:26,062 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:26,064 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452790885798_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 17:01:26,064 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=0264131D7DB64B5DAACEB3B148A74BBB, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 17:01:26,065 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:26,066 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=6203DF62DFF5425F91A0EA85C6B31307, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 17:01:26,067 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 17:01:26,067 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 6203DF62DFF5425F91A0EA85C6B31307
2016-01-14 17:01:26,068 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 17:01:26,068 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 6203DF62DFF5425F91A0EA85C6B31307
2016-01-14 17:01:26,069 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 17:01:26,076 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 17:01:26,076 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 0264131D7DB64B5DAACEB3B148A74BBB
2016-01-14 17:01:26,076 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 0264131D7DB64B5DAACEB3B148A74BBB
2016-01-14 17:01:26,088 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F2A1E86FBB0B421BB8B28E24FE83056F, ordinal: 0
2016-01-14 17:01:26,089 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F2A1E86FBB0B421BB8B28E24FE83056F, mem on start (mb), free: 275, total: 397, max: 672
2016-01-14 17:01:26,089 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:26,090 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 17:01:26,090 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 17:01:26,091 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 0264131D7DB64B5DAACEB3B148A74BBB
2016-01-14 17:01:26,091 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 0264131D7DB64B5DAACEB3B148A74BBB
2016-01-14 17:01:26,091 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 17:01:26,100 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 17:01:26,100 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 6203DF62DFF5425F91A0EA85C6B31307
2016-01-14 17:01:26,100 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 17:01:26,100 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 17:01:26,100 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 17:01:26,101 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:01:26,101 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 17:01:26,101 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:01:26,101 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 17:01:26,101 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 17:01:26,101 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 6203DF62DFF5425F91A0EA85C6B31307, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 17:01:26,102 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 0264131D7DB64B5DAACEB3B148A74BBB, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 17:01:26,102 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 17:01:26,102 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 0264131D7DB64B5DAACEB3B148A74BBB being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 17:01:26,102 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 17:01:26,102 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 17:01:26,103 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 0264131D7DB64B5DAACEB3B148A74BBB
2016-01-14 17:01:26,104 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:01:26,104 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 0264131D7DB64B5DAACEB3B148A74BBB
2016-01-14 17:01:26,105 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 17:01:26,105 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452790885798_0001_1_00_000000_0
2016-01-14 17:01:26,109 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second"]
2016-01-14 17:01:26,110 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second"] streamed: true, id: 0264131D7DB64B5DAACEB3B148A74BBB
2016-01-14 17:01:26,111 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third"], id: 6203DF62DFF5425F91A0EA85C6B31307
2016-01-14 17:01:26,111 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third"]
2016-01-14 17:01:26,112 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second"]
2016-01-14 17:01:26,112 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:01:26,113 INFO  input.MRInput (MRInput.java:checkAndAwaitRecordReaderInitialization(597)) - Awaiting RecordReader initialization
2016-01-14 17:01:26,113 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 17:01:26,114 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@4ba3164
2016-01-14 17:01:26,116 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@4ba3164
2016-01-14 17:01:26,116 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 17:01:26,117 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 17:01:26,117 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F2A1E86FBB0B421BB8B28E24FE83056F, all 1 inputs ready in: 00:00:00.000
2016-01-14 17:01:26,123 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 17:01:26,124 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 17:01:26,125 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452790885798_0001_1_00_000000_0
2016-01-14 17:01:26,126 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452790885798_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 17:01:26,127 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452790885798_0001_1_00_000000_0
2016-01-14 17:01:26,128 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F2A1E86FBB0B421BB8B28E24FE83056F, mem on close (mb), free: 273, total: 397, max: 672
2016-01-14 17:01:26 Completed running task attempt: attempt_1452790885798_0001_1_00_000000_0
2016-01-14 17:01:26,129 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452790885798_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 17:01:26,131 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452790886118, Process_Duration=9, Process_End_Time=1452790886127, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 17:01:26,131 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885798_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F2A1E86FBB0B421BB8B28E24FE83056F, taskAttemptId=attempt_1452790885798_0001_1_00_000000_0, startTime=1452790886051, finishTime=1452790886131, timeTaken=80, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790886118, Process_Duration=9, Process_End_Time=1452790886127, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:26,132 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790885798_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 17:01:26,132 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 17:01:26,131 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 17:01:26,132 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452790885798_0001_1_00_000000_0
2016-01-14 17:01:26,134 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 17:01:26,134 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885798_0001_1][Event:TASK_FINISHED]: vertexName=F2A1E86FBB0B421BB8B28E24FE83056F, taskId=task_1452790885798_0001_1_00_000000, startTime=1452790886051, finishTime=1452790886133, timeTaken=82, status=SUCCEEDED, successfulAttemptID=attempt_1452790885798_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790886118, Process_Duration=9, Process_End_Time=1452790886127, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:26,134 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790885798_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 17:01:26,134 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F] : 1
2016-01-14 17:01:26,134 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F]
2016-01-14 17:01:26,141 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 17:01:26,141 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:26,141 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452790885798_0001_00_000001
2016-01-14 17:01:26,142 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 17:01:26,142 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885798_0001_1][Event:VERTEX_FINISHED]: vertexName=F2A1E86FBB0B421BB8B28E24FE83056F, vertexId=vertex_1452790885798_0001_1_00, initRequestedTime=1452790885990, initedTime=1452790886033, startRequestedTime=1452790886035, startedTime=1452790886035, finishTime=1452790886135, timeTaken=100, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790886118, Process_Duration=9, Process_End_Time=1452790886127, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452790886051, firstTasksToStart=[ task_1452790885798_0001_1_00_000000 ], lastTaskFinishTime=1452790886131, lastTasksToFinish=[ task_1452790885798_0001_1_00_000000 ], minTaskDuration=80, maxTaskDuration=80, avgTaskDuration=80.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452790885798_0001_1_00_000000 ], longestDurationTasks=[ task_1452790885798_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 17:01:26,143 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 17:01:26,143 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790885798_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 17:01:26,143 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 17:01:26,144 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885798_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452790885798_0001_00_000001, stoppedTime=1452790886143, exitStatus=0
2016-01-14 17:01:26,145 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790885798_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 17:01:26,145 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 17:01:26,145 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452790885798_0001_1
2016-01-14 17:01:26,146 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885798_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452790885798_0001_1
2016-01-14 17:01:26,146 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 6203DF62DFF5425F91A0EA85C6B31307 for vertex: vertex_1452790885798_0001_1_00 [F2A1E86FBB0B421BB8B28E24FE83056F]
2016-01-14 17:01:26,152 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452790885798_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 17:01:26,152 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452790885798_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 17:01:26,152 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452790885798_0001_00_000001, Exiting
2016-01-14 17:01:26,153 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452790885798_0001_00_000001
2016-01-14 17:01:26,153 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452790885798_0001_00_000001
2016-01-14 17:01:26,155 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452790885798_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 17:01:26,155 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452790885798_0001_00_000001 completed successfully
2016-01-14 17:01:26,160 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452790885798_0001_1, queueSize=0
2016-01-14 17:01:26,161 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 17:01:26,161 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790885798_0001_1][Event:DAG_FINISHED]: dagId=dag_1452790885798_0001_1, startTime=1452790885990, finishTime=1452790886159, timeTaken=169, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790886118, Process_Duration=9, Process_End_Time=1452790886127, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:26,161 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452790885798_0001_1 finished with state: SUCCEEDED
2016-01-14 17:01:26,161 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790885798_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 17:01:26,161 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790885798_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 17:01:26 Completed Dag: dag_1452790885798_0001_1
2016-01-14 17:01:26,162 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452790885798_0001_1, dagState=SUCCEEDED
2016-01-14 17:01:26,162 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452790885798_0001_1_post
2016-01-14 17:01:26,162 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:26,163 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 17:01:26,162 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452790885798_0001_00_000001
2016-01-14 17:01:26,171 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...de/perpetualcascade/third, applicationId=application_1452790885798_0001
2016-01-14 17:01:26,176 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 17:01:26,176 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 17:01:26,176 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 17:01:26,176 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 17:01:26,176 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 17:01:26,177 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 17:01:26,177 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 17:01:26,177 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 17:01:26,179 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 17:01:26,179 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 17:01:26,180 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 17:01:26,180 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 17:01:26,180 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 17:01:26,186 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/5E752A4350F14C0ABE5B54B3A71E2AF3/C7BC8EA43F33438DBB723D095D3D0437/.tez/application_1452790885798_0001
2016-01-14 17:01:26,186 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third]  completed in: 00:00.408
2016-01-14 17:01:26,187 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third] completed flow: third
2016-01-14 17:01:26,188 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third] starting flow: fourth
2016-01-14 17:01:26,188 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] at least one sink is marked for delete
2016-01-14 17:01:26,188 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 17:01:26,193 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] starting
2016-01-14 17:01:26,193 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth]  source: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third"]
2016-01-14 17:01:26,194 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/fourth"]
2016-01-14 17:01:26,195 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth]  parallel execution of steps is enabled: false
2016-01-14 17:01:26,195 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth]  executing total steps: 1
2016-01-14 17:01:26,196 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth]  allocating management threads: 1
2016-01-14 17:01:26,198 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] starting step: (1/1) ...e/perpetualcascade/fourth
2016-01-14 17:01:26,198 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [fourth] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 17:01:26,219 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] tez session mode enabled: true
2016-01-14 17:01:26,225 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:01:26,226 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 17:01:26,226 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 17:01:26,239 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E910781004A649AFA02B361236383614/BA4770319F39486B9FDE2BFA8006871A/.tez/application_1452790886226_0001 doesn't exist and is created
2016-01-14 17:01:26,264 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 17:01:26,264 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:01:26,265 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E910781004A649AFA02B361236383614/BA4770319F39486B9FDE2BFA8006871A/.tez/application_1452790886226_0001
2016-01-14 17:01:26,271 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452790886226_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:01:26,288 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 17:01:26,290 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 17:01:26,292 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 17:01:26,292 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 17:01:26,293 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E910781004A649AFA02B361236383614/BA4770319F39486B9FDE2BFA8006871A/.tez/application_1452790886226_0001/localmode-log-dir
2016-01-14 17:01:26,293 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E910781004A649AFA02B361236383614/BA4770319F39486B9FDE2BFA8006871A/.tez/application_1452790886226_0001/localmode-log-dir/history.txt.appattempt_1452790886226_0001_000000, maxErrors=10
2016-01-14 17:01:26,293 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 17:01:26,294 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452790886226_0001_000000, appSubmitTime=1452790886270, launchTime=1452790886270
2016-01-14 17:01:26,299 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 17:01:26,303 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 17:01:26,304 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 17:01:26,305 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 17:01:26,318 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:60853
2016-01-14 17:01:26,322 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 17:01:26,325 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 17:01:26,325 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452790886226_0001_000000, startTime=1452790886325
2016-01-14 17:01:26,326 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 17:01:26,365 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 17:01:26,365 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 17:01:26,365 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...e/perpetualcascade/fourth, applicationId=application_1452790886226_0001, dagName=[E910781004A649AFA02B361236383614/BA4770319F39486B9FDE2BFA8006871A] fourth/(1/1) ...e/perpetualcascade/fourth
2016-01-14 17:01:26,383 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [E910781004A649AFA02B361236383614/BA4770319F39486B9FDE2BFA8006871A] fourth/(1/1) ...e/perpetualcascade/fourth
2016-01-14 17:01:26,384 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452790886226_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E910781004A649AFA02B361236383614/BA4770319F39486B9FDE2BFA8006871A/.tez/application_1452790886226_0001/localmode-log-dir/dag_1452790886226_0001_1.dot
2016-01-14 17:01:26,385 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E910781004A649AFA02B361236383614/BA4770319F39486B9FDE2BFA8006871A/.tez/application_1452790886226_0001/localmode-log-dir/dag_1452790886226_0001_1-tez-dag.pb.txt
2016-01-14 17:01:26,398 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452790886226_0001_1
2016-01-14 17:01:26,399 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:26,399 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [E910781004A649AFA02B361236383614/BA4770319F39486B9FDE2BFA8006871A] fourth/(1/1) ...e/perpetualcascade/fourth
2016-01-14 17:01:26 Running Dag: dag_1452790886226_0001_1
2016-01-14 17:01:26,414 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790886226_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452790886226_0001_1, submitTime=1452790886383
2016-01-14 17:01:26,414 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 17:01:26,415 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex ACF8EA7AEAC4499AB55C850452BBBD8C
2016-01-14 17:01:26,415 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 17:01:26,416 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 17:01:26,416 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790886226_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452790886226_0001_1, initTime=1452790886415
2016-01-14 17:01:26,416 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790886226_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 17:01:26,418 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790886226_0001_1][Event:DAG_STARTED]: dagID=dag_1452790886226_0001_1, startTime=1452790886418
2016-01-14 17:01:26,418 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 17:01:26,418 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 17:01:26,418 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...e/perpetualcascade/fourth, applicationId=application_1452790886226_0001, dagName=[E910781004A649AFA02B361236383614/BA4770319F39486B9FDE2BFA8006871A] fourth/(1/1) ...e/perpetualcascade/fourth
2016-01-14 17:01:26,418 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790886226_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 17:01:26,419 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: ACF8EA7AEAC4499AB55C850452BBBD8C : {6203DF62DFF5425F91A0EA85C6B31307={InputName=6203DF62DFF5425F91A0EA85C6B31307}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 17:01:26,419 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 6203DF62DFF5425F91A0EA85C6B31307, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 17:01:26,419 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C]
2016-01-14 17:01:26,419 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C]
2016-01-14 17:01:26,419 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C]
2016-01-14 17:01:26,420 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C]. Starting root input initializers: 1
2016-01-14 17:01:26,420 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 17:01:26,421 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 6203DF62DFF5425F91A0EA85C6B31307 on vertex vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C]
2016-01-14 17:01:26,422 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 17:01:26,423 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 6203DF62DFF5425F91A0EA85C6B31307 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 17:01:26,423 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 17:01:26,423 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 17:01:26,437 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] submitted tez dag to app master: application_1452790886226_0001, with dag id: dag_1452790886226_0001_1
2016-01-14 17:01:26,438 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 574
2016-01-14 17:01:26,439 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 6203DF62DFF5425F91A0EA85C6B31307 on vertex vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C]
2016-01-14 17:01:26,439 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:01:26,439 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {6203DF62DFF5425F91A0EA85C6B31307=forAllWorkUnits=true, update=[1]}
2016-01-14 17:01:26,441 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C] parallelism set to 1
2016-01-14 17:01:26,441 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:01:26,441 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790886226_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452790886226_0001_1_00, eventCount=1
2016-01-14 17:01:26,442 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C]
2016-01-14 17:01:26,442 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=78D3DAACF93E475FA916BE843453B3E7, vertexId=vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 17:01:26,442 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=78D3DAACF93E475FA916BE843453B3E7, vertexId=vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C]
2016-01-14 17:01:26,444 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=78D3DAACF93E475FA916BE843453B3E7, vertexName=ACF8EA7AEAC4499AB55C850452BBBD8C, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 17:01:26,444 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=78D3DAACF93E475FA916BE843453B3E7, vertexId=vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C]
2016-01-14 17:01:26,446 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790886226_0001_1][Event:VERTEX_INITIALIZED]: vertexName=ACF8EA7AEAC4499AB55C850452BBBD8C, vertexId=vertex_1452790886226_0001_1_00, initRequestedTime=1452790886419, initedTime=1452790886446, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 17:01:26,446 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C] with distanceFromRoot: 0
2016-01-14 17:01:26,446 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 17:01:26,446 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 17:01:26,447 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in ACF8EA7AEAC4499AB55C850452BBBD8C
2016-01-14 17:01:26,447 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C]
2016-01-14 17:01:26,447 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790886226_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452790886226_0001_1_00, startRequestedTime=1452790886446, startedTime=1452790886446
2016-01-14 17:01:26,447 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 17:01:26,447 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C] transitioned from INITED to RUNNING due to event V_START
2016-01-14 17:01:26,449 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790886226_0001_1][Event:TASK_STARTED]: vertexName=ACF8EA7AEAC4499AB55C850452BBBD8C, taskId=task_1452790886226_0001_1_00_000000, scheduledTime=1452790886449, launchTime=1452790886449
2016-01-14 17:01:26,450 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 17:01:26,450 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790886226_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 17:01:26,451 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C]
2016-01-14 17:01:26,451 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [E910781004A649AFA02B361236383614/BA4770319F39486B9FDE2BFA8006871A] fourth/(1/1) ...e/perpetualcascade/fourth, VertexName: ACF8EA7AEAC4499AB55C850452BBBD8C, VertexParallelism: 1, TaskAttemptID:attempt_1452790886226_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=6203DF62DFF5425F91A0EA85C6B31307, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=78D3DAACF93E475FA916BE843453B3E7, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:01:26,452 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790886226_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 17:01:26,452 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 17:01:26,453 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 17:01:26,454 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 17:01:26,454 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 17:01:26,454 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452790886226_0001_00_000001
2016-01-14 17:01:26,454 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790886226_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 17:01:26,456 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452790886226_0001_00_000001
2016-01-14 17:01:26,456 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-01-14 17:01:26,457 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790886226_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 17:01:26,457 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 17:01:26,457 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790886226_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452790886226_0001_00_000001, launchTime=1452790886456
2016-01-14 17:01:26,458 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452790886226_0001_00_000001
2016-01-14 17:01:26,458 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452790886226_0001_1_00_000000_0] to container: [container_1452790886226_0001_00_000001]
2016-01-14 17:01:26,458 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790886226_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 17:01:26,459 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452790886226_0001_00_000001 given task: attempt_1452790886226_0001_1_00_000000_0
2016-01-14 17:01:26,459 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452790886226_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452790886226_0001_1_00_000000_0
2016-01-14 17:01:26,459 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452790886226_0001_1_00_000000_0] started. Is using containerId: [container_1452790886226_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 17:01:26,459 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 17:01:26 Starting to run new task attempt: attempt_1452790886226_0001_1_00_000000_0
2016-01-14 17:01:26,460 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452790886226_0001_1_00_000000_0
2016-01-14 17:01:26,460 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:26,460 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 17:01:26,460 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 17:01:26,460 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 17:01:26,460 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 17:01:26,460 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 17:01:26,460 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [E910781004A649AFA02B361236383614/BA4770319F39486B9FDE2BFA8006871A] fourth/(1/1) ...e/perpetualcascade/fourth, VertexName: ACF8EA7AEAC4499AB55C850452BBBD8C, VertexParallelism: 1, TaskAttemptID:attempt_1452790886226_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=6203DF62DFF5425F91A0EA85C6B31307, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=78D3DAACF93E475FA916BE843453B3E7, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:01:26,461 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 17:01:26,461 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452790886226_0001_1_00_000000_0
2016-01-14 17:01:26,462 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 17:01:26,462 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:26,462 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790886226_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=ACF8EA7AEAC4499AB55C850452BBBD8C, taskAttemptId=attempt_1452790886226_0001_1_00_000000_0, startTime=1452790886459, containerId=container_1452790886226_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452790886226_0001_00_000001/teamcity, completedLogs=
2016-01-14 17:01:26,462 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790886226_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 17:01:26,463 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790886226_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 17:01:26,465 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=6203DF62DFF5425F91A0EA85C6B31307, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 17:01:26,466 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452790886226_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 17:01:26,466 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 17:01:26,466 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 6203DF62DFF5425F91A0EA85C6B31307
2016-01-14 17:01:26,466 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 6203DF62DFF5425F91A0EA85C6B31307
2016-01-14 17:01:26,467 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=78D3DAACF93E475FA916BE843453B3E7, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 17:01:26,468 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 17:01:26,465 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:26,469 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 78D3DAACF93E475FA916BE843453B3E7
2016-01-14 17:01:26,469 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 17:01:26,470 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 78D3DAACF93E475FA916BE843453B3E7
2016-01-14 17:01:26,472 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 17:01:26,472 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 6203DF62DFF5425F91A0EA85C6B31307
2016-01-14 17:01:26,472 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 17:01:26,472 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 6203DF62DFF5425F91A0EA85C6B31307
2016-01-14 17:01:26,480 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: ACF8EA7AEAC4499AB55C850452BBBD8C, ordinal: 0
2016-01-14 17:01:26,481 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: ACF8EA7AEAC4499AB55C850452BBBD8C, mem on start (mb), free: 233, total: 397, max: 672
2016-01-14 17:01:26,481 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:01:26,481 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 17:01:26,481 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 17:01:26,482 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 17:01:26,482 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 78D3DAACF93E475FA916BE843453B3E7
2016-01-14 17:01:26,482 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 17:01:26,483 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 17:01:26,483 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 17:01:26,483 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:01:26,483 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 17:01:26,483 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:01:26,483 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 17:01:26,483 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 17:01:26,483 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 6203DF62DFF5425F91A0EA85C6B31307, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 17:01:26,484 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 78D3DAACF93E475FA916BE843453B3E7, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 17:01:26,484 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 17:01:26,484 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 6203DF62DFF5425F91A0EA85C6B31307
2016-01-14 17:01:26,484 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:01:26,484 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 6203DF62DFF5425F91A0EA85C6B31307
2016-01-14 17:01:26,484 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 6203DF62DFF5425F91A0EA85C6B31307 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 17:01:26,484 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 17:01:26,484 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 17:01:26,485 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 17:01:26,485 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452790886226_0001_1_00_000000_0
2016-01-14 17:01:26,485 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 17:01:26,486 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@4f9d6258
2016-01-14 17:01:26,487 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@4f9d6258
2016-01-14 17:01:26,487 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 17:01:26,487 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 17:01:26,488 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third"]
2016-01-14 17:01:26,488 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third"] streamed: true, id: 6203DF62DFF5425F91A0EA85C6B31307
2016-01-14 17:01:26,489 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/fourth"], id: 78D3DAACF93E475FA916BE843453B3E7
2016-01-14 17:01:26,489 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/fourth"]
2016-01-14 17:01:26,489 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third"]
2016-01-14 17:01:26,490 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:01:26,490 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: ACF8EA7AEAC4499AB55C850452BBBD8C, all 1 inputs ready in: 00:00:00.000
2016-01-14 17:01:26,493 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 17:01:26,494 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 17:01:26,494 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452790886226_0001_1_00_000000_0
2016-01-14 17:01:26,494 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452790886226_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 17:01:26,495 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452790886226_0001_1_00_000000_0
2016-01-14 17:01:26,495 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: ACF8EA7AEAC4499AB55C850452BBBD8C, mem on close (mb), free: 231, total: 397, max: 672
2016-01-14 17:01:26 Completed running task attempt: attempt_1452790886226_0001_1_00_000000_0
2016-01-14 17:01:26,496 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452790886226_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 17:01:26,497 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452790886491, Process_Duration=4, Process_End_Time=1452790886495, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 17:01:26,497 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 17:01:26,498 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790886226_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=ACF8EA7AEAC4499AB55C850452BBBD8C, taskAttemptId=attempt_1452790886226_0001_1_00_000000_0, startTime=1452790886459, finishTime=1452790886497, timeTaken=38, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790886491, Process_Duration=4, Process_End_Time=1452790886495, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:26,498 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452790886226_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 17:01:26,498 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 17:01:26,498 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:26,498 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452790886226_0001_1_00_000000_0
2016-01-14 17:01:26,499 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 17:01:26,499 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452790886226_0001_00_000001
2016-01-14 17:01:26,499 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 17:01:26,500 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790886226_0001_1][Event:TASK_FINISHED]: vertexName=ACF8EA7AEAC4499AB55C850452BBBD8C, taskId=task_1452790886226_0001_1_00_000000, startTime=1452790886459, finishTime=1452790886499, timeTaken=40, status=SUCCEEDED, successfulAttemptID=attempt_1452790886226_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790886491, Process_Duration=4, Process_End_Time=1452790886495, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:26,500 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452790886226_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 17:01:26,500 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C] : 1
2016-01-14 17:01:26,500 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C]
2016-01-14 17:01:26,501 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 17:01:26,501 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790886226_0001_1][Event:VERTEX_FINISHED]: vertexName=ACF8EA7AEAC4499AB55C850452BBBD8C, vertexId=vertex_1452790886226_0001_1_00, initRequestedTime=1452790886419, initedTime=1452790886446, startRequestedTime=1452790886446, startedTime=1452790886446, finishTime=1452790886500, timeTaken=54, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790886491, Process_Duration=4, Process_End_Time=1452790886495, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452790886459, firstTasksToStart=[ task_1452790886226_0001_1_00_000000 ], lastTaskFinishTime=1452790886497, lastTasksToFinish=[ task_1452790886226_0001_1_00_000000 ], minTaskDuration=38, maxTaskDuration=38, avgTaskDuration=38.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452790886226_0001_1_00_000000 ], longestDurationTasks=[ task_1452790886226_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 17:01:26,501 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 17:01:26,502 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790886226_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 17:01:26,502 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790886226_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452790886226_0001_00_000001, stoppedTime=1452790886502, exitStatus=0
2016-01-14 17:01:26,502 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 17:01:26,502 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790886226_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 17:01:26,503 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 17:01:26,503 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452790886226_0001_1
2016-01-14 17:01:26,503 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790886226_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452790886226_0001_1
2016-01-14 17:01:26,503 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 78D3DAACF93E475FA916BE843453B3E7 for vertex: vertex_1452790886226_0001_1_00 [ACF8EA7AEAC4499AB55C850452BBBD8C]
2016-01-14 17:01:26,510 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452790886226_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 17:01:26,510 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452790886226_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 17:01:26,511 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452790886226_0001_00_000001, Exiting
2016-01-14 17:01:26,511 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452790886226_0001_00_000001
2016-01-14 17:01:26,511 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452790886226_0001_00_000001
2016-01-14 17:01:26,513 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452790886226_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 17:01:26,513 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452790886226_0001_00_000001 completed successfully
2016-01-14 17:01:26,514 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452790886226_0001_1, queueSize=0
2016-01-14 17:01:26,514 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 17:01:26,515 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452790886226_0001_1][Event:DAG_FINISHED]: dagId=dag_1452790886226_0001_1, startTime=1452790886418, finishTime=1452790886512, timeTaken=94, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=586, FILE_BYTES_WRITTEN=287, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452790886491, Process_Duration=4, Process_End_Time=1452790886495, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 17:01:26,515 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452790886226_0001_1 finished with state: SUCCEEDED
2016-01-14 17:01:26,515 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452790886226_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 17:01:26,516 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452790886226_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 17:01:26,516 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452790886226_0001_00_000001
2016-01-14 17:01:26 Completed Dag: dag_1452790886226_0001_1
2016-01-14 17:01:26,518 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452790886226_0001_1, dagState=SUCCEEDED
2016-01-14 17:01:26,518 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452790886226_0001_1_post
2016-01-14 17:01:26,518 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:01:26,518 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 17:01:26,523 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...e/perpetualcascade/fourth, applicationId=application_1452790886226_0001
2016-01-14 17:01:26,525 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 17:01:26,525 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 17:01:26,526 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 17:01:26,526 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 17:01:26,526 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 17:01:26,526 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 17:01:26,528 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 17:01:26,528 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 17:01:26,528 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 17:01:26,529 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 17:01:26,530 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 17:01:26,530 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 17:01:26,530 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 17:01:26,534 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E910781004A649AFA02B361236383614/BA4770319F39486B9FDE2BFA8006871A/.tez/application_1452790886226_0001
2016-01-14 17:01:26,535 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth]  completed in: 00:00.341
2016-01-14 17:01:26,535 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+first+third] completed flow: fourth
2016-01-14 17:01:26,572 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/fourth
2016-01-14 17:01:26,572 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/second
2016-01-14 17:01:26,573 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/third
2016-01-14 17:01:26,573 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testSimpleRiffleCascade/perpetualcascade/first
2016-01-14 17:01:26,579 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testProcessFlowWithCounters/counter/first
2016-01-14 17:01:26,583 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testProcessFlowFlowListenerExceptionHandlingInComplete/completeException/first
2016-01-14 17:01:26,587 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/rifflecascadeplatform/testProcessFlowFlowListenerExceptionHandlingInStart/startException/first

Standard error

2016-01-14 17:01:22 Running Dag: dag_1452790881498_0001_1
2016-01-14 17:01:22 Starting to run new task attempt: attempt_1452790881498_0001_1_00_000000_0
2016-01-14 17:01:22 Completed running task attempt: attempt_1452790881498_0001_1_00_000000_0
2016-01-14 17:01:23 Completed Dag: dag_1452790881498_0001_1
2016-01-14 17:01:23 Running Dag: dag_1452790883100_0001_1
2016-01-14 17:01:23 Starting to run new task attempt: attempt_1452790883100_0001_1_00_000000_0
2016-01-14 17:01:23 Completed running task attempt: attempt_1452790883100_0001_1_00_000000_0
2016-01-14 17:01:23 Completed Dag: dag_1452790883100_0001_1
2016-01-14 17:01:23 Running Dag: dag_1452790883586_0001_1
2016-01-14 17:01:23 Starting to run new task attempt: attempt_1452790883586_0001_1_00_000000_0
2016-01-14 17:01:23 Completed running task attempt: attempt_1452790883586_0001_1_00_000000_0
2016-01-14 17:01:23 Completed Dag: dag_1452790883586_0001_1
2016-01-14 17:01:24 Running Dag: dag_1452790883993_0001_1
2016-01-14 17:01:24 Starting to run new task attempt: attempt_1452790883993_0001_1_00_000000_0
2016-01-14 17:01:24 Completed running task attempt: attempt_1452790883993_0001_1_00_000000_0
2016-01-14 17:01:24 Completed Dag: dag_1452790883993_0001_1
2016-01-14 17:01:25 Running Dag: dag_1452790885009_0001_1
2016-01-14 17:01:25 Starting to run new task attempt: attempt_1452790885009_0001_1_00_000000_0
2016-01-14 17:01:25 Completed running task attempt: attempt_1452790885009_0001_1_00_000000_0
2016-01-14 17:01:25 Completed Dag: dag_1452790885009_0001_1
2016-01-14 17:01:25 Running Dag: dag_1452790885378_0001_1
2016-01-14 17:01:25 Starting to run new task attempt: attempt_1452790885378_0001_1_00_000000_0
2016-01-14 17:01:25 Completed running task attempt: attempt_1452790885378_0001_1_00_000000_0
2016-01-14 17:01:25 Completed Dag: dag_1452790885378_0001_1
2016-01-14 17:01:25 Running Dag: dag_1452790885798_0001_1
2016-01-14 17:01:26 Starting to run new task attempt: attempt_1452790885798_0001_1_00_000000_0
2016-01-14 17:01:26 Completed running task attempt: attempt_1452790885798_0001_1_00_000000_0
2016-01-14 17:01:26 Completed Dag: dag_1452790885798_0001_1
2016-01-14 17:01:26 Running Dag: dag_1452790886226_0001_1
2016-01-14 17:01:26 Starting to run new task attempt: attempt_1452790886226_0001_1_00_000000_0
2016-01-14 17:01:26 Completed running task attempt: attempt_1452790886226_0001_1_00_000000_0
2016-01-14 17:01:26 Completed Dag: dag_1452790886226_0001_1