Class cascading.operation.assertion.AppliedAssertionsPlatformTest

6

tests

0

failures

0

ignored

13.522s

duration

100%

successful

Tests

Test Duration Result
testGroupAssertionsFail 0.618s passed
testGroupAssertionsPass 0.661s passed
testGroupAssertionsRemoval 3.381s passed
testValueAssertionsFail 0.581s passed
testValueAssertionsPass 0.618s passed
testValueAssertionsRemoval 7.663s passed

Standard output

2016-05-18 01:57:11,496 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(197)) - found 1 test platforms from classpath
2016-05-18 01:57:11,521 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(246)) - adding test: cascading.operation.assertion.AppliedAssertionsPlatformTest, with platform: hadoop2-tez
2016-05-18 01:57:11,562 INFO  tez.Hadoop2TezPlatform (Hadoop2TezPlatform.java:setUp(136)) - not using cluster
2016-05-18 01:57:12,157 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-05-18 01:57:12,512 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(75)) - platform property overrides: 
2016-05-18 01:57:12,840 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 01:57:12,842 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-18 01:57:12,939 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 25E1F0EF3D60464D9B5E577338E9179A
2016-05-18 01:57:13,220 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.120
2016-05-18 01:57:13,249 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.150
2016-05-18 01:57:13,251 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:13,251 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:13,252 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 01:57:13,419 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt
2016-05-18 01:57:13,556 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/NONE/STRICT
2016-05-18 01:57:13,729 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.1.0
2016-05-18 01:57:13,731 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting
2016-05-18 01:57:13,733 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:13,733 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  sink: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/NONE/STRICT"]
2016-05-18 01:57:13,733 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  parallel execution of steps is enabled: false
2016-05-18 01:57:13,733 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  executing total steps: 1
2016-05-18 01:57:13,734 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  allocating management threads: 1
2016-05-18 01:57:13,735 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting step: (1/1) ...Removal/value/NONE/STRICT
2016-05-18 01:57:13,735 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [test] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-18 01:57:13,772 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tez session mode enabled: true
2016-05-18 01:57:13,951 INFO  client.TezClient (TezClient.java:<init>(174)) - Tez Client Version: [ component=tez-api, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:13,961 INFO  client.TezClient (TezClient.java:start(394)) - Session mode. Starting session.
2016-05-18 01:57:13,961 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(164)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-18 01:57:14,030 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(122)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/35B88F07641D45A0AE666B09C659E177/DAB05B713B9A40F781CEC38316FF5E8E/.tez/application_1463536633960_0001 doesn't exist and is created
2016-05-18 01:57:14,122 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(332)) - DAGAppMaster thread has been created
2016-05-18 01:57:14,123 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-18 01:57:14,124 INFO  client.LocalClient (LocalClient.java:run(282)) - Using working directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/35B88F07641D45A0AE666B09C659E177/DAB05B713B9A40F781CEC38316FF5E8E/.tez/application_1463536633960_0001_wd
2016-05-18 01:57:14,190 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(363)) - Created DAGAppMaster for application appattempt_1463536633960_0001_000000, versionInfo=[ component=tez-dag, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:14,205 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(80)) - Trying to locate HadoopShimProvider for hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:14,205 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(139)) - Picked HadoopShim org.apache.tez.hadoop.shim.DefaultHadoopShim, providerName=null, overrideProviderViaConfig=null, hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:14,212 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(436)) - AM Level configured TaskSchedulers: [0:TezUber:null]
2016-05-18 01:57:14,212 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(437)) - AM Level configured ContainerLaunchers: [0:TezUber:null]
2016-05-18 01:57:14,213 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(438)) - AM Level configured TaskCommunicators: [0:TezUber:null]
2016-05-18 01:57:14,213 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(447)) - Comparing client version with AM version, clientVersion=0.8.2, AMVersion=0.8.2
2016-05-18 01:57:14,223 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: NEW
2016-05-18 01:57:14,223 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(238)) - DAGAppMaster is not started wait for 100ms...
2016-05-18 01:57:14,223 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-18 01:57:14,236 INFO  app.TaskCommunicatorManager (TaskCommunicatorManager.java:createUberTaskCommunicator(192)) - Creating Default Local Task Communicator
2016-05-18 01:57:14,260 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.container.AMContainerEventType for class org.apache.tez.dag.app.rm.container.AMContainerMap
2016-05-18 01:57:14,261 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.node.AMNodeEventType for class org.apache.tez.dag.app.rm.node.AMNodeTracker
2016-05-18 01:57:14,263 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGAppMasterEventType for class org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterEventHandler
2016-05-18 01:57:14,264 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGEventType for class org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher
2016-05-18 01:57:14,264 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.VertexEventType for class org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher
2016-05-18 01:57:14,264 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(529)) - Using concurrent dispatcher: false
2016-05-18 01:57:14,266 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher
2016-05-18 01:57:14,267 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskAttemptEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher
2016-05-18 01:57:14,268 INFO  common.AsyncDispatcher (AsyncDispatcher.java:registerAndCreateDispatcher(262)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for independent dispatch using: class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:14,269 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:14,280 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.AMSchedulerEventType for class org.apache.tez.dag.app.rm.TaskSchedulerManager
2016-05-18 01:57:14,286 INFO  launcher.TezContainerLauncherImpl (ContainerLauncherManager.java:createUberContainerLauncher(134)) - Creating LocalContainerLauncher
2016-05-18 01:57:14,308 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.ContainerLauncherEventType for class org.apache.tez.dag.app.launcher.ContainerLauncherManager
2016-05-18 01:57:14,315 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(78)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1, nodeUpdatesRescheduleEnabled: false
2016-05-18 01:57:14,315 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(57)) - Initializing HistoryEventHandler withrecoveryEnabled=true, historyServiceClassName=org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService
2016-05-18 01:57:14,318 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/35B88F07641D45A0AE666B09C659E177/DAB05B713B9A40F781CEC38316FF5E8E/.tez/application_1463536633960_0001_wd/localmode-log-dir
2016-05-18 01:57:14,319 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/35B88F07641D45A0AE666B09C659E177/DAB05B713B9A40F781CEC38316FF5E8E/.tez/application_1463536633960_0001_wd/localmode-log-dir/history.txt.appattempt_1463536633960_0001_000000, maxErrors=10
2016-05-18 01:57:14,319 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(124)) - RecoveryService initialized with recoveryPath=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/35B88F07641D45A0AE666B09C659E177/DAB05B713B9A40F781CEC38316FF5E8E/.tez/application_1463536633960_0001/recovery/0, bufferSize(bytes)=8192, flushInterval(s)=30, maxUnflushedEvents=100
2016-05-18 01:57:14,321 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463536633960_0001_000000, appSubmitTime=1463536634170, launchTime=1463536634189
2016-05-18 01:57:14,324 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-05-18 01:57:14,324 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-05-18 01:57:14,324 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-18 01:57:14,327 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-18 01:57:14,382 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:40103
2016-05-18 01:57:14,383 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:createUberTaskScheduler(557)) - Creating TaskScheduler: Local TaskScheduler with clusterIdentifier=1463536633960
2016-05-18 01:57:14,400 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463536633960_0001_000000, startTime=1463536634399
2016-05-18 01:57:14,400 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1945)) - In Session mode. Waiting for DAG over RPC
2016-05-18 01:57:14,424 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-18 01:57:14,440 INFO  client.TezClient (TezClient.java:start(428)) - The url to track the Tez Session: N/A
2016-05-18 01:57:14,440 INFO  client.TezClient (TezClient.java:submitDAGSession(470)) - Submitting dag to TezSession, sessionName=(1/1) ...Removal/value/NONE/STRICT, applicationId=application_1463536633960_0001, dagName=[35B88F07641D45A0AE666B09C659E177/DAB05B713B9A40F781CEC38316FF5E8E] test/(1/1) ...Removal/value/NONE/STRICT
2016-05-18 01:57:14,668 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1351)) - Starting DAG submitted via RPC: [35B88F07641D45A0AE666B09C659E177/DAB05B713B9A40F781CEC38316FF5E8E] test/(1/1) ...Removal/value/NONE/STRICT
2016-05-18 01:57:14,677 INFO  app.DAGAppMaster (DAGAppMaster.java:createDAG(985)) - Merging AM credentials into DAG credentials
2016-05-18 01:57:14,738 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(1076)) - Generating DAG graphviz file, dagId=dag_1463536633960_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/35B88F07641D45A0AE666B09C659E177/DAB05B713B9A40F781CEC38316FF5E8E/.tez/application_1463536633960_0001_wd/localmode-log-dir/dag_1463536633960_0001_1.dot
2016-05-18 01:57:14,742 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(1093)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/35B88F07641D45A0AE666B09C659E177/DAB05B713B9A40F781CEC38316FF5E8E/.tez/application_1463536633960_0001_wd/localmode-log-dir/dag_1463536633960_0001_1-tez-dag.pb.txt
2016-05-18 01:57:14,811 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536633960_0001_1
2016-05-18 01:57:14,812 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:14,812 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2399)) - Running DAG: [35B88F07641D45A0AE666B09C659E177/DAB05B713B9A40F781CEC38316FF5E8E] test/(1/1) ...Removal/value/NONE/STRICT
2016-05-18 01:57:14 Running Dag: dag_1463536633960_0001_1
2016-05-18 01:57:14,841 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463536633960_0001_1, submitTime=1463536634668
2016-05-18 01:57:14,894 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/35B88F07641D45A0AE666B09C659E177/DAB05B713B9A40F781CEC38316FF5E8E/.tez/application_1463536633960_0001/tez-conf.pb" } size: 40984 timestamp: 1463536634000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:14,894 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalInputs(3978)) - Setting 1 additional inputs for vertexvertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821]
2016-05-18 01:57:14,895 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:14,896 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/35B88F07641D45A0AE666B09C659E177/DAB05B713B9A40F781CEC38316FF5E8E/.tez/application_1463536633960_0001/tez-conf.pb" } size: 40984 timestamp: 1463536634000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:14,897 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4023)) - Setting 1 additional outputs for vertex vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901]
2016-05-18 01:57:14,898 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:14,906 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1593)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-18 01:57:14,911 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463536633960_0001_1, initTime=1463536634908
2016-05-18 01:57:14,912 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536633960_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-18 01:57:14,914 INFO  impl.DAGImpl (DAGImpl.java:transition(1768)) - Added additional resources : [[]] to classpath
2016-05-18 01:57:14,916 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:DAG_STARTED]: dagID=dag_1463536633960_0001_1, startTime=1463536634916
2016-05-18 01:57:14,916 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536633960_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-18 01:57:14,917 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2400)) - Root Inputs exist for Vertex: A6516E103DAA40AD9F004A34EEC43821 : {0AD118E96C424DAA8667FC9AE67CC3DA={InputName=0AD118E96C424DAA8667FC9AE67CC3DA}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-18 01:57:14,917 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2410)) - Starting root input initializer for input: 0AD118E96C424DAA8667FC9AE67CC3DA, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-18 01:57:14,917 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2550)) - Setting vertexManager to RootInputVertexManager for vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821]
2016-05-18 01:57:14,925 INFO  client.TezClient (TezClient.java:submitDAGSession(545)) - Submitted dag to TezSession, sessionName=(1/1) ...Removal/value/NONE/STRICT, applicationId=application_1463536633960_0001, dagName=[35B88F07641D45A0AE666B09C659E177/DAB05B713B9A40F781CEC38316FF5E8E] test/(1/1) ...Removal/value/NONE/STRICT
2016-05-18 01:57:14,931 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2721)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821]
2016-05-18 01:57:14,932 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2726)) - Vertex will initialize from input initializer. vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821]
2016-05-18 01:57:14,934 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3893)) - Starting 1 inputInitializers for vertex vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821]
2016-05-18 01:57:14,941 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(272)) - Starting InputInitializer for Input: 0AD118E96C424DAA8667FC9AE67CC3DA on vertex vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821]
2016-05-18 01:57:14,954 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-18 01:57:14,954 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2562)) - Setting vertexManager to ShuffleVertexManager for vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901]
2016-05-18 01:57:14,964 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(109)) - Input 0AD118E96C424DAA8667FC9AE67CC3DA asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7, groupingEnabled: true
2016-05-18 01:57:14,985 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] submitted tez dag to app master: application_1463536633960_0001, with dag id: dag_1463536633960_0001_1
2016-05-18 01:57:14,990 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:initialize(1022)) - Shuffle Vertex Manager: settings minFrac:0.25 maxFrac:0.75 auto:false desiredTaskIput:104857600 minTasks:1
2016-05-18 01:57:14,991 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2760)) - Creating 1 tasks for vertex: vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901]
2016-05-18 01:57:15,007 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2779)) - Directly initializing vertex: vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901]
2016-05-18 01:57:15,011 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(168)) - Grouping splits in Tez
2016-05-18 01:57:15,011 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(226)) - Desired splits: 1 too large.  Desired splitLength: 1449 Min splitLength: 52428800 New desired splits: 1 Total length: 1449 Original splits: 2
2016-05-18 01:57:15,012 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(321)) - Desired numSplits: 1 lengthPerGroup: 1449 numLocations: 1 numSplitsPerLocation: 2 numSplitsInGroup: 2 totalLength: 1449 numOriginalSplits: 2 . Grouping by length: true count: false nodeLocalOnly: false
2016-05-18 01:57:15,014 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(539)) - Number of splits desired: 1 created: 1 splitsProcessed: 2
2016-05-18 01:57:15,018 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536633960_0001_1_01, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=null, edgeManagersCount=1, rootInputSpecUpdateCount=0, setParallelismCalledFlag=false
2016-05-18 01:57:15,019 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2187)) - Setting up committers for vertex vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901], numAdditionalOutputs=1
2016-05-18 01:57:15,019 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2202)) - Instantiating committer for output=AB2D2DADEDAF4B7A8382677F807A2A61, vertex=vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-18 01:57:15,034 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(308)) - Succeeded InputInitializer for Input: 0AD118E96C424DAA8667FC9AE67CC3DA on vertex vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821]
2016-05-18 01:57:15,036 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(121)) - Committer for B87CC61E6303457193750A4E1A39C901:AB2D2DADEDAF4B7A8382677F807A2A61 using oldmapred API
2016-05-18 01:57:15,037 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(146)) - OutputCommitter for outputName=AB2D2DADEDAF4B7A8382677F807A2A61, vertexName=B87CC61E6303457193750A4E1A39C901, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-18 01:57:15,049 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B87CC61E6303457193750A4E1A39C901, vertexId=vertex_1463536633960_0001_1_01, initRequestedTime=1463536634954, initedTime=1463536635019, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=0, initGeneratedEventsCount=0
2016-05-18 01:57:15,049 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901] transitioned from NEW to INITED due to event V_INIT
2016-05-18 01:57:15,057 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:15,057 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1644)) - Got updated RootInputsSpecs: {0AD118E96C424DAA8667FC9AE67CC3DA=forAllWorkUnits=true, update=[1]}
2016-05-18 01:57:15,058 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1664)) - Vertex vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821] parallelism set to 1
2016-05-18 01:57:15,058 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:15,064 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:VERTEX_INITIALIZED]: vertexName=A6516E103DAA40AD9F004A34EEC43821, vertexId=vertex_1463536633960_0001_1_00, initRequestedTime=1463536634917, initedTime=1463536635064, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1, initGeneratedEventsCount=1
2016-05-18 01:57:15,064 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821] with distanceFromRoot: 0
2016-05-18 01:57:15,065 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821] transitioned from INITIALIZING to INITED due to event V_INPUT_DATA_INFORMATION
2016-05-18 01:57:15,066 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536633960_0001_1_00, startRequestedTime=1463536634954, startedTime=1463536635065
2016-05-18 01:57:15,066 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536633960_0001_1_00, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=org.apache.tez.dag.api.VertexLocationHint@b8338fe7, edgeManagersCount=0, rootInputSpecUpdateCount=1, setParallelismCalledFlag=true
2016-05-18 01:57:15,067 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:15,067 INFO  impl.VertexImpl (VertexImpl.java:transition(2932)) - Source vertex started: vertex_1463536633960_0001_1_00 for vertex: vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901] numStartedSources: 1 numSources: 1
2016-05-18 01:57:15,067 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901] with distanceFromRoot: 1
2016-05-18 01:57:15,068 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536633960_0001_1_01, startRequestedTime=1463536635067, startedTime=1463536635068
2016-05-18 01:57:15,069 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:15,071 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(100)) - Starting 1 in A6516E103DAA40AD9F004A34EEC43821
2016-05-18 01:57:15,072 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821]
2016-05-18 01:57:15,077 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:TASK_STARTED]: vertexName=A6516E103DAA40AD9F004A34EEC43821, taskId=task_1463536633960_0001_1_00_000000, scheduledTime=1463536635077, launchTime=1463536635077
2016-05-18 01:57:15,086 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:onVertexStarted(519)) - OnVertexStarted vertex: B87CC61E6303457193750A4E1A39C901 with 0 source tasks and 1 pending tasks
2016-05-18 01:57:15,090 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:handleVertexStateUpdate(1051)) - Received configured notification : CONFIGURED for vertex: A6516E103DAA40AD9F004A34EEC43821 in vertex: B87CC61E6303457193750A4E1A39C901 numBipartiteSourceTasks: 1
2016-05-18 01:57:15,115 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821]
2016-05-18 01:57:15,164 INFO  node.PerSourceNodeTracker (PerSourceNodeTracker.java:nodeSeen(74)) - Adding new node 127.0.0.1:0 to nodeTracker 0
2016-05-18 01:57:15,180 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536633960_0001_00_000001, launchTime=1463536635180
2016-05-18 01:57:15,185 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536633960_0001_00_000001
2016-05-18 01:57:15,189 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536633960_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536633960_0001_1_00_000000_0
2016-05-18 01:57:15 Starting to run new task attempt: attempt_1463536633960_0001_1_00_000000_0
2016-05-18 01:57:15,191 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536633960_0001_1_00_000000_0] started. Is using containerId: [container_1463536633960_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-18 01:57:15,191 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536633960_0001_1_00_000000_0
2016-05-18 01:57:15,192 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:15,193 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:15,195 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=A6516E103DAA40AD9F004A34EEC43821, taskAttemptId=attempt_1463536633960_0001_1_00_000000_0, startTime=1463536635189, containerId=container_1463536633960_0001_00_000001, nodeId=127.0.0.1:0
2016-05-18 01:57:15,196 INFO  counters.Limits (Limits.java:ensureInitialized(60)) - Counter limits initialized with parameters:  GROUP_NAME_MAX=256, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200
2016-05-18 01:57:15,207 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [35B88F07641D45A0AE666B09C659E177/DAB05B713B9A40F781CEC38316FF5E8E] test/(1/1) ...Removal/value/NONE/STRICT, VertexName: A6516E103DAA40AD9F004A34EEC43821, VertexParallelism: 1, TaskAttemptID:attempt_1463536633960_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0AD118E96C424DAA8667FC9AE67CC3DA, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=B87CC61E6303457193750A4E1A39C901, physicalEdgeCount=1, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ]
2016-05-18 01:57:15,209 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:15,213 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536633960_0001_1_00_000000_0
2016-05-18 01:57:15,219 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(496)) - TaskAttempt:attempt_1463536633960_0001_1_00_000000_0 sent events: (0-1).
2016-05-18 01:57:15,221 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536633960_0001_1_00_000000_0, eventCount=1 fromEventId=0 nextFromEventId=0
2016-05-18 01:57:15,236 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:15,244 INFO  input.MRInput (MRInput.java:initialize(440)) - 0AD118E96C424DAA8667FC9AE67CC3DA using newmapreduce API=false, split via event=true, numPhysicalInputs=1
2016-05-18 01:57:15,245 INFO  input.MRInput (MRInput.java:initializeInternal(494)) - Initialized MRInput: 0AD118E96C424DAA8667FC9AE67CC3DA
2016-05-18 01:57:15,256 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: A6516E103DAA40AD9F004A34EEC43821, ordinal: 0
2016-05-18 01:57:15,257 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A6516E103DAA40AD9F004A34EEC43821, mem on start (mb), free: 216, total: 281, max: 672
2016-05-18 01:57:15,257 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:15,258 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:15,258 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:15,260 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:15,260 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[0AD118E96C424DAA8667FC9AE67CC3DA:INPUT:0:org.apache.tez.mapreduce.input.MRInput], [B87CC61E6303457193750A4E1A39C901:OUTPUT:104857600:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput]
2016-05-18 01:57:15,265 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:15,268 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:15,268 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 104857600, TotalRequestedScaled: 9.679163076923077E7, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.15
2016-05-18 01:57:15,269 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[0AD118E96C424DAA8667FC9AE67CC3DA:org.apache.tez.mapreduce.input.MRInput:INPUT:0:0], [B87CC61E6303457193750A4E1A39C901:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput:OUTPUT:104857600:104857600]
2016-05-18 01:57:15,269 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:15,270 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: 0AD118E96C424DAA8667FC9AE67CC3DA
2016-05-18 01:57:15,270 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: 0AD118E96C424DAA8667FC9AE67CC3DA being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:15,271 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:15,271 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:15,272 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:15,273 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536633960_0001_1_00_000000_0
2016-05-18 01:57:15,310 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(174)) - Processing split: TezGroupedSplit{wrappedSplits=[file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:0+724, file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:724+725], wrappedInputFormatName='org.apache.hadoop.mapred.TextInputFormat', locations=[localhost], rack='null', length=1449}
2016-05-18 01:57:15,311 INFO  input.MRInput (MRInput.java:initFromEventInternal(653)) - 0AD118E96C424DAA8667FC9AE67CC3DA initialized RecordReader from event
2016-05-18 01:57:15,340 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:15,389 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"] streamed: true, id: 0AD118E96C424DAA8667FC9AE67CC3DA
2016-05-18 01:57:15,389 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: GroupBy(test)[by:[{1}:'method']], id: 2CA7DF31A4D04FC6B77FED90DA088FF8
2016-05-18 01:57:15,390 INFO  element.TezGroupGate (TezGroupGate.java:prepare(98)) - calling OrderedPartitionedKVOutput#start() on: GroupBy(test)[by:[{1}:'method']] 2CA7DF31A4D04FC6B77FED90DA088FF8
2016-05-18 01:57:15,434 INFO  impl.ExternalSorter (ExternalSorter.java:<init>(199)) - B87CC61E6303457193750A4E1A39C901 using: memoryMb=100, keySerializerClass=class cascading.tuple.io.KeyTuple, valueSerializerClass=cascading.tuple.hadoop.io.ValueTupleSerializer@ae84998, comparator=cascading.tuple.hadoop.util.TupleComparator@6bd902ab, partitioner=cascading.tuple.tez.util.TuplePartitioner, serialization=cascading.tuple.hadoop.TupleSerialization,org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
2016-05-18 01:57:15,439 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(170)) - Setting up PipelinedSorter for B87CC61E6303457193750A4E1A39C901: , UsingHashComparator=false
2016-05-18 01:57:15,552 INFO  impl.PipelinedSorter (PipelinedSorter.java:allocateSpace(245)) - Newly allocated block size=104857600, index=0, Number of buffers=1, currentAllocatableMemory=0, currentBufferSize=104857600, total=104857600
2016-05-18 01:57:15,553 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(189)) - Pre allocating rest of memory buffers upfront
2016-05-18 01:57:15,553 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(207)) - Setting up PipelinedSorter for B87CC61E6303457193750A4E1A39C901: , UsingHashComparator=false#blocks=1, maxMemUsage=104857600, lazyAllocateMem=false, minBlockSize=2097152000, initial BLOCK_SIZE=104857600, finalMergeEnabled=true, pipelinedShuffle=false, sendEmptyPartitions=true, tez.runtime.io.sort.mb=100
2016-05-18 01:57:15,554 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(882)) - B87CC61E6303457193750A4E1A39C901: reserved.remaining()=104857600, reserved.metasize=16777216
2016-05-18 01:57:15,559 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:15,560 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: A6516E103DAA40AD9F004A34EEC43821, all 1 inputs ready in: 00:00:00.001
2016-05-18 01:57:15,570 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536633960_0001_1_00_000000_0
2016-05-18 01:57:15,571 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A6516E103DAA40AD9F004A34EEC43821, mem on close (mb), free: 104, total: 281, max: 672
2016-05-18 01:57:15,571 INFO  impl.PipelinedSorter (PipelinedSorter.java:flush(629)) - B87CC61E6303457193750A4E1A39C901: Starting flush of map output
2016-05-18 01:57:15,572 INFO  impl.PipelinedSorter (PipelinedSorter.java:end(995)) - B87CC61E6303457193750A4E1A39C901: Span0.length = 7, perItem = 99
2016-05-18 01:57:15,573 INFO  impl.PipelinedSorter (PipelinedSorter.java:sort(904)) - B87CC61E6303457193750A4E1A39C901: done sorting span=0, length=7, time=1
2016-05-18 01:57:15,575 INFO  impl.PipelinedSorter (PipelinedSorter.java:ready(1297)) - B87CC61E6303457193750A4E1A39C901: Heap = SpanIterator<0:6> (span=Span[16777216,693]),
2016-05-18 01:57:15,581 INFO  impl.PipelinedSorter (PipelinedSorter.java:spill(546)) - B87CC61E6303457193750A4E1A39C901: Spilling to /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/35B88F07641D45A0AE666B09C659E177/DAB05B713B9A40F781CEC38316FF5E8E/.tez/application_1463536633960_0001_wd/localmode-local-dir/output/attempt_1463536633960_0001_1_00_000000_0_10003_0/file.out
2016-05-18 01:57:15,610 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:15 Completed running task attempt: attempt_1463536633960_0001_1_00_000000_0
2016-05-18 01:57:15,614 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536633960_0001_1_00_000000_0, askedToStop=false
2016-05-18 01:57:15,614 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536633960_0001_1_00_000000_0, stopRequested=false
2016-05-18 01:57:15,617 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536633960_0001_1_00_000000_0: Counters: 18 [[org.apache.tez.common.counters.TaskCounter SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1][cascading.flow.SliceCounters Process_Begin_Time=1463536635561, Process_Duration=9, Process_End_Time=1463536635570, Read_Duration=2, Tuples_Read=10, Tuples_Written=7, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=10]]
2016-05-18 01:57:15,622 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536633960_0001_1_00_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:15,624 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:15,625 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=A6516E103DAA40AD9F004A34EEC43821, taskAttemptId=attempt_1463536633960_0001_1_00_000000_0, creationTime=1463536635105, allocationTime=1463536635172, startTime=1463536635189, finishTime=1463536635623, timeTaken=434, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:15,628 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:15,628 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:15,629 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536633960_0001_00_000001
2016-05-18 01:57:15,634 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536633960_0001_1_00_000000_0
2016-05-18 01:57:15,641 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:TASK_FINISHED]: vertexName=A6516E103DAA40AD9F004A34EEC43821, taskId=task_1463536633960_0001_1_00_000000, startTime=1463536635189, finishTime=1463536635636, timeTaken=447, status=SUCCEEDED, successfulAttemptID=attempt_1463536633960_0001_1_00_000000_0, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536635561, Process_Duration=9, Process_End_Time=1463536635570, Read_Duration=2, Tuples_Read=10, Tuples_Written=7, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10
2016-05-18 01:57:15,652 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:15,652 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821]
2016-05-18 01:57:15,667 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:VERTEX_FINISHED]: vertexName=A6516E103DAA40AD9F004A34EEC43821, vertexId=vertex_1463536633960_0001_1_00, initRequestedTime=1463536634917, initedTime=1463536635064, startRequestedTime=1463536634954, startedTime=1463536635065, finishTime=1463536635652, timeTaken=587, status=SUCCEEDED, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536635561, Process_Duration=9, Process_End_Time=1463536635570, Read_Duration=2, Tuples_Read=10, Tuples_Written=7, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10, vertexStats=firstTaskStartTime=1463536635189, firstTasksToStart=[ task_1463536633960_0001_1_00_000000 ], lastTaskFinishTime=1463536635623, lastTasksToFinish=[ task_1463536633960_0001_1_00_000000 ], minTaskDuration=434, maxTaskDuration=434, avgTaskDuration=434.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536633960_0001_1_00_000000 ], longestDurationTasks=[ task_1463536633960_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:15,668 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:15,670 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536633960_0001_00_000001, stoppedTime=1463536635669, exitStatus=0
2016-05-18 01:57:15,671 INFO  impl.VertexImpl (VertexImpl.java:transition(3279)) - Source task attempt completed for vertex: vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901] attempt: attempt_1463536633960_0001_1_00_000000_0 with state: SUCCEEDED vertexState: RUNNING
2016-05-18 01:57:15,671 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:15,671 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:schedulePendingTasks(920)) - All source tasks assigned. Ramping up 1 remaining tasks for vertex: B87CC61E6303457193750A4E1A39C901
2016-05-18 01:57:15,672 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:15,673 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(262)) - Ignoring stop request for containerId container_1463536633960_0001_00_000001. Relying on regular task shutdown for it to end
2016-05-18 01:57:15,674 INFO  impl.Edge (Edge.java:routingToBegin(232)) - Routing to begin for edge: EdgeInfo: sourceVertexName=A6516E103DAA40AD9F004A34EEC43821, destinationVertexName=B87CC61E6303457193750A4E1A39C901. EdgeProperty: { SCATTER_GATHER : org.apache.tez.runtime.library.input.OrderedGroupedKVInput >> PERSISTED >> org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput >> NullEdgeManager } onDemandRouting: true
2016-05-18 01:57:15,674 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901]
2016-05-18 01:57:15,677 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:TASK_STARTED]: vertexName=B87CC61E6303457193750A4E1A39C901, taskId=task_1463536633960_0001_1_01_000000, scheduledTime=1463536635676, launchTime=1463536635676
2016-05-18 01:57:15,677 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901]
2016-05-18 01:57:15,679 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536633960_0001_00_000002, launchTime=1463536635679
2016-05-18 01:57:15,680 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536633960_0001_00_000002
2016-05-18 01:57:15,680 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536633960_0001_00_000002: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536633960_0001_1_01_000000_0
2016-05-18 01:57:15,681 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536633960_0001_1_01_000000_0] started. Is using containerId: [container_1463536633960_0001_00_000002] on NM: [127.0.0.1:0]
2016-05-18 01:57:15 Starting to run new task attempt: attempt_1463536633960_0001_1_01_000000_0
2016-05-18 01:57:15,681 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536633960_0001_1_01_000000_0
2016-05-18 01:57:15,682 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:15,682 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:15,682 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B87CC61E6303457193750A4E1A39C901, taskAttemptId=attempt_1463536633960_0001_1_01_000000_0, startTime=1463536635680, containerId=container_1463536633960_0001_00_000002, nodeId=127.0.0.1:0
2016-05-18 01:57:15,683 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [35B88F07641D45A0AE666B09C659E177/DAB05B713B9A40F781CEC38316FF5E8E] test/(1/1) ...Removal/value/NONE/STRICT, VertexName: B87CC61E6303457193750A4E1A39C901, VertexParallelism: 1, TaskAttemptID:attempt_1463536633960_0001_1_01_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=A6516E103DAA40AD9F004A34EEC43821, physicalEdgeCount=1, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=AB2D2DADEDAF4B7A8382677F807A2A61, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-18 01:57:15,683 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:15,684 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536633960_0001_1_01_000000_0
2016-05-18 01:57:15,686 INFO  impl.VertexImpl (VertexImpl.java:getTaskAttemptTezEvents(3662)) - Sending attempt_1463536633960_0001_1_01_000000_0 1 events [0,1) total 1 vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901]
2016-05-18 01:57:15,687 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536633960_0001_1_01_000000_0, eventCount=1 fromEventId=0 nextFromEventId=1
2016-05-18 01:57:15,691 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536633960_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-18 01:57:15,691 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536633960_0001_00_000001: 62 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:15,691 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536633960_0001_00_000001, Exiting
2016-05-18 01:57:15,692 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536633960_0001_00_000001
2016-05-18 01:57:15,692 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536633960_0001_00_000001
2016-05-18 01:57:15,697 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:15,703 INFO  orderedgrouped.MergeManager (MergeManager.java:getInitialMemoryRequirement(339)) - Initial Memory required for SHUFFLE_BUFFER=211392912 based on INPUT_BUFFER_FACTOR=0.9,  for final merged output=0, using factor: 0.0
2016-05-18 01:57:15,710 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536633960_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:15,711 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536633960_0001_00_000001 completed successfully
2016-05-18 01:57:15,719 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B87CC61E6303457193750A4E1A39C901, ordinal: 1
2016-05-18 01:57:15,719 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B87CC61E6303457193750A4E1A39C901, mem on start (mb), free: 91, total: 281, max: 672
2016-05-18 01:57:15,719 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:15,720 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:15,720 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:15,731 INFO  output.MROutput (MROutput.java:initialize(421)) - AB2D2DADEDAF4B7A8382677F807A2A61: outputFormat=org.apache.hadoop.mapred.TextOutputFormat, using newmapreduce API=false
2016-05-18 01:57:15,731 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:15,731 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[AB2D2DADEDAF4B7A8382677F807A2A61:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput], [A6516E103DAA40AD9F004A34EEC43821:INPUT:211392912:org.apache.tez.runtime.library.input.OrderedGroupedKVInput]
2016-05-18 01:57:15,731 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:15,732 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:15,732 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 211392912, TotalRequestedScaled: 1.9513191876923078E8, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.30
2016-05-18 01:57:15,732 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[AB2D2DADEDAF4B7A8382677F807A2A61:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0], [A6516E103DAA40AD9F004A34EEC43821:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:211392912:211392912]
2016-05-18 01:57:15,732 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:15,732 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: A6516E103DAA40AD9F004A34EEC43821 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:15,733 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:15,733 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:15,734 INFO  orderedgrouped.Shuffle (Shuffle.java:<init>(147)) - A6516E103DAA40AD9F004A34EEC43821: Shuffle assigned with 1 inputs, codec: None, ifileReadAhead: true
2016-05-18 01:57:15,736 INFO  orderedgrouped.MergeManager (MergeManager.java:<init>(273)) - A6516E103DAA40AD9F004A34EEC43821: MergerManager: memoryLimit=211392912, maxSingleShuffleLimit=52848228, mergeThreshold=190253616, ioSortFactor=100, postMergeMem=0, memToMemMergeOutputsThreshold=100
2016-05-18 01:57:15,753 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:<init>(353)) - ShuffleScheduler running for sourceVertex: A6516E103DAA40AD9F004A34EEC43821 with configuration: maxFetchFailuresBeforeReporting=5, reportReadErrorImmediately=true, maxFailedUniqueFetches=1, abortFailureLimit=15, maxTaskOutputAtOnce=20, numFetchers=1, hostFailureFraction=0.2, minFailurePerHost=4, maxAllowedFailedFetchFraction=0.5, maxStallTimeFraction=0.5, minReqProgressFraction=0.5, checkFailedFetchSinceLastCompletion=true
2016-05-18 01:57:15,757 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: A6516E103DAA40AD9F004A34EEC43821
2016-05-18 01:57:15,757 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:15,758 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536633960_0001_1_01_000000_0
2016-05-18 01:57:15,765 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: GroupBy(test)[by:[{1}:'method']]
2016-05-18 01:57:15,775 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - A6516E103DAA40AD9F004A34EEC43821: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0
2016-05-18 01:57:15,781 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: GroupBy(test)[by:[{1}:'method']] streamed: true, id: 2CA7DF31A4D04FC6B77FED90DA088FF8
2016-05-18 01:57:15,782 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/NONE/STRICT"], id: AB2D2DADEDAF4B7A8382677F807A2A61
2016-05-18 01:57:15,782 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/NONE/STRICT"]
2016-05-18 01:57:15,783 INFO  element.TezGroupGate (TezGroupGate.java:prepare(90)) - calling OrderedGroupedKVInput#start() on: GroupBy(test)[by:[{1}:'method']] 2CA7DF31A4D04FC6B77FED90DA088FF8, for 1 inputs
2016-05-18 01:57:15,785 INFO  orderedgrouped.ShuffleScheduler (ShuffleUtils.java:logIndividualFetchComplete(489)) - Completed fetch for attempt: {0, 0, attempt_1463536633960_0001_1_00_000000_0_10003} to DISK_DIRECT, csize=653, dsize=649, EndTime=1463536635785, TimeTaken=9, Rate=0.07 MB/s
2016-05-18 01:57:15,786 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:copySucceeded(551)) - All inputs fetched for input vertex : A6516E103DAA40AD9F004A34EEC43821
2016-05-18 01:57:15,786 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:15,787 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:callInternal(1289)) - Shutting down FetchScheduler for input: A6516E103DAA40AD9F004A34EEC43821, wasInterrupted=false
2016-05-18 01:57:15,788 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:onSuccess(1328)) - A6516E103DAA40AD9F004A34EEC43821: Already shutdown. Ignoring fetch complete
2016-05-18 01:57:15,788 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:15,789 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1005)) - finalMerge called with 0 in-memory map-outputs and 1 on-disk map-outputs
2016-05-18 01:57:15,790 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1103)) - Disk file=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/35B88F07641D45A0AE666B09C659E177/DAB05B713B9A40F781CEC38316FF5E8E/.tez/application_1463536633960_0001_wd/localmode-local-dir/output/attempt_1463536633960_0001_1_00_000000_0_10003/file.out, len=653, isLocal=true
2016-05-18 01:57:15,791 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1115)) - Merging 1 files, 653 bytes from disk
2016-05-18 01:57:15,792 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1130)) - Merging 0 segments, 0 bytes from memory into reduce
2016-05-18 01:57:15,796 INFO  impl.TezMerger (TezMerger.java:merge(644)) - Merging 1 sorted segments
2016-05-18 01:57:15,799 INFO  impl.TezMerger (TezMerger.java:merge(749)) - Down to the last merge-pass, with 1 segments left of total size: 633 bytes
2016-05-18 01:57:15,800 INFO  orderedgrouped.Shuffle (Shuffle.java:callInternal(332)) - merge complete for input vertex : A6516E103DAA40AD9F004A34EEC43821
2016-05-18 01:57:15,800 INFO  orderedgrouped.Shuffle (Shuffle.java:onSuccess(417)) - A6516E103DAA40AD9F004A34EEC43821: Shuffle Runner thread complete
2016-05-18 01:57:15,801 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B87CC61E6303457193750A4E1A39C901, all 1 inputs ready in: 00:00:00.016
2016-05-18 01:57:15,803 INFO  input.OrderedGroupedKVInput (OrderedGroupedKVInput.java:createValuesIterator(292)) - A6516E103DAA40AD9F004A34EEC43821: creating ValuesIterator with comparator=cascading.tuple.hadoop.util.TupleComparator, keyClass=cascading.tuple.io.KeyTuple, valClass=cascading.tuple.io.ValueTuple
2016-05-18 01:57:15,814 INFO  output.MROutput (MROutput.java:close(526)) - AB2D2DADEDAF4B7A8382677F807A2A61 closed
2016-05-18 01:57:15,815 INFO  impl.TaskImpl (TaskImpl.java:canCommit(671)) - attempt_1463536633960_0001_1_01_000000_0 given a go for committing the task output.
2016-05-18 01:57:15,817 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536633960_0001_1_01_000000_0
2016-05-18 01:57:15,818 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B87CC61E6303457193750A4E1A39C901, mem on close (mb), free: 84, total: 281, max: 672
2016-05-18 01:57:15,818 INFO  orderedgrouped.Shuffle (Shuffle.java:shutdown(278)) - Shutting down Shuffle for source: A6516E103DAA40AD9F004A34EEC43821
2016-05-18 01:57:15,818 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - A6516E103DAA40AD9F004A34EEC43821: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0, updateOnClose
2016-05-18 01:57:15,819 INFO  output.MROutput (MROutput.java:close(526)) - AB2D2DADEDAF4B7A8382677F807A2A61 closed
2016-05-18 01:57:15,819 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:15 Completed running task attempt: attempt_1463536633960_0001_1_01_000000_0
2016-05-18 01:57:15,821 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536633960_0001_1_01_000000_0, askedToStop=false
2016-05-18 01:57:15,821 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536633960_0001_1_01_000000_0, stopRequested=false
2016-05-18 01:57:15,823 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536633960_0001_1_01_000000_0: Counters: 36 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=53, MERGE_PHASE_TIME=66, FIRST_EVENT_RECEIVED=40, LAST_EVENT_RECEIVED=40][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][cascading.flow.SliceCounters Process_Begin_Time=1463536635801, Process_Duration=16, Process_End_Time=1463536635817, Read_Duration=1, Tuples_Read=7, Tuples_Written=1, Write_Duration=1][cascading.flow.StepCounters Tuples_Written=1]]
2016-05-18 01:57:15,825 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536633960_0001_1_01_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:15,825 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B87CC61E6303457193750A4E1A39C901, taskAttemptId=attempt_1463536633960_0001_1_01_000000_0, creationTime=1463536635677, allocationTime=1463536635678, startTime=1463536635680, finishTime=1463536635825, timeTaken=145, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:15,825 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:15,826 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:15,826 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:15,826 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536633960_0001_1_01_000000_0
2016-05-18 01:57:15,828 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536633960_0001_00_000002
2016-05-18 01:57:15,830 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:TASK_FINISHED]: vertexName=B87CC61E6303457193750A4E1A39C901, taskId=task_1463536633960_0001_1_01_000000, startTime=1463536635680, finishTime=1463536635827, timeTaken=147, status=SUCCEEDED, successfulAttemptID=attempt_1463536633960_0001_1_01_000000_0, diagnostics=, counters=Counters: 36, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=53, MERGE_PHASE_TIME=66, FIRST_EVENT_RECEIVED=40, LAST_EVENT_RECEIVED=40, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536635801, Process_Duration=16, Process_End_Time=1463536635817, Read_Duration=1, Tuples_Read=7, Tuples_Written=1, Write_Duration=1, cascading.flow.StepCounters, Tuples_Written=1
2016-05-18 01:57:15,830 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:15,830 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901]
2016-05-18 01:57:15,835 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:VERTEX_FINISHED]: vertexName=B87CC61E6303457193750A4E1A39C901, vertexId=vertex_1463536633960_0001_1_01, initRequestedTime=1463536634954, initedTime=1463536635019, startRequestedTime=1463536635067, startedTime=1463536635068, finishTime=1463536635831, timeTaken=763, status=SUCCEEDED, diagnostics=, counters=Counters: 36, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=53, MERGE_PHASE_TIME=66, FIRST_EVENT_RECEIVED=40, LAST_EVENT_RECEIVED=40, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536635801, Process_Duration=16, Process_End_Time=1463536635817, Read_Duration=1, Tuples_Read=7, Tuples_Written=1, Write_Duration=1, cascading.flow.StepCounters, Tuples_Written=1, vertexStats=firstTaskStartTime=1463536635680, firstTasksToStart=[ task_1463536633960_0001_1_01_000000 ], lastTaskFinishTime=1463536635825, lastTasksToFinish=[ task_1463536633960_0001_1_01_000000 ], minTaskDuration=145, maxTaskDuration=145, avgTaskDuration=145.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536633960_0001_1_01_000000 ], longestDurationTasks=[ task_1463536633960_0001_1_01_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:15,835 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:15,835 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536633960_0001_00_000002, stoppedTime=1463536635835, exitStatus=0
2016-05-18 01:57:15,835 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901] completed., numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:15,836 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:15,837 INFO  impl.DAGImpl (DAGImpl.java:commitOrFinish(1051)) - No output committers for vertex: vertex_1463536633960_0001_1_00 [A6516E103DAA40AD9F004A34EEC43821]
2016-05-18 01:57:15,838 INFO  impl.DAGImpl (DAGImpl.java:commitOrFinish(1098)) - Start writing dag commit event, dag_1463536633960_0001_1
2016-05-18 01:57:15,839 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536633960_0001_00_000002 is valid, but no longer registered, and will be killed
2016-05-18 01:57:15,842 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463536633960_0001_1
2016-05-18 01:57:15,842 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536633960_0001_00_000002: 14 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:15,842 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536633960_0001_00_000002, Exiting
2016-05-18 01:57:15,842 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536633960_0001_00_000002
2016-05-18 01:57:15,843 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536633960_0001_00_000002
2016-05-18 01:57:15,842 INFO  impl.DAGImpl (DAGImpl.java:call(1083)) - Committing output: AB2D2DADEDAF4B7A8382677F807A2A61 for vertex: vertex_1463536633960_0001_1_01 [B87CC61E6303457193750A4E1A39C901], outputName: AB2D2DADEDAF4B7A8382677F807A2A61
2016-05-18 01:57:15,842 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536633960_0001_1 transitioned from RUNNING to COMMITTING due to event DAG_VERTEX_COMPLETED
2016-05-18 01:57:15,843 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536633960_0001_00_000002 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:15,844 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536633960_0001_00_000002 completed successfully
2016-05-18 01:57:15,845 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(260)) - Ignoring stop request for containerId: container_1463536633960_0001_00_000002
2016-05-18 01:57:15,859 INFO  impl.DAGImpl (DAGImpl.java:commitCompleted(2192)) - Commit succeeded for output:outputName:AB2D2DADEDAF4B7A8382677F807A2A61 of vertex/vertexGroup:B87CC61E6303457193750A4E1A39C901 isVertexGroupOutput:false
2016-05-18 01:57:15,859 INFO  impl.DAGImpl (DAGImpl.java:checkCommitsForCompletion(1313)) - Checking commits for DAG completion, numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:15,866 INFO  recovery.RecoveryService (RecoveryService.java:handle(327)) - DAG completed, dagId=dag_1463536633960_0001_1, queueSize=0
2016-05-18 01:57:15,870 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536633960_0001_1][Event:DAG_FINISHED]: dagId=dag_1463536633960_0001_1, startTime=1463536634914, finishTime=1463536635859, timeTaken=945, status=SUCCEEDED, diagnostics=, counters=Counters: 48, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=2, TOTAL_LAUNCHED_TASKS=2, RACK_LOCAL_TASKS=1, AM_CPU_MILLISECONDS=2270, AM_GC_TIME_MILLIS=0, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=14, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=8, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=53, MERGE_PHASE_TIME=66, FIRST_EVENT_RECEIVED=40, LAST_EVENT_RECEIVED=40, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=2927073271362, Process_Duration=25, Process_End_Time=2927073271387, Read_Duration=3, Tuples_Read=17, Tuples_Written=8, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=10, Tuples_Written=1
2016-05-18 01:57:15,871 INFO  impl.DAGImpl (DAGImpl.java:finished(1405)) - DAG: dag_1463536633960_0001_1 finished with state: SUCCEEDED
2016-05-18 01:57:15,871 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536633960_0001_1 transitioned from COMMITTING to SUCCEEDED due to event DAG_COMMIT_COMPLETED
2016-05-18 01:57:15 Completed Dag: dag_1463536633960_0001_1
2016-05-18 01:57:15,872 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(751)) - DAG completed, dagId=dag_1463536633960_0001_1, dagState=SUCCEEDED
2016-05-18 01:57:15,872 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536633960_0001_1_post
2016-05-18 01:57:15,872 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:15,873 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(800)) - Central Dispatcher queue size after DAG completion, before cleanup: 0
2016-05-18 01:57:15,874 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(802)) - Waiting for next DAG to be submitted.
2016-05-18 01:57:15,874 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(842)) - Cleaning up DAG: name=[35B88F07641D45A0AE666B09C659E177/DAB05B713B9A40F781CEC38316FF5E8E] test/(1/1) ...Removal/value/NONE/STRICT, with id=dag_1463536633960_0001_1
2016-05-18 01:57:15,878 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(852)) - Completed cleanup for DAG: name=[35B88F07641D45A0AE666B09C659E177/DAB05B713B9A40F781CEC38316FF5E8E] test/(1/1) ...Removal/value/NONE/STRICT, with id=dag_1463536633960_0001_1
2016-05-18 01:57:15,885 INFO  client.TezClient (TezClient.java:stop(566)) - Shutting down Tez Session, sessionName=(1/1) ...Removal/value/NONE/STRICT, applicationId=application_1463536633960_0001
2016-05-18 01:57:15,889 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(124)) - Received message to shutdown AM
2016-05-18 01:57:15,889 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:setShouldUnregisterFlag(895)) - TaskScheduler notified that it should unregister from RM
2016-05-18 01:57:15,889 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1301)) - No current running DAG, shutting down the AM
2016-05-18 01:57:15,889 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(907)) - DAGAppMasterShutdownHandler invoked
2016-05-18 01:57:15,889 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(916)) - Handling DAGAppMaster shutdown
2016-05-18 01:57:15,890 INFO  app.DAGAppMaster (DAGAppMaster.java:run(936)) - Sleeping for 5 seconds before shutting down
2016-05-18 01:57:15,893 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(84)) - Stopping HistoryEventHandler
2016-05-18 01:57:15,893 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(196)) - Stopping RecoveryService
2016-05-18 01:57:15,893 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(199)) - Handle the remaining events in queue, queue size=0
2016-05-18 01:57:15,893 INFO  recovery.RecoveryService (RecoveryService.java:run(173)) - EventQueue take interrupted. Returning
2016-05-18 01:57:15,893 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(221)) - Closing Summary Stream
2016-05-18 01:57:15,894 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-18 01:57:15,894 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-18 01:57:15,895 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:serviceStop(678)) - Shutting down AppCallbackExecutor
2016-05-18 01:57:15,900 INFO  app.DAGAppMaster (DAGAppMaster.java:run(2084)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/35B88F07641D45A0AE666B09C659E177/DAB05B713B9A40F781CEC38316FF5E8E/.tez/application_1463536633960_0001
2016-05-18 01:57:15,902 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/NONE/STRICT/_temporary
2016-05-18 01:57:15,903 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  completed in: 00:02.169
2016-05-18 01:57:16,027 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 01:57:16,028 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-18 01:57:16,173 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.041
2016-05-18 01:57:16,204 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.071
2016-05-18 01:57:16,205 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:16,205 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:16,206 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 01:57:16,229 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt
2016-05-18 01:57:16,249 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/VALID/STRICT
2016-05-18 01:57:16,338 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting
2016-05-18 01:57:16,339 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:16,339 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  sink: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/VALID/STRICT"]
2016-05-18 01:57:16,340 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  parallel execution of steps is enabled: false
2016-05-18 01:57:16,340 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  executing total steps: 1
2016-05-18 01:57:16,341 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  allocating management threads: 1
2016-05-18 01:57:16,342 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting step: (1/1) ...emoval/value/VALID/STRICT
2016-05-18 01:57:16,342 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [test] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-18 01:57:16,363 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tez session mode enabled: true
2016-05-18 01:57:16,368 INFO  client.TezClient (TezClient.java:<init>(174)) - Tez Client Version: [ component=tez-api, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:16,369 INFO  client.TezClient (TezClient.java:start(394)) - Session mode. Starting session.
2016-05-18 01:57:16,369 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(164)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-18 01:57:16,380 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(122)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/49E2A0E4F1AD4B2AB2BCCEB0519336B0/C9FBBBD0C02C474EB5FE54A5CAEFB8B6/.tez/application_1463536636368_0001 doesn't exist and is created
2016-05-18 01:57:16,408 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(332)) - DAGAppMaster thread has been created
2016-05-18 01:57:16,409 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-18 01:57:16,411 INFO  client.LocalClient (LocalClient.java:run(282)) - Using working directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/49E2A0E4F1AD4B2AB2BCCEB0519336B0/C9FBBBD0C02C474EB5FE54A5CAEFB8B6/.tez/application_1463536636368_0001_wd
2016-05-18 01:57:16,429 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(363)) - Created DAGAppMaster for application appattempt_1463536636368_0001_000000, versionInfo=[ component=tez-dag, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:16,429 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(80)) - Trying to locate HadoopShimProvider for hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:16,429 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(139)) - Picked HadoopShim org.apache.tez.hadoop.shim.DefaultHadoopShim, providerName=null, overrideProviderViaConfig=null, hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:16,433 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(436)) - AM Level configured TaskSchedulers: [0:TezUber:null]
2016-05-18 01:57:16,433 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(437)) - AM Level configured ContainerLaunchers: [0:TezUber:null]
2016-05-18 01:57:16,434 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(438)) - AM Level configured TaskCommunicators: [0:TezUber:null]
2016-05-18 01:57:16,434 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(447)) - Comparing client version with AM version, clientVersion=0.8.2, AMVersion=0.8.2
2016-05-18 01:57:16,435 INFO  app.TaskCommunicatorManager (TaskCommunicatorManager.java:createUberTaskCommunicator(192)) - Creating Default Local Task Communicator
2016-05-18 01:57:16,439 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.container.AMContainerEventType for class org.apache.tez.dag.app.rm.container.AMContainerMap
2016-05-18 01:57:16,440 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.node.AMNodeEventType for class org.apache.tez.dag.app.rm.node.AMNodeTracker
2016-05-18 01:57:16,440 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGAppMasterEventType for class org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterEventHandler
2016-05-18 01:57:16,440 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGEventType for class org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher
2016-05-18 01:57:16,441 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.VertexEventType for class org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher
2016-05-18 01:57:16,441 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(529)) - Using concurrent dispatcher: false
2016-05-18 01:57:16,442 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher
2016-05-18 01:57:16,442 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskAttemptEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher
2016-05-18 01:57:16,442 INFO  common.AsyncDispatcher (AsyncDispatcher.java:registerAndCreateDispatcher(262)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for independent dispatch using: class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:16,443 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:16,443 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.AMSchedulerEventType for class org.apache.tez.dag.app.rm.TaskSchedulerManager
2016-05-18 01:57:16,443 INFO  launcher.TezContainerLauncherImpl (ContainerLauncherManager.java:createUberContainerLauncher(134)) - Creating LocalContainerLauncher
2016-05-18 01:57:16,447 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.ContainerLauncherEventType for class org.apache.tez.dag.app.launcher.ContainerLauncherManager
2016-05-18 01:57:16,448 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(78)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1, nodeUpdatesRescheduleEnabled: false
2016-05-18 01:57:16,448 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(57)) - Initializing HistoryEventHandler withrecoveryEnabled=true, historyServiceClassName=org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService
2016-05-18 01:57:16,449 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/49E2A0E4F1AD4B2AB2BCCEB0519336B0/C9FBBBD0C02C474EB5FE54A5CAEFB8B6/.tez/application_1463536636368_0001_wd/localmode-log-dir
2016-05-18 01:57:16,449 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/49E2A0E4F1AD4B2AB2BCCEB0519336B0/C9FBBBD0C02C474EB5FE54A5CAEFB8B6/.tez/application_1463536636368_0001_wd/localmode-log-dir/history.txt.appattempt_1463536636368_0001_000000, maxErrors=10
2016-05-18 01:57:16,450 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(124)) - RecoveryService initialized with recoveryPath=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/49E2A0E4F1AD4B2AB2BCCEB0519336B0/C9FBBBD0C02C474EB5FE54A5CAEFB8B6/.tez/application_1463536636368_0001/recovery/0, bufferSize(bytes)=8192, flushInterval(s)=30, maxUnflushedEvents=100
2016-05-18 01:57:16,450 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463536636368_0001_000000, appSubmitTime=1463536636428, launchTime=1463536636429
2016-05-18 01:57:16,459 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-18 01:57:16,464 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:38507
2016-05-18 01:57:16,465 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:createUberTaskScheduler(557)) - Creating TaskScheduler: Local TaskScheduler with clusterIdentifier=1463536636368
2016-05-18 01:57:16,470 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463536636368_0001_000000, startTime=1463536636470
2016-05-18 01:57:16,470 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1945)) - In Session mode. Waiting for DAG over RPC
2016-05-18 01:57:16,509 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-18 01:57:16,509 INFO  client.TezClient (TezClient.java:start(428)) - The url to track the Tez Session: N/A
2016-05-18 01:57:16,510 INFO  client.TezClient (TezClient.java:submitDAGSession(470)) - Submitting dag to TezSession, sessionName=(1/1) ...emoval/value/VALID/STRICT, applicationId=application_1463536636368_0001, dagName=[49E2A0E4F1AD4B2AB2BCCEB0519336B0/C9FBBBD0C02C474EB5FE54A5CAEFB8B6] test/(1/1) ...emoval/value/VALID/STRICT
2016-05-18 01:57:16,536 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1351)) - Starting DAG submitted via RPC: [49E2A0E4F1AD4B2AB2BCCEB0519336B0/C9FBBBD0C02C474EB5FE54A5CAEFB8B6] test/(1/1) ...emoval/value/VALID/STRICT
2016-05-18 01:57:16,536 INFO  app.DAGAppMaster (DAGAppMaster.java:createDAG(985)) - Merging AM credentials into DAG credentials
2016-05-18 01:57:16,538 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(1076)) - Generating DAG graphviz file, dagId=dag_1463536636368_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/49E2A0E4F1AD4B2AB2BCCEB0519336B0/C9FBBBD0C02C474EB5FE54A5CAEFB8B6/.tez/application_1463536636368_0001_wd/localmode-log-dir/dag_1463536636368_0001_1.dot
2016-05-18 01:57:16,539 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(1093)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/49E2A0E4F1AD4B2AB2BCCEB0519336B0/C9FBBBD0C02C474EB5FE54A5CAEFB8B6/.tez/application_1463536636368_0001_wd/localmode-log-dir/dag_1463536636368_0001_1-tez-dag.pb.txt
2016-05-18 01:57:16,548 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536636368_0001_1
2016-05-18 01:57:16,549 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:16,549 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2399)) - Running DAG: [49E2A0E4F1AD4B2AB2BCCEB0519336B0/C9FBBBD0C02C474EB5FE54A5CAEFB8B6] test/(1/1) ...emoval/value/VALID/STRICT
2016-05-18 01:57:16 Running Dag: dag_1463536636368_0001_1
2016-05-18 01:57:16,564 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463536636368_0001_1, submitTime=1463536636536
2016-05-18 01:57:16,566 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/49E2A0E4F1AD4B2AB2BCCEB0519336B0/C9FBBBD0C02C474EB5FE54A5CAEFB8B6/.tez/application_1463536636368_0001/tez-conf.pb" } size: 40985 timestamp: 1463536636000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:16,566 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalInputs(3978)) - Setting 1 additional inputs for vertexvertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290]
2016-05-18 01:57:16,567 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:16,569 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/49E2A0E4F1AD4B2AB2BCCEB0519336B0/C9FBBBD0C02C474EB5FE54A5CAEFB8B6/.tez/application_1463536636368_0001/tez-conf.pb" } size: 40985 timestamp: 1463536636000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:16,569 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4023)) - Setting 1 additional outputs for vertex vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA]
2016-05-18 01:57:16,570 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:16,570 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1593)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-18 01:57:16,570 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463536636368_0001_1, initTime=1463536636570
2016-05-18 01:57:16,574 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536636368_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-18 01:57:16,575 INFO  impl.DAGImpl (DAGImpl.java:transition(1768)) - Added additional resources : [[]] to classpath
2016-05-18 01:57:16,575 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:DAG_STARTED]: dagID=dag_1463536636368_0001_1, startTime=1463536636575
2016-05-18 01:57:16,576 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536636368_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-18 01:57:16,576 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2400)) - Root Inputs exist for Vertex: AD57B2EB202B49C8B0604BD6D5530290 : {AAA1DD2CEB5E4CF880D37BB85AE35755={InputName=AAA1DD2CEB5E4CF880D37BB85AE35755}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-18 01:57:16,576 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2410)) - Starting root input initializer for input: AAA1DD2CEB5E4CF880D37BB85AE35755, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-18 01:57:16,576 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2550)) - Setting vertexManager to RootInputVertexManager for vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290]
2016-05-18 01:57:16,576 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2721)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290]
2016-05-18 01:57:16,576 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2726)) - Vertex will initialize from input initializer. vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290]
2016-05-18 01:57:16,577 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3893)) - Starting 1 inputInitializers for vertex vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290]
2016-05-18 01:57:16,577 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-18 01:57:16,577 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(272)) - Starting InputInitializer for Input: AAA1DD2CEB5E4CF880D37BB85AE35755 on vertex vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290]
2016-05-18 01:57:16,578 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2562)) - Setting vertexManager to ShuffleVertexManager for vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA]
2016-05-18 01:57:16,581 INFO  client.TezClient (TezClient.java:submitDAGSession(545)) - Submitted dag to TezSession, sessionName=(1/1) ...emoval/value/VALID/STRICT, applicationId=application_1463536636368_0001, dagName=[49E2A0E4F1AD4B2AB2BCCEB0519336B0/C9FBBBD0C02C474EB5FE54A5CAEFB8B6] test/(1/1) ...emoval/value/VALID/STRICT
2016-05-18 01:57:16,581 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(109)) - Input AAA1DD2CEB5E4CF880D37BB85AE35755 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7, groupingEnabled: true
2016-05-18 01:57:16,587 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(168)) - Grouping splits in Tez
2016-05-18 01:57:16,587 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(226)) - Desired splits: 1 too large.  Desired splitLength: 1449 Min splitLength: 52428800 New desired splits: 1 Total length: 1449 Original splits: 2
2016-05-18 01:57:16,587 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(321)) - Desired numSplits: 1 lengthPerGroup: 1449 numLocations: 1 numSplitsPerLocation: 2 numSplitsInGroup: 2 totalLength: 1449 numOriginalSplits: 2 . Grouping by length: true count: false nodeLocalOnly: false
2016-05-18 01:57:16,588 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(539)) - Number of splits desired: 1 created: 1 splitsProcessed: 2
2016-05-18 01:57:16,589 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(308)) - Succeeded InputInitializer for Input: AAA1DD2CEB5E4CF880D37BB85AE35755 on vertex vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290]
2016-05-18 01:57:16,590 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:initialize(1022)) - Shuffle Vertex Manager: settings minFrac:0.25 maxFrac:0.75 auto:false desiredTaskIput:104857600 minTasks:1
2016-05-18 01:57:16,590 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2760)) - Creating 1 tasks for vertex: vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA]
2016-05-18 01:57:16,591 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2779)) - Directly initializing vertex: vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA]
2016-05-18 01:57:16,594 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536636368_0001_1_01, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=null, edgeManagersCount=1, rootInputSpecUpdateCount=0, setParallelismCalledFlag=false
2016-05-18 01:57:16,594 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2187)) - Setting up committers for vertex vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA], numAdditionalOutputs=1
2016-05-18 01:57:16,595 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2202)) - Instantiating committer for output=5D1D0B7D730240F8BD152869557B0AF6, vertex=vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-18 01:57:16,598 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(121)) - Committer for A1707CA1F04C45F8817A057FD4DCE4DA:5D1D0B7D730240F8BD152869557B0AF6 using oldmapred API
2016-05-18 01:57:16,598 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(146)) - OutputCommitter for outputName=5D1D0B7D730240F8BD152869557B0AF6, vertexName=A1707CA1F04C45F8817A057FD4DCE4DA, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-18 01:57:16,599 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:VERTEX_INITIALIZED]: vertexName=A1707CA1F04C45F8817A057FD4DCE4DA, vertexId=vertex_1463536636368_0001_1_01, initRequestedTime=1463536636578, initedTime=1463536636594, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=0, initGeneratedEventsCount=0
2016-05-18 01:57:16,600 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA] transitioned from NEW to INITED due to event V_INIT
2016-05-18 01:57:16,601 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:16,601 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1644)) - Got updated RootInputsSpecs: {AAA1DD2CEB5E4CF880D37BB85AE35755=forAllWorkUnits=true, update=[1]}
2016-05-18 01:57:16,602 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1664)) - Vertex vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290] parallelism set to 1
2016-05-18 01:57:16,602 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:16,605 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:VERTEX_INITIALIZED]: vertexName=AD57B2EB202B49C8B0604BD6D5530290, vertexId=vertex_1463536636368_0001_1_00, initRequestedTime=1463536636576, initedTime=1463536636603, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1, initGeneratedEventsCount=1
2016-05-18 01:57:16,605 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290] with distanceFromRoot: 0
2016-05-18 01:57:16,605 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290] transitioned from INITIALIZING to INITED due to event V_INPUT_DATA_INFORMATION
2016-05-18 01:57:16,606 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536636368_0001_1_00, startRequestedTime=1463536636578, startedTime=1463536636605
2016-05-18 01:57:16,606 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536636368_0001_1_00, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=org.apache.tez.dag.api.VertexLocationHint@b8338fe7, edgeManagersCount=0, rootInputSpecUpdateCount=1, setParallelismCalledFlag=true
2016-05-18 01:57:16,607 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:16,607 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(100)) - Starting 1 in AD57B2EB202B49C8B0604BD6D5530290
2016-05-18 01:57:16,607 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290]
2016-05-18 01:57:16,607 INFO  impl.VertexImpl (VertexImpl.java:transition(2932)) - Source vertex started: vertex_1463536636368_0001_1_00 for vertex: vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA] numStartedSources: 1 numSources: 1
2016-05-18 01:57:16,608 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA] with distanceFromRoot: 1
2016-05-18 01:57:16,608 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] submitted tez dag to app master: application_1463536636368_0001, with dag id: dag_1463536636368_0001_1
2016-05-18 01:57:16,609 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536636368_0001_1_01, startRequestedTime=1463536636607, startedTime=1463536636608
2016-05-18 01:57:16,609 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:16,610 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:TASK_STARTED]: vertexName=AD57B2EB202B49C8B0604BD6D5530290, taskId=task_1463536636368_0001_1_00_000000, scheduledTime=1463536636610, launchTime=1463536636610
2016-05-18 01:57:16,611 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290]
2016-05-18 01:57:16,613 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:onVertexStarted(519)) - OnVertexStarted vertex: A1707CA1F04C45F8817A057FD4DCE4DA with 0 source tasks and 1 pending tasks
2016-05-18 01:57:16,614 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:handleVertexStateUpdate(1051)) - Received configured notification : CONFIGURED for vertex: AD57B2EB202B49C8B0604BD6D5530290 in vertex: A1707CA1F04C45F8817A057FD4DCE4DA numBipartiteSourceTasks: 1
2016-05-18 01:57:16,615 INFO  node.PerSourceNodeTracker (PerSourceNodeTracker.java:nodeSeen(74)) - Adding new node 127.0.0.1:0 to nodeTracker 0
2016-05-18 01:57:16,618 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536636368_0001_00_000001, launchTime=1463536636617
2016-05-18 01:57:16,619 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536636368_0001_00_000001
2016-05-18 01:57:16,620 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536636368_0001_1_00_000000_0] started. Is using containerId: [container_1463536636368_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-18 01:57:16,621 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=AD57B2EB202B49C8B0604BD6D5530290, taskAttemptId=attempt_1463536636368_0001_1_00_000000_0, startTime=1463536636620, containerId=container_1463536636368_0001_00_000001, nodeId=127.0.0.1:0
2016-05-18 01:57:16,622 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536636368_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536636368_0001_1_00_000000_0
2016-05-18 01:57:16 Starting to run new task attempt: attempt_1463536636368_0001_1_00_000000_0
2016-05-18 01:57:16,624 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536636368_0001_1_00_000000_0
2016-05-18 01:57:16,624 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:16,624 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:16,624 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [49E2A0E4F1AD4B2AB2BCCEB0519336B0/C9FBBBD0C02C474EB5FE54A5CAEFB8B6] test/(1/1) ...emoval/value/VALID/STRICT, VertexName: AD57B2EB202B49C8B0604BD6D5530290, VertexParallelism: 1, TaskAttemptID:attempt_1463536636368_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=AAA1DD2CEB5E4CF880D37BB85AE35755, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=A1707CA1F04C45F8817A057FD4DCE4DA, physicalEdgeCount=1, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ]
2016-05-18 01:57:16,624 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:16,626 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536636368_0001_1_00_000000_0
2016-05-18 01:57:16,626 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(496)) - TaskAttempt:attempt_1463536636368_0001_1_00_000000_0 sent events: (0-1).
2016-05-18 01:57:16,626 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536636368_0001_1_00_000000_0, eventCount=1 fromEventId=0 nextFromEventId=0
2016-05-18 01:57:16,634 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:16,636 INFO  input.MRInput (MRInput.java:initialize(440)) - AAA1DD2CEB5E4CF880D37BB85AE35755 using newmapreduce API=false, split via event=true, numPhysicalInputs=1
2016-05-18 01:57:16,637 INFO  input.MRInput (MRInput.java:initializeInternal(494)) - Initialized MRInput: AAA1DD2CEB5E4CF880D37BB85AE35755
2016-05-18 01:57:16,646 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: AD57B2EB202B49C8B0604BD6D5530290, ordinal: 0
2016-05-18 01:57:16,647 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AD57B2EB202B49C8B0604BD6D5530290, mem on start (mb), free: 84, total: 281, max: 672
2016-05-18 01:57:16,647 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:16,647 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:16,648 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:16,648 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:16,649 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[AAA1DD2CEB5E4CF880D37BB85AE35755:INPUT:0:org.apache.tez.mapreduce.input.MRInput], [A1707CA1F04C45F8817A057FD4DCE4DA:OUTPUT:104857600:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput]
2016-05-18 01:57:16,649 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:16,649 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:16,650 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 104857600, TotalRequestedScaled: 9.679163076923077E7, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.15
2016-05-18 01:57:16,650 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[AAA1DD2CEB5E4CF880D37BB85AE35755:org.apache.tez.mapreduce.input.MRInput:INPUT:0:0], [A1707CA1F04C45F8817A057FD4DCE4DA:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput:OUTPUT:104857600:104857600]
2016-05-18 01:57:16,651 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:16,651 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: AAA1DD2CEB5E4CF880D37BB85AE35755 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:16,651 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:16,651 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: AAA1DD2CEB5E4CF880D37BB85AE35755
2016-05-18 01:57:16,652 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:16,652 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:16,653 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536636368_0001_1_00_000000_0
2016-05-18 01:57:16,654 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(174)) - Processing split: TezGroupedSplit{wrappedSplits=[file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:0+724, file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:724+725], wrappedInputFormatName='org.apache.hadoop.mapred.TextInputFormat', locations=[localhost], rack='null', length=1449}
2016-05-18 01:57:16,654 INFO  input.MRInput (MRInput.java:initFromEventInternal(653)) - AAA1DD2CEB5E4CF880D37BB85AE35755 initialized RecordReader from event
2016-05-18 01:57:16,660 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:16,660 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"] streamed: true, id: AAA1DD2CEB5E4CF880D37BB85AE35755
2016-05-18 01:57:16,661 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: GroupBy(test)[by:[{1}:'method']], id: 5DDE8E50792E4A52809AB6B74AB16DBD
2016-05-18 01:57:16,661 INFO  element.TezGroupGate (TezGroupGate.java:prepare(98)) - calling OrderedPartitionedKVOutput#start() on: GroupBy(test)[by:[{1}:'method']] 5DDE8E50792E4A52809AB6B74AB16DBD
2016-05-18 01:57:16,663 INFO  impl.ExternalSorter (ExternalSorter.java:<init>(199)) - A1707CA1F04C45F8817A057FD4DCE4DA using: memoryMb=100, keySerializerClass=class cascading.tuple.io.KeyTuple, valueSerializerClass=cascading.tuple.hadoop.io.ValueTupleSerializer@6d0433ee, comparator=cascading.tuple.hadoop.util.TupleComparator@2eed862c, partitioner=cascading.tuple.tez.util.TuplePartitioner, serialization=cascading.tuple.hadoop.TupleSerialization,org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
2016-05-18 01:57:16,664 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(170)) - Setting up PipelinedSorter for A1707CA1F04C45F8817A057FD4DCE4DA: , UsingHashComparator=false
2016-05-18 01:57:16,773 INFO  impl.PipelinedSorter (PipelinedSorter.java:allocateSpace(245)) - Newly allocated block size=104857600, index=0, Number of buffers=1, currentAllocatableMemory=0, currentBufferSize=104857600, total=104857600
2016-05-18 01:57:16,773 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(189)) - Pre allocating rest of memory buffers upfront
2016-05-18 01:57:16,773 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(207)) - Setting up PipelinedSorter for A1707CA1F04C45F8817A057FD4DCE4DA: , UsingHashComparator=false#blocks=1, maxMemUsage=104857600, lazyAllocateMem=false, minBlockSize=2097152000, initial BLOCK_SIZE=104857600, finalMergeEnabled=true, pipelinedShuffle=false, sendEmptyPartitions=true, tez.runtime.io.sort.mb=100
2016-05-18 01:57:16,774 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(882)) - A1707CA1F04C45F8817A057FD4DCE4DA: reserved.remaining()=104857600, reserved.metasize=16777216
2016-05-18 01:57:16,774 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:16,775 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: AD57B2EB202B49C8B0604BD6D5530290, all 1 inputs ready in: 00:00:00.000
2016-05-18 01:57:16,779 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536636368_0001_1_00_000000_0
2016-05-18 01:57:16,779 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AD57B2EB202B49C8B0604BD6D5530290, mem on close (mb), free: 81, total: 382, max: 672
2016-05-18 01:57:16,779 INFO  impl.PipelinedSorter (PipelinedSorter.java:flush(629)) - A1707CA1F04C45F8817A057FD4DCE4DA: Starting flush of map output
2016-05-18 01:57:16,780 INFO  impl.PipelinedSorter (PipelinedSorter.java:end(995)) - A1707CA1F04C45F8817A057FD4DCE4DA: Span0.length = 7, perItem = 99
2016-05-18 01:57:16,780 INFO  impl.PipelinedSorter (PipelinedSorter.java:sort(904)) - A1707CA1F04C45F8817A057FD4DCE4DA: done sorting span=0, length=7, time=0
2016-05-18 01:57:16,781 INFO  impl.PipelinedSorter (PipelinedSorter.java:ready(1297)) - A1707CA1F04C45F8817A057FD4DCE4DA: Heap = SpanIterator<0:6> (span=Span[16777216,693]),
2016-05-18 01:57:16,782 INFO  impl.PipelinedSorter (PipelinedSorter.java:spill(546)) - A1707CA1F04C45F8817A057FD4DCE4DA: Spilling to /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/49E2A0E4F1AD4B2AB2BCCEB0519336B0/C9FBBBD0C02C474EB5FE54A5CAEFB8B6/.tez/application_1463536636368_0001_wd/localmode-local-dir/output/attempt_1463536636368_0001_1_00_000000_0_10009_0/file.out
2016-05-18 01:57:16,786 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:16 Completed running task attempt: attempt_1463536636368_0001_1_00_000000_0
2016-05-18 01:57:16,787 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536636368_0001_1_00_000000_0, askedToStop=false
2016-05-18 01:57:16,788 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536636368_0001_1_00_000000_0, stopRequested=false
2016-05-18 01:57:16,788 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536636368_0001_1_00_000000_0: Counters: 18 [[org.apache.tez.common.counters.TaskCounter SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1][cascading.flow.SliceCounters Process_Begin_Time=1463536636775, Process_Duration=4, Process_End_Time=1463536636779, Read_Duration=3, Tuples_Read=10, Tuples_Written=7, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=10]]
2016-05-18 01:57:16,790 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536636368_0001_1_00_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:16,790 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:16,791 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:16,791 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:16,791 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=AD57B2EB202B49C8B0604BD6D5530290, taskAttemptId=attempt_1463536636368_0001_1_00_000000_0, creationTime=1463536636611, allocationTime=1463536636617, startTime=1463536636620, finishTime=1463536636790, timeTaken=170, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:16,793 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536636368_0001_1_00_000000_0
2016-05-18 01:57:16,794 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:TASK_FINISHED]: vertexName=AD57B2EB202B49C8B0604BD6D5530290, taskId=task_1463536636368_0001_1_00_000000, startTime=1463536636620, finishTime=1463536636794, timeTaken=174, status=SUCCEEDED, successfulAttemptID=attempt_1463536636368_0001_1_00_000000_0, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536636775, Process_Duration=4, Process_End_Time=1463536636779, Read_Duration=3, Tuples_Read=10, Tuples_Written=7, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10
2016-05-18 01:57:16,795 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:16,795 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290]
2016-05-18 01:57:16,794 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536636368_0001_00_000001
2016-05-18 01:57:16,798 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:VERTEX_FINISHED]: vertexName=AD57B2EB202B49C8B0604BD6D5530290, vertexId=vertex_1463536636368_0001_1_00, initRequestedTime=1463536636576, initedTime=1463536636603, startRequestedTime=1463536636578, startedTime=1463536636605, finishTime=1463536636796, timeTaken=191, status=SUCCEEDED, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536636775, Process_Duration=4, Process_End_Time=1463536636779, Read_Duration=3, Tuples_Read=10, Tuples_Written=7, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10, vertexStats=firstTaskStartTime=1463536636620, firstTasksToStart=[ task_1463536636368_0001_1_00_000000 ], lastTaskFinishTime=1463536636790, lastTasksToFinish=[ task_1463536636368_0001_1_00_000000 ], minTaskDuration=170, maxTaskDuration=170, avgTaskDuration=170.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536636368_0001_1_00_000000 ], longestDurationTasks=[ task_1463536636368_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:16,798 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:16,799 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536636368_0001_00_000001, stoppedTime=1463536636799, exitStatus=0
2016-05-18 01:57:16,799 INFO  impl.VertexImpl (VertexImpl.java:transition(3279)) - Source task attempt completed for vertex: vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA] attempt: attempt_1463536636368_0001_1_00_000000_0 with state: SUCCEEDED vertexState: RUNNING
2016-05-18 01:57:16,800 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:16,800 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:schedulePendingTasks(920)) - All source tasks assigned. Ramping up 1 remaining tasks for vertex: A1707CA1F04C45F8817A057FD4DCE4DA
2016-05-18 01:57:16,800 INFO  impl.Edge (Edge.java:routingToBegin(232)) - Routing to begin for edge: EdgeInfo: sourceVertexName=AD57B2EB202B49C8B0604BD6D5530290, destinationVertexName=A1707CA1F04C45F8817A057FD4DCE4DA. EdgeProperty: { SCATTER_GATHER : org.apache.tez.runtime.library.input.OrderedGroupedKVInput >> PERSISTED >> org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput >> NullEdgeManager } onDemandRouting: true
2016-05-18 01:57:16,801 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA]
2016-05-18 01:57:16,800 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:16,801 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(262)) - Ignoring stop request for containerId container_1463536636368_0001_00_000001. Relying on regular task shutdown for it to end
2016-05-18 01:57:16,802 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:TASK_STARTED]: vertexName=A1707CA1F04C45F8817A057FD4DCE4DA, taskId=task_1463536636368_0001_1_01_000000, scheduledTime=1463536636801, launchTime=1463536636801
2016-05-18 01:57:16,802 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA]
2016-05-18 01:57:16,804 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536636368_0001_00_000002, launchTime=1463536636804
2016-05-18 01:57:16,805 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536636368_0001_00_000002
2016-05-18 01:57:16,806 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536636368_0001_00_000002: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536636368_0001_1_01_000000_0
2016-05-18 01:57:16,806 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536636368_0001_1_01_000000_0] started. Is using containerId: [container_1463536636368_0001_00_000002] on NM: [127.0.0.1:0]
2016-05-18 01:57:16,806 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=A1707CA1F04C45F8817A057FD4DCE4DA, taskAttemptId=attempt_1463536636368_0001_1_01_000000_0, startTime=1463536636806, containerId=container_1463536636368_0001_00_000002, nodeId=127.0.0.1:0
2016-05-18 01:57:16,807 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536636368_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-18 01:57:16,807 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536636368_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:16 Starting to run new task attempt: attempt_1463536636368_0001_1_01_000000_0
2016-05-18 01:57:16,807 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536636368_0001_1_01_000000_0
2016-05-18 01:57:16,807 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536636368_0001_00_000001, Exiting
2016-05-18 01:57:16,808 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536636368_0001_00_000001
2016-05-18 01:57:16,807 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:16,808 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:16,808 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536636368_0001_00_000001
2016-05-18 01:57:16,808 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [49E2A0E4F1AD4B2AB2BCCEB0519336B0/C9FBBBD0C02C474EB5FE54A5CAEFB8B6] test/(1/1) ...emoval/value/VALID/STRICT, VertexName: A1707CA1F04C45F8817A057FD4DCE4DA, VertexParallelism: 1, TaskAttemptID:attempt_1463536636368_0001_1_01_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=AD57B2EB202B49C8B0604BD6D5530290, physicalEdgeCount=1, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=5D1D0B7D730240F8BD152869557B0AF6, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-18 01:57:16,809 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:16,809 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536636368_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:16,810 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536636368_0001_1_01_000000_0
2016-05-18 01:57:16,811 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536636368_0001_00_000001 completed successfully
2016-05-18 01:57:16,813 INFO  impl.VertexImpl (VertexImpl.java:getTaskAttemptTezEvents(3662)) - Sending attempt_1463536636368_0001_1_01_000000_0 1 events [0,1) total 1 vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA]
2016-05-18 01:57:16,813 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536636368_0001_1_01_000000_0, eventCount=1 fromEventId=0 nextFromEventId=1
2016-05-18 01:57:16,819 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:16,823 INFO  orderedgrouped.MergeManager (MergeManager.java:getInitialMemoryRequirement(339)) - Initial Memory required for SHUFFLE_BUFFER=211392912 based on INPUT_BUFFER_FACTOR=0.9,  for final merged output=0, using factor: 0.0
2016-05-18 01:57:16,843 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: A1707CA1F04C45F8817A057FD4DCE4DA, ordinal: 1
2016-05-18 01:57:16,844 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A1707CA1F04C45F8817A057FD4DCE4DA, mem on start (mb), free: 74, total: 382, max: 672
2016-05-18 01:57:16,845 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:16,845 INFO  output.MROutput (MROutput.java:initialize(421)) - 5D1D0B7D730240F8BD152869557B0AF6: outputFormat=org.apache.hadoop.mapred.TextOutputFormat, using newmapreduce API=false
2016-05-18 01:57:16,845 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:16,846 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:16,847 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:16,847 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[5D1D0B7D730240F8BD152869557B0AF6:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput], [AD57B2EB202B49C8B0604BD6D5530290:INPUT:211392912:org.apache.tez.runtime.library.input.OrderedGroupedKVInput]
2016-05-18 01:57:16,847 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:16,848 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:16,848 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 211392912, TotalRequestedScaled: 1.9513191876923078E8, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.30
2016-05-18 01:57:16,849 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[5D1D0B7D730240F8BD152869557B0AF6:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0], [AD57B2EB202B49C8B0604BD6D5530290:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:211392912:211392912]
2016-05-18 01:57:16,849 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:16,850 INFO  orderedgrouped.Shuffle (Shuffle.java:<init>(147)) - AD57B2EB202B49C8B0604BD6D5530290: Shuffle assigned with 1 inputs, codec: None, ifileReadAhead: true
2016-05-18 01:57:16,850 INFO  orderedgrouped.MergeManager (MergeManager.java:<init>(273)) - AD57B2EB202B49C8B0604BD6D5530290: MergerManager: memoryLimit=211392912, maxSingleShuffleLimit=52848228, mergeThreshold=190253616, ioSortFactor=100, postMergeMem=0, memToMemMergeOutputsThreshold=100
2016-05-18 01:57:16,851 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: AD57B2EB202B49C8B0604BD6D5530290 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:16,851 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:16,852 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:16,854 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:<init>(353)) - ShuffleScheduler running for sourceVertex: AD57B2EB202B49C8B0604BD6D5530290 with configuration: maxFetchFailuresBeforeReporting=5, reportReadErrorImmediately=true, maxFailedUniqueFetches=1, abortFailureLimit=15, maxTaskOutputAtOnce=20, numFetchers=1, hostFailureFraction=0.2, minFailurePerHost=4, maxAllowedFailedFetchFraction=0.5, maxStallTimeFraction=0.5, minReqProgressFraction=0.5, checkFailedFetchSinceLastCompletion=true
2016-05-18 01:57:16,855 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: AD57B2EB202B49C8B0604BD6D5530290
2016-05-18 01:57:16,855 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:16,855 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536636368_0001_1_01_000000_0
2016-05-18 01:57:16,856 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - AD57B2EB202B49C8B0604BD6D5530290: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0
2016-05-18 01:57:16,858 INFO  orderedgrouped.ShuffleScheduler (ShuffleUtils.java:logIndividualFetchComplete(489)) - Completed fetch for attempt: {0, 0, attempt_1463536636368_0001_1_00_000000_0_10009} to DISK_DIRECT, csize=653, dsize=649, EndTime=1463536636858, TimeTaken=1, Rate=0.62 MB/s
2016-05-18 01:57:16,859 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:copySucceeded(551)) - All inputs fetched for input vertex : AD57B2EB202B49C8B0604BD6D5530290
2016-05-18 01:57:16,859 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:16,859 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:callInternal(1289)) - Shutting down FetchScheduler for input: AD57B2EB202B49C8B0604BD6D5530290, wasInterrupted=false
2016-05-18 01:57:16,860 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:16,861 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1005)) - finalMerge called with 0 in-memory map-outputs and 1 on-disk map-outputs
2016-05-18 01:57:16,861 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: GroupBy(test)[by:[{1}:'method']]
2016-05-18 01:57:16,862 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1103)) - Disk file=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/49E2A0E4F1AD4B2AB2BCCEB0519336B0/C9FBBBD0C02C474EB5FE54A5CAEFB8B6/.tez/application_1463536636368_0001_wd/localmode-local-dir/output/attempt_1463536636368_0001_1_00_000000_0_10009/file.out, len=653, isLocal=true
2016-05-18 01:57:16,862 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1115)) - Merging 1 files, 653 bytes from disk
2016-05-18 01:57:16,862 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: GroupBy(test)[by:[{1}:'method']] streamed: true, id: 5DDE8E50792E4A52809AB6B74AB16DBD
2016-05-18 01:57:16,862 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1130)) - Merging 0 segments, 0 bytes from memory into reduce
2016-05-18 01:57:16,862 INFO  impl.TezMerger (TezMerger.java:merge(644)) - Merging 1 sorted segments
2016-05-18 01:57:16,863 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:onSuccess(1328)) - AD57B2EB202B49C8B0604BD6D5530290: Already shutdown. Ignoring fetch complete
2016-05-18 01:57:16,863 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/VALID/STRICT"], id: 5D1D0B7D730240F8BD152869557B0AF6
2016-05-18 01:57:16,863 INFO  impl.TezMerger (TezMerger.java:merge(749)) - Down to the last merge-pass, with 1 segments left of total size: 633 bytes
2016-05-18 01:57:16,863 INFO  orderedgrouped.Shuffle (Shuffle.java:callInternal(332)) - merge complete for input vertex : AD57B2EB202B49C8B0604BD6D5530290
2016-05-18 01:57:16,864 INFO  orderedgrouped.Shuffle (Shuffle.java:onSuccess(417)) - AD57B2EB202B49C8B0604BD6D5530290: Shuffle Runner thread complete
2016-05-18 01:57:16,865 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/VALID/STRICT"]
2016-05-18 01:57:16,866 INFO  element.TezGroupGate (TezGroupGate.java:prepare(90)) - calling OrderedGroupedKVInput#start() on: GroupBy(test)[by:[{1}:'method']] 5DDE8E50792E4A52809AB6B74AB16DBD, for 1 inputs
2016-05-18 01:57:16,866 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: A1707CA1F04C45F8817A057FD4DCE4DA, all 1 inputs ready in: 00:00:00.000
2016-05-18 01:57:16,867 INFO  input.OrderedGroupedKVInput (OrderedGroupedKVInput.java:createValuesIterator(292)) - AD57B2EB202B49C8B0604BD6D5530290: creating ValuesIterator with comparator=cascading.tuple.hadoop.util.TupleComparator, keyClass=cascading.tuple.io.KeyTuple, valClass=cascading.tuple.io.ValueTuple
2016-05-18 01:57:16,869 INFO  output.MROutput (MROutput.java:close(526)) - 5D1D0B7D730240F8BD152869557B0AF6 closed
2016-05-18 01:57:16,870 INFO  impl.TaskImpl (TaskImpl.java:canCommit(671)) - attempt_1463536636368_0001_1_01_000000_0 given a go for committing the task output.
2016-05-18 01:57:16,871 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536636368_0001_1_01_000000_0
2016-05-18 01:57:16,871 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A1707CA1F04C45F8817A057FD4DCE4DA, mem on close (mb), free: 70, total: 382, max: 672
2016-05-18 01:57:16,871 INFO  orderedgrouped.Shuffle (Shuffle.java:shutdown(278)) - Shutting down Shuffle for source: AD57B2EB202B49C8B0604BD6D5530290
2016-05-18 01:57:16,871 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - AD57B2EB202B49C8B0604BD6D5530290: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0, updateOnClose
2016-05-18 01:57:16,872 INFO  output.MROutput (MROutput.java:close(526)) - 5D1D0B7D730240F8BD152869557B0AF6 closed
2016-05-18 01:57:16,872 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:16 Completed running task attempt: attempt_1463536636368_0001_1_01_000000_0
2016-05-18 01:57:16,872 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536636368_0001_1_01_000000_0, askedToStop=false
2016-05-18 01:57:16,872 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536636368_0001_1_01_000000_0, stopRequested=false
2016-05-18 01:57:16,873 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536636368_0001_1_01_000000_0: Counters: 36 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=9, MERGE_PHASE_TIME=13, FIRST_EVENT_RECEIVED=6, LAST_EVENT_RECEIVED=6][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][cascading.flow.SliceCounters Process_Begin_Time=1463536636866, Process_Duration=5, Process_End_Time=1463536636871, Read_Duration=0, Tuples_Read=7, Tuples_Written=1, Write_Duration=0][cascading.flow.StepCounters Tuples_Written=1]]
2016-05-18 01:57:16,875 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536636368_0001_1_01_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:16,875 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:16,875 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=A1707CA1F04C45F8817A057FD4DCE4DA, taskAttemptId=attempt_1463536636368_0001_1_01_000000_0, creationTime=1463536636802, allocationTime=1463536636803, startTime=1463536636806, finishTime=1463536636875, timeTaken=69, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:16,876 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536636368_0001_1_01_000000_0
2016-05-18 01:57:16,875 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:16,877 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:16,878 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:TASK_FINISHED]: vertexName=A1707CA1F04C45F8817A057FD4DCE4DA, taskId=task_1463536636368_0001_1_01_000000, startTime=1463536636806, finishTime=1463536636876, timeTaken=70, status=SUCCEEDED, successfulAttemptID=attempt_1463536636368_0001_1_01_000000_0, diagnostics=, counters=Counters: 36, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=9, MERGE_PHASE_TIME=13, FIRST_EVENT_RECEIVED=6, LAST_EVENT_RECEIVED=6, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536636866, Process_Duration=5, Process_End_Time=1463536636871, Read_Duration=0, Tuples_Read=7, Tuples_Written=1, Write_Duration=0, cascading.flow.StepCounters, Tuples_Written=1
2016-05-18 01:57:16,878 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:16,878 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA]
2016-05-18 01:57:16,878 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536636368_0001_00_000002
2016-05-18 01:57:16,880 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:VERTEX_FINISHED]: vertexName=A1707CA1F04C45F8817A057FD4DCE4DA, vertexId=vertex_1463536636368_0001_1_01, initRequestedTime=1463536636578, initedTime=1463536636594, startRequestedTime=1463536636607, startedTime=1463536636608, finishTime=1463536636878, timeTaken=270, status=SUCCEEDED, diagnostics=, counters=Counters: 36, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=9, MERGE_PHASE_TIME=13, FIRST_EVENT_RECEIVED=6, LAST_EVENT_RECEIVED=6, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536636866, Process_Duration=5, Process_End_Time=1463536636871, Read_Duration=0, Tuples_Read=7, Tuples_Written=1, Write_Duration=0, cascading.flow.StepCounters, Tuples_Written=1, vertexStats=firstTaskStartTime=1463536636806, firstTasksToStart=[ task_1463536636368_0001_1_01_000000 ], lastTaskFinishTime=1463536636875, lastTasksToFinish=[ task_1463536636368_0001_1_01_000000 ], minTaskDuration=69, maxTaskDuration=69, avgTaskDuration=69.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536636368_0001_1_01_000000 ], longestDurationTasks=[ task_1463536636368_0001_1_01_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:16,884 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:16,884 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536636368_0001_00_000002, stoppedTime=1463536636884, exitStatus=0
2016-05-18 01:57:16,885 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA] completed., numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:16,885 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:16,885 INFO  impl.DAGImpl (DAGImpl.java:commitOrFinish(1051)) - No output committers for vertex: vertex_1463536636368_0001_1_00 [AD57B2EB202B49C8B0604BD6D5530290]
2016-05-18 01:57:16,885 INFO  impl.DAGImpl (DAGImpl.java:commitOrFinish(1098)) - Start writing dag commit event, dag_1463536636368_0001_1
2016-05-18 01:57:16,886 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463536636368_0001_1
2016-05-18 01:57:16,887 INFO  impl.DAGImpl (DAGImpl.java:call(1083)) - Committing output: 5D1D0B7D730240F8BD152869557B0AF6 for vertex: vertex_1463536636368_0001_1_01 [A1707CA1F04C45F8817A057FD4DCE4DA], outputName: 5D1D0B7D730240F8BD152869557B0AF6
2016-05-18 01:57:16,885 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536636368_0001_00_000002 is valid, but no longer registered, and will be killed
2016-05-18 01:57:16,889 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536636368_0001_00_000002: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:16,889 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536636368_0001_00_000002, Exiting
2016-05-18 01:57:16,889 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536636368_0001_00_000002
2016-05-18 01:57:16,890 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536636368_0001_00_000002
2016-05-18 01:57:16,888 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536636368_0001_1 transitioned from RUNNING to COMMITTING due to event DAG_VERTEX_COMPLETED
2016-05-18 01:57:16,890 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536636368_0001_00_000002 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:16,892 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536636368_0001_00_000002 completed successfully
2016-05-18 01:57:16,892 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(260)) - Ignoring stop request for containerId: container_1463536636368_0001_00_000002
2016-05-18 01:57:16,902 INFO  impl.DAGImpl (DAGImpl.java:commitCompleted(2192)) - Commit succeeded for output:outputName:5D1D0B7D730240F8BD152869557B0AF6 of vertex/vertexGroup:A1707CA1F04C45F8817A057FD4DCE4DA isVertexGroupOutput:false
2016-05-18 01:57:16,902 INFO  impl.DAGImpl (DAGImpl.java:checkCommitsForCompletion(1313)) - Checking commits for DAG completion, numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:16,905 INFO  recovery.RecoveryService (RecoveryService.java:handle(327)) - DAG completed, dagId=dag_1463536636368_0001_1, queueSize=0
2016-05-18 01:57:16,907 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536636368_0001_1][Event:DAG_FINISHED]: dagId=dag_1463536636368_0001_1, startTime=1463536636575, finishTime=1463536636902, timeTaken=327, status=SUCCEEDED, diagnostics=, counters=Counters: 48, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=2, TOTAL_LAUNCHED_TASKS=2, RACK_LOCAL_TASKS=1, AM_CPU_MILLISECONDS=630, AM_GC_TIME_MILLIS=0, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=14, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=8, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=9, MERGE_PHASE_TIME=13, FIRST_EVENT_RECEIVED=6, LAST_EVENT_RECEIVED=6, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=2927073273641, Process_Duration=9, Process_End_Time=2927073273650, Read_Duration=3, Tuples_Read=17, Tuples_Written=8, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10, Tuples_Written=1
2016-05-18 01:57:16,908 INFO  impl.DAGImpl (DAGImpl.java:finished(1405)) - DAG: dag_1463536636368_0001_1 finished with state: SUCCEEDED
2016-05-18 01:57:16,908 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536636368_0001_1 transitioned from COMMITTING to SUCCEEDED due to event DAG_COMMIT_COMPLETED
2016-05-18 01:57:16 Completed Dag: dag_1463536636368_0001_1
2016-05-18 01:57:16,912 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(751)) - DAG completed, dagId=dag_1463536636368_0001_1, dagState=SUCCEEDED
2016-05-18 01:57:16,914 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536636368_0001_1_post
2016-05-18 01:57:16,914 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:16,916 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(800)) - Central Dispatcher queue size after DAG completion, before cleanup: 0
2016-05-18 01:57:16,918 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(802)) - Waiting for next DAG to be submitted.
2016-05-18 01:57:16,918 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(842)) - Cleaning up DAG: name=[49E2A0E4F1AD4B2AB2BCCEB0519336B0/C9FBBBD0C02C474EB5FE54A5CAEFB8B6] test/(1/1) ...emoval/value/VALID/STRICT, with id=dag_1463536636368_0001_1
2016-05-18 01:57:16,918 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(852)) - Completed cleanup for DAG: name=[49E2A0E4F1AD4B2AB2BCCEB0519336B0/C9FBBBD0C02C474EB5FE54A5CAEFB8B6] test/(1/1) ...emoval/value/VALID/STRICT, with id=dag_1463536636368_0001_1
2016-05-18 01:57:16,920 INFO  client.TezClient (TezClient.java:stop(566)) - Shutting down Tez Session, sessionName=(1/1) ...emoval/value/VALID/STRICT, applicationId=application_1463536636368_0001
2016-05-18 01:57:16,926 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(124)) - Received message to shutdown AM
2016-05-18 01:57:16,926 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:setShouldUnregisterFlag(895)) - TaskScheduler notified that it should unregister from RM
2016-05-18 01:57:16,926 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1301)) - No current running DAG, shutting down the AM
2016-05-18 01:57:16,926 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(907)) - DAGAppMasterShutdownHandler invoked
2016-05-18 01:57:16,926 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(916)) - Handling DAGAppMaster shutdown
2016-05-18 01:57:16,930 INFO  app.DAGAppMaster (DAGAppMaster.java:run(936)) - Sleeping for 5 seconds before shutting down
2016-05-18 01:57:16,930 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(84)) - Stopping HistoryEventHandler
2016-05-18 01:57:16,931 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(196)) - Stopping RecoveryService
2016-05-18 01:57:16,931 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(199)) - Handle the remaining events in queue, queue size=0
2016-05-18 01:57:16,931 INFO  recovery.RecoveryService (RecoveryService.java:run(173)) - EventQueue take interrupted. Returning
2016-05-18 01:57:16,931 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(221)) - Closing Summary Stream
2016-05-18 01:57:16,932 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-18 01:57:16,932 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-18 01:57:16,934 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:serviceStop(678)) - Shutting down AppCallbackExecutor
2016-05-18 01:57:16,939 INFO  app.DAGAppMaster (DAGAppMaster.java:run(2084)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/49E2A0E4F1AD4B2AB2BCCEB0519336B0/C9FBBBD0C02C474EB5FE54A5CAEFB8B6/.tez/application_1463536636368_0001
2016-05-18 01:57:16,944 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/VALID/STRICT/_temporary
2016-05-18 01:57:16,945 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  completed in: 00:00.605
2016-05-18 01:57:17,026 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 01:57:17,027 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-18 01:57:17,126 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.038
2016-05-18 01:57:17,142 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.054
2016-05-18 01:57:17,143 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:17,143 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:17,144 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 01:57:17,165 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt
2016-05-18 01:57:17,176 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/STRICT/STRICT
2016-05-18 01:57:17,244 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting
2016-05-18 01:57:17,244 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:17,245 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  sink: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/STRICT/STRICT"]
2016-05-18 01:57:17,245 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  parallel execution of steps is enabled: false
2016-05-18 01:57:17,246 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  executing total steps: 1
2016-05-18 01:57:17,246 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  allocating management threads: 1
2016-05-18 01:57:17,247 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting step: (1/1) ...moval/value/STRICT/STRICT
2016-05-18 01:57:17,247 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [test] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-18 01:57:17,263 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tez session mode enabled: true
2016-05-18 01:57:17,268 INFO  client.TezClient (TezClient.java:<init>(174)) - Tez Client Version: [ component=tez-api, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:17,269 INFO  client.TezClient (TezClient.java:start(394)) - Session mode. Starting session.
2016-05-18 01:57:17,269 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(164)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-18 01:57:17,279 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(122)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/AE7FE9D21BA440EAA9259A4AE18A9F74/D4785184DA044555A177BF09E9B78832/.tez/application_1463536637269_0001 doesn't exist and is created
2016-05-18 01:57:17,307 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(332)) - DAGAppMaster thread has been created
2016-05-18 01:57:17,308 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-18 01:57:17,309 INFO  client.LocalClient (LocalClient.java:run(282)) - Using working directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/AE7FE9D21BA440EAA9259A4AE18A9F74/D4785184DA044555A177BF09E9B78832/.tez/application_1463536637269_0001_wd
2016-05-18 01:57:17,328 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(363)) - Created DAGAppMaster for application appattempt_1463536637269_0001_000000, versionInfo=[ component=tez-dag, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:17,329 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(80)) - Trying to locate HadoopShimProvider for hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:17,329 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(139)) - Picked HadoopShim org.apache.tez.hadoop.shim.DefaultHadoopShim, providerName=null, overrideProviderViaConfig=null, hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:17,331 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(436)) - AM Level configured TaskSchedulers: [0:TezUber:null]
2016-05-18 01:57:17,331 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(437)) - AM Level configured ContainerLaunchers: [0:TezUber:null]
2016-05-18 01:57:17,331 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(438)) - AM Level configured TaskCommunicators: [0:TezUber:null]
2016-05-18 01:57:17,331 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(447)) - Comparing client version with AM version, clientVersion=0.8.2, AMVersion=0.8.2
2016-05-18 01:57:17,333 INFO  app.TaskCommunicatorManager (TaskCommunicatorManager.java:createUberTaskCommunicator(192)) - Creating Default Local Task Communicator
2016-05-18 01:57:17,335 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.container.AMContainerEventType for class org.apache.tez.dag.app.rm.container.AMContainerMap
2016-05-18 01:57:17,335 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.node.AMNodeEventType for class org.apache.tez.dag.app.rm.node.AMNodeTracker
2016-05-18 01:57:17,335 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGAppMasterEventType for class org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterEventHandler
2016-05-18 01:57:17,335 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGEventType for class org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher
2016-05-18 01:57:17,336 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.VertexEventType for class org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher
2016-05-18 01:57:17,336 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(529)) - Using concurrent dispatcher: false
2016-05-18 01:57:17,336 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher
2016-05-18 01:57:17,336 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskAttemptEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher
2016-05-18 01:57:17,336 INFO  common.AsyncDispatcher (AsyncDispatcher.java:registerAndCreateDispatcher(262)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for independent dispatch using: class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:17,336 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:17,337 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.AMSchedulerEventType for class org.apache.tez.dag.app.rm.TaskSchedulerManager
2016-05-18 01:57:17,337 INFO  launcher.TezContainerLauncherImpl (ContainerLauncherManager.java:createUberContainerLauncher(134)) - Creating LocalContainerLauncher
2016-05-18 01:57:17,340 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.ContainerLauncherEventType for class org.apache.tez.dag.app.launcher.ContainerLauncherManager
2016-05-18 01:57:17,342 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(78)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1, nodeUpdatesRescheduleEnabled: false
2016-05-18 01:57:17,342 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(57)) - Initializing HistoryEventHandler withrecoveryEnabled=true, historyServiceClassName=org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService
2016-05-18 01:57:17,342 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/AE7FE9D21BA440EAA9259A4AE18A9F74/D4785184DA044555A177BF09E9B78832/.tez/application_1463536637269_0001_wd/localmode-log-dir
2016-05-18 01:57:17,343 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/AE7FE9D21BA440EAA9259A4AE18A9F74/D4785184DA044555A177BF09E9B78832/.tez/application_1463536637269_0001_wd/localmode-log-dir/history.txt.appattempt_1463536637269_0001_000000, maxErrors=10
2016-05-18 01:57:17,344 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(124)) - RecoveryService initialized with recoveryPath=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/AE7FE9D21BA440EAA9259A4AE18A9F74/D4785184DA044555A177BF09E9B78832/.tez/application_1463536637269_0001/recovery/0, bufferSize(bytes)=8192, flushInterval(s)=30, maxUnflushedEvents=100
2016-05-18 01:57:17,344 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463536637269_0001_000000, appSubmitTime=1463536637328, launchTime=1463536637328
2016-05-18 01:57:17,358 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-18 01:57:17,361 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:56912
2016-05-18 01:57:17,363 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:createUberTaskScheduler(557)) - Creating TaskScheduler: Local TaskScheduler with clusterIdentifier=1463536637269
2016-05-18 01:57:17,365 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463536637269_0001_000000, startTime=1463536637365
2016-05-18 01:57:17,365 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1945)) - In Session mode. Waiting for DAG over RPC
2016-05-18 01:57:17,408 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-18 01:57:17,408 INFO  client.TezClient (TezClient.java:start(428)) - The url to track the Tez Session: N/A
2016-05-18 01:57:17,409 INFO  client.TezClient (TezClient.java:submitDAGSession(470)) - Submitting dag to TezSession, sessionName=(1/1) ...moval/value/STRICT/STRICT, applicationId=application_1463536637269_0001, dagName=[AE7FE9D21BA440EAA9259A4AE18A9F74/D4785184DA044555A177BF09E9B78832] test/(1/1) ...moval/value/STRICT/STRICT
2016-05-18 01:57:17,430 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1351)) - Starting DAG submitted via RPC: [AE7FE9D21BA440EAA9259A4AE18A9F74/D4785184DA044555A177BF09E9B78832] test/(1/1) ...moval/value/STRICT/STRICT
2016-05-18 01:57:17,431 INFO  app.DAGAppMaster (DAGAppMaster.java:createDAG(985)) - Merging AM credentials into DAG credentials
2016-05-18 01:57:17,432 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(1076)) - Generating DAG graphviz file, dagId=dag_1463536637269_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/AE7FE9D21BA440EAA9259A4AE18A9F74/D4785184DA044555A177BF09E9B78832/.tez/application_1463536637269_0001_wd/localmode-log-dir/dag_1463536637269_0001_1.dot
2016-05-18 01:57:17,433 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(1093)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/AE7FE9D21BA440EAA9259A4AE18A9F74/D4785184DA044555A177BF09E9B78832/.tez/application_1463536637269_0001_wd/localmode-log-dir/dag_1463536637269_0001_1-tez-dag.pb.txt
2016-05-18 01:57:17,441 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536637269_0001_1
2016-05-18 01:57:17,441 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:17,441 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2399)) - Running DAG: [AE7FE9D21BA440EAA9259A4AE18A9F74/D4785184DA044555A177BF09E9B78832] test/(1/1) ...moval/value/STRICT/STRICT
2016-05-18 01:57:17 Running Dag: dag_1463536637269_0001_1
2016-05-18 01:57:17,457 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463536637269_0001_1, submitTime=1463536637430
2016-05-18 01:57:17,458 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/AE7FE9D21BA440EAA9259A4AE18A9F74/D4785184DA044555A177BF09E9B78832/.tez/application_1463536637269_0001/tez-conf.pb" } size: 40986 timestamp: 1463536637000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:17,458 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalInputs(3978)) - Setting 1 additional inputs for vertexvertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F]
2016-05-18 01:57:17,458 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:17,459 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/AE7FE9D21BA440EAA9259A4AE18A9F74/D4785184DA044555A177BF09E9B78832/.tez/application_1463536637269_0001/tez-conf.pb" } size: 40986 timestamp: 1463536637000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:17,459 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4023)) - Setting 1 additional outputs for vertex vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD]
2016-05-18 01:57:17,459 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:17,460 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1593)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-18 01:57:17,461 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463536637269_0001_1, initTime=1463536637460
2016-05-18 01:57:17,461 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536637269_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-18 01:57:17,461 INFO  impl.DAGImpl (DAGImpl.java:transition(1768)) - Added additional resources : [[]] to classpath
2016-05-18 01:57:17,462 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:DAG_STARTED]: dagID=dag_1463536637269_0001_1, startTime=1463536637462
2016-05-18 01:57:17,462 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536637269_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-18 01:57:17,462 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2400)) - Root Inputs exist for Vertex: FF9829BAD0674371A4D3793B45ABDA8F : {8F8B58C94CBE4727A44A7FEB235DA096={InputName=8F8B58C94CBE4727A44A7FEB235DA096}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-18 01:57:17,462 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2410)) - Starting root input initializer for input: 8F8B58C94CBE4727A44A7FEB235DA096, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-18 01:57:17,463 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2550)) - Setting vertexManager to RootInputVertexManager for vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F]
2016-05-18 01:57:17,463 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2721)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F]
2016-05-18 01:57:17,463 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2726)) - Vertex will initialize from input initializer. vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F]
2016-05-18 01:57:17,463 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3893)) - Starting 1 inputInitializers for vertex vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F]
2016-05-18 01:57:17,464 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-18 01:57:17,464 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(272)) - Starting InputInitializer for Input: 8F8B58C94CBE4727A44A7FEB235DA096 on vertex vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F]
2016-05-18 01:57:17,464 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2562)) - Setting vertexManager to ShuffleVertexManager for vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD]
2016-05-18 01:57:17,464 INFO  client.TezClient (TezClient.java:submitDAGSession(545)) - Submitted dag to TezSession, sessionName=(1/1) ...moval/value/STRICT/STRICT, applicationId=application_1463536637269_0001, dagName=[AE7FE9D21BA440EAA9259A4AE18A9F74/D4785184DA044555A177BF09E9B78832] test/(1/1) ...moval/value/STRICT/STRICT
2016-05-18 01:57:17,467 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(109)) - Input 8F8B58C94CBE4727A44A7FEB235DA096 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7, groupingEnabled: true
2016-05-18 01:57:17,470 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:initialize(1022)) - Shuffle Vertex Manager: settings minFrac:0.25 maxFrac:0.75 auto:false desiredTaskIput:104857600 minTasks:1
2016-05-18 01:57:17,470 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2760)) - Creating 1 tasks for vertex: vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD]
2016-05-18 01:57:17,471 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2779)) - Directly initializing vertex: vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD]
2016-05-18 01:57:17,472 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536637269_0001_1_01, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=null, edgeManagersCount=1, rootInputSpecUpdateCount=0, setParallelismCalledFlag=false
2016-05-18 01:57:17,473 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2187)) - Setting up committers for vertex vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD], numAdditionalOutputs=1
2016-05-18 01:57:17,473 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2202)) - Instantiating committer for output=E831F390C2584B96ACADD893990EF077, vertex=vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-18 01:57:17,476 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(121)) - Committer for DDBA01E0F5C74EEAA5109B462C17ACFD:E831F390C2584B96ACADD893990EF077 using oldmapred API
2016-05-18 01:57:17,476 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(146)) - OutputCommitter for outputName=E831F390C2584B96ACADD893990EF077, vertexName=DDBA01E0F5C74EEAA5109B462C17ACFD, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-18 01:57:17,476 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(168)) - Grouping splits in Tez
2016-05-18 01:57:17,477 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(226)) - Desired splits: 1 too large.  Desired splitLength: 1449 Min splitLength: 52428800 New desired splits: 1 Total length: 1449 Original splits: 2
2016-05-18 01:57:17,477 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(321)) - Desired numSplits: 1 lengthPerGroup: 1449 numLocations: 1 numSplitsPerLocation: 2 numSplitsInGroup: 2 totalLength: 1449 numOriginalSplits: 2 . Grouping by length: true count: false nodeLocalOnly: false
2016-05-18 01:57:17,478 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(539)) - Number of splits desired: 1 created: 1 splitsProcessed: 2
2016-05-18 01:57:17,479 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:VERTEX_INITIALIZED]: vertexName=DDBA01E0F5C74EEAA5109B462C17ACFD, vertexId=vertex_1463536637269_0001_1_01, initRequestedTime=1463536637464, initedTime=1463536637473, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=0, initGeneratedEventsCount=0
2016-05-18 01:57:17,479 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD] transitioned from NEW to INITED due to event V_INIT
2016-05-18 01:57:17,479 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(308)) - Succeeded InputInitializer for Input: 8F8B58C94CBE4727A44A7FEB235DA096 on vertex vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F]
2016-05-18 01:57:17,483 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:17,484 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1644)) - Got updated RootInputsSpecs: {8F8B58C94CBE4727A44A7FEB235DA096=forAllWorkUnits=true, update=[1]}
2016-05-18 01:57:17,485 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1664)) - Vertex vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F] parallelism set to 1
2016-05-18 01:57:17,486 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:17,487 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:VERTEX_INITIALIZED]: vertexName=FF9829BAD0674371A4D3793B45ABDA8F, vertexId=vertex_1463536637269_0001_1_00, initRequestedTime=1463536637462, initedTime=1463536637487, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1, initGeneratedEventsCount=1
2016-05-18 01:57:17,488 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F] with distanceFromRoot: 0
2016-05-18 01:57:17,488 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F] transitioned from INITIALIZING to INITED due to event V_INPUT_DATA_INFORMATION
2016-05-18 01:57:17,491 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536637269_0001_1_00, startRequestedTime=1463536637464, startedTime=1463536637490
2016-05-18 01:57:17,492 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536637269_0001_1_00, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=org.apache.tez.dag.api.VertexLocationHint@b8338fe7, edgeManagersCount=0, rootInputSpecUpdateCount=1, setParallelismCalledFlag=true
2016-05-18 01:57:17,492 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:17,492 INFO  impl.VertexImpl (VertexImpl.java:transition(2932)) - Source vertex started: vertex_1463536637269_0001_1_00 for vertex: vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD] numStartedSources: 1 numSources: 1
2016-05-18 01:57:17,493 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD] with distanceFromRoot: 1
2016-05-18 01:57:17,492 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(100)) - Starting 1 in FF9829BAD0674371A4D3793B45ABDA8F
2016-05-18 01:57:17,494 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536637269_0001_1_01, startRequestedTime=1463536637492, startedTime=1463536637494
2016-05-18 01:57:17,494 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:17,494 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F]
2016-05-18 01:57:17,496 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:TASK_STARTED]: vertexName=FF9829BAD0674371A4D3793B45ABDA8F, taskId=task_1463536637269_0001_1_00_000000, scheduledTime=1463536637496, launchTime=1463536637496
2016-05-18 01:57:17,497 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:onVertexStarted(519)) - OnVertexStarted vertex: DDBA01E0F5C74EEAA5109B462C17ACFD with 0 source tasks and 1 pending tasks
2016-05-18 01:57:17,497 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F]
2016-05-18 01:57:17,500 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] submitted tez dag to app master: application_1463536637269_0001, with dag id: dag_1463536637269_0001_1
2016-05-18 01:57:17,500 INFO  node.PerSourceNodeTracker (PerSourceNodeTracker.java:nodeSeen(74)) - Adding new node 127.0.0.1:0 to nodeTracker 0
2016-05-18 01:57:17,500 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:handleVertexStateUpdate(1051)) - Received configured notification : CONFIGURED for vertex: FF9829BAD0674371A4D3793B45ABDA8F in vertex: DDBA01E0F5C74EEAA5109B462C17ACFD numBipartiteSourceTasks: 1
2016-05-18 01:57:17,507 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536637269_0001_00_000001, launchTime=1463536637507
2016-05-18 01:57:17,508 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536637269_0001_00_000001
2016-05-18 01:57:17,512 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536637269_0001_1_00_000000_0] started. Is using containerId: [container_1463536637269_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-18 01:57:17,512 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=FF9829BAD0674371A4D3793B45ABDA8F, taskAttemptId=attempt_1463536637269_0001_1_00_000000_0, startTime=1463536637511, containerId=container_1463536637269_0001_00_000001, nodeId=127.0.0.1:0
2016-05-18 01:57:17,513 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536637269_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536637269_0001_1_00_000000_0
2016-05-18 01:57:17 Starting to run new task attempt: attempt_1463536637269_0001_1_00_000000_0
2016-05-18 01:57:17,514 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536637269_0001_1_00_000000_0
2016-05-18 01:57:17,514 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:17,514 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:17,515 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [AE7FE9D21BA440EAA9259A4AE18A9F74/D4785184DA044555A177BF09E9B78832] test/(1/1) ...moval/value/STRICT/STRICT, VertexName: FF9829BAD0674371A4D3793B45ABDA8F, VertexParallelism: 1, TaskAttemptID:attempt_1463536637269_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8F8B58C94CBE4727A44A7FEB235DA096, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=DDBA01E0F5C74EEAA5109B462C17ACFD, physicalEdgeCount=1, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ]
2016-05-18 01:57:17,515 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:17,516 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536637269_0001_1_00_000000_0
2016-05-18 01:57:17,518 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(496)) - TaskAttempt:attempt_1463536637269_0001_1_00_000000_0 sent events: (0-1).
2016-05-18 01:57:17,518 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536637269_0001_1_00_000000_0, eventCount=1 fromEventId=0 nextFromEventId=0
2016-05-18 01:57:17,521 INFO  input.MRInput (MRInput.java:initialize(440)) - 8F8B58C94CBE4727A44A7FEB235DA096 using newmapreduce API=false, split via event=true, numPhysicalInputs=1
2016-05-18 01:57:17,521 INFO  input.MRInput (MRInput.java:initializeInternal(494)) - Initialized MRInput: 8F8B58C94CBE4727A44A7FEB235DA096
2016-05-18 01:57:17,525 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:17,535 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: FF9829BAD0674371A4D3793B45ABDA8F, ordinal: 0
2016-05-18 01:57:17,535 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FF9829BAD0674371A4D3793B45ABDA8F, mem on start (mb), free: 181, total: 490, max: 672
2016-05-18 01:57:17,535 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:17,535 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:17,535 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:17,535 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:17,535 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[8F8B58C94CBE4727A44A7FEB235DA096:INPUT:0:org.apache.tez.mapreduce.input.MRInput], [DDBA01E0F5C74EEAA5109B462C17ACFD:OUTPUT:104857600:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput]
2016-05-18 01:57:17,536 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:17,538 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:17,538 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 104857600, TotalRequestedScaled: 9.679163076923077E7, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.15
2016-05-18 01:57:17,538 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[8F8B58C94CBE4727A44A7FEB235DA096:org.apache.tez.mapreduce.input.MRInput:INPUT:0:0], [DDBA01E0F5C74EEAA5109B462C17ACFD:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput:OUTPUT:104857600:104857600]
2016-05-18 01:57:17,539 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:17,539 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: 8F8B58C94CBE4727A44A7FEB235DA096 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:17,539 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: 8F8B58C94CBE4727A44A7FEB235DA096
2016-05-18 01:57:17,540 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:17,541 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:17,541 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:17,541 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536637269_0001_1_00_000000_0
2016-05-18 01:57:17,543 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(174)) - Processing split: TezGroupedSplit{wrappedSplits=[file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:0+724, file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:724+725], wrappedInputFormatName='org.apache.hadoop.mapred.TextInputFormat', locations=[localhost], rack='null', length=1449}
2016-05-18 01:57:17,544 INFO  input.MRInput (MRInput.java:initFromEventInternal(653)) - 8F8B58C94CBE4727A44A7FEB235DA096 initialized RecordReader from event
2016-05-18 01:57:17,547 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:17,549 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"] streamed: true, id: 8F8B58C94CBE4727A44A7FEB235DA096
2016-05-18 01:57:17,549 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: GroupBy(test)[by:[{1}:'method']], id: 0CA0D63F7A7F4C8497973DF09E726838
2016-05-18 01:57:17,549 INFO  element.TezGroupGate (TezGroupGate.java:prepare(98)) - calling OrderedPartitionedKVOutput#start() on: GroupBy(test)[by:[{1}:'method']] 0CA0D63F7A7F4C8497973DF09E726838
2016-05-18 01:57:17,552 INFO  impl.ExternalSorter (ExternalSorter.java:<init>(199)) - DDBA01E0F5C74EEAA5109B462C17ACFD using: memoryMb=100, keySerializerClass=class cascading.tuple.io.KeyTuple, valueSerializerClass=cascading.tuple.hadoop.io.ValueTupleSerializer@7de721, comparator=cascading.tuple.hadoop.util.TupleComparator@49d127c7, partitioner=cascading.tuple.tez.util.TuplePartitioner, serialization=cascading.tuple.hadoop.TupleSerialization,org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
2016-05-18 01:57:17,553 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(170)) - Setting up PipelinedSorter for DDBA01E0F5C74EEAA5109B462C17ACFD: , UsingHashComparator=false
2016-05-18 01:57:17,616 INFO  impl.PipelinedSorter (PipelinedSorter.java:allocateSpace(245)) - Newly allocated block size=104857600, index=0, Number of buffers=1, currentAllocatableMemory=0, currentBufferSize=104857600, total=104857600
2016-05-18 01:57:17,616 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(189)) - Pre allocating rest of memory buffers upfront
2016-05-18 01:57:17,617 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(207)) - Setting up PipelinedSorter for DDBA01E0F5C74EEAA5109B462C17ACFD: , UsingHashComparator=false#blocks=1, maxMemUsage=104857600, lazyAllocateMem=false, minBlockSize=2097152000, initial BLOCK_SIZE=104857600, finalMergeEnabled=true, pipelinedShuffle=false, sendEmptyPartitions=true, tez.runtime.io.sort.mb=100
2016-05-18 01:57:17,617 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(882)) - DDBA01E0F5C74EEAA5109B462C17ACFD: reserved.remaining()=104857600, reserved.metasize=16777216
2016-05-18 01:57:17,618 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:17,620 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: FF9829BAD0674371A4D3793B45ABDA8F, all 1 inputs ready in: 00:00:00.000
2016-05-18 01:57:17,624 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536637269_0001_1_00_000000_0
2016-05-18 01:57:17,625 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FF9829BAD0674371A4D3793B45ABDA8F, mem on close (mb), free: 78, total: 490, max: 672
2016-05-18 01:57:17,625 INFO  impl.PipelinedSorter (PipelinedSorter.java:flush(629)) - DDBA01E0F5C74EEAA5109B462C17ACFD: Starting flush of map output
2016-05-18 01:57:17,626 INFO  impl.PipelinedSorter (PipelinedSorter.java:end(995)) - DDBA01E0F5C74EEAA5109B462C17ACFD: Span0.length = 7, perItem = 99
2016-05-18 01:57:17,626 INFO  impl.PipelinedSorter (PipelinedSorter.java:sort(904)) - DDBA01E0F5C74EEAA5109B462C17ACFD: done sorting span=0, length=7, time=0
2016-05-18 01:57:17,627 INFO  impl.PipelinedSorter (PipelinedSorter.java:ready(1297)) - DDBA01E0F5C74EEAA5109B462C17ACFD: Heap = SpanIterator<0:6> (span=Span[16777216,693]),
2016-05-18 01:57:17,628 INFO  impl.PipelinedSorter (PipelinedSorter.java:spill(546)) - DDBA01E0F5C74EEAA5109B462C17ACFD: Spilling to /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/AE7FE9D21BA440EAA9259A4AE18A9F74/D4785184DA044555A177BF09E9B78832/.tez/application_1463536637269_0001_wd/localmode-local-dir/output/attempt_1463536637269_0001_1_00_000000_0_10015_0/file.out
2016-05-18 01:57:17,631 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:17 Completed running task attempt: attempt_1463536637269_0001_1_00_000000_0
2016-05-18 01:57:17,632 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536637269_0001_1_00_000000_0, askedToStop=false
2016-05-18 01:57:17,633 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536637269_0001_1_00_000000_0, stopRequested=false
2016-05-18 01:57:17,633 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536637269_0001_1_00_000000_0: Counters: 18 [[org.apache.tez.common.counters.TaskCounter SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1][cascading.flow.SliceCounters Process_Begin_Time=1463536637620, Process_Duration=4, Process_End_Time=1463536637624, Read_Duration=3, Tuples_Read=10, Tuples_Written=7, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=10]]
2016-05-18 01:57:17,634 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536637269_0001_1_00_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:17,635 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:17,635 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=FF9829BAD0674371A4D3793B45ABDA8F, taskAttemptId=attempt_1463536637269_0001_1_00_000000_0, creationTime=1463536637497, allocationTime=1463536637505, startTime=1463536637511, finishTime=1463536637635, timeTaken=124, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:17,636 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536637269_0001_1_00_000000_0
2016-05-18 01:57:17,635 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:17,637 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:17,638 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536637269_0001_00_000001
2016-05-18 01:57:17,638 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:TASK_FINISHED]: vertexName=FF9829BAD0674371A4D3793B45ABDA8F, taskId=task_1463536637269_0001_1_00_000000, startTime=1463536637511, finishTime=1463536637637, timeTaken=126, status=SUCCEEDED, successfulAttemptID=attempt_1463536637269_0001_1_00_000000_0, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536637620, Process_Duration=4, Process_End_Time=1463536637624, Read_Duration=3, Tuples_Read=10, Tuples_Written=7, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=10
2016-05-18 01:57:17,640 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:17,640 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F]
2016-05-18 01:57:17,642 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:VERTEX_FINISHED]: vertexName=FF9829BAD0674371A4D3793B45ABDA8F, vertexId=vertex_1463536637269_0001_1_00, initRequestedTime=1463536637462, initedTime=1463536637487, startRequestedTime=1463536637464, startedTime=1463536637490, finishTime=1463536637640, timeTaken=150, status=SUCCEEDED, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536637620, Process_Duration=4, Process_End_Time=1463536637624, Read_Duration=3, Tuples_Read=10, Tuples_Written=7, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=10, vertexStats=firstTaskStartTime=1463536637511, firstTasksToStart=[ task_1463536637269_0001_1_00_000000 ], lastTaskFinishTime=1463536637635, lastTasksToFinish=[ task_1463536637269_0001_1_00_000000 ], minTaskDuration=124, maxTaskDuration=124, avgTaskDuration=124.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536637269_0001_1_00_000000 ], longestDurationTasks=[ task_1463536637269_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:17,642 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:17,642 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536637269_0001_00_000001, stoppedTime=1463536637642, exitStatus=0
2016-05-18 01:57:17,643 INFO  impl.VertexImpl (VertexImpl.java:transition(3279)) - Source task attempt completed for vertex: vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD] attempt: attempt_1463536637269_0001_1_00_000000_0 with state: SUCCEEDED vertexState: RUNNING
2016-05-18 01:57:17,643 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:schedulePendingTasks(920)) - All source tasks assigned. Ramping up 1 remaining tasks for vertex: DDBA01E0F5C74EEAA5109B462C17ACFD
2016-05-18 01:57:17,644 INFO  impl.Edge (Edge.java:routingToBegin(232)) - Routing to begin for edge: EdgeInfo: sourceVertexName=FF9829BAD0674371A4D3793B45ABDA8F, destinationVertexName=DDBA01E0F5C74EEAA5109B462C17ACFD. EdgeProperty: { SCATTER_GATHER : org.apache.tez.runtime.library.input.OrderedGroupedKVInput >> PERSISTED >> org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput >> NullEdgeManager } onDemandRouting: true
2016-05-18 01:57:17,644 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD]
2016-05-18 01:57:17,644 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536637269_0001_1_00 [FF9829BAD0674371A4D3793B45ABDA8F] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:17,645 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:17,645 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(262)) - Ignoring stop request for containerId container_1463536637269_0001_00_000001. Relying on regular task shutdown for it to end
2016-05-18 01:57:17,645 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:TASK_STARTED]: vertexName=DDBA01E0F5C74EEAA5109B462C17ACFD, taskId=task_1463536637269_0001_1_01_000000, scheduledTime=1463536637645, launchTime=1463536637645
2016-05-18 01:57:17,646 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD]
2016-05-18 01:57:17,648 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536637269_0001_00_000002, launchTime=1463536637647
2016-05-18 01:57:17,648 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536637269_0001_00_000002
2016-05-18 01:57:17,649 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536637269_0001_00_000002: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536637269_0001_1_01_000000_0
2016-05-18 01:57:17,649 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536637269_0001_1_01_000000_0] started. Is using containerId: [container_1463536637269_0001_00_000002] on NM: [127.0.0.1:0]
2016-05-18 01:57:17,650 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=DDBA01E0F5C74EEAA5109B462C17ACFD, taskAttemptId=attempt_1463536637269_0001_1_01_000000_0, startTime=1463536637649, containerId=container_1463536637269_0001_00_000002, nodeId=127.0.0.1:0
2016-05-18 01:57:17 Starting to run new task attempt: attempt_1463536637269_0001_1_01_000000_0
2016-05-18 01:57:17,650 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536637269_0001_1_01_000000_0
2016-05-18 01:57:17,650 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:17,651 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:17,651 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [AE7FE9D21BA440EAA9259A4AE18A9F74/D4785184DA044555A177BF09E9B78832] test/(1/1) ...moval/value/STRICT/STRICT, VertexName: DDBA01E0F5C74EEAA5109B462C17ACFD, VertexParallelism: 1, TaskAttemptID:attempt_1463536637269_0001_1_01_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=FF9829BAD0674371A4D3793B45ABDA8F, physicalEdgeCount=1, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=E831F390C2584B96ACADD893990EF077, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-18 01:57:17,651 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:17,652 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536637269_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-18 01:57:17,652 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536637269_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:17,652 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536637269_0001_00_000001, Exiting
2016-05-18 01:57:17,652 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536637269_0001_00_000001
2016-05-18 01:57:17,652 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536637269_0001_00_000001
2016-05-18 01:57:17,653 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536637269_0001_1_01_000000_0
2016-05-18 01:57:17,657 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536637269_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:17,657 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536637269_0001_00_000001 completed successfully
2016-05-18 01:57:17,659 INFO  impl.VertexImpl (VertexImpl.java:getTaskAttemptTezEvents(3662)) - Sending attempt_1463536637269_0001_1_01_000000_0 1 events [0,1) total 1 vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD]
2016-05-18 01:57:17,659 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536637269_0001_1_01_000000_0, eventCount=1 fromEventId=0 nextFromEventId=1
2016-05-18 01:57:17,662 INFO  orderedgrouped.MergeManager (MergeManager.java:getInitialMemoryRequirement(339)) - Initial Memory required for SHUFFLE_BUFFER=211392912 based on INPUT_BUFFER_FACTOR=0.9,  for final merged output=0, using factor: 0.0
2016-05-18 01:57:17,662 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:17,678 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: DDBA01E0F5C74EEAA5109B462C17ACFD, ordinal: 1
2016-05-18 01:57:17,678 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DDBA01E0F5C74EEAA5109B462C17ACFD, mem on start (mb), free: 71, total: 490, max: 672
2016-05-18 01:57:17,679 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:17,679 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:17,679 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:17,679 INFO  output.MROutput (MROutput.java:initialize(421)) - E831F390C2584B96ACADD893990EF077: outputFormat=org.apache.hadoop.mapred.TextOutputFormat, using newmapreduce API=false
2016-05-18 01:57:17,680 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:17,681 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[E831F390C2584B96ACADD893990EF077:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput], [FF9829BAD0674371A4D3793B45ABDA8F:INPUT:211392912:org.apache.tez.runtime.library.input.OrderedGroupedKVInput]
2016-05-18 01:57:17,682 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:17,682 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:17,682 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 211392912, TotalRequestedScaled: 1.9513191876923078E8, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.30
2016-05-18 01:57:17,683 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[E831F390C2584B96ACADD893990EF077:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0], [FF9829BAD0674371A4D3793B45ABDA8F:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:211392912:211392912]
2016-05-18 01:57:17,683 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:17,683 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: FF9829BAD0674371A4D3793B45ABDA8F being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:17,684 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:17,684 INFO  orderedgrouped.Shuffle (Shuffle.java:<init>(147)) - FF9829BAD0674371A4D3793B45ABDA8F: Shuffle assigned with 1 inputs, codec: None, ifileReadAhead: true
2016-05-18 01:57:17,685 INFO  orderedgrouped.MergeManager (MergeManager.java:<init>(273)) - FF9829BAD0674371A4D3793B45ABDA8F: MergerManager: memoryLimit=211392912, maxSingleShuffleLimit=52848228, mergeThreshold=190253616, ioSortFactor=100, postMergeMem=0, memToMemMergeOutputsThreshold=100
2016-05-18 01:57:17,684 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:17,686 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:<init>(353)) - ShuffleScheduler running for sourceVertex: FF9829BAD0674371A4D3793B45ABDA8F with configuration: maxFetchFailuresBeforeReporting=5, reportReadErrorImmediately=true, maxFailedUniqueFetches=1, abortFailureLimit=15, maxTaskOutputAtOnce=20, numFetchers=1, hostFailureFraction=0.2, minFailurePerHost=4, maxAllowedFailedFetchFraction=0.5, maxStallTimeFraction=0.5, minReqProgressFraction=0.5, checkFailedFetchSinceLastCompletion=true
2016-05-18 01:57:17,688 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: FF9829BAD0674371A4D3793B45ABDA8F
2016-05-18 01:57:17,688 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:17,689 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536637269_0001_1_01_000000_0
2016-05-18 01:57:17,691 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - FF9829BAD0674371A4D3793B45ABDA8F: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0
2016-05-18 01:57:17,692 INFO  orderedgrouped.ShuffleScheduler (ShuffleUtils.java:logIndividualFetchComplete(489)) - Completed fetch for attempt: {0, 0, attempt_1463536637269_0001_1_00_000000_0_10015} to DISK_DIRECT, csize=653, dsize=649, EndTime=1463536637692, TimeTaken=1, Rate=0.62 MB/s
2016-05-18 01:57:17,692 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:copySucceeded(551)) - All inputs fetched for input vertex : FF9829BAD0674371A4D3793B45ABDA8F
2016-05-18 01:57:17,692 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:17,693 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:callInternal(1289)) - Shutting down FetchScheduler for input: FF9829BAD0674371A4D3793B45ABDA8F, wasInterrupted=false
2016-05-18 01:57:17,694 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:onSuccess(1328)) - FF9829BAD0674371A4D3793B45ABDA8F: Already shutdown. Ignoring fetch complete
2016-05-18 01:57:17,695 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:17,695 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1005)) - finalMerge called with 0 in-memory map-outputs and 1 on-disk map-outputs
2016-05-18 01:57:17,695 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: GroupBy(test)[by:[{1}:'method']]
2016-05-18 01:57:17,696 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1103)) - Disk file=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/AE7FE9D21BA440EAA9259A4AE18A9F74/D4785184DA044555A177BF09E9B78832/.tez/application_1463536637269_0001_wd/localmode-local-dir/output/attempt_1463536637269_0001_1_00_000000_0_10015/file.out, len=653, isLocal=true
2016-05-18 01:57:17,696 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1115)) - Merging 1 files, 653 bytes from disk
2016-05-18 01:57:17,696 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1130)) - Merging 0 segments, 0 bytes from memory into reduce
2016-05-18 01:57:17,696 INFO  impl.TezMerger (TezMerger.java:merge(644)) - Merging 1 sorted segments
2016-05-18 01:57:17,697 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: GroupBy(test)[by:[{1}:'method']] streamed: true, id: 0CA0D63F7A7F4C8497973DF09E726838
2016-05-18 01:57:17,697 INFO  impl.TezMerger (TezMerger.java:merge(749)) - Down to the last merge-pass, with 1 segments left of total size: 633 bytes
2016-05-18 01:57:17,697 INFO  orderedgrouped.Shuffle (Shuffle.java:callInternal(332)) - merge complete for input vertex : FF9829BAD0674371A4D3793B45ABDA8F
2016-05-18 01:57:17,698 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/STRICT/STRICT"], id: E831F390C2584B96ACADD893990EF077
2016-05-18 01:57:17,698 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/STRICT/STRICT"]
2016-05-18 01:57:17,700 INFO  orderedgrouped.Shuffle (Shuffle.java:onSuccess(417)) - FF9829BAD0674371A4D3793B45ABDA8F: Shuffle Runner thread complete
2016-05-18 01:57:17,700 INFO  element.TezGroupGate (TezGroupGate.java:prepare(90)) - calling OrderedGroupedKVInput#start() on: GroupBy(test)[by:[{1}:'method']] 0CA0D63F7A7F4C8497973DF09E726838, for 1 inputs
2016-05-18 01:57:17,701 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: DDBA01E0F5C74EEAA5109B462C17ACFD, all 1 inputs ready in: 00:00:00.000
2016-05-18 01:57:17,701 INFO  input.OrderedGroupedKVInput (OrderedGroupedKVInput.java:createValuesIterator(292)) - FF9829BAD0674371A4D3793B45ABDA8F: creating ValuesIterator with comparator=cascading.tuple.hadoop.util.TupleComparator, keyClass=cascading.tuple.io.KeyTuple, valClass=cascading.tuple.io.ValueTuple
2016-05-18 01:57:17,704 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-05-18 01:57:17,710 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-05-18 01:57:17,715 ERROR element.TezGroupByGate (TezGroupByGate.java:reduce(91)) - caught throwable
cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-05-18 01:57:17,719 INFO  output.MROutput (MROutput.java:close(526)) - E831F390C2584B96ACADD893990EF077 closed
2016-05-18 01:57:17,720 INFO  impl.TaskImpl (TaskImpl.java:canCommit(671)) - attempt_1463536637269_0001_1_01_000000_0 given a go for committing the task output.
2016-05-18 01:57:17,721 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536637269_0001_1_01_000000_0, stopRequested=false
2016-05-18 01:57:17,722 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536637269_0001_1_01_000000_0: Counters: 33 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=8, MERGE_PHASE_TIME=12, FIRST_EVENT_RECEIVED=6, LAST_EVENT_RECEIVED=6][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][cascading.flow.SliceCounters Process_Begin_Time=1463536637701, Process_Duration=20, Process_End_Time=1463536637721, Read_Duration=1, Tuples_Read=7]]
2016-05-18 01:57:17,722 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(817)) - Joining on EventRouter
2016-05-18 01:57:17,722 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DDBA01E0F5C74EEAA5109B462C17ACFD, mem on close (mb), free: 65, total: 490, max: 672
2016-05-18 01:57:17,723 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(851)) - Closed processor for vertex=DDBA01E0F5C74EEAA5109B462C17ACFD, index=1, interruptedStatus=false
2016-05-18 01:57:17,723 INFO  orderedgrouped.Shuffle (Shuffle.java:shutdown(278)) - Shutting down Shuffle for source: FF9829BAD0674371A4D3793B45ABDA8F
2016-05-18 01:57:17,723 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - FF9829BAD0674371A4D3793B45ABDA8F: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0, updateOnClose
2016-05-18 01:57:17,724 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(887)) - Closed input for vertex=DDBA01E0F5C74EEAA5109B462C17ACFD, sourceVertex=FF9829BAD0674371A4D3793B45ABDA8F, interruptedStatus=true
2016-05-18 01:57:17,724 INFO  output.MROutput (MROutput.java:close(526)) - E831F390C2584B96ACADD893990EF077 closed
2016-05-18 01:57:17,725 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(911)) - Closed input for vertex=DDBA01E0F5C74EEAA5109B462C17ACFD, sourceVertex=E831F390C2584B96ACADD893990EF077, interruptedStatus=true
2016-05-18 01:57:17,733 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=DDBA01E0F5C74EEAA5109B462C17ACFD, taskAttemptId=attempt_1463536637269_0001_1_01_000000_0, creationTime=1463536637646, allocationTime=1463536637647, startTime=1463536637649, finishTime=1463536637729, timeTaken=80, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task: attempt_1463536637269_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 33, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=8, MERGE_PHASE_TIME=12, FIRST_EVENT_RECEIVED=6, LAST_EVENT_RECEIVED=6, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536637701, Process_Duration=20, Process_End_Time=1463536637721, Read_Duration=1, Tuples_Read=7
2016-05-18 01:57:17,734 INFO  impl.TaskImpl (TaskImpl.java:transition(1170)) - Failing task: task_1463536637269_0001_1_01_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-05-18 01:57:17,735 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:TASK_FINISHED]: vertexName=DDBA01E0F5C74EEAA5109B462C17ACFD, taskId=task_1463536637269_0001_1_01_000000, startTime=1463536637649, finishTime=1463536637734, timeTaken=85, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task: attempt_1463536637269_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-05-18 01:57:17,736 INFO  impl.VertexImpl (VertexImpl.java:transition(3353)) - Failing vertex: vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD] because task failed: task_1463536637269_0001_1_01_000000
2016-05-18 01:57:17,736 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(2102)) - Killing tasks in vertex: vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD] due to trigger: OWN_TASK_FAILURE
2016-05-18 01:57:17,737 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD], tasks=1, failed=1, killed=0, success=0, completed=1, commits=0, err=OWN_TASK_FAILURE
2016-05-18 01:57:17,738 INFO  impl.VertexImpl (VertexImpl.java:finishWithTerminationCause(2084)) - Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0
2016-05-18 01:57:17,738 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3087)) - Invoking committer abort for vertex, vertexId=vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD]
2016-05-18 01:57:17,733 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536637269_0001_1_01_000000_0 : TaskRunner2Result{endReason=TASK_ERROR, error=cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0'], containerShutdownRequested=false}  
2016-05-18 01:57:17,739 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=TASK_ERROR, error=cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0'], containerShutdownRequested=false}
2016-05-18 01:57:17,739 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536637269_0001_00_000002
2016-05-18 01:57:17,739 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536637269_0001_00_000002
2016-05-18 01:57:17,741 INFO  impl.VertexImpl (VertexImpl.java:run(3095)) - Invoking committer abort for output=E831F390C2584B96ACADD893990EF077, vertexId=vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD]
2016-05-18 01:57:17,744 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536637269_0001_00_000002 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0'], errorMessage='TaskExecutionFailure: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0']'}
2016-05-18 01:57:17,744 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(294)) - Container: container_1463536637269_0001_00_000002 completed but with errors
2016-05-18 01:57:17,746 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:VERTEX_FINISHED]: vertexName=DDBA01E0F5C74EEAA5109B462C17ACFD, vertexId=vertex_1463536637269_0001_1_01, initRequestedTime=1463536637464, initedTime=1463536637473, startRequestedTime=1463536637492, startedTime=1463536637494, finishTime=1463536637745, timeTaken=251, status=FAILED, diagnostics=Task failed, taskId=task_1463536637269_0001_1_01_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task: attempt_1463536637269_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]]
Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0
Vertex vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD] killed/failed due to:OWN_TASK_FAILURE, counters=Counters: 0, vertexStats=firstTaskStartTime=1463536637649, firstTasksToStart=[ task_1463536637269_0001_1_01_000000 ], lastTaskFinishTime=1463536637729, lastTasksToFinish=[ task_1463536637269_0001_1_01_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-05-18 01:57:17,747 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-05-18 01:57:17,749 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536637269_0001_00_000002, stoppedTime=1463536637749, exitStatus=-1000
2016-05-18 01:57:17,750 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(298)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1463536637269_0001_1_01_000000_0 failed: true container: container_1463536637269_0001_00_000002 numFailedTAs: 0
2016-05-18 01:57:17,751 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(993)) - Container container_1463536637269_0001_00_000002 exited with diagnostics set to TaskExecutionFailure: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0']
2016-05-18 01:57:17,752 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD] completed., numCompletedVertices=2, numSuccessfulVertices=1, numFailedVertices=1, numKilledVertices=0, numVertices=2
2016-05-18 01:57:17,752 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=2, numSuccessfulVertices=1, numFailedVertices=1, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=VERTEX_FAILURE
2016-05-18 01:57:17,752 INFO  impl.DAGImpl (DAGImpl.java:finishWithTerminationCause(1350)) - DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0
2016-05-18 01:57:17,756 INFO  recovery.RecoveryService (RecoveryService.java:handle(327)) - DAG completed, dagId=dag_1463536637269_0001_1, queueSize=0
2016-05-18 01:57:17,758 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536637269_0001_1][Event:DAG_FINISHED]: dagId=dag_1463536637269_0001_1, startTime=1463536637461, finishTime=1463536637756, timeTaken=295, status=FAILED, diagnostics=Vertex failed, vertexName=DDBA01E0F5C74EEAA5109B462C17ACFD, vertexId=vertex_1463536637269_0001_1_01, diagnostics=[Task failed, taskId=task_1463536637269_0001_1_01_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task: attempt_1463536637269_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD] killed/failed due to:OWN_TASK_FAILURE]
DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=2, RACK_LOCAL_TASKS=1, AM_CPU_MILLISECONDS=460, AM_GC_TIME_MILLIS=0, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536637620, Process_Duration=4, Process_End_Time=1463536637624, Read_Duration=3, Tuples_Read=10, Tuples_Written=7, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=10
2016-05-18 01:57:17,759 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3082)) - Ignoring multiple aborts for vertex: vertex_1463536637269_0001_1_01 [DDBA01E0F5C74EEAA5109B462C17ACFD]
2016-05-18 01:57:17,759 INFO  impl.DAGImpl (DAGImpl.java:finished(1405)) - DAG: dag_1463536637269_0001_1 finished with state: FAILED
2016-05-18 01:57:17,759 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536637269_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-05-18 01:57:17,760 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(260)) - Ignoring stop request for containerId: container_1463536637269_0001_00_000002
2016-05-18 01:57:17 Completed Dag: dag_1463536637269_0001_1
2016-05-18 01:57:17,764 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(751)) - DAG completed, dagId=dag_1463536637269_0001_1, dagState=FAILED
2016-05-18 01:57:17,764 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536637269_0001_1_post
2016-05-18 01:57:17,764 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:17,764 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(800)) - Central Dispatcher queue size after DAG completion, before cleanup: 1
2016-05-18 01:57:17,764 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(802)) - Waiting for next DAG to be submitted.
2016-05-18 01:57:17,765 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(842)) - Cleaning up DAG: name=[AE7FE9D21BA440EAA9259A4AE18A9F74/D4785184DA044555A177BF09E9B78832] test/(1/1) ...moval/value/STRICT/STRICT, with id=dag_1463536637269_0001_1
2016-05-18 01:57:17,765 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(852)) - Completed cleanup for DAG: name=[AE7FE9D21BA440EAA9259A4AE18A9F74/D4785184DA044555A177BF09E9B78832] test/(1/1) ...moval/value/STRICT/STRICT, with id=dag_1463536637269_0001_1
2016-05-18 01:57:17,767 INFO  client.TezClient (TezClient.java:stop(566)) - Shutting down Tez Session, sessionName=(1/1) ...moval/value/STRICT/STRICT, applicationId=application_1463536637269_0001
2016-05-18 01:57:17,771 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(124)) - Received message to shutdown AM
2016-05-18 01:57:17,772 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:setShouldUnregisterFlag(895)) - TaskScheduler notified that it should unregister from RM
2016-05-18 01:57:17,772 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1301)) - No current running DAG, shutting down the AM
2016-05-18 01:57:17,772 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(907)) - DAGAppMasterShutdownHandler invoked
2016-05-18 01:57:17,772 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(916)) - Handling DAGAppMaster shutdown
2016-05-18 01:57:17,773 INFO  app.DAGAppMaster (DAGAppMaster.java:run(936)) - Sleeping for 5 seconds before shutting down
2016-05-18 01:57:17,773 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(84)) - Stopping HistoryEventHandler
2016-05-18 01:57:17,774 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(196)) - Stopping RecoveryService
2016-05-18 01:57:17,774 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(199)) - Handle the remaining events in queue, queue size=0
2016-05-18 01:57:17,775 INFO  recovery.RecoveryService (RecoveryService.java:run(173)) - EventQueue take interrupted. Returning
2016-05-18 01:57:17,775 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(221)) - Closing Summary Stream
2016-05-18 01:57:17,776 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-18 01:57:17,776 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-18 01:57:17,780 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:serviceStop(678)) - Shutting down AppCallbackExecutor
2016-05-18 01:57:17,785 INFO  app.DAGAppMaster (DAGAppMaster.java:run(2084)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/AE7FE9D21BA440EAA9259A4AE18A9F74/D4785184DA044555A177BF09E9B78832/.tez/application_1463536637269_0001
2016-05-18 01:57:17,786 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] stopping all jobs
2016-05-18 01:57:17,786 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] stopping: (1/1) ...moval/value/STRICT/STRICT
2016-05-18 01:57:17,788 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] stopped all jobs
2016-05-18 01:57:17,788 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/STRICT/STRICT/_temporary
2016-05-18 01:57:17,789 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  completed in: 00:00.544
2016-05-18 01:57:17,833 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 01:57:17,833 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-18 01:57:17,925 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.031
2016-05-18 01:57:17,943 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.049
2016-05-18 01:57:17,944 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:17,944 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:17,945 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 01:57:17,965 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt
2016-05-18 01:57:17,978 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/NONE/VALID
2016-05-18 01:57:18,057 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting
2016-05-18 01:57:18,057 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:18,058 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  sink: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/NONE/VALID"]
2016-05-18 01:57:18,058 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  parallel execution of steps is enabled: false
2016-05-18 01:57:18,058 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  executing total steps: 1
2016-05-18 01:57:18,059 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  allocating management threads: 1
2016-05-18 01:57:18,060 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting step: (1/1) ...sRemoval/value/NONE/VALID
2016-05-18 01:57:18,060 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [test] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-18 01:57:18,081 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tez session mode enabled: true
2016-05-18 01:57:18,086 INFO  client.TezClient (TezClient.java:<init>(174)) - Tez Client Version: [ component=tez-api, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:18,086 INFO  client.TezClient (TezClient.java:start(394)) - Session mode. Starting session.
2016-05-18 01:57:18,086 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(164)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-18 01:57:18,095 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(122)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4E19F90B76A64B95BCD09ED8F1E133FA/FD6E54E5F75C4382BC86D5A3D321D569/.tez/application_1463536638086_0001 doesn't exist and is created
2016-05-18 01:57:18,115 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(332)) - DAGAppMaster thread has been created
2016-05-18 01:57:18,116 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-18 01:57:18,116 INFO  client.LocalClient (LocalClient.java:run(282)) - Using working directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4E19F90B76A64B95BCD09ED8F1E133FA/FD6E54E5F75C4382BC86D5A3D321D569/.tez/application_1463536638086_0001_wd
2016-05-18 01:57:18,132 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(363)) - Created DAGAppMaster for application appattempt_1463536638086_0001_000000, versionInfo=[ component=tez-dag, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:18,133 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(80)) - Trying to locate HadoopShimProvider for hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:18,133 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(139)) - Picked HadoopShim org.apache.tez.hadoop.shim.DefaultHadoopShim, providerName=null, overrideProviderViaConfig=null, hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:18,135 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(436)) - AM Level configured TaskSchedulers: [0:TezUber:null]
2016-05-18 01:57:18,135 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(437)) - AM Level configured ContainerLaunchers: [0:TezUber:null]
2016-05-18 01:57:18,135 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(438)) - AM Level configured TaskCommunicators: [0:TezUber:null]
2016-05-18 01:57:18,135 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(447)) - Comparing client version with AM version, clientVersion=0.8.2, AMVersion=0.8.2
2016-05-18 01:57:18,136 INFO  app.TaskCommunicatorManager (TaskCommunicatorManager.java:createUberTaskCommunicator(192)) - Creating Default Local Task Communicator
2016-05-18 01:57:18,138 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.container.AMContainerEventType for class org.apache.tez.dag.app.rm.container.AMContainerMap
2016-05-18 01:57:18,138 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.node.AMNodeEventType for class org.apache.tez.dag.app.rm.node.AMNodeTracker
2016-05-18 01:57:18,139 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGAppMasterEventType for class org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterEventHandler
2016-05-18 01:57:18,139 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGEventType for class org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher
2016-05-18 01:57:18,139 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.VertexEventType for class org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher
2016-05-18 01:57:18,140 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(529)) - Using concurrent dispatcher: false
2016-05-18 01:57:18,140 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher
2016-05-18 01:57:18,140 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskAttemptEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher
2016-05-18 01:57:18,141 INFO  common.AsyncDispatcher (AsyncDispatcher.java:registerAndCreateDispatcher(262)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for independent dispatch using: class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:18,141 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:18,142 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.AMSchedulerEventType for class org.apache.tez.dag.app.rm.TaskSchedulerManager
2016-05-18 01:57:18,142 INFO  launcher.TezContainerLauncherImpl (ContainerLauncherManager.java:createUberContainerLauncher(134)) - Creating LocalContainerLauncher
2016-05-18 01:57:18,144 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.ContainerLauncherEventType for class org.apache.tez.dag.app.launcher.ContainerLauncherManager
2016-05-18 01:57:18,145 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(78)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1, nodeUpdatesRescheduleEnabled: false
2016-05-18 01:57:18,145 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(57)) - Initializing HistoryEventHandler withrecoveryEnabled=true, historyServiceClassName=org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService
2016-05-18 01:57:18,145 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4E19F90B76A64B95BCD09ED8F1E133FA/FD6E54E5F75C4382BC86D5A3D321D569/.tez/application_1463536638086_0001_wd/localmode-log-dir
2016-05-18 01:57:18,146 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4E19F90B76A64B95BCD09ED8F1E133FA/FD6E54E5F75C4382BC86D5A3D321D569/.tez/application_1463536638086_0001_wd/localmode-log-dir/history.txt.appattempt_1463536638086_0001_000000, maxErrors=10
2016-05-18 01:57:18,146 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(124)) - RecoveryService initialized with recoveryPath=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4E19F90B76A64B95BCD09ED8F1E133FA/FD6E54E5F75C4382BC86D5A3D321D569/.tez/application_1463536638086_0001/recovery/0, bufferSize(bytes)=8192, flushInterval(s)=30, maxUnflushedEvents=100
2016-05-18 01:57:18,147 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463536638086_0001_000000, appSubmitTime=1463536638132, launchTime=1463536638132
2016-05-18 01:57:18,155 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-18 01:57:18,158 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:47270
2016-05-18 01:57:18,160 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:createUberTaskScheduler(557)) - Creating TaskScheduler: Local TaskScheduler with clusterIdentifier=1463536638086
2016-05-18 01:57:18,162 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463536638086_0001_000000, startTime=1463536638162
2016-05-18 01:57:18,162 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1945)) - In Session mode. Waiting for DAG over RPC
2016-05-18 01:57:18,216 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-18 01:57:18,216 INFO  client.TezClient (TezClient.java:start(428)) - The url to track the Tez Session: N/A
2016-05-18 01:57:18,216 INFO  client.TezClient (TezClient.java:submitDAGSession(470)) - Submitting dag to TezSession, sessionName=(1/1) ...sRemoval/value/NONE/VALID, applicationId=application_1463536638086_0001, dagName=[4E19F90B76A64B95BCD09ED8F1E133FA/FD6E54E5F75C4382BC86D5A3D321D569] test/(1/1) ...sRemoval/value/NONE/VALID
2016-05-18 01:57:18,237 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1351)) - Starting DAG submitted via RPC: [4E19F90B76A64B95BCD09ED8F1E133FA/FD6E54E5F75C4382BC86D5A3D321D569] test/(1/1) ...sRemoval/value/NONE/VALID
2016-05-18 01:57:18,237 INFO  app.DAGAppMaster (DAGAppMaster.java:createDAG(985)) - Merging AM credentials into DAG credentials
2016-05-18 01:57:18,238 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(1076)) - Generating DAG graphviz file, dagId=dag_1463536638086_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4E19F90B76A64B95BCD09ED8F1E133FA/FD6E54E5F75C4382BC86D5A3D321D569/.tez/application_1463536638086_0001_wd/localmode-log-dir/dag_1463536638086_0001_1.dot
2016-05-18 01:57:18,239 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(1093)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4E19F90B76A64B95BCD09ED8F1E133FA/FD6E54E5F75C4382BC86D5A3D321D569/.tez/application_1463536638086_0001_wd/localmode-log-dir/dag_1463536638086_0001_1-tez-dag.pb.txt
2016-05-18 01:57:18,247 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536638086_0001_1
2016-05-18 01:57:18,247 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:18,247 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2399)) - Running DAG: [4E19F90B76A64B95BCD09ED8F1E133FA/FD6E54E5F75C4382BC86D5A3D321D569] test/(1/1) ...sRemoval/value/NONE/VALID
2016-05-18 01:57:18 Running Dag: dag_1463536638086_0001_1
2016-05-18 01:57:18,262 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463536638086_0001_1, submitTime=1463536638237
2016-05-18 01:57:18,263 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4E19F90B76A64B95BCD09ED8F1E133FA/FD6E54E5F75C4382BC86D5A3D321D569/.tez/application_1463536638086_0001/tez-conf.pb" } size: 40984 timestamp: 1463536638000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:18,263 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalInputs(3978)) - Setting 1 additional inputs for vertexvertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011]
2016-05-18 01:57:18,264 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:18,264 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4E19F90B76A64B95BCD09ED8F1E133FA/FD6E54E5F75C4382BC86D5A3D321D569/.tez/application_1463536638086_0001/tez-conf.pb" } size: 40984 timestamp: 1463536638000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:18,265 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4023)) - Setting 1 additional outputs for vertex vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442]
2016-05-18 01:57:18,265 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:18,265 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1593)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-18 01:57:18,265 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463536638086_0001_1, initTime=1463536638265
2016-05-18 01:57:18,266 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536638086_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-18 01:57:18,267 INFO  impl.DAGImpl (DAGImpl.java:transition(1768)) - Added additional resources : [[]] to classpath
2016-05-18 01:57:18,267 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:DAG_STARTED]: dagID=dag_1463536638086_0001_1, startTime=1463536638267
2016-05-18 01:57:18,267 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536638086_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-18 01:57:18,267 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2400)) - Root Inputs exist for Vertex: D7D84A117FF14B7897FA9AF9281F5011 : {291B804FC0104163BB2AF8C17DB13CED={InputName=291B804FC0104163BB2AF8C17DB13CED}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-18 01:57:18,268 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2410)) - Starting root input initializer for input: 291B804FC0104163BB2AF8C17DB13CED, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-18 01:57:18,268 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2550)) - Setting vertexManager to RootInputVertexManager for vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011]
2016-05-18 01:57:18,268 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2721)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011]
2016-05-18 01:57:18,268 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2726)) - Vertex will initialize from input initializer. vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011]
2016-05-18 01:57:18,268 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3893)) - Starting 1 inputInitializers for vertex vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011]
2016-05-18 01:57:18,269 INFO  client.TezClient (TezClient.java:submitDAGSession(545)) - Submitted dag to TezSession, sessionName=(1/1) ...sRemoval/value/NONE/VALID, applicationId=application_1463536638086_0001, dagName=[4E19F90B76A64B95BCD09ED8F1E133FA/FD6E54E5F75C4382BC86D5A3D321D569] test/(1/1) ...sRemoval/value/NONE/VALID
2016-05-18 01:57:18,269 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-18 01:57:18,269 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2562)) - Setting vertexManager to ShuffleVertexManager for vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442]
2016-05-18 01:57:18,271 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(272)) - Starting InputInitializer for Input: 291B804FC0104163BB2AF8C17DB13CED on vertex vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011]
2016-05-18 01:57:18,273 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:initialize(1022)) - Shuffle Vertex Manager: settings minFrac:0.25 maxFrac:0.75 auto:false desiredTaskIput:104857600 minTasks:1
2016-05-18 01:57:18,273 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2760)) - Creating 1 tasks for vertex: vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442]
2016-05-18 01:57:18,274 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2779)) - Directly initializing vertex: vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442]
2016-05-18 01:57:18,274 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(109)) - Input 291B804FC0104163BB2AF8C17DB13CED asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7, groupingEnabled: true
2016-05-18 01:57:18,276 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536638086_0001_1_01, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=null, edgeManagersCount=1, rootInputSpecUpdateCount=0, setParallelismCalledFlag=false
2016-05-18 01:57:18,276 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2187)) - Setting up committers for vertex vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442], numAdditionalOutputs=1
2016-05-18 01:57:18,276 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2202)) - Instantiating committer for output=1BB3E06825ED4278909118992AB533E9, vertex=vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-18 01:57:18,280 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(121)) - Committer for B8C6FD0B3A354F169FF4C1E1B484C442:1BB3E06825ED4278909118992AB533E9 using oldmapred API
2016-05-18 01:57:18,281 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(146)) - OutputCommitter for outputName=1BB3E06825ED4278909118992AB533E9, vertexName=B8C6FD0B3A354F169FF4C1E1B484C442, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-18 01:57:18,281 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(168)) - Grouping splits in Tez
2016-05-18 01:57:18,281 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(226)) - Desired splits: 1 too large.  Desired splitLength: 1449 Min splitLength: 52428800 New desired splits: 1 Total length: 1449 Original splits: 2
2016-05-18 01:57:18,282 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(321)) - Desired numSplits: 1 lengthPerGroup: 1449 numLocations: 1 numSplitsPerLocation: 2 numSplitsInGroup: 2 totalLength: 1449 numOriginalSplits: 2 . Grouping by length: true count: false nodeLocalOnly: false
2016-05-18 01:57:18,282 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(539)) - Number of splits desired: 1 created: 1 splitsProcessed: 2
2016-05-18 01:57:18,283 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(308)) - Succeeded InputInitializer for Input: 291B804FC0104163BB2AF8C17DB13CED on vertex vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011]
2016-05-18 01:57:18,282 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B8C6FD0B3A354F169FF4C1E1B484C442, vertexId=vertex_1463536638086_0001_1_01, initRequestedTime=1463536638269, initedTime=1463536638276, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=0, initGeneratedEventsCount=0
2016-05-18 01:57:18,285 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442] transitioned from NEW to INITED due to event V_INIT
2016-05-18 01:57:18,285 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:18,286 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1644)) - Got updated RootInputsSpecs: {291B804FC0104163BB2AF8C17DB13CED=forAllWorkUnits=true, update=[1]}
2016-05-18 01:57:18,286 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1664)) - Vertex vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011] parallelism set to 1
2016-05-18 01:57:18,287 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:18,289 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:VERTEX_INITIALIZED]: vertexName=D7D84A117FF14B7897FA9AF9281F5011, vertexId=vertex_1463536638086_0001_1_00, initRequestedTime=1463536638267, initedTime=1463536638288, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1, initGeneratedEventsCount=1
2016-05-18 01:57:18,289 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011] with distanceFromRoot: 0
2016-05-18 01:57:18,289 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011] transitioned from INITIALIZING to INITED due to event V_INPUT_DATA_INFORMATION
2016-05-18 01:57:18,289 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536638086_0001_1_00, startRequestedTime=1463536638269, startedTime=1463536638289
2016-05-18 01:57:18,290 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536638086_0001_1_00, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=org.apache.tez.dag.api.VertexLocationHint@b8338fe7, edgeManagersCount=0, rootInputSpecUpdateCount=1, setParallelismCalledFlag=true
2016-05-18 01:57:18,290 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:18,290 INFO  impl.VertexImpl (VertexImpl.java:transition(2932)) - Source vertex started: vertex_1463536638086_0001_1_00 for vertex: vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442] numStartedSources: 1 numSources: 1
2016-05-18 01:57:18,290 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442] with distanceFromRoot: 1
2016-05-18 01:57:18,291 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(100)) - Starting 1 in D7D84A117FF14B7897FA9AF9281F5011
2016-05-18 01:57:18,291 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011]
2016-05-18 01:57:18,293 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536638086_0001_1_01, startRequestedTime=1463536638290, startedTime=1463536638291
2016-05-18 01:57:18,294 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:18,295 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:onVertexStarted(519)) - OnVertexStarted vertex: B8C6FD0B3A354F169FF4C1E1B484C442 with 0 source tasks and 1 pending tasks
2016-05-18 01:57:18,295 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:TASK_STARTED]: vertexName=D7D84A117FF14B7897FA9AF9281F5011, taskId=task_1463536638086_0001_1_00_000000, scheduledTime=1463536638295, launchTime=1463536638295
2016-05-18 01:57:18,296 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:handleVertexStateUpdate(1051)) - Received configured notification : CONFIGURED for vertex: D7D84A117FF14B7897FA9AF9281F5011 in vertex: B8C6FD0B3A354F169FF4C1E1B484C442 numBipartiteSourceTasks: 1
2016-05-18 01:57:18,296 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011]
2016-05-18 01:57:18,297 INFO  node.PerSourceNodeTracker (PerSourceNodeTracker.java:nodeSeen(74)) - Adding new node 127.0.0.1:0 to nodeTracker 0
2016-05-18 01:57:18,297 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] submitted tez dag to app master: application_1463536638086_0001, with dag id: dag_1463536638086_0001_1
2016-05-18 01:57:18,300 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536638086_0001_00_000001, launchTime=1463536638300
2016-05-18 01:57:18,300 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536638086_0001_00_000001
2016-05-18 01:57:18,301 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536638086_0001_1_00_000000_0] started. Is using containerId: [container_1463536638086_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-18 01:57:18,301 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=D7D84A117FF14B7897FA9AF9281F5011, taskAttemptId=attempt_1463536638086_0001_1_00_000000_0, startTime=1463536638301, containerId=container_1463536638086_0001_00_000001, nodeId=127.0.0.1:0
2016-05-18 01:57:18,302 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536638086_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536638086_0001_1_00_000000_0
2016-05-18 01:57:18 Starting to run new task attempt: attempt_1463536638086_0001_1_00_000000_0
2016-05-18 01:57:18,303 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536638086_0001_1_00_000000_0
2016-05-18 01:57:18,303 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:18,304 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:18,304 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [4E19F90B76A64B95BCD09ED8F1E133FA/FD6E54E5F75C4382BC86D5A3D321D569] test/(1/1) ...sRemoval/value/NONE/VALID, VertexName: D7D84A117FF14B7897FA9AF9281F5011, VertexParallelism: 1, TaskAttemptID:attempt_1463536638086_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=291B804FC0104163BB2AF8C17DB13CED, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=B8C6FD0B3A354F169FF4C1E1B484C442, physicalEdgeCount=1, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ]
2016-05-18 01:57:18,304 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:18,305 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536638086_0001_1_00_000000_0
2016-05-18 01:57:18,307 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(496)) - TaskAttempt:attempt_1463536638086_0001_1_00_000000_0 sent events: (0-1).
2016-05-18 01:57:18,308 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536638086_0001_1_00_000000_0, eventCount=1 fromEventId=0 nextFromEventId=0
2016-05-18 01:57:18,311 INFO  input.MRInput (MRInput.java:initialize(440)) - 291B804FC0104163BB2AF8C17DB13CED using newmapreduce API=false, split via event=true, numPhysicalInputs=1
2016-05-18 01:57:18,311 INFO  input.MRInput (MRInput.java:initializeInternal(494)) - Initialized MRInput: 291B804FC0104163BB2AF8C17DB13CED
2016-05-18 01:57:18,313 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:18,320 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: D7D84A117FF14B7897FA9AF9281F5011, ordinal: 0
2016-05-18 01:57:18,320 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D7D84A117FF14B7897FA9AF9281F5011, mem on start (mb), free: 167, total: 483, max: 672
2016-05-18 01:57:18,320 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:18,320 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:18,320 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:18,321 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:18,321 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[291B804FC0104163BB2AF8C17DB13CED:INPUT:0:org.apache.tez.mapreduce.input.MRInput], [B8C6FD0B3A354F169FF4C1E1B484C442:OUTPUT:104857600:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput]
2016-05-18 01:57:18,321 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:18,321 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:18,322 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 104857600, TotalRequestedScaled: 9.679163076923077E7, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.15
2016-05-18 01:57:18,322 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[291B804FC0104163BB2AF8C17DB13CED:org.apache.tez.mapreduce.input.MRInput:INPUT:0:0], [B8C6FD0B3A354F169FF4C1E1B484C442:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput:OUTPUT:104857600:104857600]
2016-05-18 01:57:18,322 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:18,322 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: 291B804FC0104163BB2AF8C17DB13CED being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:18,323 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:18,323 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:18,322 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: 291B804FC0104163BB2AF8C17DB13CED
2016-05-18 01:57:18,324 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:18,324 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536638086_0001_1_00_000000_0
2016-05-18 01:57:18,325 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(174)) - Processing split: TezGroupedSplit{wrappedSplits=[file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:0+724, file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:724+725], wrappedInputFormatName='org.apache.hadoop.mapred.TextInputFormat', locations=[localhost], rack='null', length=1449}
2016-05-18 01:57:18,327 INFO  input.MRInput (MRInput.java:initFromEventInternal(653)) - 291B804FC0104163BB2AF8C17DB13CED initialized RecordReader from event
2016-05-18 01:57:18,328 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:18,329 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"] streamed: true, id: 291B804FC0104163BB2AF8C17DB13CED
2016-05-18 01:57:18,329 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: GroupBy(test)[by:[{1}:'method']], id: C1BF3EEAF7314C77933DB73EEBC51261
2016-05-18 01:57:18,330 INFO  element.TezGroupGate (TezGroupGate.java:prepare(98)) - calling OrderedPartitionedKVOutput#start() on: GroupBy(test)[by:[{1}:'method']] C1BF3EEAF7314C77933DB73EEBC51261
2016-05-18 01:57:18,331 INFO  impl.ExternalSorter (ExternalSorter.java:<init>(199)) - B8C6FD0B3A354F169FF4C1E1B484C442 using: memoryMb=100, keySerializerClass=class cascading.tuple.io.KeyTuple, valueSerializerClass=cascading.tuple.hadoop.io.ValueTupleSerializer@61387c19, comparator=cascading.tuple.hadoop.util.TupleComparator@435b7f2c, partitioner=cascading.tuple.tez.util.TuplePartitioner, serialization=cascading.tuple.hadoop.TupleSerialization,org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
2016-05-18 01:57:18,332 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(170)) - Setting up PipelinedSorter for B8C6FD0B3A354F169FF4C1E1B484C442: , UsingHashComparator=false
2016-05-18 01:57:18,346 INFO  impl.PipelinedSorter (PipelinedSorter.java:allocateSpace(245)) - Newly allocated block size=104857600, index=0, Number of buffers=1, currentAllocatableMemory=0, currentBufferSize=104857600, total=104857600
2016-05-18 01:57:18,346 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(189)) - Pre allocating rest of memory buffers upfront
2016-05-18 01:57:18,347 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(207)) - Setting up PipelinedSorter for B8C6FD0B3A354F169FF4C1E1B484C442: , UsingHashComparator=false#blocks=1, maxMemUsage=104857600, lazyAllocateMem=false, minBlockSize=2097152000, initial BLOCK_SIZE=104857600, finalMergeEnabled=true, pipelinedShuffle=false, sendEmptyPartitions=true, tez.runtime.io.sort.mb=100
2016-05-18 01:57:18,347 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(882)) - B8C6FD0B3A354F169FF4C1E1B484C442: reserved.remaining()=104857600, reserved.metasize=16777216
2016-05-18 01:57:18,348 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:18,348 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: D7D84A117FF14B7897FA9AF9281F5011, all 1 inputs ready in: 00:00:00.000
2016-05-18 01:57:18,351 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536638086_0001_1_00_000000_0
2016-05-18 01:57:18,352 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D7D84A117FF14B7897FA9AF9281F5011, mem on close (mb), free: 65, total: 483, max: 672
2016-05-18 01:57:18,352 INFO  impl.PipelinedSorter (PipelinedSorter.java:flush(629)) - B8C6FD0B3A354F169FF4C1E1B484C442: Starting flush of map output
2016-05-18 01:57:18,352 INFO  impl.PipelinedSorter (PipelinedSorter.java:end(995)) - B8C6FD0B3A354F169FF4C1E1B484C442: Span0.length = 7, perItem = 99
2016-05-18 01:57:18,353 INFO  impl.PipelinedSorter (PipelinedSorter.java:sort(904)) - B8C6FD0B3A354F169FF4C1E1B484C442: done sorting span=0, length=7, time=0
2016-05-18 01:57:18,353 INFO  impl.PipelinedSorter (PipelinedSorter.java:ready(1297)) - B8C6FD0B3A354F169FF4C1E1B484C442: Heap = SpanIterator<0:6> (span=Span[16777216,693]),
2016-05-18 01:57:18,354 INFO  impl.PipelinedSorter (PipelinedSorter.java:spill(546)) - B8C6FD0B3A354F169FF4C1E1B484C442: Spilling to /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4E19F90B76A64B95BCD09ED8F1E133FA/FD6E54E5F75C4382BC86D5A3D321D569/.tez/application_1463536638086_0001_wd/localmode-local-dir/output/attempt_1463536638086_0001_1_00_000000_0_10021_0/file.out
2016-05-18 01:57:18,357 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:18 Completed running task attempt: attempt_1463536638086_0001_1_00_000000_0
2016-05-18 01:57:18,358 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536638086_0001_1_00_000000_0, askedToStop=false
2016-05-18 01:57:18,359 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536638086_0001_1_00_000000_0, stopRequested=false
2016-05-18 01:57:18,359 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536638086_0001_1_00_000000_0: Counters: 18 [[org.apache.tez.common.counters.TaskCounter SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1][cascading.flow.SliceCounters Process_Begin_Time=1463536638348, Process_Duration=3, Process_End_Time=1463536638351, Read_Duration=1, Tuples_Read=10, Tuples_Written=7, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=10]]
2016-05-18 01:57:18,360 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536638086_0001_1_00_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:18,360 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:18,360 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:18,361 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:18,361 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=D7D84A117FF14B7897FA9AF9281F5011, taskAttemptId=attempt_1463536638086_0001_1_00_000000_0, creationTime=1463536638296, allocationTime=1463536638299, startTime=1463536638301, finishTime=1463536638360, timeTaken=59, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:18,363 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536638086_0001_1_00_000000_0
2016-05-18 01:57:18,361 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536638086_0001_00_000001
2016-05-18 01:57:18,364 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:TASK_FINISHED]: vertexName=D7D84A117FF14B7897FA9AF9281F5011, taskId=task_1463536638086_0001_1_00_000000, startTime=1463536638301, finishTime=1463536638363, timeTaken=62, status=SUCCEEDED, successfulAttemptID=attempt_1463536638086_0001_1_00_000000_0, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536638348, Process_Duration=3, Process_End_Time=1463536638351, Read_Duration=1, Tuples_Read=10, Tuples_Written=7, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10
2016-05-18 01:57:18,365 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:18,365 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011]
2016-05-18 01:57:18,366 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:VERTEX_FINISHED]: vertexName=D7D84A117FF14B7897FA9AF9281F5011, vertexId=vertex_1463536638086_0001_1_00, initRequestedTime=1463536638267, initedTime=1463536638288, startRequestedTime=1463536638269, startedTime=1463536638289, finishTime=1463536638365, timeTaken=76, status=SUCCEEDED, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536638348, Process_Duration=3, Process_End_Time=1463536638351, Read_Duration=1, Tuples_Read=10, Tuples_Written=7, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10, vertexStats=firstTaskStartTime=1463536638301, firstTasksToStart=[ task_1463536638086_0001_1_00_000000 ], lastTaskFinishTime=1463536638360, lastTasksToFinish=[ task_1463536638086_0001_1_00_000000 ], minTaskDuration=59, maxTaskDuration=59, avgTaskDuration=59.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536638086_0001_1_00_000000 ], longestDurationTasks=[ task_1463536638086_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:18,366 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:18,366 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536638086_0001_00_000001, stoppedTime=1463536638366, exitStatus=0
2016-05-18 01:57:18,367 INFO  impl.VertexImpl (VertexImpl.java:transition(3279)) - Source task attempt completed for vertex: vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442] attempt: attempt_1463536638086_0001_1_00_000000_0 with state: SUCCEEDED vertexState: RUNNING
2016-05-18 01:57:18,367 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:18,367 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:schedulePendingTasks(920)) - All source tasks assigned. Ramping up 1 remaining tasks for vertex: B8C6FD0B3A354F169FF4C1E1B484C442
2016-05-18 01:57:18,367 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:18,367 INFO  impl.Edge (Edge.java:routingToBegin(232)) - Routing to begin for edge: EdgeInfo: sourceVertexName=D7D84A117FF14B7897FA9AF9281F5011, destinationVertexName=B8C6FD0B3A354F169FF4C1E1B484C442. EdgeProperty: { SCATTER_GATHER : org.apache.tez.runtime.library.input.OrderedGroupedKVInput >> PERSISTED >> org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput >> NullEdgeManager } onDemandRouting: true
2016-05-18 01:57:18,368 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442]
2016-05-18 01:57:18,368 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(262)) - Ignoring stop request for containerId container_1463536638086_0001_00_000001. Relying on regular task shutdown for it to end
2016-05-18 01:57:18,368 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:TASK_STARTED]: vertexName=B8C6FD0B3A354F169FF4C1E1B484C442, taskId=task_1463536638086_0001_1_01_000000, scheduledTime=1463536638368, launchTime=1463536638368
2016-05-18 01:57:18,369 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442]
2016-05-18 01:57:18,371 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536638086_0001_00_000002, launchTime=1463536638371
2016-05-18 01:57:18,372 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536638086_0001_00_000002
2016-05-18 01:57:18,373 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536638086_0001_1_01_000000_0] started. Is using containerId: [container_1463536638086_0001_00_000002] on NM: [127.0.0.1:0]
2016-05-18 01:57:18,373 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B8C6FD0B3A354F169FF4C1E1B484C442, taskAttemptId=attempt_1463536638086_0001_1_01_000000_0, startTime=1463536638373, containerId=container_1463536638086_0001_00_000002, nodeId=127.0.0.1:0
2016-05-18 01:57:18,373 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536638086_0001_00_000002: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536638086_0001_1_01_000000_0
2016-05-18 01:57:18,374 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536638086_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-18 01:57:18,374 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536638086_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:18,374 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536638086_0001_00_000001, Exiting
2016-05-18 01:57:18,374 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536638086_0001_00_000001
2016-05-18 01:57:18,374 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536638086_0001_00_000001
2016-05-18 01:57:18 Starting to run new task attempt: attempt_1463536638086_0001_1_01_000000_0
2016-05-18 01:57:18,375 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536638086_0001_1_01_000000_0
2016-05-18 01:57:18,375 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:18,376 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:18,375 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536638086_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:18,376 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536638086_0001_00_000001 completed successfully
2016-05-18 01:57:18,376 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [4E19F90B76A64B95BCD09ED8F1E133FA/FD6E54E5F75C4382BC86D5A3D321D569] test/(1/1) ...sRemoval/value/NONE/VALID, VertexName: B8C6FD0B3A354F169FF4C1E1B484C442, VertexParallelism: 1, TaskAttemptID:attempt_1463536638086_0001_1_01_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=D7D84A117FF14B7897FA9AF9281F5011, physicalEdgeCount=1, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=1BB3E06825ED4278909118992AB533E9, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-18 01:57:18,377 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:18,377 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536638086_0001_1_01_000000_0
2016-05-18 01:57:18,381 INFO  impl.VertexImpl (VertexImpl.java:getTaskAttemptTezEvents(3662)) - Sending attempt_1463536638086_0001_1_01_000000_0 1 events [0,1) total 1 vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442]
2016-05-18 01:57:18,382 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536638086_0001_1_01_000000_0, eventCount=1 fromEventId=0 nextFromEventId=1
2016-05-18 01:57:18,395 INFO  orderedgrouped.MergeManager (MergeManager.java:getInitialMemoryRequirement(339)) - Initial Memory required for SHUFFLE_BUFFER=211392912 based on INPUT_BUFFER_FACTOR=0.9,  for final merged output=0, using factor: 0.0
2016-05-18 01:57:18,400 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:18,412 INFO  output.MROutput (MROutput.java:initialize(421)) - 1BB3E06825ED4278909118992AB533E9: outputFormat=org.apache.hadoop.mapred.TextOutputFormat, using newmapreduce API=false
2016-05-18 01:57:18,413 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B8C6FD0B3A354F169FF4C1E1B484C442, ordinal: 1
2016-05-18 01:57:18,413 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B8C6FD0B3A354F169FF4C1E1B484C442, mem on start (mb), free: 58, total: 483, max: 672
2016-05-18 01:57:18,413 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:18,414 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:18,414 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:18,414 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:18,414 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[1BB3E06825ED4278909118992AB533E9:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput], [D7D84A117FF14B7897FA9AF9281F5011:INPUT:211392912:org.apache.tez.runtime.library.input.OrderedGroupedKVInput]
2016-05-18 01:57:18,415 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:18,415 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:18,415 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 211392912, TotalRequestedScaled: 1.9513191876923078E8, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.30
2016-05-18 01:57:18,415 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[1BB3E06825ED4278909118992AB533E9:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0], [D7D84A117FF14B7897FA9AF9281F5011:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:211392912:211392912]
2016-05-18 01:57:18,416 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:18,416 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: D7D84A117FF14B7897FA9AF9281F5011 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:18,416 INFO  orderedgrouped.Shuffle (Shuffle.java:<init>(147)) - D7D84A117FF14B7897FA9AF9281F5011: Shuffle assigned with 1 inputs, codec: None, ifileReadAhead: true
2016-05-18 01:57:18,417 INFO  orderedgrouped.MergeManager (MergeManager.java:<init>(273)) - D7D84A117FF14B7897FA9AF9281F5011: MergerManager: memoryLimit=211392912, maxSingleShuffleLimit=52848228, mergeThreshold=190253616, ioSortFactor=100, postMergeMem=0, memToMemMergeOutputsThreshold=100
2016-05-18 01:57:18,419 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:18,419 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:18,419 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:<init>(353)) - ShuffleScheduler running for sourceVertex: D7D84A117FF14B7897FA9AF9281F5011 with configuration: maxFetchFailuresBeforeReporting=5, reportReadErrorImmediately=true, maxFailedUniqueFetches=1, abortFailureLimit=15, maxTaskOutputAtOnce=20, numFetchers=1, hostFailureFraction=0.2, minFailurePerHost=4, maxAllowedFailedFetchFraction=0.5, maxStallTimeFraction=0.5, minReqProgressFraction=0.5, checkFailedFetchSinceLastCompletion=true
2016-05-18 01:57:18,421 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: D7D84A117FF14B7897FA9AF9281F5011
2016-05-18 01:57:18,422 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:18,422 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536638086_0001_1_01_000000_0
2016-05-18 01:57:18,424 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - D7D84A117FF14B7897FA9AF9281F5011: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0
2016-05-18 01:57:18,426 INFO  orderedgrouped.ShuffleScheduler (ShuffleUtils.java:logIndividualFetchComplete(489)) - Completed fetch for attempt: {0, 0, attempt_1463536638086_0001_1_00_000000_0_10021} to DISK_DIRECT, csize=653, dsize=649, EndTime=1463536638426, TimeTaken=1, Rate=0.62 MB/s
2016-05-18 01:57:18,426 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:copySucceeded(551)) - All inputs fetched for input vertex : D7D84A117FF14B7897FA9AF9281F5011
2016-05-18 01:57:18,427 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:18,428 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:callInternal(1289)) - Shutting down FetchScheduler for input: D7D84A117FF14B7897FA9AF9281F5011, wasInterrupted=false
2016-05-18 01:57:18,428 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:18,430 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1005)) - finalMerge called with 0 in-memory map-outputs and 1 on-disk map-outputs
2016-05-18 01:57:18,431 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1103)) - Disk file=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4E19F90B76A64B95BCD09ED8F1E133FA/FD6E54E5F75C4382BC86D5A3D321D569/.tez/application_1463536638086_0001_wd/localmode-local-dir/output/attempt_1463536638086_0001_1_00_000000_0_10021/file.out, len=653, isLocal=true
2016-05-18 01:57:18,431 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1115)) - Merging 1 files, 653 bytes from disk
2016-05-18 01:57:18,431 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1130)) - Merging 0 segments, 0 bytes from memory into reduce
2016-05-18 01:57:18,431 INFO  impl.TezMerger (TezMerger.java:merge(644)) - Merging 1 sorted segments
2016-05-18 01:57:18,431 INFO  impl.TezMerger (TezMerger.java:merge(749)) - Down to the last merge-pass, with 1 segments left of total size: 633 bytes
2016-05-18 01:57:18,431 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:onSuccess(1328)) - D7D84A117FF14B7897FA9AF9281F5011: Already shutdown. Ignoring fetch complete
2016-05-18 01:57:18,431 INFO  orderedgrouped.Shuffle (Shuffle.java:callInternal(332)) - merge complete for input vertex : D7D84A117FF14B7897FA9AF9281F5011
2016-05-18 01:57:18,432 INFO  orderedgrouped.Shuffle (Shuffle.java:onSuccess(417)) - D7D84A117FF14B7897FA9AF9281F5011: Shuffle Runner thread complete
2016-05-18 01:57:18,432 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: GroupBy(test)[by:[{1}:'method']]
2016-05-18 01:57:18,435 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: GroupBy(test)[by:[{1}:'method']] streamed: true, id: C1BF3EEAF7314C77933DB73EEBC51261
2016-05-18 01:57:18,435 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/NONE/VALID"], id: 1BB3E06825ED4278909118992AB533E9
2016-05-18 01:57:18,436 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/NONE/VALID"]
2016-05-18 01:57:18,437 INFO  element.TezGroupGate (TezGroupGate.java:prepare(90)) - calling OrderedGroupedKVInput#start() on: GroupBy(test)[by:[{1}:'method']] C1BF3EEAF7314C77933DB73EEBC51261, for 1 inputs
2016-05-18 01:57:18,437 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B8C6FD0B3A354F169FF4C1E1B484C442, all 1 inputs ready in: 00:00:00.000
2016-05-18 01:57:18,439 INFO  input.OrderedGroupedKVInput (OrderedGroupedKVInput.java:createValuesIterator(292)) - D7D84A117FF14B7897FA9AF9281F5011: creating ValuesIterator with comparator=cascading.tuple.hadoop.util.TupleComparator, keyClass=cascading.tuple.io.KeyTuple, valClass=cascading.tuple.io.ValueTuple
2016-05-18 01:57:18,442 INFO  output.MROutput (MROutput.java:close(526)) - 1BB3E06825ED4278909118992AB533E9 closed
2016-05-18 01:57:18,443 INFO  impl.TaskImpl (TaskImpl.java:canCommit(671)) - attempt_1463536638086_0001_1_01_000000_0 given a go for committing the task output.
2016-05-18 01:57:18,445 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536638086_0001_1_01_000000_0
2016-05-18 01:57:18,445 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B8C6FD0B3A354F169FF4C1E1B484C442, mem on close (mb), free: 52, total: 483, max: 672
2016-05-18 01:57:18,445 INFO  orderedgrouped.Shuffle (Shuffle.java:shutdown(278)) - Shutting down Shuffle for source: D7D84A117FF14B7897FA9AF9281F5011
2016-05-18 01:57:18,446 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - D7D84A117FF14B7897FA9AF9281F5011: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0, updateOnClose
2016-05-18 01:57:18,446 INFO  output.MROutput (MROutput.java:close(526)) - 1BB3E06825ED4278909118992AB533E9 closed
2016-05-18 01:57:18,447 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:18 Completed running task attempt: attempt_1463536638086_0001_1_01_000000_0
2016-05-18 01:57:18,448 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536638086_0001_1_01_000000_0, askedToStop=false
2016-05-18 01:57:18,449 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536638086_0001_1_01_000000_0, stopRequested=false
2016-05-18 01:57:18,450 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536638086_0001_1_01_000000_0: Counters: 36 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=11, MERGE_PHASE_TIME=14, FIRST_EVENT_RECEIVED=7, LAST_EVENT_RECEIVED=7][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][cascading.flow.SliceCounters Process_Begin_Time=1463536638438, Process_Duration=7, Process_End_Time=1463536638445, Read_Duration=1, Tuples_Read=7, Tuples_Written=1, Write_Duration=0][cascading.flow.StepCounters Tuples_Written=1]]
2016-05-18 01:57:18,451 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536638086_0001_1_01_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:18,451 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B8C6FD0B3A354F169FF4C1E1B484C442, taskAttemptId=attempt_1463536638086_0001_1_01_000000_0, creationTime=1463536638369, allocationTime=1463536638370, startTime=1463536638373, finishTime=1463536638451, timeTaken=78, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:18,451 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:18,451 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:18,452 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536638086_0001_1_01_000000_0
2016-05-18 01:57:18,452 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:18,452 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536638086_0001_00_000002
2016-05-18 01:57:18,452 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:TASK_FINISHED]: vertexName=B8C6FD0B3A354F169FF4C1E1B484C442, taskId=task_1463536638086_0001_1_01_000000, startTime=1463536638373, finishTime=1463536638452, timeTaken=79, status=SUCCEEDED, successfulAttemptID=attempt_1463536638086_0001_1_01_000000_0, diagnostics=, counters=Counters: 36, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=11, MERGE_PHASE_TIME=14, FIRST_EVENT_RECEIVED=7, LAST_EVENT_RECEIVED=7, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536638438, Process_Duration=7, Process_End_Time=1463536638445, Read_Duration=1, Tuples_Read=7, Tuples_Written=1, Write_Duration=0, cascading.flow.StepCounters, Tuples_Written=1
2016-05-18 01:57:18,453 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:18,453 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442]
2016-05-18 01:57:18,455 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:VERTEX_FINISHED]: vertexName=B8C6FD0B3A354F169FF4C1E1B484C442, vertexId=vertex_1463536638086_0001_1_01, initRequestedTime=1463536638269, initedTime=1463536638276, startRequestedTime=1463536638290, startedTime=1463536638291, finishTime=1463536638453, timeTaken=162, status=SUCCEEDED, diagnostics=, counters=Counters: 36, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=11, MERGE_PHASE_TIME=14, FIRST_EVENT_RECEIVED=7, LAST_EVENT_RECEIVED=7, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536638438, Process_Duration=7, Process_End_Time=1463536638445, Read_Duration=1, Tuples_Read=7, Tuples_Written=1, Write_Duration=0, cascading.flow.StepCounters, Tuples_Written=1, vertexStats=firstTaskStartTime=1463536638373, firstTasksToStart=[ task_1463536638086_0001_1_01_000000 ], lastTaskFinishTime=1463536638451, lastTasksToFinish=[ task_1463536638086_0001_1_01_000000 ], minTaskDuration=78, maxTaskDuration=78, avgTaskDuration=78.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536638086_0001_1_01_000000 ], longestDurationTasks=[ task_1463536638086_0001_1_01_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:18,455 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:18,455 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536638086_0001_00_000002, stoppedTime=1463536638455, exitStatus=0
2016-05-18 01:57:18,456 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442] completed., numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:18,456 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:18,456 INFO  impl.DAGImpl (DAGImpl.java:commitOrFinish(1051)) - No output committers for vertex: vertex_1463536638086_0001_1_00 [D7D84A117FF14B7897FA9AF9281F5011]
2016-05-18 01:57:18,456 INFO  impl.DAGImpl (DAGImpl.java:commitOrFinish(1098)) - Start writing dag commit event, dag_1463536638086_0001_1
2016-05-18 01:57:18,457 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463536638086_0001_1
2016-05-18 01:57:18,457 INFO  impl.DAGImpl (DAGImpl.java:call(1083)) - Committing output: 1BB3E06825ED4278909118992AB533E9 for vertex: vertex_1463536638086_0001_1_01 [B8C6FD0B3A354F169FF4C1E1B484C442], outputName: 1BB3E06825ED4278909118992AB533E9
2016-05-18 01:57:18,459 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536638086_0001_1 transitioned from RUNNING to COMMITTING due to event DAG_VERTEX_COMPLETED
2016-05-18 01:57:18,459 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(262)) - Ignoring stop request for containerId container_1463536638086_0001_00_000002. Relying on regular task shutdown for it to end
2016-05-18 01:57:18,462 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536638086_0001_00_000002 is valid, but no longer registered, and will be killed
2016-05-18 01:57:18,463 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536638086_0001_00_000002: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:18,463 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536638086_0001_00_000002, Exiting
2016-05-18 01:57:18,463 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536638086_0001_00_000002
2016-05-18 01:57:18,463 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536638086_0001_00_000002
2016-05-18 01:57:18,463 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536638086_0001_00_000002 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:18,463 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536638086_0001_00_000002 completed successfully
2016-05-18 01:57:18,469 INFO  impl.DAGImpl (DAGImpl.java:commitCompleted(2192)) - Commit succeeded for output:outputName:1BB3E06825ED4278909118992AB533E9 of vertex/vertexGroup:B8C6FD0B3A354F169FF4C1E1B484C442 isVertexGroupOutput:false
2016-05-18 01:57:18,469 INFO  impl.DAGImpl (DAGImpl.java:checkCommitsForCompletion(1313)) - Checking commits for DAG completion, numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:18,471 INFO  recovery.RecoveryService (RecoveryService.java:handle(327)) - DAG completed, dagId=dag_1463536638086_0001_1, queueSize=0
2016-05-18 01:57:18,472 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638086_0001_1][Event:DAG_FINISHED]: dagId=dag_1463536638086_0001_1, startTime=1463536638267, finishTime=1463536638469, timeTaken=202, status=SUCCEEDED, diagnostics=, counters=Counters: 48, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=2, TOTAL_LAUNCHED_TASKS=2, RACK_LOCAL_TASKS=1, AM_CPU_MILLISECONDS=390, AM_GC_TIME_MILLIS=0, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=14, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=8, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=11, MERGE_PHASE_TIME=14, FIRST_EVENT_RECEIVED=7, LAST_EVENT_RECEIVED=7, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=2927073276786, Process_Duration=10, Process_End_Time=2927073276796, Read_Duration=2, Tuples_Read=17, Tuples_Written=8, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10, Tuples_Written=1
2016-05-18 01:57:18,472 INFO  impl.DAGImpl (DAGImpl.java:finished(1405)) - DAG: dag_1463536638086_0001_1 finished with state: SUCCEEDED
2016-05-18 01:57:18,472 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536638086_0001_1 transitioned from COMMITTING to SUCCEEDED due to event DAG_COMMIT_COMPLETED
2016-05-18 01:57:18 Completed Dag: dag_1463536638086_0001_1
2016-05-18 01:57:18,473 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(751)) - DAG completed, dagId=dag_1463536638086_0001_1, dagState=SUCCEEDED
2016-05-18 01:57:18,473 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536638086_0001_1_post
2016-05-18 01:57:18,473 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:18,473 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(800)) - Central Dispatcher queue size after DAG completion, before cleanup: 0
2016-05-18 01:57:18,473 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(802)) - Waiting for next DAG to be submitted.
2016-05-18 01:57:18,473 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(842)) - Cleaning up DAG: name=[4E19F90B76A64B95BCD09ED8F1E133FA/FD6E54E5F75C4382BC86D5A3D321D569] test/(1/1) ...sRemoval/value/NONE/VALID, with id=dag_1463536638086_0001_1
2016-05-18 01:57:18,474 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(852)) - Completed cleanup for DAG: name=[4E19F90B76A64B95BCD09ED8F1E133FA/FD6E54E5F75C4382BC86D5A3D321D569] test/(1/1) ...sRemoval/value/NONE/VALID, with id=dag_1463536638086_0001_1
2016-05-18 01:57:18,480 INFO  client.TezClient (TezClient.java:stop(566)) - Shutting down Tez Session, sessionName=(1/1) ...sRemoval/value/NONE/VALID, applicationId=application_1463536638086_0001
2016-05-18 01:57:18,483 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(124)) - Received message to shutdown AM
2016-05-18 01:57:18,483 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:setShouldUnregisterFlag(895)) - TaskScheduler notified that it should unregister from RM
2016-05-18 01:57:18,483 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1301)) - No current running DAG, shutting down the AM
2016-05-18 01:57:18,484 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(907)) - DAGAppMasterShutdownHandler invoked
2016-05-18 01:57:18,484 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(916)) - Handling DAGAppMaster shutdown
2016-05-18 01:57:18,484 INFO  app.DAGAppMaster (DAGAppMaster.java:run(936)) - Sleeping for 5 seconds before shutting down
2016-05-18 01:57:18,484 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(84)) - Stopping HistoryEventHandler
2016-05-18 01:57:18,486 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(196)) - Stopping RecoveryService
2016-05-18 01:57:18,486 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(199)) - Handle the remaining events in queue, queue size=0
2016-05-18 01:57:18,486 INFO  recovery.RecoveryService (RecoveryService.java:run(173)) - EventQueue take interrupted. Returning
2016-05-18 01:57:18,486 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(221)) - Closing Summary Stream
2016-05-18 01:57:18,487 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-18 01:57:18,487 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-18 01:57:18,489 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:serviceStop(678)) - Shutting down AppCallbackExecutor
2016-05-18 01:57:18,492 INFO  app.DAGAppMaster (DAGAppMaster.java:run(2084)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4E19F90B76A64B95BCD09ED8F1E133FA/FD6E54E5F75C4382BC86D5A3D321D569/.tez/application_1463536638086_0001
2016-05-18 01:57:18,492 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/NONE/VALID/_temporary
2016-05-18 01:57:18,493 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  completed in: 00:00.435
2016-05-18 01:57:18,591 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 01:57:18,591 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-18 01:57:18,658 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.030
2016-05-18 01:57:18,685 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.057
2016-05-18 01:57:18,686 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:18,686 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:18,686 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 01:57:18,706 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt
2016-05-18 01:57:18,717 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/VALID/VALID
2016-05-18 01:57:18,776 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting
2016-05-18 01:57:18,776 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:18,776 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  sink: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/VALID/VALID"]
2016-05-18 01:57:18,777 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  parallel execution of steps is enabled: false
2016-05-18 01:57:18,777 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  executing total steps: 1
2016-05-18 01:57:18,777 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  allocating management threads: 1
2016-05-18 01:57:18,778 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting step: (1/1) ...Removal/value/VALID/VALID
2016-05-18 01:57:18,778 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [test] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-18 01:57:18,793 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tez session mode enabled: true
2016-05-18 01:57:18,797 INFO  client.TezClient (TezClient.java:<init>(174)) - Tez Client Version: [ component=tez-api, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:18,797 INFO  client.TezClient (TezClient.java:start(394)) - Session mode. Starting session.
2016-05-18 01:57:18,797 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(164)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-18 01:57:18,806 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(122)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/F85B3AE070E349FD8FE0622FDF7032A9/F749B20E606E4618934869DC589EA359/.tez/application_1463536638797_0001 doesn't exist and is created
2016-05-18 01:57:18,827 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(332)) - DAGAppMaster thread has been created
2016-05-18 01:57:18,827 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-18 01:57:18,828 INFO  client.LocalClient (LocalClient.java:run(282)) - Using working directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/F85B3AE070E349FD8FE0622FDF7032A9/F749B20E606E4618934869DC589EA359/.tez/application_1463536638797_0001_wd
2016-05-18 01:57:18,843 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(363)) - Created DAGAppMaster for application appattempt_1463536638797_0001_000000, versionInfo=[ component=tez-dag, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:18,843 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(80)) - Trying to locate HadoopShimProvider for hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:18,844 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(139)) - Picked HadoopShim org.apache.tez.hadoop.shim.DefaultHadoopShim, providerName=null, overrideProviderViaConfig=null, hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:18,845 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(436)) - AM Level configured TaskSchedulers: [0:TezUber:null]
2016-05-18 01:57:18,846 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(437)) - AM Level configured ContainerLaunchers: [0:TezUber:null]
2016-05-18 01:57:18,846 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(438)) - AM Level configured TaskCommunicators: [0:TezUber:null]
2016-05-18 01:57:18,846 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(447)) - Comparing client version with AM version, clientVersion=0.8.2, AMVersion=0.8.2
2016-05-18 01:57:18,847 INFO  app.TaskCommunicatorManager (TaskCommunicatorManager.java:createUberTaskCommunicator(192)) - Creating Default Local Task Communicator
2016-05-18 01:57:18,849 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.container.AMContainerEventType for class org.apache.tez.dag.app.rm.container.AMContainerMap
2016-05-18 01:57:18,850 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.node.AMNodeEventType for class org.apache.tez.dag.app.rm.node.AMNodeTracker
2016-05-18 01:57:18,850 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGAppMasterEventType for class org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterEventHandler
2016-05-18 01:57:18,850 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGEventType for class org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher
2016-05-18 01:57:18,851 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.VertexEventType for class org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher
2016-05-18 01:57:18,851 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(529)) - Using concurrent dispatcher: false
2016-05-18 01:57:18,852 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher
2016-05-18 01:57:18,852 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskAttemptEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher
2016-05-18 01:57:18,853 INFO  common.AsyncDispatcher (AsyncDispatcher.java:registerAndCreateDispatcher(262)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for independent dispatch using: class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:18,853 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:18,854 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.AMSchedulerEventType for class org.apache.tez.dag.app.rm.TaskSchedulerManager
2016-05-18 01:57:18,854 INFO  launcher.TezContainerLauncherImpl (ContainerLauncherManager.java:createUberContainerLauncher(134)) - Creating LocalContainerLauncher
2016-05-18 01:57:18,857 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.ContainerLauncherEventType for class org.apache.tez.dag.app.launcher.ContainerLauncherManager
2016-05-18 01:57:18,858 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(78)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1, nodeUpdatesRescheduleEnabled: false
2016-05-18 01:57:18,858 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(57)) - Initializing HistoryEventHandler withrecoveryEnabled=true, historyServiceClassName=org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService
2016-05-18 01:57:18,859 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/F85B3AE070E349FD8FE0622FDF7032A9/F749B20E606E4618934869DC589EA359/.tez/application_1463536638797_0001_wd/localmode-log-dir
2016-05-18 01:57:18,860 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/F85B3AE070E349FD8FE0622FDF7032A9/F749B20E606E4618934869DC589EA359/.tez/application_1463536638797_0001_wd/localmode-log-dir/history.txt.appattempt_1463536638797_0001_000000, maxErrors=10
2016-05-18 01:57:18,861 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(124)) - RecoveryService initialized with recoveryPath=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/F85B3AE070E349FD8FE0622FDF7032A9/F749B20E606E4618934869DC589EA359/.tez/application_1463536638797_0001/recovery/0, bufferSize(bytes)=8192, flushInterval(s)=30, maxUnflushedEvents=100
2016-05-18 01:57:18,862 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463536638797_0001_000000, appSubmitTime=1463536638843, launchTime=1463536638843
2016-05-18 01:57:18,868 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-18 01:57:18,875 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:46740
2016-05-18 01:57:18,875 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:createUberTaskScheduler(557)) - Creating TaskScheduler: Local TaskScheduler with clusterIdentifier=1463536638797
2016-05-18 01:57:18,877 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463536638797_0001_000000, startTime=1463536638877
2016-05-18 01:57:18,877 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1945)) - In Session mode. Waiting for DAG over RPC
2016-05-18 01:57:18,928 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-18 01:57:18,928 INFO  client.TezClient (TezClient.java:start(428)) - The url to track the Tez Session: N/A
2016-05-18 01:57:18,928 INFO  client.TezClient (TezClient.java:submitDAGSession(470)) - Submitting dag to TezSession, sessionName=(1/1) ...Removal/value/VALID/VALID, applicationId=application_1463536638797_0001, dagName=[F85B3AE070E349FD8FE0622FDF7032A9/F749B20E606E4618934869DC589EA359] test/(1/1) ...Removal/value/VALID/VALID
2016-05-18 01:57:18,947 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1351)) - Starting DAG submitted via RPC: [F85B3AE070E349FD8FE0622FDF7032A9/F749B20E606E4618934869DC589EA359] test/(1/1) ...Removal/value/VALID/VALID
2016-05-18 01:57:18,947 INFO  app.DAGAppMaster (DAGAppMaster.java:createDAG(985)) - Merging AM credentials into DAG credentials
2016-05-18 01:57:18,948 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(1076)) - Generating DAG graphviz file, dagId=dag_1463536638797_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/F85B3AE070E349FD8FE0622FDF7032A9/F749B20E606E4618934869DC589EA359/.tez/application_1463536638797_0001_wd/localmode-log-dir/dag_1463536638797_0001_1.dot
2016-05-18 01:57:18,949 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(1093)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/F85B3AE070E349FD8FE0622FDF7032A9/F749B20E606E4618934869DC589EA359/.tez/application_1463536638797_0001_wd/localmode-log-dir/dag_1463536638797_0001_1-tez-dag.pb.txt
2016-05-18 01:57:18,957 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536638797_0001_1
2016-05-18 01:57:18,957 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:18,957 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2399)) - Running DAG: [F85B3AE070E349FD8FE0622FDF7032A9/F749B20E606E4618934869DC589EA359] test/(1/1) ...Removal/value/VALID/VALID
2016-05-18 01:57:18 Running Dag: dag_1463536638797_0001_1
2016-05-18 01:57:18,974 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463536638797_0001_1, submitTime=1463536638947
2016-05-18 01:57:18,975 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/F85B3AE070E349FD8FE0622FDF7032A9/F749B20E606E4618934869DC589EA359/.tez/application_1463536638797_0001/tez-conf.pb" } size: 40985 timestamp: 1463536638000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:18,975 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalInputs(3978)) - Setting 1 additional inputs for vertexvertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349]
2016-05-18 01:57:18,976 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:18,977 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/F85B3AE070E349FD8FE0622FDF7032A9/F749B20E606E4618934869DC589EA359/.tez/application_1463536638797_0001/tez-conf.pb" } size: 40985 timestamp: 1463536638000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:18,977 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4023)) - Setting 1 additional outputs for vertex vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60]
2016-05-18 01:57:18,978 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:18,978 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1593)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-18 01:57:18,979 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463536638797_0001_1, initTime=1463536638978
2016-05-18 01:57:18,979 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536638797_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-18 01:57:18,980 INFO  impl.DAGImpl (DAGImpl.java:transition(1768)) - Added additional resources : [[]] to classpath
2016-05-18 01:57:18,980 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:DAG_STARTED]: dagID=dag_1463536638797_0001_1, startTime=1463536638980
2016-05-18 01:57:18,980 INFO  client.TezClient (TezClient.java:submitDAGSession(545)) - Submitted dag to TezSession, sessionName=(1/1) ...Removal/value/VALID/VALID, applicationId=application_1463536638797_0001, dagName=[F85B3AE070E349FD8FE0622FDF7032A9/F749B20E606E4618934869DC589EA359] test/(1/1) ...Removal/value/VALID/VALID
2016-05-18 01:57:18,980 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536638797_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-18 01:57:18,981 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2400)) - Root Inputs exist for Vertex: F8B5F8B17114476C91439529272E6349 : {A6EC200F8BD3433FB996CFF2352E8094={InputName=A6EC200F8BD3433FB996CFF2352E8094}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-18 01:57:18,981 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2410)) - Starting root input initializer for input: A6EC200F8BD3433FB996CFF2352E8094, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-18 01:57:18,981 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2550)) - Setting vertexManager to RootInputVertexManager for vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349]
2016-05-18 01:57:18,981 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2721)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349]
2016-05-18 01:57:18,981 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2726)) - Vertex will initialize from input initializer. vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349]
2016-05-18 01:57:18,981 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3893)) - Starting 1 inputInitializers for vertex vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349]
2016-05-18 01:57:18,983 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-18 01:57:18,983 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(272)) - Starting InputInitializer for Input: A6EC200F8BD3433FB996CFF2352E8094 on vertex vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349]
2016-05-18 01:57:18,983 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2562)) - Setting vertexManager to ShuffleVertexManager for vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60]
2016-05-18 01:57:18,986 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(109)) - Input A6EC200F8BD3433FB996CFF2352E8094 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7, groupingEnabled: true
2016-05-18 01:57:18,988 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:initialize(1022)) - Shuffle Vertex Manager: settings minFrac:0.25 maxFrac:0.75 auto:false desiredTaskIput:104857600 minTasks:1
2016-05-18 01:57:18,988 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2760)) - Creating 1 tasks for vertex: vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60]
2016-05-18 01:57:18,989 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2779)) - Directly initializing vertex: vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60]
2016-05-18 01:57:18,989 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536638797_0001_1_01, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=null, edgeManagersCount=1, rootInputSpecUpdateCount=0, setParallelismCalledFlag=false
2016-05-18 01:57:18,990 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2187)) - Setting up committers for vertex vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60], numAdditionalOutputs=1
2016-05-18 01:57:18,991 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2202)) - Instantiating committer for output=243109DB1CEC41E98DC36725B9BA944A, vertex=vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-18 01:57:18,991 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(168)) - Grouping splits in Tez
2016-05-18 01:57:18,991 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(226)) - Desired splits: 1 too large.  Desired splitLength: 1449 Min splitLength: 52428800 New desired splits: 1 Total length: 1449 Original splits: 2
2016-05-18 01:57:18,992 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(321)) - Desired numSplits: 1 lengthPerGroup: 1449 numLocations: 1 numSplitsPerLocation: 2 numSplitsInGroup: 2 totalLength: 1449 numOriginalSplits: 2 . Grouping by length: true count: false nodeLocalOnly: false
2016-05-18 01:57:18,992 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(539)) - Number of splits desired: 1 created: 1 splitsProcessed: 2
2016-05-18 01:57:18,993 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(308)) - Succeeded InputInitializer for Input: A6EC200F8BD3433FB996CFF2352E8094 on vertex vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349]
2016-05-18 01:57:18,994 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(121)) - Committer for EE11C9196E8D4DC2A8A393B30282CB60:243109DB1CEC41E98DC36725B9BA944A using oldmapred API
2016-05-18 01:57:18,994 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(146)) - OutputCommitter for outputName=243109DB1CEC41E98DC36725B9BA944A, vertexName=EE11C9196E8D4DC2A8A393B30282CB60, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-18 01:57:18,996 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:VERTEX_INITIALIZED]: vertexName=EE11C9196E8D4DC2A8A393B30282CB60, vertexId=vertex_1463536638797_0001_1_01, initRequestedTime=1463536638983, initedTime=1463536638990, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=0, initGeneratedEventsCount=0
2016-05-18 01:57:18,996 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60] transitioned from NEW to INITED due to event V_INIT
2016-05-18 01:57:18,997 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:18,998 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1644)) - Got updated RootInputsSpecs: {A6EC200F8BD3433FB996CFF2352E8094=forAllWorkUnits=true, update=[1]}
2016-05-18 01:57:18,998 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1664)) - Vertex vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349] parallelism set to 1
2016-05-18 01:57:18,999 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:19,000 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F8B5F8B17114476C91439529272E6349, vertexId=vertex_1463536638797_0001_1_00, initRequestedTime=1463536638981, initedTime=1463536638999, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1, initGeneratedEventsCount=1
2016-05-18 01:57:19,000 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349] with distanceFromRoot: 0
2016-05-18 01:57:19,000 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349] transitioned from INITIALIZING to INITED due to event V_INPUT_DATA_INFORMATION
2016-05-18 01:57:19,001 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536638797_0001_1_00, startRequestedTime=1463536638983, startedTime=1463536639000
2016-05-18 01:57:19,001 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536638797_0001_1_00, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=org.apache.tez.dag.api.VertexLocationHint@b8338fe7, edgeManagersCount=0, rootInputSpecUpdateCount=1, setParallelismCalledFlag=true
2016-05-18 01:57:19,001 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:19,002 INFO  impl.VertexImpl (VertexImpl.java:transition(2932)) - Source vertex started: vertex_1463536638797_0001_1_00 for vertex: vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60] numStartedSources: 1 numSources: 1
2016-05-18 01:57:19,002 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60] with distanceFromRoot: 1
2016-05-18 01:57:19,002 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(100)) - Starting 1 in F8B5F8B17114476C91439529272E6349
2016-05-18 01:57:19,002 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349]
2016-05-18 01:57:19,003 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536638797_0001_1_01, startRequestedTime=1463536639001, startedTime=1463536639002
2016-05-18 01:57:19,004 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:19,006 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] submitted tez dag to app master: application_1463536638797_0001, with dag id: dag_1463536638797_0001_1
2016-05-18 01:57:19,007 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:onVertexStarted(519)) - OnVertexStarted vertex: EE11C9196E8D4DC2A8A393B30282CB60 with 0 source tasks and 1 pending tasks
2016-05-18 01:57:19,007 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:TASK_STARTED]: vertexName=F8B5F8B17114476C91439529272E6349, taskId=task_1463536638797_0001_1_00_000000, scheduledTime=1463536639006, launchTime=1463536639006
2016-05-18 01:57:19,009 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:handleVertexStateUpdate(1051)) - Received configured notification : CONFIGURED for vertex: F8B5F8B17114476C91439529272E6349 in vertex: EE11C9196E8D4DC2A8A393B30282CB60 numBipartiteSourceTasks: 1
2016-05-18 01:57:19,010 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349]
2016-05-18 01:57:19,011 INFO  node.PerSourceNodeTracker (PerSourceNodeTracker.java:nodeSeen(74)) - Adding new node 127.0.0.1:0 to nodeTracker 0
2016-05-18 01:57:19,014 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536638797_0001_00_000001, launchTime=1463536639014
2016-05-18 01:57:19,015 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536638797_0001_00_000001
2016-05-18 01:57:19,016 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536638797_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536638797_0001_1_00_000000_0
2016-05-18 01:57:19,016 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536638797_0001_1_00_000000_0] started. Is using containerId: [container_1463536638797_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-18 01:57:19,017 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F8B5F8B17114476C91439529272E6349, taskAttemptId=attempt_1463536638797_0001_1_00_000000_0, startTime=1463536639016, containerId=container_1463536638797_0001_00_000001, nodeId=127.0.0.1:0
2016-05-18 01:57:19 Starting to run new task attempt: attempt_1463536638797_0001_1_00_000000_0
2016-05-18 01:57:19,017 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536638797_0001_1_00_000000_0
2016-05-18 01:57:19,017 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:19,017 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:19,017 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [F85B3AE070E349FD8FE0622FDF7032A9/F749B20E606E4618934869DC589EA359] test/(1/1) ...Removal/value/VALID/VALID, VertexName: F8B5F8B17114476C91439529272E6349, VertexParallelism: 1, TaskAttemptID:attempt_1463536638797_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=A6EC200F8BD3433FB996CFF2352E8094, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=EE11C9196E8D4DC2A8A393B30282CB60, physicalEdgeCount=1, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ]
2016-05-18 01:57:19,018 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:19,018 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536638797_0001_1_00_000000_0
2016-05-18 01:57:19,023 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(496)) - TaskAttempt:attempt_1463536638797_0001_1_00_000000_0 sent events: (0-1).
2016-05-18 01:57:19,023 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536638797_0001_1_00_000000_0, eventCount=1 fromEventId=0 nextFromEventId=0
2016-05-18 01:57:19,028 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:19,029 INFO  input.MRInput (MRInput.java:initialize(440)) - A6EC200F8BD3433FB996CFF2352E8094 using newmapreduce API=false, split via event=true, numPhysicalInputs=1
2016-05-18 01:57:19,030 INFO  input.MRInput (MRInput.java:initializeInternal(494)) - Initialized MRInput: A6EC200F8BD3433FB996CFF2352E8094
2016-05-18 01:57:19,038 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F8B5F8B17114476C91439529272E6349, ordinal: 0
2016-05-18 01:57:19,039 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F8B5F8B17114476C91439529272E6349, mem on start (mb), free: 160, total: 489, max: 672
2016-05-18 01:57:19,039 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:19,039 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:19,039 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:19,040 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:19,040 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[A6EC200F8BD3433FB996CFF2352E8094:INPUT:0:org.apache.tez.mapreduce.input.MRInput], [EE11C9196E8D4DC2A8A393B30282CB60:OUTPUT:104857600:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput]
2016-05-18 01:57:19,041 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:19,042 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:19,042 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 104857600, TotalRequestedScaled: 9.679163076923077E7, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.15
2016-05-18 01:57:19,042 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[A6EC200F8BD3433FB996CFF2352E8094:org.apache.tez.mapreduce.input.MRInput:INPUT:0:0], [EE11C9196E8D4DC2A8A393B30282CB60:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput:OUTPUT:104857600:104857600]
2016-05-18 01:57:19,043 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:19,043 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: A6EC200F8BD3433FB996CFF2352E8094 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:19,044 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:19,044 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:19,043 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: A6EC200F8BD3433FB996CFF2352E8094
2016-05-18 01:57:19,045 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:19,045 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536638797_0001_1_00_000000_0
2016-05-18 01:57:19,047 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(174)) - Processing split: TezGroupedSplit{wrappedSplits=[file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:0+724, file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:724+725], wrappedInputFormatName='org.apache.hadoop.mapred.TextInputFormat', locations=[localhost], rack='null', length=1449}
2016-05-18 01:57:19,047 INFO  input.MRInput (MRInput.java:initFromEventInternal(653)) - A6EC200F8BD3433FB996CFF2352E8094 initialized RecordReader from event
2016-05-18 01:57:19,048 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:19,049 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"] streamed: true, id: A6EC200F8BD3433FB996CFF2352E8094
2016-05-18 01:57:19,049 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: GroupBy(test)[by:[{1}:'method']], id: A62B36FDD3B24A83BAB1DE683DFD078E
2016-05-18 01:57:19,049 INFO  element.TezGroupGate (TezGroupGate.java:prepare(98)) - calling OrderedPartitionedKVOutput#start() on: GroupBy(test)[by:[{1}:'method']] A62B36FDD3B24A83BAB1DE683DFD078E
2016-05-18 01:57:19,051 INFO  impl.ExternalSorter (ExternalSorter.java:<init>(199)) - EE11C9196E8D4DC2A8A393B30282CB60 using: memoryMb=100, keySerializerClass=class cascading.tuple.io.KeyTuple, valueSerializerClass=cascading.tuple.hadoop.io.ValueTupleSerializer@16d6b06f, comparator=cascading.tuple.hadoop.util.TupleComparator@68d9531f, partitioner=cascading.tuple.tez.util.TuplePartitioner, serialization=cascading.tuple.hadoop.TupleSerialization,org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
2016-05-18 01:57:19,051 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(170)) - Setting up PipelinedSorter for EE11C9196E8D4DC2A8A393B30282CB60: , UsingHashComparator=false
2016-05-18 01:57:19,069 INFO  impl.PipelinedSorter (PipelinedSorter.java:allocateSpace(245)) - Newly allocated block size=104857600, index=0, Number of buffers=1, currentAllocatableMemory=0, currentBufferSize=104857600, total=104857600
2016-05-18 01:57:19,069 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(189)) - Pre allocating rest of memory buffers upfront
2016-05-18 01:57:19,069 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(207)) - Setting up PipelinedSorter for EE11C9196E8D4DC2A8A393B30282CB60: , UsingHashComparator=false#blocks=1, maxMemUsage=104857600, lazyAllocateMem=false, minBlockSize=2097152000, initial BLOCK_SIZE=104857600, finalMergeEnabled=true, pipelinedShuffle=false, sendEmptyPartitions=true, tez.runtime.io.sort.mb=100
2016-05-18 01:57:19,070 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(882)) - EE11C9196E8D4DC2A8A393B30282CB60: reserved.remaining()=104857600, reserved.metasize=16777216
2016-05-18 01:57:19,071 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:19,072 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F8B5F8B17114476C91439529272E6349, all 1 inputs ready in: 00:00:00.000
2016-05-18 01:57:19,075 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536638797_0001_1_00_000000_0
2016-05-18 01:57:19,075 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F8B5F8B17114476C91439529272E6349, mem on close (mb), free: 58, total: 489, max: 672
2016-05-18 01:57:19,076 INFO  impl.PipelinedSorter (PipelinedSorter.java:flush(629)) - EE11C9196E8D4DC2A8A393B30282CB60: Starting flush of map output
2016-05-18 01:57:19,076 INFO  impl.PipelinedSorter (PipelinedSorter.java:end(995)) - EE11C9196E8D4DC2A8A393B30282CB60: Span0.length = 7, perItem = 99
2016-05-18 01:57:19,076 INFO  impl.PipelinedSorter (PipelinedSorter.java:sort(904)) - EE11C9196E8D4DC2A8A393B30282CB60: done sorting span=0, length=7, time=0
2016-05-18 01:57:19,077 INFO  impl.PipelinedSorter (PipelinedSorter.java:ready(1297)) - EE11C9196E8D4DC2A8A393B30282CB60: Heap = SpanIterator<0:6> (span=Span[16777216,693]),
2016-05-18 01:57:19,078 INFO  impl.PipelinedSorter (PipelinedSorter.java:spill(546)) - EE11C9196E8D4DC2A8A393B30282CB60: Spilling to /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/F85B3AE070E349FD8FE0622FDF7032A9/F749B20E606E4618934869DC589EA359/.tez/application_1463536638797_0001_wd/localmode-local-dir/output/attempt_1463536638797_0001_1_00_000000_0_10027_0/file.out
2016-05-18 01:57:19,081 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:19 Completed running task attempt: attempt_1463536638797_0001_1_00_000000_0
2016-05-18 01:57:19,082 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536638797_0001_1_00_000000_0, askedToStop=false
2016-05-18 01:57:19,083 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536638797_0001_1_00_000000_0, stopRequested=false
2016-05-18 01:57:19,083 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536638797_0001_1_00_000000_0: Counters: 18 [[org.apache.tez.common.counters.TaskCounter SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1][cascading.flow.SliceCounters Process_Begin_Time=1463536639072, Process_Duration=3, Process_End_Time=1463536639075, Read_Duration=1, Tuples_Read=10, Tuples_Written=7, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=10]]
2016-05-18 01:57:19,085 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536638797_0001_1_00_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:19,085 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:19,085 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:19,085 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:19,086 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F8B5F8B17114476C91439529272E6349, taskAttemptId=attempt_1463536638797_0001_1_00_000000_0, creationTime=1463536639009, allocationTime=1463536639012, startTime=1463536639016, finishTime=1463536639086, timeTaken=70, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:19,086 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536638797_0001_1_00_000000_0
2016-05-18 01:57:19,087 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:TASK_FINISHED]: vertexName=F8B5F8B17114476C91439529272E6349, taskId=task_1463536638797_0001_1_00_000000, startTime=1463536639016, finishTime=1463536639086, timeTaken=70, status=SUCCEEDED, successfulAttemptID=attempt_1463536638797_0001_1_00_000000_0, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536639072, Process_Duration=3, Process_End_Time=1463536639075, Read_Duration=1, Tuples_Read=10, Tuples_Written=7, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=10
2016-05-18 01:57:19,088 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:19,088 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349]
2016-05-18 01:57:19,088 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536638797_0001_00_000001
2016-05-18 01:57:19,089 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:VERTEX_FINISHED]: vertexName=F8B5F8B17114476C91439529272E6349, vertexId=vertex_1463536638797_0001_1_00, initRequestedTime=1463536638981, initedTime=1463536638999, startRequestedTime=1463536638983, startedTime=1463536639000, finishTime=1463536639088, timeTaken=88, status=SUCCEEDED, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536639072, Process_Duration=3, Process_End_Time=1463536639075, Read_Duration=1, Tuples_Read=10, Tuples_Written=7, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=10, vertexStats=firstTaskStartTime=1463536639016, firstTasksToStart=[ task_1463536638797_0001_1_00_000000 ], lastTaskFinishTime=1463536639086, lastTasksToFinish=[ task_1463536638797_0001_1_00_000000 ], minTaskDuration=70, maxTaskDuration=70, avgTaskDuration=70.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536638797_0001_1_00_000000 ], longestDurationTasks=[ task_1463536638797_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:19,090 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:19,090 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536638797_0001_00_000001, stoppedTime=1463536639090, exitStatus=0
2016-05-18 01:57:19,090 INFO  impl.VertexImpl (VertexImpl.java:transition(3279)) - Source task attempt completed for vertex: vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60] attempt: attempt_1463536638797_0001_1_00_000000_0 with state: SUCCEEDED vertexState: RUNNING
2016-05-18 01:57:19,090 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536638797_0001_1_00 [F8B5F8B17114476C91439529272E6349] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:19,090 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:schedulePendingTasks(920)) - All source tasks assigned. Ramping up 1 remaining tasks for vertex: EE11C9196E8D4DC2A8A393B30282CB60
2016-05-18 01:57:19,090 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:19,091 INFO  impl.Edge (Edge.java:routingToBegin(232)) - Routing to begin for edge: EdgeInfo: sourceVertexName=F8B5F8B17114476C91439529272E6349, destinationVertexName=EE11C9196E8D4DC2A8A393B30282CB60. EdgeProperty: { SCATTER_GATHER : org.apache.tez.runtime.library.input.OrderedGroupedKVInput >> PERSISTED >> org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput >> NullEdgeManager } onDemandRouting: true
2016-05-18 01:57:19,091 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(262)) - Ignoring stop request for containerId container_1463536638797_0001_00_000001. Relying on regular task shutdown for it to end
2016-05-18 01:57:19,091 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60]
2016-05-18 01:57:19,092 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:TASK_STARTED]: vertexName=EE11C9196E8D4DC2A8A393B30282CB60, taskId=task_1463536638797_0001_1_01_000000, scheduledTime=1463536639091, launchTime=1463536639091
2016-05-18 01:57:19,092 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60]
2016-05-18 01:57:19,094 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536638797_0001_00_000002, launchTime=1463536639094
2016-05-18 01:57:19,095 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536638797_0001_00_000002
2016-05-18 01:57:19,096 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536638797_0001_1_01_000000_0] started. Is using containerId: [container_1463536638797_0001_00_000002] on NM: [127.0.0.1:0]
2016-05-18 01:57:19,096 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=EE11C9196E8D4DC2A8A393B30282CB60, taskAttemptId=attempt_1463536638797_0001_1_01_000000_0, startTime=1463536639096, containerId=container_1463536638797_0001_00_000002, nodeId=127.0.0.1:0
2016-05-18 01:57:19,097 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536638797_0001_00_000002: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536638797_0001_1_01_000000_0
2016-05-18 01:57:19 Starting to run new task attempt: attempt_1463536638797_0001_1_01_000000_0
2016-05-18 01:57:19,098 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536638797_0001_1_01_000000_0
2016-05-18 01:57:19,098 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:19,098 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:19,098 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [F85B3AE070E349FD8FE0622FDF7032A9/F749B20E606E4618934869DC589EA359] test/(1/1) ...Removal/value/VALID/VALID, VertexName: EE11C9196E8D4DC2A8A393B30282CB60, VertexParallelism: 1, TaskAttemptID:attempt_1463536638797_0001_1_01_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=F8B5F8B17114476C91439529272E6349, physicalEdgeCount=1, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=243109DB1CEC41E98DC36725B9BA944A, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-18 01:57:19,098 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:19,099 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536638797_0001_1_01_000000_0
2016-05-18 01:57:19,099 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536638797_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-18 01:57:19,100 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536638797_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:19,100 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536638797_0001_00_000001, Exiting
2016-05-18 01:57:19,100 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536638797_0001_00_000001
2016-05-18 01:57:19,100 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536638797_0001_00_000001
2016-05-18 01:57:19,102 INFO  orderedgrouped.MergeManager (MergeManager.java:getInitialMemoryRequirement(339)) - Initial Memory required for SHUFFLE_BUFFER=211392912 based on INPUT_BUFFER_FACTOR=0.9,  for final merged output=0, using factor: 0.0
2016-05-18 01:57:19,104 INFO  impl.VertexImpl (VertexImpl.java:getTaskAttemptTezEvents(3662)) - Sending attempt_1463536638797_0001_1_01_000000_0 1 events [0,1) total 1 vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60]
2016-05-18 01:57:19,104 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536638797_0001_1_01_000000_0, eventCount=1 fromEventId=0 nextFromEventId=1
2016-05-18 01:57:19,105 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:19,103 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536638797_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:19,105 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536638797_0001_00_000001 completed successfully
2016-05-18 01:57:19,119 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: EE11C9196E8D4DC2A8A393B30282CB60, ordinal: 1
2016-05-18 01:57:19,119 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: EE11C9196E8D4DC2A8A393B30282CB60, mem on start (mb), free: 51, total: 489, max: 672
2016-05-18 01:57:19,119 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:19,119 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:19,119 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:19,123 INFO  output.MROutput (MROutput.java:initialize(421)) - 243109DB1CEC41E98DC36725B9BA944A: outputFormat=org.apache.hadoop.mapred.TextOutputFormat, using newmapreduce API=false
2016-05-18 01:57:19,123 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:19,124 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[F8B5F8B17114476C91439529272E6349:INPUT:211392912:org.apache.tez.runtime.library.input.OrderedGroupedKVInput], [243109DB1CEC41E98DC36725B9BA944A:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput]
2016-05-18 01:57:19,124 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:19,124 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:19,126 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 211392912, TotalRequestedScaled: 1.9513191876923078E8, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.30
2016-05-18 01:57:19,126 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[F8B5F8B17114476C91439529272E6349:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:211392912:211392912], [243109DB1CEC41E98DC36725B9BA944A:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0]
2016-05-18 01:57:19,126 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:19,126 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: F8B5F8B17114476C91439529272E6349 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:19,127 INFO  orderedgrouped.Shuffle (Shuffle.java:<init>(147)) - F8B5F8B17114476C91439529272E6349: Shuffle assigned with 1 inputs, codec: None, ifileReadAhead: true
2016-05-18 01:57:19,128 INFO  orderedgrouped.MergeManager (MergeManager.java:<init>(273)) - F8B5F8B17114476C91439529272E6349: MergerManager: memoryLimit=211392912, maxSingleShuffleLimit=52848228, mergeThreshold=190253616, ioSortFactor=100, postMergeMem=0, memToMemMergeOutputsThreshold=100
2016-05-18 01:57:19,128 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:19,129 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:<init>(353)) - ShuffleScheduler running for sourceVertex: F8B5F8B17114476C91439529272E6349 with configuration: maxFetchFailuresBeforeReporting=5, reportReadErrorImmediately=true, maxFailedUniqueFetches=1, abortFailureLimit=15, maxTaskOutputAtOnce=20, numFetchers=1, hostFailureFraction=0.2, minFailurePerHost=4, maxAllowedFailedFetchFraction=0.5, maxStallTimeFraction=0.5, minReqProgressFraction=0.5, checkFailedFetchSinceLastCompletion=true
2016-05-18 01:57:19,129 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:19,130 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: F8B5F8B17114476C91439529272E6349
2016-05-18 01:57:19,130 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:19,131 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536638797_0001_1_01_000000_0
2016-05-18 01:57:19,132 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - F8B5F8B17114476C91439529272E6349: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0
2016-05-18 01:57:19,134 INFO  orderedgrouped.ShuffleScheduler (ShuffleUtils.java:logIndividualFetchComplete(489)) - Completed fetch for attempt: {0, 0, attempt_1463536638797_0001_1_00_000000_0_10027} to DISK_DIRECT, csize=653, dsize=649, EndTime=1463536639134, TimeTaken=1, Rate=0.62 MB/s
2016-05-18 01:57:19,135 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:copySucceeded(551)) - All inputs fetched for input vertex : F8B5F8B17114476C91439529272E6349
2016-05-18 01:57:19,136 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:19,137 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:callInternal(1289)) - Shutting down FetchScheduler for input: F8B5F8B17114476C91439529272E6349, wasInterrupted=false
2016-05-18 01:57:19,136 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: GroupBy(test)[by:[{1}:'method']]
2016-05-18 01:57:19,137 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:19,138 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1005)) - finalMerge called with 0 in-memory map-outputs and 1 on-disk map-outputs
2016-05-18 01:57:19,138 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1103)) - Disk file=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/F85B3AE070E349FD8FE0622FDF7032A9/F749B20E606E4618934869DC589EA359/.tez/application_1463536638797_0001_wd/localmode-local-dir/output/attempt_1463536638797_0001_1_00_000000_0_10027/file.out, len=653, isLocal=true
2016-05-18 01:57:19,138 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: GroupBy(test)[by:[{1}:'method']] streamed: true, id: A62B36FDD3B24A83BAB1DE683DFD078E
2016-05-18 01:57:19,139 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/VALID/VALID"], id: 243109DB1CEC41E98DC36725B9BA944A
2016-05-18 01:57:19,139 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/VALID/VALID"]
2016-05-18 01:57:19,139 INFO  element.TezGroupGate (TezGroupGate.java:prepare(90)) - calling OrderedGroupedKVInput#start() on: GroupBy(test)[by:[{1}:'method']] A62B36FDD3B24A83BAB1DE683DFD078E, for 1 inputs
2016-05-18 01:57:19,138 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1115)) - Merging 1 files, 653 bytes from disk
2016-05-18 01:57:19,140 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1130)) - Merging 0 segments, 0 bytes from memory into reduce
2016-05-18 01:57:19,140 INFO  impl.TezMerger (TezMerger.java:merge(644)) - Merging 1 sorted segments
2016-05-18 01:57:19,140 INFO  impl.TezMerger (TezMerger.java:merge(749)) - Down to the last merge-pass, with 1 segments left of total size: 633 bytes
2016-05-18 01:57:19,140 INFO  orderedgrouped.Shuffle (Shuffle.java:callInternal(332)) - merge complete for input vertex : F8B5F8B17114476C91439529272E6349
2016-05-18 01:57:19,141 INFO  orderedgrouped.Shuffle (Shuffle.java:onSuccess(417)) - F8B5F8B17114476C91439529272E6349: Shuffle Runner thread complete
2016-05-18 01:57:19,142 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: EE11C9196E8D4DC2A8A393B30282CB60, all 1 inputs ready in: 00:00:00.003
2016-05-18 01:57:19,143 INFO  input.OrderedGroupedKVInput (OrderedGroupedKVInput.java:createValuesIterator(292)) - F8B5F8B17114476C91439529272E6349: creating ValuesIterator with comparator=cascading.tuple.hadoop.util.TupleComparator, keyClass=cascading.tuple.io.KeyTuple, valClass=cascading.tuple.io.ValueTuple
2016-05-18 01:57:19,145 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-05-18 01:57:19,155 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-05-18 01:57:19,163 ERROR element.TezGroupByGate (TezGroupByGate.java:reduce(91)) - caught throwable
cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-05-18 01:57:19,166 INFO  output.MROutput (MROutput.java:close(526)) - 243109DB1CEC41E98DC36725B9BA944A closed
2016-05-18 01:57:19,167 INFO  impl.TaskImpl (TaskImpl.java:canCommit(671)) - attempt_1463536638797_0001_1_01_000000_0 given a go for committing the task output.
2016-05-18 01:57:19,168 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536638797_0001_1_01_000000_0, stopRequested=false
2016-05-18 01:57:19,168 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536638797_0001_1_01_000000_0: Counters: 33 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=9, MERGE_PHASE_TIME=12, FIRST_EVENT_RECEIVED=4, LAST_EVENT_RECEIVED=4][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][cascading.flow.SliceCounters Process_Begin_Time=1463536639142, Process_Duration=26, Process_End_Time=1463536639168, Read_Duration=0, Tuples_Read=7]]
2016-05-18 01:57:19,169 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(817)) - Joining on EventRouter
2016-05-18 01:57:19,169 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: EE11C9196E8D4DC2A8A393B30282CB60, mem on close (mb), free: 45, total: 489, max: 672
2016-05-18 01:57:19,169 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(851)) - Closed processor for vertex=EE11C9196E8D4DC2A8A393B30282CB60, index=1, interruptedStatus=false
2016-05-18 01:57:19,170 INFO  orderedgrouped.Shuffle (Shuffle.java:shutdown(278)) - Shutting down Shuffle for source: F8B5F8B17114476C91439529272E6349
2016-05-18 01:57:19,170 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - F8B5F8B17114476C91439529272E6349: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0, updateOnClose
2016-05-18 01:57:19,170 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(887)) - Closed input for vertex=EE11C9196E8D4DC2A8A393B30282CB60, sourceVertex=F8B5F8B17114476C91439529272E6349, interruptedStatus=true
2016-05-18 01:57:19,170 INFO  output.MROutput (MROutput.java:close(526)) - 243109DB1CEC41E98DC36725B9BA944A closed
2016-05-18 01:57:19,171 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(911)) - Closed input for vertex=EE11C9196E8D4DC2A8A393B30282CB60, sourceVertex=243109DB1CEC41E98DC36725B9BA944A, interruptedStatus=true
2016-05-18 01:57:19,172 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536638797_0001_1_01_000000_0 : TaskRunner2Result{endReason=TASK_ERROR, error=cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0'], containerShutdownRequested=false}  
2016-05-18 01:57:19,172 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=TASK_ERROR, error=cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0'], containerShutdownRequested=false}
2016-05-18 01:57:19,172 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536638797_0001_00_000002
2016-05-18 01:57:19,172 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536638797_0001_00_000002
2016-05-18 01:57:19,173 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=EE11C9196E8D4DC2A8A393B30282CB60, taskAttemptId=attempt_1463536638797_0001_1_01_000000_0, creationTime=1463536639092, allocationTime=1463536639093, startTime=1463536639096, finishTime=1463536639173, timeTaken=77, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task: attempt_1463536638797_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 33, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=9, MERGE_PHASE_TIME=12, FIRST_EVENT_RECEIVED=4, LAST_EVENT_RECEIVED=4, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536639142, Process_Duration=26, Process_End_Time=1463536639168, Read_Duration=0, Tuples_Read=7
2016-05-18 01:57:19,174 INFO  impl.TaskImpl (TaskImpl.java:transition(1170)) - Failing task: task_1463536638797_0001_1_01_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-05-18 01:57:19,174 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:TASK_FINISHED]: vertexName=EE11C9196E8D4DC2A8A393B30282CB60, taskId=task_1463536638797_0001_1_01_000000, startTime=1463536639096, finishTime=1463536639174, timeTaken=78, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task: attempt_1463536638797_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-05-18 01:57:19,175 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536638797_0001_00_000002 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0'], errorMessage='TaskExecutionFailure: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0']'}
2016-05-18 01:57:19,175 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(294)) - Container: container_1463536638797_0001_00_000002 completed but with errors
2016-05-18 01:57:19,175 INFO  impl.VertexImpl (VertexImpl.java:transition(3353)) - Failing vertex: vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60] because task failed: task_1463536638797_0001_1_01_000000
2016-05-18 01:57:19,175 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(2102)) - Killing tasks in vertex: vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60] due to trigger: OWN_TASK_FAILURE
2016-05-18 01:57:19,175 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60], tasks=1, failed=1, killed=0, success=0, completed=1, commits=0, err=OWN_TASK_FAILURE
2016-05-18 01:57:19,175 INFO  impl.VertexImpl (VertexImpl.java:finishWithTerminationCause(2084)) - Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0
2016-05-18 01:57:19,175 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3087)) - Invoking committer abort for vertex, vertexId=vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60]
2016-05-18 01:57:19,176 INFO  impl.VertexImpl (VertexImpl.java:run(3095)) - Invoking committer abort for output=243109DB1CEC41E98DC36725B9BA944A, vertexId=vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60]
2016-05-18 01:57:19,178 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:VERTEX_FINISHED]: vertexName=EE11C9196E8D4DC2A8A393B30282CB60, vertexId=vertex_1463536638797_0001_1_01, initRequestedTime=1463536638983, initedTime=1463536638990, startRequestedTime=1463536639001, startedTime=1463536639002, finishTime=1463536639177, timeTaken=175, status=FAILED, diagnostics=Task failed, taskId=task_1463536638797_0001_1_01_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task: attempt_1463536638797_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]]
Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0
Vertex vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60] killed/failed due to:OWN_TASK_FAILURE, counters=Counters: 0, vertexStats=firstTaskStartTime=1463536639096, firstTasksToStart=[ task_1463536638797_0001_1_01_000000 ], lastTaskFinishTime=1463536639173, lastTasksToFinish=[ task_1463536638797_0001_1_01_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-05-18 01:57:19,178 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-05-18 01:57:19,180 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(704)) - Container container_1463536638797_0001_00_000002 exited with diagnostics set to TaskExecutionFailure: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0']
2016-05-18 01:57:19,182 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536638797_0001_00_000002, stoppedTime=1463536639182, exitStatus=1
2016-05-18 01:57:19,183 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(298)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1463536638797_0001_1_01_000000_0 failed: true container: container_1463536638797_0001_00_000002 numFailedTAs: 0
2016-05-18 01:57:19,183 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60] completed., numCompletedVertices=2, numSuccessfulVertices=1, numFailedVertices=1, numKilledVertices=0, numVertices=2
2016-05-18 01:57:19,183 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=2, numSuccessfulVertices=1, numFailedVertices=1, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=VERTEX_FAILURE
2016-05-18 01:57:19,183 INFO  impl.DAGImpl (DAGImpl.java:finishWithTerminationCause(1350)) - DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0
2016-05-18 01:57:19,200 INFO  recovery.RecoveryService (RecoveryService.java:handle(327)) - DAG completed, dagId=dag_1463536638797_0001_1, queueSize=0
2016-05-18 01:57:19,202 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536638797_0001_1][Event:DAG_FINISHED]: dagId=dag_1463536638797_0001_1, startTime=1463536638980, finishTime=1463536639199, timeTaken=219, status=FAILED, diagnostics=Vertex failed, vertexName=EE11C9196E8D4DC2A8A393B30282CB60, vertexId=vertex_1463536638797_0001_1_01, diagnostics=[Task failed, taskId=task_1463536638797_0001_1_01_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task: attempt_1463536638797_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runValueAssertions(AppliedAssertionsPlatformTest.java:158)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60] killed/failed due to:OWN_TASK_FAILURE]
DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=2, RACK_LOCAL_TASKS=1, AM_CPU_MILLISECONDS=370, AM_GC_TIME_MILLIS=15, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536639072, Process_Duration=3, Process_End_Time=1463536639075, Read_Duration=1, Tuples_Read=10, Tuples_Written=7, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=10
2016-05-18 01:57:19,203 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3082)) - Ignoring multiple aborts for vertex: vertex_1463536638797_0001_1_01 [EE11C9196E8D4DC2A8A393B30282CB60]
2016-05-18 01:57:19,203 INFO  impl.DAGImpl (DAGImpl.java:finished(1405)) - DAG: dag_1463536638797_0001_1 finished with state: FAILED
2016-05-18 01:57:19,203 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536638797_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-05-18 01:57:19 Completed Dag: dag_1463536638797_0001_1
2016-05-18 01:57:19,205 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(751)) - DAG completed, dagId=dag_1463536638797_0001_1, dagState=FAILED
2016-05-18 01:57:19,205 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536638797_0001_1_post
2016-05-18 01:57:19,205 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:19,206 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(800)) - Central Dispatcher queue size after DAG completion, before cleanup: 0
2016-05-18 01:57:19,206 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(802)) - Waiting for next DAG to be submitted.
2016-05-18 01:57:19,206 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(842)) - Cleaning up DAG: name=[F85B3AE070E349FD8FE0622FDF7032A9/F749B20E606E4618934869DC589EA359] test/(1/1) ...Removal/value/VALID/VALID, with id=dag_1463536638797_0001_1
2016-05-18 01:57:19,206 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(852)) - Completed cleanup for DAG: name=[F85B3AE070E349FD8FE0622FDF7032A9/F749B20E606E4618934869DC589EA359] test/(1/1) ...Removal/value/VALID/VALID, with id=dag_1463536638797_0001_1
2016-05-18 01:57:19,209 INFO  client.TezClient (TezClient.java:stop(566)) - Shutting down Tez Session, sessionName=(1/1) ...Removal/value/VALID/VALID, applicationId=application_1463536638797_0001
2016-05-18 01:57:19,211 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(124)) - Received message to shutdown AM
2016-05-18 01:57:19,211 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:setShouldUnregisterFlag(895)) - TaskScheduler notified that it should unregister from RM
2016-05-18 01:57:19,211 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1301)) - No current running DAG, shutting down the AM
2016-05-18 01:57:19,212 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(907)) - DAGAppMasterShutdownHandler invoked
2016-05-18 01:57:19,212 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(916)) - Handling DAGAppMaster shutdown
2016-05-18 01:57:19,212 INFO  app.DAGAppMaster (DAGAppMaster.java:run(936)) - Sleeping for 5 seconds before shutting down
2016-05-18 01:57:19,212 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(84)) - Stopping HistoryEventHandler
2016-05-18 01:57:19,213 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(196)) - Stopping RecoveryService
2016-05-18 01:57:19,213 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(199)) - Handle the remaining events in queue, queue size=0
2016-05-18 01:57:19,213 INFO  recovery.RecoveryService (RecoveryService.java:run(173)) - EventQueue take interrupted. Returning
2016-05-18 01:57:19,213 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(221)) - Closing Summary Stream
2016-05-18 01:57:19,214 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-18 01:57:19,214 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-18 01:57:19,215 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:serviceStop(678)) - Shutting down AppCallbackExecutor
2016-05-18 01:57:19,218 INFO  app.DAGAppMaster (DAGAppMaster.java:run(2084)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/F85B3AE070E349FD8FE0622FDF7032A9/F749B20E606E4618934869DC589EA359/.tez/application_1463536638797_0001
2016-05-18 01:57:19,218 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] stopping all jobs
2016-05-18 01:57:19,219 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] stopping: (1/1) ...Removal/value/VALID/VALID
2016-05-18 01:57:19,219 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] stopped all jobs
2016-05-18 01:57:19,220 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/VALID/VALID/_temporary
2016-05-18 01:57:19,220 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  completed in: 00:00.443
2016-05-18 01:57:19,221 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output//hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/VALID/STRICT
2016-05-18 01:57:19,221 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output//hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/NONE/VALID
2016-05-18 01:57:19,221 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output//hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/VALID/VALID
2016-05-18 01:57:19,221 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output//hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/NONE/STRICT
2016-05-18 01:57:19,221 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output//hadoop2-tez/appliedassertionsplatform/testValueAssertionsRemoval/value/STRICT/STRICT
2016-05-18 01:57:19,264 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 01:57:19,264 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-18 01:57:19,319 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-05-18 01:57:19,338 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.041
2016-05-18 01:57:19,339 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:19,339 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:19,339 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 01:57:19,358 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt
2016-05-18 01:57:19,371 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/NONE/STRICT
2016-05-18 01:57:19,434 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting
2016-05-18 01:57:19,435 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:19,435 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  sink: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/NONE/STRICT"]
2016-05-18 01:57:19,435 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  parallel execution of steps is enabled: false
2016-05-18 01:57:19,435 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  executing total steps: 1
2016-05-18 01:57:19,435 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  allocating management threads: 1
2016-05-18 01:57:19,436 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting step: (1/1) ...Removal/group/NONE/STRICT
2016-05-18 01:57:19,436 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [test] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-18 01:57:19,453 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tez session mode enabled: true
2016-05-18 01:57:19,458 INFO  client.TezClient (TezClient.java:<init>(174)) - Tez Client Version: [ component=tez-api, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:19,459 INFO  client.TezClient (TezClient.java:start(394)) - Session mode. Starting session.
2016-05-18 01:57:19,459 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(164)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-18 01:57:19,469 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(122)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/1CB18EE6637642E286712CCAAFA58153/E3D6F0F9EE374AF19BD18DBC168D591C/.tez/application_1463536639459_0001 doesn't exist and is created
2016-05-18 01:57:19,491 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(332)) - DAGAppMaster thread has been created
2016-05-18 01:57:19,491 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-18 01:57:19,492 INFO  client.LocalClient (LocalClient.java:run(282)) - Using working directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/1CB18EE6637642E286712CCAAFA58153/E3D6F0F9EE374AF19BD18DBC168D591C/.tez/application_1463536639459_0001_wd
2016-05-18 01:57:19,507 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(363)) - Created DAGAppMaster for application appattempt_1463536639459_0001_000000, versionInfo=[ component=tez-dag, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:19,508 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(80)) - Trying to locate HadoopShimProvider for hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:19,508 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(139)) - Picked HadoopShim org.apache.tez.hadoop.shim.DefaultHadoopShim, providerName=null, overrideProviderViaConfig=null, hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:19,509 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(436)) - AM Level configured TaskSchedulers: [0:TezUber:null]
2016-05-18 01:57:19,509 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(437)) - AM Level configured ContainerLaunchers: [0:TezUber:null]
2016-05-18 01:57:19,509 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(438)) - AM Level configured TaskCommunicators: [0:TezUber:null]
2016-05-18 01:57:19,509 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(447)) - Comparing client version with AM version, clientVersion=0.8.2, AMVersion=0.8.2
2016-05-18 01:57:19,510 INFO  app.TaskCommunicatorManager (TaskCommunicatorManager.java:createUberTaskCommunicator(192)) - Creating Default Local Task Communicator
2016-05-18 01:57:19,512 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.container.AMContainerEventType for class org.apache.tez.dag.app.rm.container.AMContainerMap
2016-05-18 01:57:19,512 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.node.AMNodeEventType for class org.apache.tez.dag.app.rm.node.AMNodeTracker
2016-05-18 01:57:19,512 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGAppMasterEventType for class org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterEventHandler
2016-05-18 01:57:19,513 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGEventType for class org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher
2016-05-18 01:57:19,513 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.VertexEventType for class org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher
2016-05-18 01:57:19,513 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(529)) - Using concurrent dispatcher: false
2016-05-18 01:57:19,513 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher
2016-05-18 01:57:19,514 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskAttemptEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher
2016-05-18 01:57:19,514 INFO  common.AsyncDispatcher (AsyncDispatcher.java:registerAndCreateDispatcher(262)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for independent dispatch using: class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:19,514 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:19,514 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.AMSchedulerEventType for class org.apache.tez.dag.app.rm.TaskSchedulerManager
2016-05-18 01:57:19,515 INFO  launcher.TezContainerLauncherImpl (ContainerLauncherManager.java:createUberContainerLauncher(134)) - Creating LocalContainerLauncher
2016-05-18 01:57:19,516 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.ContainerLauncherEventType for class org.apache.tez.dag.app.launcher.ContainerLauncherManager
2016-05-18 01:57:19,517 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(78)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1, nodeUpdatesRescheduleEnabled: false
2016-05-18 01:57:19,517 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(57)) - Initializing HistoryEventHandler withrecoveryEnabled=true, historyServiceClassName=org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService
2016-05-18 01:57:19,518 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/1CB18EE6637642E286712CCAAFA58153/E3D6F0F9EE374AF19BD18DBC168D591C/.tez/application_1463536639459_0001_wd/localmode-log-dir
2016-05-18 01:57:19,518 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/1CB18EE6637642E286712CCAAFA58153/E3D6F0F9EE374AF19BD18DBC168D591C/.tez/application_1463536639459_0001_wd/localmode-log-dir/history.txt.appattempt_1463536639459_0001_000000, maxErrors=10
2016-05-18 01:57:19,518 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(124)) - RecoveryService initialized with recoveryPath=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/1CB18EE6637642E286712CCAAFA58153/E3D6F0F9EE374AF19BD18DBC168D591C/.tez/application_1463536639459_0001/recovery/0, bufferSize(bytes)=8192, flushInterval(s)=30, maxUnflushedEvents=100
2016-05-18 01:57:19,519 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463536639459_0001_000000, appSubmitTime=1463536639507, launchTime=1463536639507
2016-05-18 01:57:19,525 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-18 01:57:19,530 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:50017
2016-05-18 01:57:19,530 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:createUberTaskScheduler(557)) - Creating TaskScheduler: Local TaskScheduler with clusterIdentifier=1463536639459
2016-05-18 01:57:19,532 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463536639459_0001_000000, startTime=1463536639532
2016-05-18 01:57:19,532 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1945)) - In Session mode. Waiting for DAG over RPC
2016-05-18 01:57:19,591 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-18 01:57:19,592 INFO  client.TezClient (TezClient.java:start(428)) - The url to track the Tez Session: N/A
2016-05-18 01:57:19,592 INFO  client.TezClient (TezClient.java:submitDAGSession(470)) - Submitting dag to TezSession, sessionName=(1/1) ...Removal/group/NONE/STRICT, applicationId=application_1463536639459_0001, dagName=[1CB18EE6637642E286712CCAAFA58153/E3D6F0F9EE374AF19BD18DBC168D591C] test/(1/1) ...Removal/group/NONE/STRICT
2016-05-18 01:57:19,611 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1351)) - Starting DAG submitted via RPC: [1CB18EE6637642E286712CCAAFA58153/E3D6F0F9EE374AF19BD18DBC168D591C] test/(1/1) ...Removal/group/NONE/STRICT
2016-05-18 01:57:19,611 INFO  app.DAGAppMaster (DAGAppMaster.java:createDAG(985)) - Merging AM credentials into DAG credentials
2016-05-18 01:57:19,612 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(1076)) - Generating DAG graphviz file, dagId=dag_1463536639459_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/1CB18EE6637642E286712CCAAFA58153/E3D6F0F9EE374AF19BD18DBC168D591C/.tez/application_1463536639459_0001_wd/localmode-log-dir/dag_1463536639459_0001_1.dot
2016-05-18 01:57:19,613 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(1093)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/1CB18EE6637642E286712CCAAFA58153/E3D6F0F9EE374AF19BD18DBC168D591C/.tez/application_1463536639459_0001_wd/localmode-log-dir/dag_1463536639459_0001_1-tez-dag.pb.txt
2016-05-18 01:57:19,624 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536639459_0001_1
2016-05-18 01:57:19,624 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:19,624 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2399)) - Running DAG: [1CB18EE6637642E286712CCAAFA58153/E3D6F0F9EE374AF19BD18DBC168D591C] test/(1/1) ...Removal/group/NONE/STRICT
2016-05-18 01:57:19 Running Dag: dag_1463536639459_0001_1
2016-05-18 01:57:19,640 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463536639459_0001_1, submitTime=1463536639611
2016-05-18 01:57:19,642 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/1CB18EE6637642E286712CCAAFA58153/E3D6F0F9EE374AF19BD18DBC168D591C/.tez/application_1463536639459_0001/tez-conf.pb" } size: 40984 timestamp: 1463536639000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:19,642 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalInputs(3978)) - Setting 1 additional inputs for vertexvertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2]
2016-05-18 01:57:19,642 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:19,644 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/1CB18EE6637642E286712CCAAFA58153/E3D6F0F9EE374AF19BD18DBC168D591C/.tez/application_1463536639459_0001/tez-conf.pb" } size: 40984 timestamp: 1463536639000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:19,644 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4023)) - Setting 1 additional outputs for vertex vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B]
2016-05-18 01:57:19,644 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:19,645 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1593)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-18 01:57:19,646 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463536639459_0001_1, initTime=1463536639646
2016-05-18 01:57:19,647 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536639459_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-18 01:57:19,647 INFO  impl.DAGImpl (DAGImpl.java:transition(1768)) - Added additional resources : [[]] to classpath
2016-05-18 01:57:19,647 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:DAG_STARTED]: dagID=dag_1463536639459_0001_1, startTime=1463536639647
2016-05-18 01:57:19,647 INFO  client.TezClient (TezClient.java:submitDAGSession(545)) - Submitted dag to TezSession, sessionName=(1/1) ...Removal/group/NONE/STRICT, applicationId=application_1463536639459_0001, dagName=[1CB18EE6637642E286712CCAAFA58153/E3D6F0F9EE374AF19BD18DBC168D591C] test/(1/1) ...Removal/group/NONE/STRICT
2016-05-18 01:57:19,647 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536639459_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-18 01:57:19,648 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2400)) - Root Inputs exist for Vertex: BCD9CB27E51542B2955CEC538DCA14D2 : {048DCE6B892043CBAA7F16AA6D87DFEB={InputName=048DCE6B892043CBAA7F16AA6D87DFEB}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-18 01:57:19,648 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2410)) - Starting root input initializer for input: 048DCE6B892043CBAA7F16AA6D87DFEB, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-18 01:57:19,648 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2550)) - Setting vertexManager to RootInputVertexManager for vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2]
2016-05-18 01:57:19,648 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2721)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2]
2016-05-18 01:57:19,648 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2726)) - Vertex will initialize from input initializer. vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2]
2016-05-18 01:57:19,649 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3893)) - Starting 1 inputInitializers for vertex vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2]
2016-05-18 01:57:19,649 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-18 01:57:19,649 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2562)) - Setting vertexManager to ShuffleVertexManager for vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B]
2016-05-18 01:57:19,650 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(272)) - Starting InputInitializer for Input: 048DCE6B892043CBAA7F16AA6D87DFEB on vertex vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2]
2016-05-18 01:57:19,653 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(109)) - Input 048DCE6B892043CBAA7F16AA6D87DFEB asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7, groupingEnabled: true
2016-05-18 01:57:19,653 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:initialize(1022)) - Shuffle Vertex Manager: settings minFrac:0.25 maxFrac:0.75 auto:false desiredTaskIput:104857600 minTasks:1
2016-05-18 01:57:19,654 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2760)) - Creating 1 tasks for vertex: vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B]
2016-05-18 01:57:19,654 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2779)) - Directly initializing vertex: vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B]
2016-05-18 01:57:19,657 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536639459_0001_1_01, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=null, edgeManagersCount=1, rootInputSpecUpdateCount=0, setParallelismCalledFlag=false
2016-05-18 01:57:19,657 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2187)) - Setting up committers for vertex vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B], numAdditionalOutputs=1
2016-05-18 01:57:19,657 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2202)) - Instantiating committer for output=FEFD7329B1D84F8DBF2DC5BA139026D7, vertex=vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-18 01:57:19,659 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(168)) - Grouping splits in Tez
2016-05-18 01:57:19,659 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(226)) - Desired splits: 1 too large.  Desired splitLength: 1449 Min splitLength: 52428800 New desired splits: 1 Total length: 1449 Original splits: 2
2016-05-18 01:57:19,660 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(321)) - Desired numSplits: 1 lengthPerGroup: 1449 numLocations: 1 numSplitsPerLocation: 2 numSplitsInGroup: 2 totalLength: 1449 numOriginalSplits: 2 . Grouping by length: true count: false nodeLocalOnly: false
2016-05-18 01:57:19,660 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(539)) - Number of splits desired: 1 created: 1 splitsProcessed: 2
2016-05-18 01:57:19,660 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(308)) - Succeeded InputInitializer for Input: 048DCE6B892043CBAA7F16AA6D87DFEB on vertex vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2]
2016-05-18 01:57:19,661 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(121)) - Committer for A0F2C78FBDA64314AA5D3029C831147B:FEFD7329B1D84F8DBF2DC5BA139026D7 using oldmapred API
2016-05-18 01:57:19,662 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(146)) - OutputCommitter for outputName=FEFD7329B1D84F8DBF2DC5BA139026D7, vertexName=A0F2C78FBDA64314AA5D3029C831147B, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-18 01:57:19,663 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:VERTEX_INITIALIZED]: vertexName=A0F2C78FBDA64314AA5D3029C831147B, vertexId=vertex_1463536639459_0001_1_01, initRequestedTime=1463536639649, initedTime=1463536639657, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=0, initGeneratedEventsCount=0
2016-05-18 01:57:19,664 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B] transitioned from NEW to INITED due to event V_INIT
2016-05-18 01:57:19,665 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:19,665 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1644)) - Got updated RootInputsSpecs: {048DCE6B892043CBAA7F16AA6D87DFEB=forAllWorkUnits=true, update=[1]}
2016-05-18 01:57:19,665 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1664)) - Vertex vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2] parallelism set to 1
2016-05-18 01:57:19,665 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:19,666 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:VERTEX_INITIALIZED]: vertexName=BCD9CB27E51542B2955CEC538DCA14D2, vertexId=vertex_1463536639459_0001_1_00, initRequestedTime=1463536639648, initedTime=1463536639666, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1, initGeneratedEventsCount=1
2016-05-18 01:57:19,666 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2] with distanceFromRoot: 0
2016-05-18 01:57:19,667 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2] transitioned from INITIALIZING to INITED due to event V_INPUT_DATA_INFORMATION
2016-05-18 01:57:19,667 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536639459_0001_1_00, startRequestedTime=1463536639649, startedTime=1463536639667
2016-05-18 01:57:19,668 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536639459_0001_1_00, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=org.apache.tez.dag.api.VertexLocationHint@b8338fe7, edgeManagersCount=0, rootInputSpecUpdateCount=1, setParallelismCalledFlag=true
2016-05-18 01:57:19,668 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:19,668 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(100)) - Starting 1 in BCD9CB27E51542B2955CEC538DCA14D2
2016-05-18 01:57:19,669 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2]
2016-05-18 01:57:19,668 INFO  impl.VertexImpl (VertexImpl.java:transition(2932)) - Source vertex started: vertex_1463536639459_0001_1_00 for vertex: vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B] numStartedSources: 1 numSources: 1
2016-05-18 01:57:19,669 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B] with distanceFromRoot: 1
2016-05-18 01:57:19,670 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536639459_0001_1_01, startRequestedTime=1463536639668, startedTime=1463536639670
2016-05-18 01:57:19,672 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:19,673 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:onVertexStarted(519)) - OnVertexStarted vertex: A0F2C78FBDA64314AA5D3029C831147B with 0 source tasks and 1 pending tasks
2016-05-18 01:57:19,673 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:handleVertexStateUpdate(1051)) - Received configured notification : CONFIGURED for vertex: BCD9CB27E51542B2955CEC538DCA14D2 in vertex: A0F2C78FBDA64314AA5D3029C831147B numBipartiteSourceTasks: 1
2016-05-18 01:57:19,673 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:TASK_STARTED]: vertexName=BCD9CB27E51542B2955CEC538DCA14D2, taskId=task_1463536639459_0001_1_00_000000, scheduledTime=1463536639672, launchTime=1463536639672
2016-05-18 01:57:19,674 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2]
2016-05-18 01:57:19,675 INFO  node.PerSourceNodeTracker (PerSourceNodeTracker.java:nodeSeen(74)) - Adding new node 127.0.0.1:0 to nodeTracker 0
2016-05-18 01:57:19,677 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536639459_0001_00_000001, launchTime=1463536639677
2016-05-18 01:57:19,678 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536639459_0001_00_000001
2016-05-18 01:57:19,678 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536639459_0001_1_00_000000_0] started. Is using containerId: [container_1463536639459_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-18 01:57:19,679 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=BCD9CB27E51542B2955CEC538DCA14D2, taskAttemptId=attempt_1463536639459_0001_1_00_000000_0, startTime=1463536639678, containerId=container_1463536639459_0001_00_000001, nodeId=127.0.0.1:0
2016-05-18 01:57:19,679 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536639459_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536639459_0001_1_00_000000_0
2016-05-18 01:57:19 Starting to run new task attempt: attempt_1463536639459_0001_1_00_000000_0
2016-05-18 01:57:19,680 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536639459_0001_1_00_000000_0
2016-05-18 01:57:19,680 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:19,680 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:19,681 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] submitted tez dag to app master: application_1463536639459_0001, with dag id: dag_1463536639459_0001_1
2016-05-18 01:57:19,681 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [1CB18EE6637642E286712CCAAFA58153/E3D6F0F9EE374AF19BD18DBC168D591C] test/(1/1) ...Removal/group/NONE/STRICT, VertexName: BCD9CB27E51542B2955CEC538DCA14D2, VertexParallelism: 1, TaskAttemptID:attempt_1463536639459_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=048DCE6B892043CBAA7F16AA6D87DFEB, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=A0F2C78FBDA64314AA5D3029C831147B, physicalEdgeCount=1, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ]
2016-05-18 01:57:19,682 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:19,684 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536639459_0001_1_00_000000_0
2016-05-18 01:57:19,687 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(496)) - TaskAttempt:attempt_1463536639459_0001_1_00_000000_0 sent events: (0-1).
2016-05-18 01:57:19,687 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536639459_0001_1_00_000000_0, eventCount=1 fromEventId=0 nextFromEventId=0
2016-05-18 01:57:19,691 INFO  input.MRInput (MRInput.java:initialize(440)) - 048DCE6B892043CBAA7F16AA6D87DFEB using newmapreduce API=false, split via event=true, numPhysicalInputs=1
2016-05-18 01:57:19,691 INFO  input.MRInput (MRInput.java:initializeInternal(494)) - Initialized MRInput: 048DCE6B892043CBAA7F16AA6D87DFEB
2016-05-18 01:57:19,693 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:19,702 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: BCD9CB27E51542B2955CEC538DCA14D2, ordinal: 0
2016-05-18 01:57:19,703 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BCD9CB27E51542B2955CEC538DCA14D2, mem on start (mb), free: 157, total: 489, max: 672
2016-05-18 01:57:19,703 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:19,703 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:19,703 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:19,704 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:19,704 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[048DCE6B892043CBAA7F16AA6D87DFEB:INPUT:0:org.apache.tez.mapreduce.input.MRInput], [A0F2C78FBDA64314AA5D3029C831147B:OUTPUT:104857600:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput]
2016-05-18 01:57:19,705 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:19,705 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:19,705 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 104857600, TotalRequestedScaled: 9.679163076923077E7, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.15
2016-05-18 01:57:19,706 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[048DCE6B892043CBAA7F16AA6D87DFEB:org.apache.tez.mapreduce.input.MRInput:INPUT:0:0], [A0F2C78FBDA64314AA5D3029C831147B:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput:OUTPUT:104857600:104857600]
2016-05-18 01:57:19,706 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:19,706 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: 048DCE6B892043CBAA7F16AA6D87DFEB being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:19,706 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: 048DCE6B892043CBAA7F16AA6D87DFEB
2016-05-18 01:57:19,706 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:19,707 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:19,707 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:19,708 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536639459_0001_1_00_000000_0
2016-05-18 01:57:19,710 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(174)) - Processing split: TezGroupedSplit{wrappedSplits=[file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:0+724, file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:724+725], wrappedInputFormatName='org.apache.hadoop.mapred.TextInputFormat', locations=[localhost], rack='null', length=1449}
2016-05-18 01:57:19,710 INFO  input.MRInput (MRInput.java:initFromEventInternal(653)) - 048DCE6B892043CBAA7F16AA6D87DFEB initialized RecordReader from event
2016-05-18 01:57:19,712 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:19,712 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"] streamed: true, id: 048DCE6B892043CBAA7F16AA6D87DFEB
2016-05-18 01:57:19,712 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: GroupBy(test)[by:[{1}:'method']], id: D8DC140F1E4B4CFAA0BC465ECF84A20C
2016-05-18 01:57:19,713 INFO  element.TezGroupGate (TezGroupGate.java:prepare(98)) - calling OrderedPartitionedKVOutput#start() on: GroupBy(test)[by:[{1}:'method']] D8DC140F1E4B4CFAA0BC465ECF84A20C
2016-05-18 01:57:19,715 INFO  impl.ExternalSorter (ExternalSorter.java:<init>(199)) - A0F2C78FBDA64314AA5D3029C831147B using: memoryMb=100, keySerializerClass=class cascading.tuple.io.KeyTuple, valueSerializerClass=cascading.tuple.hadoop.io.ValueTupleSerializer@1ae79a45, comparator=cascading.tuple.hadoop.util.TupleComparator@5b4135cf, partitioner=cascading.tuple.tez.util.TuplePartitioner, serialization=cascading.tuple.hadoop.TupleSerialization,org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
2016-05-18 01:57:19,715 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(170)) - Setting up PipelinedSorter for A0F2C78FBDA64314AA5D3029C831147B: , UsingHashComparator=false
2016-05-18 01:57:19,728 INFO  impl.PipelinedSorter (PipelinedSorter.java:allocateSpace(245)) - Newly allocated block size=104857600, index=0, Number of buffers=1, currentAllocatableMemory=0, currentBufferSize=104857600, total=104857600
2016-05-18 01:57:19,728 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(189)) - Pre allocating rest of memory buffers upfront
2016-05-18 01:57:19,728 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(207)) - Setting up PipelinedSorter for A0F2C78FBDA64314AA5D3029C831147B: , UsingHashComparator=false#blocks=1, maxMemUsage=104857600, lazyAllocateMem=false, minBlockSize=2097152000, initial BLOCK_SIZE=104857600, finalMergeEnabled=true, pipelinedShuffle=false, sendEmptyPartitions=true, tez.runtime.io.sort.mb=100
2016-05-18 01:57:19,729 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(882)) - A0F2C78FBDA64314AA5D3029C831147B: reserved.remaining()=104857600, reserved.metasize=16777216
2016-05-18 01:57:19,730 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:19,730 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: BCD9CB27E51542B2955CEC538DCA14D2, all 1 inputs ready in: 00:00:00.000
2016-05-18 01:57:19,734 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536639459_0001_1_00_000000_0
2016-05-18 01:57:19,734 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BCD9CB27E51542B2955CEC538DCA14D2, mem on close (mb), free: 55, total: 489, max: 672
2016-05-18 01:57:19,735 INFO  impl.PipelinedSorter (PipelinedSorter.java:flush(629)) - A0F2C78FBDA64314AA5D3029C831147B: Starting flush of map output
2016-05-18 01:57:19,735 INFO  impl.PipelinedSorter (PipelinedSorter.java:end(995)) - A0F2C78FBDA64314AA5D3029C831147B: Span0.length = 7, perItem = 99
2016-05-18 01:57:19,735 INFO  impl.PipelinedSorter (PipelinedSorter.java:sort(904)) - A0F2C78FBDA64314AA5D3029C831147B: done sorting span=0, length=7, time=0
2016-05-18 01:57:19,736 INFO  impl.PipelinedSorter (PipelinedSorter.java:ready(1297)) - A0F2C78FBDA64314AA5D3029C831147B: Heap = SpanIterator<0:6> (span=Span[16777216,693]),
2016-05-18 01:57:19,737 INFO  impl.PipelinedSorter (PipelinedSorter.java:spill(546)) - A0F2C78FBDA64314AA5D3029C831147B: Spilling to /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/1CB18EE6637642E286712CCAAFA58153/E3D6F0F9EE374AF19BD18DBC168D591C/.tez/application_1463536639459_0001_wd/localmode-local-dir/output/attempt_1463536639459_0001_1_00_000000_0_10032_0/file.out
2016-05-18 01:57:19,740 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:19 Completed running task attempt: attempt_1463536639459_0001_1_00_000000_0
2016-05-18 01:57:19,741 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536639459_0001_1_00_000000_0, askedToStop=false
2016-05-18 01:57:19,741 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536639459_0001_1_00_000000_0, stopRequested=false
2016-05-18 01:57:19,742 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536639459_0001_1_00_000000_0: Counters: 18 [[org.apache.tez.common.counters.TaskCounter SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1][cascading.flow.SliceCounters Process_Begin_Time=1463536639731, Process_Duration=3, Process_End_Time=1463536639734, Read_Duration=1, Tuples_Read=10, Tuples_Written=7, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=10]]
2016-05-18 01:57:19,743 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536639459_0001_1_00_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:19,743 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:19,743 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=BCD9CB27E51542B2955CEC538DCA14D2, taskAttemptId=attempt_1463536639459_0001_1_00_000000_0, creationTime=1463536639674, allocationTime=1463536639676, startTime=1463536639678, finishTime=1463536639743, timeTaken=65, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:19,744 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536639459_0001_1_00_000000_0
2016-05-18 01:57:19,744 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:TASK_FINISHED]: vertexName=BCD9CB27E51542B2955CEC538DCA14D2, taskId=task_1463536639459_0001_1_00_000000, startTime=1463536639678, finishTime=1463536639744, timeTaken=66, status=SUCCEEDED, successfulAttemptID=attempt_1463536639459_0001_1_00_000000_0, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536639731, Process_Duration=3, Process_End_Time=1463536639734, Read_Duration=1, Tuples_Read=10, Tuples_Written=7, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10
2016-05-18 01:57:19,745 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:19,745 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2]
2016-05-18 01:57:19,743 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:19,745 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:19,746 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536639459_0001_00_000001
2016-05-18 01:57:19,746 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:VERTEX_FINISHED]: vertexName=BCD9CB27E51542B2955CEC538DCA14D2, vertexId=vertex_1463536639459_0001_1_00, initRequestedTime=1463536639648, initedTime=1463536639666, startRequestedTime=1463536639649, startedTime=1463536639667, finishTime=1463536639745, timeTaken=78, status=SUCCEEDED, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536639731, Process_Duration=3, Process_End_Time=1463536639734, Read_Duration=1, Tuples_Read=10, Tuples_Written=7, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10, vertexStats=firstTaskStartTime=1463536639678, firstTasksToStart=[ task_1463536639459_0001_1_00_000000 ], lastTaskFinishTime=1463536639743, lastTasksToFinish=[ task_1463536639459_0001_1_00_000000 ], minTaskDuration=65, maxTaskDuration=65, avgTaskDuration=65.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536639459_0001_1_00_000000 ], longestDurationTasks=[ task_1463536639459_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:19,747 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:19,747 INFO  impl.VertexImpl (VertexImpl.java:transition(3279)) - Source task attempt completed for vertex: vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B] attempt: attempt_1463536639459_0001_1_00_000000_0 with state: SUCCEEDED vertexState: RUNNING
2016-05-18 01:57:19,747 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536639459_0001_00_000001, stoppedTime=1463536639747, exitStatus=0
2016-05-18 01:57:19,747 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:schedulePendingTasks(920)) - All source tasks assigned. Ramping up 1 remaining tasks for vertex: A0F2C78FBDA64314AA5D3029C831147B
2016-05-18 01:57:19,748 INFO  impl.Edge (Edge.java:routingToBegin(232)) - Routing to begin for edge: EdgeInfo: sourceVertexName=BCD9CB27E51542B2955CEC538DCA14D2, destinationVertexName=A0F2C78FBDA64314AA5D3029C831147B. EdgeProperty: { SCATTER_GATHER : org.apache.tez.runtime.library.input.OrderedGroupedKVInput >> PERSISTED >> org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput >> NullEdgeManager } onDemandRouting: true
2016-05-18 01:57:19,748 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B]
2016-05-18 01:57:19,747 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:19,748 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:19,748 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(262)) - Ignoring stop request for containerId container_1463536639459_0001_00_000001. Relying on regular task shutdown for it to end
2016-05-18 01:57:19,749 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:TASK_STARTED]: vertexName=A0F2C78FBDA64314AA5D3029C831147B, taskId=task_1463536639459_0001_1_01_000000, scheduledTime=1463536639748, launchTime=1463536639748
2016-05-18 01:57:19,749 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B]
2016-05-18 01:57:19,751 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536639459_0001_00_000002, launchTime=1463536639751
2016-05-18 01:57:19,752 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536639459_0001_00_000002
2016-05-18 01:57:19,752 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536639459_0001_1_01_000000_0] started. Is using containerId: [container_1463536639459_0001_00_000002] on NM: [127.0.0.1:0]
2016-05-18 01:57:19,753 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=A0F2C78FBDA64314AA5D3029C831147B, taskAttemptId=attempt_1463536639459_0001_1_01_000000_0, startTime=1463536639752, containerId=container_1463536639459_0001_00_000002, nodeId=127.0.0.1:0
2016-05-18 01:57:19,753 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536639459_0001_00_000002: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536639459_0001_1_01_000000_0
2016-05-18 01:57:19 Starting to run new task attempt: attempt_1463536639459_0001_1_01_000000_0
2016-05-18 01:57:19,754 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536639459_0001_1_01_000000_0
2016-05-18 01:57:19,754 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:19,754 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:19,754 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [1CB18EE6637642E286712CCAAFA58153/E3D6F0F9EE374AF19BD18DBC168D591C] test/(1/1) ...Removal/group/NONE/STRICT, VertexName: A0F2C78FBDA64314AA5D3029C831147B, VertexParallelism: 1, TaskAttemptID:attempt_1463536639459_0001_1_01_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=BCD9CB27E51542B2955CEC538DCA14D2, physicalEdgeCount=1, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=FEFD7329B1D84F8DBF2DC5BA139026D7, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-18 01:57:19,755 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:19,755 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536639459_0001_1_01_000000_0
2016-05-18 01:57:19,756 INFO  impl.VertexImpl (VertexImpl.java:getTaskAttemptTezEvents(3662)) - Sending attempt_1463536639459_0001_1_01_000000_0 1 events [0,1) total 1 vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B]
2016-05-18 01:57:19,757 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536639459_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-18 01:57:19,757 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536639459_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:19,757 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536639459_0001_00_000001, Exiting
2016-05-18 01:57:19,757 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536639459_0001_1_01_000000_0, eventCount=1 fromEventId=0 nextFromEventId=1
2016-05-18 01:57:19,757 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536639459_0001_00_000001
2016-05-18 01:57:19,757 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536639459_0001_00_000001
2016-05-18 01:57:19,758 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536639459_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:19,759 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536639459_0001_00_000001 completed successfully
2016-05-18 01:57:19,760 INFO  orderedgrouped.MergeManager (MergeManager.java:getInitialMemoryRequirement(339)) - Initial Memory required for SHUFFLE_BUFFER=211392912 based on INPUT_BUFFER_FACTOR=0.9,  for final merged output=0, using factor: 0.0
2016-05-18 01:57:19,761 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:19,772 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: A0F2C78FBDA64314AA5D3029C831147B, ordinal: 1
2016-05-18 01:57:19,772 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A0F2C78FBDA64314AA5D3029C831147B, mem on start (mb), free: 50, total: 489, max: 672
2016-05-18 01:57:19,773 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:19,773 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:19,773 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:19,778 INFO  output.MROutput (MROutput.java:initialize(421)) - FEFD7329B1D84F8DBF2DC5BA139026D7: outputFormat=org.apache.hadoop.mapred.TextOutputFormat, using newmapreduce API=false
2016-05-18 01:57:19,778 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:19,778 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[BCD9CB27E51542B2955CEC538DCA14D2:INPUT:211392912:org.apache.tez.runtime.library.input.OrderedGroupedKVInput], [FEFD7329B1D84F8DBF2DC5BA139026D7:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput]
2016-05-18 01:57:19,778 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:19,779 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:19,779 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 211392912, TotalRequestedScaled: 1.9513191876923078E8, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.30
2016-05-18 01:57:19,779 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[BCD9CB27E51542B2955CEC538DCA14D2:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:211392912:211392912], [FEFD7329B1D84F8DBF2DC5BA139026D7:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0]
2016-05-18 01:57:19,779 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:19,780 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: BCD9CB27E51542B2955CEC538DCA14D2 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:19,780 INFO  orderedgrouped.Shuffle (Shuffle.java:<init>(147)) - BCD9CB27E51542B2955CEC538DCA14D2: Shuffle assigned with 1 inputs, codec: None, ifileReadAhead: true
2016-05-18 01:57:19,780 INFO  orderedgrouped.MergeManager (MergeManager.java:<init>(273)) - BCD9CB27E51542B2955CEC538DCA14D2: MergerManager: memoryLimit=211392912, maxSingleShuffleLimit=52848228, mergeThreshold=190253616, ioSortFactor=100, postMergeMem=0, memToMemMergeOutputsThreshold=100
2016-05-18 01:57:19,780 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:19,781 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:19,781 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:<init>(353)) - ShuffleScheduler running for sourceVertex: BCD9CB27E51542B2955CEC538DCA14D2 with configuration: maxFetchFailuresBeforeReporting=5, reportReadErrorImmediately=true, maxFailedUniqueFetches=1, abortFailureLimit=15, maxTaskOutputAtOnce=20, numFetchers=1, hostFailureFraction=0.2, minFailurePerHost=4, maxAllowedFailedFetchFraction=0.5, maxStallTimeFraction=0.5, minReqProgressFraction=0.5, checkFailedFetchSinceLastCompletion=true
2016-05-18 01:57:19,782 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: BCD9CB27E51542B2955CEC538DCA14D2
2016-05-18 01:57:19,782 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:19,783 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536639459_0001_1_01_000000_0
2016-05-18 01:57:19,783 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - BCD9CB27E51542B2955CEC538DCA14D2: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0
2016-05-18 01:57:19,785 INFO  orderedgrouped.ShuffleScheduler (ShuffleUtils.java:logIndividualFetchComplete(489)) - Completed fetch for attempt: {0, 0, attempt_1463536639459_0001_1_00_000000_0_10032} to DISK_DIRECT, csize=653, dsize=649, EndTime=1463536639785, TimeTaken=0, Rate=0.00 MB/s
2016-05-18 01:57:19,785 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:copySucceeded(551)) - All inputs fetched for input vertex : BCD9CB27E51542B2955CEC538DCA14D2
2016-05-18 01:57:19,785 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:19,785 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:callInternal(1289)) - Shutting down FetchScheduler for input: BCD9CB27E51542B2955CEC538DCA14D2, wasInterrupted=false
2016-05-18 01:57:19,785 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:onSuccess(1328)) - BCD9CB27E51542B2955CEC538DCA14D2: Already shutdown. Ignoring fetch complete
2016-05-18 01:57:19,786 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:19,786 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1005)) - finalMerge called with 0 in-memory map-outputs and 1 on-disk map-outputs
2016-05-18 01:57:19,787 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1103)) - Disk file=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/1CB18EE6637642E286712CCAAFA58153/E3D6F0F9EE374AF19BD18DBC168D591C/.tez/application_1463536639459_0001_wd/localmode-local-dir/output/attempt_1463536639459_0001_1_00_000000_0_10032/file.out, len=653, isLocal=true
2016-05-18 01:57:19,787 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1115)) - Merging 1 files, 653 bytes from disk
2016-05-18 01:57:19,787 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1130)) - Merging 0 segments, 0 bytes from memory into reduce
2016-05-18 01:57:19,787 INFO  impl.TezMerger (TezMerger.java:merge(644)) - Merging 1 sorted segments
2016-05-18 01:57:19,788 INFO  impl.TezMerger (TezMerger.java:merge(749)) - Down to the last merge-pass, with 1 segments left of total size: 633 bytes
2016-05-18 01:57:19,788 INFO  orderedgrouped.Shuffle (Shuffle.java:callInternal(332)) - merge complete for input vertex : BCD9CB27E51542B2955CEC538DCA14D2
2016-05-18 01:57:19,788 INFO  orderedgrouped.Shuffle (Shuffle.java:onSuccess(417)) - BCD9CB27E51542B2955CEC538DCA14D2: Shuffle Runner thread complete
2016-05-18 01:57:19,789 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: GroupBy(test)[by:[{1}:'method']]
2016-05-18 01:57:19,790 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: GroupBy(test)[by:[{1}:'method']] streamed: true, id: D8DC140F1E4B4CFAA0BC465ECF84A20C
2016-05-18 01:57:19,790 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/NONE/STRICT"], id: FEFD7329B1D84F8DBF2DC5BA139026D7
2016-05-18 01:57:19,791 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/NONE/STRICT"]
2016-05-18 01:57:19,791 INFO  element.TezGroupGate (TezGroupGate.java:prepare(90)) - calling OrderedGroupedKVInput#start() on: GroupBy(test)[by:[{1}:'method']] D8DC140F1E4B4CFAA0BC465ECF84A20C, for 1 inputs
2016-05-18 01:57:19,791 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: A0F2C78FBDA64314AA5D3029C831147B, all 1 inputs ready in: 00:00:00.000
2016-05-18 01:57:19,792 INFO  input.OrderedGroupedKVInput (OrderedGroupedKVInput.java:createValuesIterator(292)) - BCD9CB27E51542B2955CEC538DCA14D2: creating ValuesIterator with comparator=cascading.tuple.hadoop.util.TupleComparator, keyClass=cascading.tuple.io.KeyTuple, valClass=cascading.tuple.io.ValueTuple
2016-05-18 01:57:19,795 INFO  output.MROutput (MROutput.java:close(526)) - FEFD7329B1D84F8DBF2DC5BA139026D7 closed
2016-05-18 01:57:19,796 INFO  impl.TaskImpl (TaskImpl.java:canCommit(671)) - attempt_1463536639459_0001_1_01_000000_0 given a go for committing the task output.
2016-05-18 01:57:19,797 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536639459_0001_1_01_000000_0
2016-05-18 01:57:19,797 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A0F2C78FBDA64314AA5D3029C831147B, mem on close (mb), free: 46, total: 489, max: 672
2016-05-18 01:57:19,797 INFO  orderedgrouped.Shuffle (Shuffle.java:shutdown(278)) - Shutting down Shuffle for source: BCD9CB27E51542B2955CEC538DCA14D2
2016-05-18 01:57:19,798 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - BCD9CB27E51542B2955CEC538DCA14D2: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0, updateOnClose
2016-05-18 01:57:19,798 INFO  output.MROutput (MROutput.java:close(526)) - FEFD7329B1D84F8DBF2DC5BA139026D7 closed
2016-05-18 01:57:19,798 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:19 Completed running task attempt: attempt_1463536639459_0001_1_01_000000_0
2016-05-18 01:57:19,799 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536639459_0001_1_01_000000_0, askedToStop=false
2016-05-18 01:57:19,799 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536639459_0001_1_01_000000_0, stopRequested=false
2016-05-18 01:57:19,800 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536639459_0001_1_01_000000_0: Counters: 36 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=5, MERGE_PHASE_TIME=8, FIRST_EVENT_RECEIVED=3, LAST_EVENT_RECEIVED=3][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][cascading.flow.SliceCounters Process_Begin_Time=1463536639791, Process_Duration=6, Process_End_Time=1463536639797, Read_Duration=1, Tuples_Read=7, Tuples_Written=1, Write_Duration=0][cascading.flow.StepCounters Tuples_Written=1]]
2016-05-18 01:57:19,801 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536639459_0001_1_01_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:19,801 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=A0F2C78FBDA64314AA5D3029C831147B, taskAttemptId=attempt_1463536639459_0001_1_01_000000_0, creationTime=1463536639749, allocationTime=1463536639750, startTime=1463536639752, finishTime=1463536639801, timeTaken=49, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:19,801 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:19,801 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:19,802 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:19,802 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536639459_0001_00_000002
2016-05-18 01:57:19,801 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536639459_0001_1_01_000000_0
2016-05-18 01:57:19,803 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:TASK_FINISHED]: vertexName=A0F2C78FBDA64314AA5D3029C831147B, taskId=task_1463536639459_0001_1_01_000000, startTime=1463536639752, finishTime=1463536639802, timeTaken=50, status=SUCCEEDED, successfulAttemptID=attempt_1463536639459_0001_1_01_000000_0, diagnostics=, counters=Counters: 36, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=5, MERGE_PHASE_TIME=8, FIRST_EVENT_RECEIVED=3, LAST_EVENT_RECEIVED=3, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536639791, Process_Duration=6, Process_End_Time=1463536639797, Read_Duration=1, Tuples_Read=7, Tuples_Written=1, Write_Duration=0, cascading.flow.StepCounters, Tuples_Written=1
2016-05-18 01:57:19,803 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:19,803 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B]
2016-05-18 01:57:19,805 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:VERTEX_FINISHED]: vertexName=A0F2C78FBDA64314AA5D3029C831147B, vertexId=vertex_1463536639459_0001_1_01, initRequestedTime=1463536639649, initedTime=1463536639657, startRequestedTime=1463536639668, startedTime=1463536639670, finishTime=1463536639803, timeTaken=133, status=SUCCEEDED, diagnostics=, counters=Counters: 36, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=5, MERGE_PHASE_TIME=8, FIRST_EVENT_RECEIVED=3, LAST_EVENT_RECEIVED=3, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536639791, Process_Duration=6, Process_End_Time=1463536639797, Read_Duration=1, Tuples_Read=7, Tuples_Written=1, Write_Duration=0, cascading.flow.StepCounters, Tuples_Written=1, vertexStats=firstTaskStartTime=1463536639752, firstTasksToStart=[ task_1463536639459_0001_1_01_000000 ], lastTaskFinishTime=1463536639801, lastTasksToFinish=[ task_1463536639459_0001_1_01_000000 ], minTaskDuration=49, maxTaskDuration=49, avgTaskDuration=49.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536639459_0001_1_01_000000 ], longestDurationTasks=[ task_1463536639459_0001_1_01_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:19,805 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:19,805 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536639459_0001_00_000002, stoppedTime=1463536639805, exitStatus=0
2016-05-18 01:57:19,806 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B] completed., numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:19,806 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:19,806 INFO  impl.DAGImpl (DAGImpl.java:commitOrFinish(1051)) - No output committers for vertex: vertex_1463536639459_0001_1_00 [BCD9CB27E51542B2955CEC538DCA14D2]
2016-05-18 01:57:19,806 INFO  impl.DAGImpl (DAGImpl.java:commitOrFinish(1098)) - Start writing dag commit event, dag_1463536639459_0001_1
2016-05-18 01:57:19,806 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463536639459_0001_1
2016-05-18 01:57:19,807 INFO  impl.DAGImpl (DAGImpl.java:call(1083)) - Committing output: FEFD7329B1D84F8DBF2DC5BA139026D7 for vertex: vertex_1463536639459_0001_1_01 [A0F2C78FBDA64314AA5D3029C831147B], outputName: FEFD7329B1D84F8DBF2DC5BA139026D7
2016-05-18 01:57:19,809 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536639459_0001_1 transitioned from RUNNING to COMMITTING due to event DAG_VERTEX_COMPLETED
2016-05-18 01:57:19,809 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(262)) - Ignoring stop request for containerId container_1463536639459_0001_00_000002. Relying on regular task shutdown for it to end
2016-05-18 01:57:19,812 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536639459_0001_00_000002 is valid, but no longer registered, and will be killed
2016-05-18 01:57:19,812 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536639459_0001_00_000002: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:19,812 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536639459_0001_00_000002, Exiting
2016-05-18 01:57:19,813 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536639459_0001_00_000002
2016-05-18 01:57:19,813 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536639459_0001_00_000002
2016-05-18 01:57:19,813 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536639459_0001_00_000002 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:19,813 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536639459_0001_00_000002 completed successfully
2016-05-18 01:57:19,816 INFO  impl.DAGImpl (DAGImpl.java:commitCompleted(2192)) - Commit succeeded for output:outputName:FEFD7329B1D84F8DBF2DC5BA139026D7 of vertex/vertexGroup:A0F2C78FBDA64314AA5D3029C831147B isVertexGroupOutput:false
2016-05-18 01:57:19,816 INFO  impl.DAGImpl (DAGImpl.java:checkCommitsForCompletion(1313)) - Checking commits for DAG completion, numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:19,819 INFO  recovery.RecoveryService (RecoveryService.java:handle(327)) - DAG completed, dagId=dag_1463536639459_0001_1, queueSize=0
2016-05-18 01:57:19,819 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536639459_0001_1][Event:DAG_FINISHED]: dagId=dag_1463536639459_0001_1, startTime=1463536639647, finishTime=1463536639817, timeTaken=170, status=SUCCEEDED, diagnostics=, counters=Counters: 48, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=2, TOTAL_LAUNCHED_TASKS=2, RACK_LOCAL_TASKS=1, AM_CPU_MILLISECONDS=320, AM_GC_TIME_MILLIS=0, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=14, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=8, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=5, MERGE_PHASE_TIME=8, FIRST_EVENT_RECEIVED=3, LAST_EVENT_RECEIVED=3, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=2927073279522, Process_Duration=9, Process_End_Time=2927073279531, Read_Duration=2, Tuples_Read=17, Tuples_Written=8, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10, Tuples_Written=1
2016-05-18 01:57:19,820 INFO  impl.DAGImpl (DAGImpl.java:finished(1405)) - DAG: dag_1463536639459_0001_1 finished with state: SUCCEEDED
2016-05-18 01:57:19,820 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536639459_0001_1 transitioned from COMMITTING to SUCCEEDED due to event DAG_COMMIT_COMPLETED
2016-05-18 01:57:19 Completed Dag: dag_1463536639459_0001_1
2016-05-18 01:57:19,820 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(751)) - DAG completed, dagId=dag_1463536639459_0001_1, dagState=SUCCEEDED
2016-05-18 01:57:19,820 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536639459_0001_1_post
2016-05-18 01:57:19,821 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:19,821 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(800)) - Central Dispatcher queue size after DAG completion, before cleanup: 0
2016-05-18 01:57:19,821 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(802)) - Waiting for next DAG to be submitted.
2016-05-18 01:57:19,821 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(842)) - Cleaning up DAG: name=[1CB18EE6637642E286712CCAAFA58153/E3D6F0F9EE374AF19BD18DBC168D591C] test/(1/1) ...Removal/group/NONE/STRICT, with id=dag_1463536639459_0001_1
2016-05-18 01:57:19,822 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(852)) - Completed cleanup for DAG: name=[1CB18EE6637642E286712CCAAFA58153/E3D6F0F9EE374AF19BD18DBC168D591C] test/(1/1) ...Removal/group/NONE/STRICT, with id=dag_1463536639459_0001_1
2016-05-18 01:57:19,832 INFO  client.TezClient (TezClient.java:stop(566)) - Shutting down Tez Session, sessionName=(1/1) ...Removal/group/NONE/STRICT, applicationId=application_1463536639459_0001
2016-05-18 01:57:19,834 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(124)) - Received message to shutdown AM
2016-05-18 01:57:19,834 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:setShouldUnregisterFlag(895)) - TaskScheduler notified that it should unregister from RM
2016-05-18 01:57:19,835 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1301)) - No current running DAG, shutting down the AM
2016-05-18 01:57:19,835 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(907)) - DAGAppMasterShutdownHandler invoked
2016-05-18 01:57:19,835 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(916)) - Handling DAGAppMaster shutdown
2016-05-18 01:57:19,835 INFO  app.DAGAppMaster (DAGAppMaster.java:run(936)) - Sleeping for 5 seconds before shutting down
2016-05-18 01:57:19,836 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(84)) - Stopping HistoryEventHandler
2016-05-18 01:57:19,836 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(196)) - Stopping RecoveryService
2016-05-18 01:57:19,836 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(199)) - Handle the remaining events in queue, queue size=0
2016-05-18 01:57:19,837 INFO  recovery.RecoveryService (RecoveryService.java:run(173)) - EventQueue take interrupted. Returning
2016-05-18 01:57:19,837 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(221)) - Closing Summary Stream
2016-05-18 01:57:19,837 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-18 01:57:19,838 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-18 01:57:19,839 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:serviceStop(678)) - Shutting down AppCallbackExecutor
2016-05-18 01:57:19,852 INFO  app.DAGAppMaster (DAGAppMaster.java:run(2084)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/1CB18EE6637642E286712CCAAFA58153/E3D6F0F9EE374AF19BD18DBC168D591C/.tez/application_1463536639459_0001
2016-05-18 01:57:19,853 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/NONE/STRICT/_temporary
2016-05-18 01:57:19,854 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  completed in: 00:00.418
2016-05-18 01:57:19,926 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 01:57:19,927 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-18 01:57:19,977 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-05-18 01:57:20,005 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.049
2016-05-18 01:57:20,005 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:20,005 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:20,006 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 01:57:20,023 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt
2016-05-18 01:57:20,032 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/VALID/STRICT
2016-05-18 01:57:20,093 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting
2016-05-18 01:57:20,093 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:20,093 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  sink: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/VALID/STRICT"]
2016-05-18 01:57:20,093 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  parallel execution of steps is enabled: false
2016-05-18 01:57:20,094 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  executing total steps: 1
2016-05-18 01:57:20,094 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  allocating management threads: 1
2016-05-18 01:57:20,094 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting step: (1/1) ...emoval/group/VALID/STRICT
2016-05-18 01:57:20,094 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [test] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-18 01:57:20,110 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tez session mode enabled: true
2016-05-18 01:57:20,114 INFO  client.TezClient (TezClient.java:<init>(174)) - Tez Client Version: [ component=tez-api, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:20,114 INFO  client.TezClient (TezClient.java:start(394)) - Session mode. Starting session.
2016-05-18 01:57:20,115 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(164)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-18 01:57:20,123 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(122)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4367CB11D19F4E358E9F0BD891F7327A/E6D26439E0254B4E9144D0DADC3192BE/.tez/application_1463536640114_0001 doesn't exist and is created
2016-05-18 01:57:20,143 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(332)) - DAGAppMaster thread has been created
2016-05-18 01:57:20,143 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-18 01:57:20,144 INFO  client.LocalClient (LocalClient.java:run(282)) - Using working directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4367CB11D19F4E358E9F0BD891F7327A/E6D26439E0254B4E9144D0DADC3192BE/.tez/application_1463536640114_0001_wd
2016-05-18 01:57:20,159 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(363)) - Created DAGAppMaster for application appattempt_1463536640114_0001_000000, versionInfo=[ component=tez-dag, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:20,160 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(80)) - Trying to locate HadoopShimProvider for hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:20,160 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(139)) - Picked HadoopShim org.apache.tez.hadoop.shim.DefaultHadoopShim, providerName=null, overrideProviderViaConfig=null, hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:20,162 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(436)) - AM Level configured TaskSchedulers: [0:TezUber:null]
2016-05-18 01:57:20,162 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(437)) - AM Level configured ContainerLaunchers: [0:TezUber:null]
2016-05-18 01:57:20,162 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(438)) - AM Level configured TaskCommunicators: [0:TezUber:null]
2016-05-18 01:57:20,163 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(447)) - Comparing client version with AM version, clientVersion=0.8.2, AMVersion=0.8.2
2016-05-18 01:57:20,164 INFO  app.TaskCommunicatorManager (TaskCommunicatorManager.java:createUberTaskCommunicator(192)) - Creating Default Local Task Communicator
2016-05-18 01:57:20,165 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.container.AMContainerEventType for class org.apache.tez.dag.app.rm.container.AMContainerMap
2016-05-18 01:57:20,166 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.node.AMNodeEventType for class org.apache.tez.dag.app.rm.node.AMNodeTracker
2016-05-18 01:57:20,166 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGAppMasterEventType for class org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterEventHandler
2016-05-18 01:57:20,166 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGEventType for class org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher
2016-05-18 01:57:20,167 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.VertexEventType for class org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher
2016-05-18 01:57:20,167 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(529)) - Using concurrent dispatcher: false
2016-05-18 01:57:20,167 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher
2016-05-18 01:57:20,168 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskAttemptEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher
2016-05-18 01:57:20,168 INFO  common.AsyncDispatcher (AsyncDispatcher.java:registerAndCreateDispatcher(262)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for independent dispatch using: class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:20,168 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:20,169 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.AMSchedulerEventType for class org.apache.tez.dag.app.rm.TaskSchedulerManager
2016-05-18 01:57:20,169 INFO  launcher.TezContainerLauncherImpl (ContainerLauncherManager.java:createUberContainerLauncher(134)) - Creating LocalContainerLauncher
2016-05-18 01:57:20,171 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.ContainerLauncherEventType for class org.apache.tez.dag.app.launcher.ContainerLauncherManager
2016-05-18 01:57:20,172 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(78)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1, nodeUpdatesRescheduleEnabled: false
2016-05-18 01:57:20,173 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(57)) - Initializing HistoryEventHandler withrecoveryEnabled=true, historyServiceClassName=org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService
2016-05-18 01:57:20,173 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4367CB11D19F4E358E9F0BD891F7327A/E6D26439E0254B4E9144D0DADC3192BE/.tez/application_1463536640114_0001_wd/localmode-log-dir
2016-05-18 01:57:20,173 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4367CB11D19F4E358E9F0BD891F7327A/E6D26439E0254B4E9144D0DADC3192BE/.tez/application_1463536640114_0001_wd/localmode-log-dir/history.txt.appattempt_1463536640114_0001_000000, maxErrors=10
2016-05-18 01:57:20,174 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(124)) - RecoveryService initialized with recoveryPath=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4367CB11D19F4E358E9F0BD891F7327A/E6D26439E0254B4E9144D0DADC3192BE/.tez/application_1463536640114_0001/recovery/0, bufferSize(bytes)=8192, flushInterval(s)=30, maxUnflushedEvents=100
2016-05-18 01:57:20,174 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463536640114_0001_000000, appSubmitTime=1463536640159, launchTime=1463536640159
2016-05-18 01:57:20,181 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-18 01:57:20,184 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:32974
2016-05-18 01:57:20,185 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:createUberTaskScheduler(557)) - Creating TaskScheduler: Local TaskScheduler with clusterIdentifier=1463536640114
2016-05-18 01:57:20,187 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463536640114_0001_000000, startTime=1463536640187
2016-05-18 01:57:20,187 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1945)) - In Session mode. Waiting for DAG over RPC
2016-05-18 01:57:20,244 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-18 01:57:20,244 INFO  client.TezClient (TezClient.java:start(428)) - The url to track the Tez Session: N/A
2016-05-18 01:57:20,244 INFO  client.TezClient (TezClient.java:submitDAGSession(470)) - Submitting dag to TezSession, sessionName=(1/1) ...emoval/group/VALID/STRICT, applicationId=application_1463536640114_0001, dagName=[4367CB11D19F4E358E9F0BD891F7327A/E6D26439E0254B4E9144D0DADC3192BE] test/(1/1) ...emoval/group/VALID/STRICT
2016-05-18 01:57:20,265 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1351)) - Starting DAG submitted via RPC: [4367CB11D19F4E358E9F0BD891F7327A/E6D26439E0254B4E9144D0DADC3192BE] test/(1/1) ...emoval/group/VALID/STRICT
2016-05-18 01:57:20,265 INFO  app.DAGAppMaster (DAGAppMaster.java:createDAG(985)) - Merging AM credentials into DAG credentials
2016-05-18 01:57:20,266 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(1076)) - Generating DAG graphviz file, dagId=dag_1463536640114_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4367CB11D19F4E358E9F0BD891F7327A/E6D26439E0254B4E9144D0DADC3192BE/.tez/application_1463536640114_0001_wd/localmode-log-dir/dag_1463536640114_0001_1.dot
2016-05-18 01:57:20,267 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(1093)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4367CB11D19F4E358E9F0BD891F7327A/E6D26439E0254B4E9144D0DADC3192BE/.tez/application_1463536640114_0001_wd/localmode-log-dir/dag_1463536640114_0001_1-tez-dag.pb.txt
2016-05-18 01:57:20,277 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536640114_0001_1
2016-05-18 01:57:20,277 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:20,278 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2399)) - Running DAG: [4367CB11D19F4E358E9F0BD891F7327A/E6D26439E0254B4E9144D0DADC3192BE] test/(1/1) ...emoval/group/VALID/STRICT
2016-05-18 01:57:20 Running Dag: dag_1463536640114_0001_1
2016-05-18 01:57:20,294 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463536640114_0001_1, submitTime=1463536640265
2016-05-18 01:57:20,295 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4367CB11D19F4E358E9F0BD891F7327A/E6D26439E0254B4E9144D0DADC3192BE/.tez/application_1463536640114_0001/tez-conf.pb" } size: 40985 timestamp: 1463536640000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:20,295 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalInputs(3978)) - Setting 1 additional inputs for vertexvertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE]
2016-05-18 01:57:20,296 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:20,297 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4367CB11D19F4E358E9F0BD891F7327A/E6D26439E0254B4E9144D0DADC3192BE/.tez/application_1463536640114_0001/tez-conf.pb" } size: 40985 timestamp: 1463536640000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:20,297 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4023)) - Setting 1 additional outputs for vertex vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08]
2016-05-18 01:57:20,297 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:20,297 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1593)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-18 01:57:20,298 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463536640114_0001_1, initTime=1463536640298
2016-05-18 01:57:20,298 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536640114_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-18 01:57:20,299 INFO  impl.DAGImpl (DAGImpl.java:transition(1768)) - Added additional resources : [[]] to classpath
2016-05-18 01:57:20,299 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:DAG_STARTED]: dagID=dag_1463536640114_0001_1, startTime=1463536640299
2016-05-18 01:57:20,299 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536640114_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-18 01:57:20,299 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2400)) - Root Inputs exist for Vertex: CD0417CF3A7B4B378B1DC66D7CED74DE : {37E21C126E46412A9EE09AD25ACF8579={InputName=37E21C126E46412A9EE09AD25ACF8579}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-18 01:57:20,300 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2410)) - Starting root input initializer for input: 37E21C126E46412A9EE09AD25ACF8579, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-18 01:57:20,300 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2550)) - Setting vertexManager to RootInputVertexManager for vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE]
2016-05-18 01:57:20,300 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2721)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE]
2016-05-18 01:57:20,300 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2726)) - Vertex will initialize from input initializer. vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE]
2016-05-18 01:57:20,300 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3893)) - Starting 1 inputInitializers for vertex vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE]
2016-05-18 01:57:20,301 INFO  client.TezClient (TezClient.java:submitDAGSession(545)) - Submitted dag to TezSession, sessionName=(1/1) ...emoval/group/VALID/STRICT, applicationId=application_1463536640114_0001, dagName=[4367CB11D19F4E358E9F0BD891F7327A/E6D26439E0254B4E9144D0DADC3192BE] test/(1/1) ...emoval/group/VALID/STRICT
2016-05-18 01:57:20,302 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-18 01:57:20,302 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2562)) - Setting vertexManager to ShuffleVertexManager for vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08]
2016-05-18 01:57:20,306 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:initialize(1022)) - Shuffle Vertex Manager: settings minFrac:0.25 maxFrac:0.75 auto:false desiredTaskIput:104857600 minTasks:1
2016-05-18 01:57:20,306 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2760)) - Creating 1 tasks for vertex: vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08]
2016-05-18 01:57:20,306 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2779)) - Directly initializing vertex: vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08]
2016-05-18 01:57:20,307 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536640114_0001_1_01, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=null, edgeManagersCount=1, rootInputSpecUpdateCount=0, setParallelismCalledFlag=false
2016-05-18 01:57:20,307 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2187)) - Setting up committers for vertex vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08], numAdditionalOutputs=1
2016-05-18 01:57:20,307 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2202)) - Instantiating committer for output=035782F70CB3468DBBF4BFCC3FF3CC5B, vertex=vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-18 01:57:20,307 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(272)) - Starting InputInitializer for Input: 37E21C126E46412A9EE09AD25ACF8579 on vertex vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE]
2016-05-18 01:57:20,311 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(121)) - Committer for AC269EF719464677A61EEF71497ACB08:035782F70CB3468DBBF4BFCC3FF3CC5B using oldmapred API
2016-05-18 01:57:20,311 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(146)) - OutputCommitter for outputName=035782F70CB3468DBBF4BFCC3FF3CC5B, vertexName=AC269EF719464677A61EEF71497ACB08, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-18 01:57:20,311 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(109)) - Input 37E21C126E46412A9EE09AD25ACF8579 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7, groupingEnabled: true
2016-05-18 01:57:20,312 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:VERTEX_INITIALIZED]: vertexName=AC269EF719464677A61EEF71497ACB08, vertexId=vertex_1463536640114_0001_1_01, initRequestedTime=1463536640302, initedTime=1463536640307, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=0, initGeneratedEventsCount=0
2016-05-18 01:57:20,313 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08] transitioned from NEW to INITED due to event V_INIT
2016-05-18 01:57:20,314 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(168)) - Grouping splits in Tez
2016-05-18 01:57:20,314 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(226)) - Desired splits: 1 too large.  Desired splitLength: 1449 Min splitLength: 52428800 New desired splits: 1 Total length: 1449 Original splits: 2
2016-05-18 01:57:20,314 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(321)) - Desired numSplits: 1 lengthPerGroup: 1449 numLocations: 1 numSplitsPerLocation: 2 numSplitsInGroup: 2 totalLength: 1449 numOriginalSplits: 2 . Grouping by length: true count: false nodeLocalOnly: false
2016-05-18 01:57:20,314 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(539)) - Number of splits desired: 1 created: 1 splitsProcessed: 2
2016-05-18 01:57:20,315 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(308)) - Succeeded InputInitializer for Input: 37E21C126E46412A9EE09AD25ACF8579 on vertex vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE]
2016-05-18 01:57:20,316 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:20,316 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1644)) - Got updated RootInputsSpecs: {37E21C126E46412A9EE09AD25ACF8579=forAllWorkUnits=true, update=[1]}
2016-05-18 01:57:20,317 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1664)) - Vertex vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE] parallelism set to 1
2016-05-18 01:57:20,317 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:20,318 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:VERTEX_INITIALIZED]: vertexName=CD0417CF3A7B4B378B1DC66D7CED74DE, vertexId=vertex_1463536640114_0001_1_00, initRequestedTime=1463536640299, initedTime=1463536640317, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1, initGeneratedEventsCount=1
2016-05-18 01:57:20,318 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE] with distanceFromRoot: 0
2016-05-18 01:57:20,318 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE] transitioned from INITIALIZING to INITED due to event V_INPUT_DATA_INFORMATION
2016-05-18 01:57:20,319 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536640114_0001_1_00, startRequestedTime=1463536640302, startedTime=1463536640319
2016-05-18 01:57:20,320 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536640114_0001_1_00, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=org.apache.tez.dag.api.VertexLocationHint@b8338fe7, edgeManagersCount=0, rootInputSpecUpdateCount=1, setParallelismCalledFlag=true
2016-05-18 01:57:20,320 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:20,321 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(100)) - Starting 1 in CD0417CF3A7B4B378B1DC66D7CED74DE
2016-05-18 01:57:20,321 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE]
2016-05-18 01:57:20,321 INFO  impl.VertexImpl (VertexImpl.java:transition(2932)) - Source vertex started: vertex_1463536640114_0001_1_00 for vertex: vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08] numStartedSources: 1 numSources: 1
2016-05-18 01:57:20,321 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08] with distanceFromRoot: 1
2016-05-18 01:57:20,322 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536640114_0001_1_01, startRequestedTime=1463536640321, startedTime=1463536640322
2016-05-18 01:57:20,322 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:20,323 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:TASK_STARTED]: vertexName=CD0417CF3A7B4B378B1DC66D7CED74DE, taskId=task_1463536640114_0001_1_00_000000, scheduledTime=1463536640322, launchTime=1463536640322
2016-05-18 01:57:20,324 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE]
2016-05-18 01:57:20,324 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:onVertexStarted(519)) - OnVertexStarted vertex: AC269EF719464677A61EEF71497ACB08 with 0 source tasks and 1 pending tasks
2016-05-18 01:57:20,324 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:handleVertexStateUpdate(1051)) - Received configured notification : CONFIGURED for vertex: CD0417CF3A7B4B378B1DC66D7CED74DE in vertex: AC269EF719464677A61EEF71497ACB08 numBipartiteSourceTasks: 1
2016-05-18 01:57:20,326 INFO  node.PerSourceNodeTracker (PerSourceNodeTracker.java:nodeSeen(74)) - Adding new node 127.0.0.1:0 to nodeTracker 0
2016-05-18 01:57:20,326 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] submitted tez dag to app master: application_1463536640114_0001, with dag id: dag_1463536640114_0001_1
2016-05-18 01:57:20,329 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536640114_0001_00_000001, launchTime=1463536640329
2016-05-18 01:57:20,331 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536640114_0001_00_000001
2016-05-18 01:57:20,332 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536640114_0001_1_00_000000_0] started. Is using containerId: [container_1463536640114_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-18 01:57:20,332 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=CD0417CF3A7B4B378B1DC66D7CED74DE, taskAttemptId=attempt_1463536640114_0001_1_00_000000_0, startTime=1463536640332, containerId=container_1463536640114_0001_00_000001, nodeId=127.0.0.1:0
2016-05-18 01:57:20,333 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536640114_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536640114_0001_1_00_000000_0
2016-05-18 01:57:20 Starting to run new task attempt: attempt_1463536640114_0001_1_00_000000_0
2016-05-18 01:57:20,335 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536640114_0001_1_00_000000_0
2016-05-18 01:57:20,336 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:20,336 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:20,336 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [4367CB11D19F4E358E9F0BD891F7327A/E6D26439E0254B4E9144D0DADC3192BE] test/(1/1) ...emoval/group/VALID/STRICT, VertexName: CD0417CF3A7B4B378B1DC66D7CED74DE, VertexParallelism: 1, TaskAttemptID:attempt_1463536640114_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=37E21C126E46412A9EE09AD25ACF8579, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=AC269EF719464677A61EEF71497ACB08, physicalEdgeCount=1, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ]
2016-05-18 01:57:20,337 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:20,337 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536640114_0001_1_00_000000_0
2016-05-18 01:57:20,338 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(496)) - TaskAttempt:attempt_1463536640114_0001_1_00_000000_0 sent events: (0-1).
2016-05-18 01:57:20,338 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536640114_0001_1_00_000000_0, eventCount=1 fromEventId=0 nextFromEventId=0
2016-05-18 01:57:20,340 INFO  input.MRInput (MRInput.java:initialize(440)) - 37E21C126E46412A9EE09AD25ACF8579 using newmapreduce API=false, split via event=true, numPhysicalInputs=1
2016-05-18 01:57:20,341 INFO  input.MRInput (MRInput.java:initializeInternal(494)) - Initialized MRInput: 37E21C126E46412A9EE09AD25ACF8579
2016-05-18 01:57:20,342 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:20,349 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: CD0417CF3A7B4B378B1DC66D7CED74DE, ordinal: 0
2016-05-18 01:57:20,350 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: CD0417CF3A7B4B378B1DC66D7CED74DE, mem on start (mb), free: 159, total: 490, max: 672
2016-05-18 01:57:20,350 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:20,350 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:20,350 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:20,350 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:20,350 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[37E21C126E46412A9EE09AD25ACF8579:INPUT:0:org.apache.tez.mapreduce.input.MRInput], [AC269EF719464677A61EEF71497ACB08:OUTPUT:104857600:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput]
2016-05-18 01:57:20,350 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:20,350 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:20,350 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 104857600, TotalRequestedScaled: 9.679163076923077E7, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.15
2016-05-18 01:57:20,351 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[37E21C126E46412A9EE09AD25ACF8579:org.apache.tez.mapreduce.input.MRInput:INPUT:0:0], [AC269EF719464677A61EEF71497ACB08:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput:OUTPUT:104857600:104857600]
2016-05-18 01:57:20,351 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:20,351 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: 37E21C126E46412A9EE09AD25ACF8579 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:20,351 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:20,351 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:20,351 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: 37E21C126E46412A9EE09AD25ACF8579
2016-05-18 01:57:20,351 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:20,352 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536640114_0001_1_00_000000_0
2016-05-18 01:57:20,353 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(174)) - Processing split: TezGroupedSplit{wrappedSplits=[file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:0+724, file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:724+725], wrappedInputFormatName='org.apache.hadoop.mapred.TextInputFormat', locations=[localhost], rack='null', length=1449}
2016-05-18 01:57:20,353 INFO  input.MRInput (MRInput.java:initFromEventInternal(653)) - 37E21C126E46412A9EE09AD25ACF8579 initialized RecordReader from event
2016-05-18 01:57:20,355 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:20,355 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"] streamed: true, id: 37E21C126E46412A9EE09AD25ACF8579
2016-05-18 01:57:20,356 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: GroupBy(test)[by:[{1}:'method']], id: 4840DF9D01DF4DFA9A46A21FD84D3538
2016-05-18 01:57:20,356 INFO  element.TezGroupGate (TezGroupGate.java:prepare(98)) - calling OrderedPartitionedKVOutput#start() on: GroupBy(test)[by:[{1}:'method']] 4840DF9D01DF4DFA9A46A21FD84D3538
2016-05-18 01:57:20,357 INFO  impl.ExternalSorter (ExternalSorter.java:<init>(199)) - AC269EF719464677A61EEF71497ACB08 using: memoryMb=100, keySerializerClass=class cascading.tuple.io.KeyTuple, valueSerializerClass=cascading.tuple.hadoop.io.ValueTupleSerializer@3b93be92, comparator=cascading.tuple.hadoop.util.TupleComparator@60c481cc, partitioner=cascading.tuple.tez.util.TuplePartitioner, serialization=cascading.tuple.hadoop.TupleSerialization,org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
2016-05-18 01:57:20,358 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(170)) - Setting up PipelinedSorter for AC269EF719464677A61EEF71497ACB08: , UsingHashComparator=false
2016-05-18 01:57:20,371 INFO  impl.PipelinedSorter (PipelinedSorter.java:allocateSpace(245)) - Newly allocated block size=104857600, index=0, Number of buffers=1, currentAllocatableMemory=0, currentBufferSize=104857600, total=104857600
2016-05-18 01:57:20,371 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(189)) - Pre allocating rest of memory buffers upfront
2016-05-18 01:57:20,372 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(207)) - Setting up PipelinedSorter for AC269EF719464677A61EEF71497ACB08: , UsingHashComparator=false#blocks=1, maxMemUsage=104857600, lazyAllocateMem=false, minBlockSize=2097152000, initial BLOCK_SIZE=104857600, finalMergeEnabled=true, pipelinedShuffle=false, sendEmptyPartitions=true, tez.runtime.io.sort.mb=100
2016-05-18 01:57:20,372 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(882)) - AC269EF719464677A61EEF71497ACB08: reserved.remaining()=104857600, reserved.metasize=16777216
2016-05-18 01:57:20,372 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:20,373 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: CD0417CF3A7B4B378B1DC66D7CED74DE, all 1 inputs ready in: 00:00:00.000
2016-05-18 01:57:20,379 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536640114_0001_1_00_000000_0
2016-05-18 01:57:20,379 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: CD0417CF3A7B4B378B1DC66D7CED74DE, mem on close (mb), free: 56, total: 490, max: 672
2016-05-18 01:57:20,381 INFO  impl.PipelinedSorter (PipelinedSorter.java:flush(629)) - AC269EF719464677A61EEF71497ACB08: Starting flush of map output
2016-05-18 01:57:20,381 INFO  impl.PipelinedSorter (PipelinedSorter.java:end(995)) - AC269EF719464677A61EEF71497ACB08: Span0.length = 7, perItem = 99
2016-05-18 01:57:20,382 INFO  impl.PipelinedSorter (PipelinedSorter.java:sort(904)) - AC269EF719464677A61EEF71497ACB08: done sorting span=0, length=7, time=1
2016-05-18 01:57:20,382 INFO  impl.PipelinedSorter (PipelinedSorter.java:ready(1297)) - AC269EF719464677A61EEF71497ACB08: Heap = SpanIterator<0:6> (span=Span[16777216,693]),
2016-05-18 01:57:20,384 INFO  impl.PipelinedSorter (PipelinedSorter.java:spill(546)) - AC269EF719464677A61EEF71497ACB08: Spilling to /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4367CB11D19F4E358E9F0BD891F7327A/E6D26439E0254B4E9144D0DADC3192BE/.tez/application_1463536640114_0001_wd/localmode-local-dir/output/attempt_1463536640114_0001_1_00_000000_0_10039_0/file.out
2016-05-18 01:57:20,389 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:20 Completed running task attempt: attempt_1463536640114_0001_1_00_000000_0
2016-05-18 01:57:20,390 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536640114_0001_1_00_000000_0, askedToStop=false
2016-05-18 01:57:20,390 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536640114_0001_1_00_000000_0, stopRequested=false
2016-05-18 01:57:20,390 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536640114_0001_1_00_000000_0: Counters: 18 [[org.apache.tez.common.counters.TaskCounter SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1][cascading.flow.SliceCounters Process_Begin_Time=1463536640373, Process_Duration=6, Process_End_Time=1463536640379, Read_Duration=4, Tuples_Read=10, Tuples_Written=7, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=10]]
2016-05-18 01:57:20,391 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536640114_0001_1_00_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:20,392 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:20,392 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:20,392 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:20,392 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536640114_0001_00_000001
2016-05-18 01:57:20,393 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=CD0417CF3A7B4B378B1DC66D7CED74DE, taskAttemptId=attempt_1463536640114_0001_1_00_000000_0, creationTime=1463536640324, allocationTime=1463536640328, startTime=1463536640332, finishTime=1463536640392, timeTaken=60, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:20,394 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536640114_0001_1_00_000000_0
2016-05-18 01:57:20,395 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:TASK_FINISHED]: vertexName=CD0417CF3A7B4B378B1DC66D7CED74DE, taskId=task_1463536640114_0001_1_00_000000, startTime=1463536640332, finishTime=1463536640394, timeTaken=62, status=SUCCEEDED, successfulAttemptID=attempt_1463536640114_0001_1_00_000000_0, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536640373, Process_Duration=6, Process_End_Time=1463536640379, Read_Duration=4, Tuples_Read=10, Tuples_Written=7, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=10
2016-05-18 01:57:20,396 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:20,396 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE]
2016-05-18 01:57:20,397 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:VERTEX_FINISHED]: vertexName=CD0417CF3A7B4B378B1DC66D7CED74DE, vertexId=vertex_1463536640114_0001_1_00, initRequestedTime=1463536640299, initedTime=1463536640317, startRequestedTime=1463536640302, startedTime=1463536640319, finishTime=1463536640396, timeTaken=77, status=SUCCEEDED, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536640373, Process_Duration=6, Process_End_Time=1463536640379, Read_Duration=4, Tuples_Read=10, Tuples_Written=7, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=10, vertexStats=firstTaskStartTime=1463536640332, firstTasksToStart=[ task_1463536640114_0001_1_00_000000 ], lastTaskFinishTime=1463536640392, lastTasksToFinish=[ task_1463536640114_0001_1_00_000000 ], minTaskDuration=60, maxTaskDuration=60, avgTaskDuration=60.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536640114_0001_1_00_000000 ], longestDurationTasks=[ task_1463536640114_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:20,397 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:20,398 INFO  impl.VertexImpl (VertexImpl.java:transition(3279)) - Source task attempt completed for vertex: vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08] attempt: attempt_1463536640114_0001_1_00_000000_0 with state: SUCCEEDED vertexState: RUNNING
2016-05-18 01:57:20,398 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:schedulePendingTasks(920)) - All source tasks assigned. Ramping up 1 remaining tasks for vertex: AC269EF719464677A61EEF71497ACB08
2016-05-18 01:57:20,398 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536640114_0001_00_000001, stoppedTime=1463536640398, exitStatus=0
2016-05-18 01:57:20,398 INFO  impl.Edge (Edge.java:routingToBegin(232)) - Routing to begin for edge: EdgeInfo: sourceVertexName=CD0417CF3A7B4B378B1DC66D7CED74DE, destinationVertexName=AC269EF719464677A61EEF71497ACB08. EdgeProperty: { SCATTER_GATHER : org.apache.tez.runtime.library.input.OrderedGroupedKVInput >> PERSISTED >> org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput >> NullEdgeManager } onDemandRouting: true
2016-05-18 01:57:20,399 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08]
2016-05-18 01:57:20,399 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:20,399 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:20,400 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(262)) - Ignoring stop request for containerId container_1463536640114_0001_00_000001. Relying on regular task shutdown for it to end
2016-05-18 01:57:20,400 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:TASK_STARTED]: vertexName=AC269EF719464677A61EEF71497ACB08, taskId=task_1463536640114_0001_1_01_000000, scheduledTime=1463536640400, launchTime=1463536640400
2016-05-18 01:57:20,400 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08]
2016-05-18 01:57:20,402 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536640114_0001_00_000002, launchTime=1463536640402
2016-05-18 01:57:20,403 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536640114_0001_00_000002
2016-05-18 01:57:20,404 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536640114_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-18 01:57:20,404 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536640114_0001_1_01_000000_0] started. Is using containerId: [container_1463536640114_0001_00_000002] on NM: [127.0.0.1:0]
2016-05-18 01:57:20,404 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=AC269EF719464677A61EEF71497ACB08, taskAttemptId=attempt_1463536640114_0001_1_01_000000_0, startTime=1463536640404, containerId=container_1463536640114_0001_00_000002, nodeId=127.0.0.1:0
2016-05-18 01:57:20,404 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536640114_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:20,404 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536640114_0001_00_000001, Exiting
2016-05-18 01:57:20,405 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536640114_0001_00_000001
2016-05-18 01:57:20,405 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536640114_0001_00_000001
2016-05-18 01:57:20,405 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536640114_0001_00_000002: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536640114_0001_1_01_000000_0
2016-05-18 01:57:20 Starting to run new task attempt: attempt_1463536640114_0001_1_01_000000_0
2016-05-18 01:57:20,406 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536640114_0001_1_01_000000_0
2016-05-18 01:57:20,406 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:20,406 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:20,406 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [4367CB11D19F4E358E9F0BD891F7327A/E6D26439E0254B4E9144D0DADC3192BE] test/(1/1) ...emoval/group/VALID/STRICT, VertexName: AC269EF719464677A61EEF71497ACB08, VertexParallelism: 1, TaskAttemptID:attempt_1463536640114_0001_1_01_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=CD0417CF3A7B4B378B1DC66D7CED74DE, physicalEdgeCount=1, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=035782F70CB3468DBBF4BFCC3FF3CC5B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-18 01:57:20,406 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:20,407 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536640114_0001_1_01_000000_0
2016-05-18 01:57:20,407 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536640114_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:20,408 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536640114_0001_00_000001 completed successfully
2016-05-18 01:57:20,409 INFO  impl.VertexImpl (VertexImpl.java:getTaskAttemptTezEvents(3662)) - Sending attempt_1463536640114_0001_1_01_000000_0 1 events [0,1) total 1 vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08]
2016-05-18 01:57:20,410 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536640114_0001_1_01_000000_0, eventCount=1 fromEventId=0 nextFromEventId=1
2016-05-18 01:57:20,410 INFO  orderedgrouped.MergeManager (MergeManager.java:getInitialMemoryRequirement(339)) - Initial Memory required for SHUFFLE_BUFFER=211392912 based on INPUT_BUFFER_FACTOR=0.9,  for final merged output=0, using factor: 0.0
2016-05-18 01:57:20,415 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:20,423 INFO  output.MROutput (MROutput.java:initialize(421)) - 035782F70CB3468DBBF4BFCC3FF3CC5B: outputFormat=org.apache.hadoop.mapred.TextOutputFormat, using newmapreduce API=false
2016-05-18 01:57:20,425 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: AC269EF719464677A61EEF71497ACB08, ordinal: 1
2016-05-18 01:57:20,426 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AC269EF719464677A61EEF71497ACB08, mem on start (mb), free: 50, total: 490, max: 672
2016-05-18 01:57:20,426 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:20,426 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:20,427 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:20,427 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:20,427 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[CD0417CF3A7B4B378B1DC66D7CED74DE:INPUT:211392912:org.apache.tez.runtime.library.input.OrderedGroupedKVInput], [035782F70CB3468DBBF4BFCC3FF3CC5B:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput]
2016-05-18 01:57:20,427 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:20,427 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:20,428 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 211392912, TotalRequestedScaled: 1.9513191876923078E8, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.30
2016-05-18 01:57:20,428 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[CD0417CF3A7B4B378B1DC66D7CED74DE:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:211392912:211392912], [035782F70CB3468DBBF4BFCC3FF3CC5B:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0]
2016-05-18 01:57:20,428 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:20,428 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: CD0417CF3A7B4B378B1DC66D7CED74DE being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:20,428 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:20,429 INFO  orderedgrouped.Shuffle (Shuffle.java:<init>(147)) - CD0417CF3A7B4B378B1DC66D7CED74DE: Shuffle assigned with 1 inputs, codec: None, ifileReadAhead: true
2016-05-18 01:57:20,429 INFO  orderedgrouped.MergeManager (MergeManager.java:<init>(273)) - CD0417CF3A7B4B378B1DC66D7CED74DE: MergerManager: memoryLimit=211392912, maxSingleShuffleLimit=52848228, mergeThreshold=190253616, ioSortFactor=100, postMergeMem=0, memToMemMergeOutputsThreshold=100
2016-05-18 01:57:20,430 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:20,430 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:<init>(353)) - ShuffleScheduler running for sourceVertex: CD0417CF3A7B4B378B1DC66D7CED74DE with configuration: maxFetchFailuresBeforeReporting=5, reportReadErrorImmediately=true, maxFailedUniqueFetches=1, abortFailureLimit=15, maxTaskOutputAtOnce=20, numFetchers=1, hostFailureFraction=0.2, minFailurePerHost=4, maxAllowedFailedFetchFraction=0.5, maxStallTimeFraction=0.5, minReqProgressFraction=0.5, checkFailedFetchSinceLastCompletion=true
2016-05-18 01:57:20,431 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: CD0417CF3A7B4B378B1DC66D7CED74DE
2016-05-18 01:57:20,431 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:20,432 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536640114_0001_1_01_000000_0
2016-05-18 01:57:20,432 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - CD0417CF3A7B4B378B1DC66D7CED74DE: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0
2016-05-18 01:57:20,434 INFO  orderedgrouped.ShuffleScheduler (ShuffleUtils.java:logIndividualFetchComplete(489)) - Completed fetch for attempt: {0, 0, attempt_1463536640114_0001_1_00_000000_0_10039} to DISK_DIRECT, csize=653, dsize=649, EndTime=1463536640434, TimeTaken=0, Rate=0.00 MB/s
2016-05-18 01:57:20,434 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:copySucceeded(551)) - All inputs fetched for input vertex : CD0417CF3A7B4B378B1DC66D7CED74DE
2016-05-18 01:57:20,434 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:20,434 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:callInternal(1289)) - Shutting down FetchScheduler for input: CD0417CF3A7B4B378B1DC66D7CED74DE, wasInterrupted=false
2016-05-18 01:57:20,435 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:20,435 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1005)) - finalMerge called with 0 in-memory map-outputs and 1 on-disk map-outputs
2016-05-18 01:57:20,436 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:onSuccess(1328)) - CD0417CF3A7B4B378B1DC66D7CED74DE: Already shutdown. Ignoring fetch complete
2016-05-18 01:57:20,436 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1103)) - Disk file=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4367CB11D19F4E358E9F0BD891F7327A/E6D26439E0254B4E9144D0DADC3192BE/.tez/application_1463536640114_0001_wd/localmode-local-dir/output/attempt_1463536640114_0001_1_00_000000_0_10039/file.out, len=653, isLocal=true
2016-05-18 01:57:20,437 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1115)) - Merging 1 files, 653 bytes from disk
2016-05-18 01:57:20,437 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1130)) - Merging 0 segments, 0 bytes from memory into reduce
2016-05-18 01:57:20,437 INFO  impl.TezMerger (TezMerger.java:merge(644)) - Merging 1 sorted segments
2016-05-18 01:57:20,437 INFO  impl.TezMerger (TezMerger.java:merge(749)) - Down to the last merge-pass, with 1 segments left of total size: 633 bytes
2016-05-18 01:57:20,437 INFO  orderedgrouped.Shuffle (Shuffle.java:callInternal(332)) - merge complete for input vertex : CD0417CF3A7B4B378B1DC66D7CED74DE
2016-05-18 01:57:20,437 INFO  orderedgrouped.Shuffle (Shuffle.java:onSuccess(417)) - CD0417CF3A7B4B378B1DC66D7CED74DE: Shuffle Runner thread complete
2016-05-18 01:57:20,439 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: GroupBy(test)[by:[{1}:'method']]
2016-05-18 01:57:20,440 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: GroupBy(test)[by:[{1}:'method']] streamed: true, id: 4840DF9D01DF4DFA9A46A21FD84D3538
2016-05-18 01:57:20,440 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/VALID/STRICT"], id: 035782F70CB3468DBBF4BFCC3FF3CC5B
2016-05-18 01:57:20,440 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/VALID/STRICT"]
2016-05-18 01:57:20,441 INFO  element.TezGroupGate (TezGroupGate.java:prepare(90)) - calling OrderedGroupedKVInput#start() on: GroupBy(test)[by:[{1}:'method']] 4840DF9D01DF4DFA9A46A21FD84D3538, for 1 inputs
2016-05-18 01:57:20,441 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: AC269EF719464677A61EEF71497ACB08, all 1 inputs ready in: 00:00:00.000
2016-05-18 01:57:20,442 INFO  input.OrderedGroupedKVInput (OrderedGroupedKVInput.java:createValuesIterator(292)) - CD0417CF3A7B4B378B1DC66D7CED74DE: creating ValuesIterator with comparator=cascading.tuple.hadoop.util.TupleComparator, keyClass=cascading.tuple.io.KeyTuple, valClass=cascading.tuple.io.ValueTuple
2016-05-18 01:57:20,444 INFO  output.MROutput (MROutput.java:close(526)) - 035782F70CB3468DBBF4BFCC3FF3CC5B closed
2016-05-18 01:57:20,447 INFO  impl.TaskImpl (TaskImpl.java:canCommit(671)) - attempt_1463536640114_0001_1_01_000000_0 given a go for committing the task output.
2016-05-18 01:57:20,447 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536640114_0001_1_01_000000_0
2016-05-18 01:57:20,447 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AC269EF719464677A61EEF71497ACB08, mem on close (mb), free: 46, total: 490, max: 672
2016-05-18 01:57:20,448 INFO  orderedgrouped.Shuffle (Shuffle.java:shutdown(278)) - Shutting down Shuffle for source: CD0417CF3A7B4B378B1DC66D7CED74DE
2016-05-18 01:57:20,448 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - CD0417CF3A7B4B378B1DC66D7CED74DE: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0, updateOnClose
2016-05-18 01:57:20,448 INFO  output.MROutput (MROutput.java:close(526)) - 035782F70CB3468DBBF4BFCC3FF3CC5B closed
2016-05-18 01:57:20,448 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:20 Completed running task attempt: attempt_1463536640114_0001_1_01_000000_0
2016-05-18 01:57:20,449 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536640114_0001_1_01_000000_0, askedToStop=false
2016-05-18 01:57:20,449 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536640114_0001_1_01_000000_0, stopRequested=false
2016-05-18 01:57:20,450 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536640114_0001_1_01_000000_0: Counters: 36 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=5, MERGE_PHASE_TIME=8, FIRST_EVENT_RECEIVED=3, LAST_EVENT_RECEIVED=3][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][cascading.flow.SliceCounters Process_Begin_Time=1463536640441, Process_Duration=6, Process_End_Time=1463536640447, Read_Duration=1, Tuples_Read=7, Tuples_Written=1, Write_Duration=0][cascading.flow.StepCounters Tuples_Written=1]]
2016-05-18 01:57:20,451 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536640114_0001_1_01_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:20,452 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:20,452 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:20,452 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:20,452 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=AC269EF719464677A61EEF71497ACB08, taskAttemptId=attempt_1463536640114_0001_1_01_000000_0, creationTime=1463536640400, allocationTime=1463536640402, startTime=1463536640404, finishTime=1463536640452, timeTaken=48, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:20,452 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536640114_0001_1_01_000000_0
2016-05-18 01:57:20,453 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:TASK_FINISHED]: vertexName=AC269EF719464677A61EEF71497ACB08, taskId=task_1463536640114_0001_1_01_000000, startTime=1463536640404, finishTime=1463536640452, timeTaken=48, status=SUCCEEDED, successfulAttemptID=attempt_1463536640114_0001_1_01_000000_0, diagnostics=, counters=Counters: 36, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=5, MERGE_PHASE_TIME=8, FIRST_EVENT_RECEIVED=3, LAST_EVENT_RECEIVED=3, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536640441, Process_Duration=6, Process_End_Time=1463536640447, Read_Duration=1, Tuples_Read=7, Tuples_Written=1, Write_Duration=0, cascading.flow.StepCounters, Tuples_Written=1
2016-05-18 01:57:20,453 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:20,453 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08]
2016-05-18 01:57:20,454 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536640114_0001_00_000002
2016-05-18 01:57:20,455 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:VERTEX_FINISHED]: vertexName=AC269EF719464677A61EEF71497ACB08, vertexId=vertex_1463536640114_0001_1_01, initRequestedTime=1463536640302, initedTime=1463536640307, startRequestedTime=1463536640321, startedTime=1463536640322, finishTime=1463536640453, timeTaken=131, status=SUCCEEDED, diagnostics=, counters=Counters: 36, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=5, MERGE_PHASE_TIME=8, FIRST_EVENT_RECEIVED=3, LAST_EVENT_RECEIVED=3, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536640441, Process_Duration=6, Process_End_Time=1463536640447, Read_Duration=1, Tuples_Read=7, Tuples_Written=1, Write_Duration=0, cascading.flow.StepCounters, Tuples_Written=1, vertexStats=firstTaskStartTime=1463536640404, firstTasksToStart=[ task_1463536640114_0001_1_01_000000 ], lastTaskFinishTime=1463536640452, lastTasksToFinish=[ task_1463536640114_0001_1_01_000000 ], minTaskDuration=48, maxTaskDuration=48, avgTaskDuration=48.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536640114_0001_1_01_000000 ], longestDurationTasks=[ task_1463536640114_0001_1_01_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:20,455 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:20,456 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536640114_0001_00_000002, stoppedTime=1463536640456, exitStatus=0
2016-05-18 01:57:20,456 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08] completed., numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:20,456 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:20,456 INFO  impl.DAGImpl (DAGImpl.java:commitOrFinish(1051)) - No output committers for vertex: vertex_1463536640114_0001_1_00 [CD0417CF3A7B4B378B1DC66D7CED74DE]
2016-05-18 01:57:20,456 INFO  impl.DAGImpl (DAGImpl.java:commitOrFinish(1098)) - Start writing dag commit event, dag_1463536640114_0001_1
2016-05-18 01:57:20,457 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463536640114_0001_1
2016-05-18 01:57:20,457 INFO  impl.DAGImpl (DAGImpl.java:call(1083)) - Committing output: 035782F70CB3468DBBF4BFCC3FF3CC5B for vertex: vertex_1463536640114_0001_1_01 [AC269EF719464677A61EEF71497ACB08], outputName: 035782F70CB3468DBBF4BFCC3FF3CC5B
2016-05-18 01:57:20,459 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536640114_0001_1 transitioned from RUNNING to COMMITTING due to event DAG_VERTEX_COMPLETED
2016-05-18 01:57:20,459 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(262)) - Ignoring stop request for containerId container_1463536640114_0001_00_000002. Relying on regular task shutdown for it to end
2016-05-18 01:57:20,464 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536640114_0001_00_000002 is valid, but no longer registered, and will be killed
2016-05-18 01:57:20,465 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536640114_0001_00_000002: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:20,465 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536640114_0001_00_000002, Exiting
2016-05-18 01:57:20,465 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536640114_0001_00_000002
2016-05-18 01:57:20,465 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536640114_0001_00_000002
2016-05-18 01:57:20,465 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536640114_0001_00_000002 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:20,465 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536640114_0001_00_000002 completed successfully
2016-05-18 01:57:20,468 INFO  impl.DAGImpl (DAGImpl.java:commitCompleted(2192)) - Commit succeeded for output:outputName:035782F70CB3468DBBF4BFCC3FF3CC5B of vertex/vertexGroup:AC269EF719464677A61EEF71497ACB08 isVertexGroupOutput:false
2016-05-18 01:57:20,468 INFO  impl.DAGImpl (DAGImpl.java:checkCommitsForCompletion(1313)) - Checking commits for DAG completion, numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:20,470 INFO  recovery.RecoveryService (RecoveryService.java:handle(327)) - DAG completed, dagId=dag_1463536640114_0001_1, queueSize=0
2016-05-18 01:57:20,471 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536640114_0001_1][Event:DAG_FINISHED]: dagId=dag_1463536640114_0001_1, startTime=1463536640299, finishTime=1463536640468, timeTaken=169, status=SUCCEEDED, diagnostics=, counters=Counters: 48, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=2, TOTAL_LAUNCHED_TASKS=2, RACK_LOCAL_TASKS=1, AM_CPU_MILLISECONDS=300, AM_GC_TIME_MILLIS=0, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=14, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=8, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=5, MERGE_PHASE_TIME=8, FIRST_EVENT_RECEIVED=3, LAST_EVENT_RECEIVED=3, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=2927073280814, Process_Duration=12, Process_End_Time=2927073280826, Read_Duration=5, Tuples_Read=17, Tuples_Written=8, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=10, Tuples_Written=1
2016-05-18 01:57:20,471 INFO  impl.DAGImpl (DAGImpl.java:finished(1405)) - DAG: dag_1463536640114_0001_1 finished with state: SUCCEEDED
2016-05-18 01:57:20,471 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536640114_0001_1 transitioned from COMMITTING to SUCCEEDED due to event DAG_COMMIT_COMPLETED
2016-05-18 01:57:20 Completed Dag: dag_1463536640114_0001_1
2016-05-18 01:57:20,472 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(751)) - DAG completed, dagId=dag_1463536640114_0001_1, dagState=SUCCEEDED
2016-05-18 01:57:20,472 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536640114_0001_1_post
2016-05-18 01:57:20,472 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:20,472 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(800)) - Central Dispatcher queue size after DAG completion, before cleanup: 0
2016-05-18 01:57:20,472 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(802)) - Waiting for next DAG to be submitted.
2016-05-18 01:57:20,472 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(842)) - Cleaning up DAG: name=[4367CB11D19F4E358E9F0BD891F7327A/E6D26439E0254B4E9144D0DADC3192BE] test/(1/1) ...emoval/group/VALID/STRICT, with id=dag_1463536640114_0001_1
2016-05-18 01:57:20,472 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(852)) - Completed cleanup for DAG: name=[4367CB11D19F4E358E9F0BD891F7327A/E6D26439E0254B4E9144D0DADC3192BE] test/(1/1) ...emoval/group/VALID/STRICT, with id=dag_1463536640114_0001_1
2016-05-18 01:57:20,478 INFO  client.TezClient (TezClient.java:stop(566)) - Shutting down Tez Session, sessionName=(1/1) ...emoval/group/VALID/STRICT, applicationId=application_1463536640114_0001
2016-05-18 01:57:20,481 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(124)) - Received message to shutdown AM
2016-05-18 01:57:20,481 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:setShouldUnregisterFlag(895)) - TaskScheduler notified that it should unregister from RM
2016-05-18 01:57:20,481 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1301)) - No current running DAG, shutting down the AM
2016-05-18 01:57:20,481 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(907)) - DAGAppMasterShutdownHandler invoked
2016-05-18 01:57:20,481 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(916)) - Handling DAGAppMaster shutdown
2016-05-18 01:57:20,481 INFO  app.DAGAppMaster (DAGAppMaster.java:run(936)) - Sleeping for 5 seconds before shutting down
2016-05-18 01:57:20,483 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(84)) - Stopping HistoryEventHandler
2016-05-18 01:57:20,483 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(196)) - Stopping RecoveryService
2016-05-18 01:57:20,484 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(199)) - Handle the remaining events in queue, queue size=0
2016-05-18 01:57:20,484 INFO  recovery.RecoveryService (RecoveryService.java:run(173)) - EventQueue take interrupted. Returning
2016-05-18 01:57:20,484 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(221)) - Closing Summary Stream
2016-05-18 01:57:20,485 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-18 01:57:20,486 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-18 01:57:20,487 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:serviceStop(678)) - Shutting down AppCallbackExecutor
2016-05-18 01:57:20,490 INFO  app.DAGAppMaster (DAGAppMaster.java:run(2084)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/4367CB11D19F4E358E9F0BD891F7327A/E6D26439E0254B4E9144D0DADC3192BE/.tez/application_1463536640114_0001
2016-05-18 01:57:20,491 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/VALID/STRICT/_temporary
2016-05-18 01:57:20,492 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  completed in: 00:00.398
2016-05-18 01:57:20,788 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 01:57:20,788 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-18 01:57:20,845 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-05-18 01:57:20,866 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.046
2016-05-18 01:57:20,866 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:20,867 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:20,867 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 01:57:20,890 INFO  app.DAGAppMaster (DAGAppMaster.java:run(946)) - Calling stop for all the services
2016-05-18 01:57:20,891 INFO  app.DAGAppMaster (DAGAppMaster.java:run(957)) - Exiting DAGAppMaster..GoodBye!
2016-05-18 01:57:20,896 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt
2016-05-18 01:57:20,909 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/STRICT/STRICT
2016-05-18 01:57:20,991 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting
2016-05-18 01:57:20,992 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:20,992 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  sink: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/STRICT/STRICT"]
2016-05-18 01:57:20,993 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  parallel execution of steps is enabled: false
2016-05-18 01:57:20,993 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  executing total steps: 1
2016-05-18 01:57:20,993 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  allocating management threads: 1
2016-05-18 01:57:20,994 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting step: (1/1) ...moval/group/STRICT/STRICT
2016-05-18 01:57:20,994 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [test] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-18 01:57:21,015 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tez session mode enabled: true
2016-05-18 01:57:21,021 INFO  client.TezClient (TezClient.java:<init>(174)) - Tez Client Version: [ component=tez-api, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:21,021 INFO  client.TezClient (TezClient.java:start(394)) - Session mode. Starting session.
2016-05-18 01:57:21,021 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(164)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-18 01:57:21,034 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(122)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/D1B573B9BD134678A00FD34E96E9CC3B/B65D6FC1893E4D398478C4DA4D11C859/.tez/application_1463536641021_0001 doesn't exist and is created
2016-05-18 01:57:21,058 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(332)) - DAGAppMaster thread has been created
2016-05-18 01:57:21,058 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-18 01:57:21,060 INFO  client.LocalClient (LocalClient.java:run(282)) - Using working directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/D1B573B9BD134678A00FD34E96E9CC3B/B65D6FC1893E4D398478C4DA4D11C859/.tez/application_1463536641021_0001_wd
2016-05-18 01:57:21,077 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(363)) - Created DAGAppMaster for application appattempt_1463536641021_0001_000000, versionInfo=[ component=tez-dag, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:21,078 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(80)) - Trying to locate HadoopShimProvider for hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:21,078 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(139)) - Picked HadoopShim org.apache.tez.hadoop.shim.DefaultHadoopShim, providerName=null, overrideProviderViaConfig=null, hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:21,079 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(436)) - AM Level configured TaskSchedulers: [0:TezUber:null]
2016-05-18 01:57:21,079 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(437)) - AM Level configured ContainerLaunchers: [0:TezUber:null]
2016-05-18 01:57:21,079 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(438)) - AM Level configured TaskCommunicators: [0:TezUber:null]
2016-05-18 01:57:21,080 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(447)) - Comparing client version with AM version, clientVersion=0.8.2, AMVersion=0.8.2
2016-05-18 01:57:21,080 INFO  app.TaskCommunicatorManager (TaskCommunicatorManager.java:createUberTaskCommunicator(192)) - Creating Default Local Task Communicator
2016-05-18 01:57:21,082 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.container.AMContainerEventType for class org.apache.tez.dag.app.rm.container.AMContainerMap
2016-05-18 01:57:21,082 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.node.AMNodeEventType for class org.apache.tez.dag.app.rm.node.AMNodeTracker
2016-05-18 01:57:21,082 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGAppMasterEventType for class org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterEventHandler
2016-05-18 01:57:21,082 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGEventType for class org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher
2016-05-18 01:57:21,082 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.VertexEventType for class org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher
2016-05-18 01:57:21,082 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(529)) - Using concurrent dispatcher: false
2016-05-18 01:57:21,083 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher
2016-05-18 01:57:21,083 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskAttemptEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher
2016-05-18 01:57:21,083 INFO  common.AsyncDispatcher (AsyncDispatcher.java:registerAndCreateDispatcher(262)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for independent dispatch using: class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:21,083 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:21,084 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.AMSchedulerEventType for class org.apache.tez.dag.app.rm.TaskSchedulerManager
2016-05-18 01:57:21,084 INFO  launcher.TezContainerLauncherImpl (ContainerLauncherManager.java:createUberContainerLauncher(134)) - Creating LocalContainerLauncher
2016-05-18 01:57:21,085 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.ContainerLauncherEventType for class org.apache.tez.dag.app.launcher.ContainerLauncherManager
2016-05-18 01:57:21,086 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(78)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1, nodeUpdatesRescheduleEnabled: false
2016-05-18 01:57:21,087 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(57)) - Initializing HistoryEventHandler withrecoveryEnabled=true, historyServiceClassName=org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService
2016-05-18 01:57:21,087 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/D1B573B9BD134678A00FD34E96E9CC3B/B65D6FC1893E4D398478C4DA4D11C859/.tez/application_1463536641021_0001_wd/localmode-log-dir
2016-05-18 01:57:21,087 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/D1B573B9BD134678A00FD34E96E9CC3B/B65D6FC1893E4D398478C4DA4D11C859/.tez/application_1463536641021_0001_wd/localmode-log-dir/history.txt.appattempt_1463536641021_0001_000000, maxErrors=10
2016-05-18 01:57:21,088 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(124)) - RecoveryService initialized with recoveryPath=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/D1B573B9BD134678A00FD34E96E9CC3B/B65D6FC1893E4D398478C4DA4D11C859/.tez/application_1463536641021_0001/recovery/0, bufferSize(bytes)=8192, flushInterval(s)=30, maxUnflushedEvents=100
2016-05-18 01:57:21,088 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463536641021_0001_000000, appSubmitTime=1463536641077, launchTime=1463536641077
2016-05-18 01:57:21,094 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-18 01:57:21,096 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:54515
2016-05-18 01:57:21,097 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:createUberTaskScheduler(557)) - Creating TaskScheduler: Local TaskScheduler with clusterIdentifier=1463536641021
2016-05-18 01:57:21,099 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463536641021_0001_000000, startTime=1463536641099
2016-05-18 01:57:21,099 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1945)) - In Session mode. Waiting for DAG over RPC
2016-05-18 01:57:21,159 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-18 01:57:21,159 INFO  client.TezClient (TezClient.java:start(428)) - The url to track the Tez Session: N/A
2016-05-18 01:57:21,159 INFO  client.TezClient (TezClient.java:submitDAGSession(470)) - Submitting dag to TezSession, sessionName=(1/1) ...moval/group/STRICT/STRICT, applicationId=application_1463536641021_0001, dagName=[D1B573B9BD134678A00FD34E96E9CC3B/B65D6FC1893E4D398478C4DA4D11C859] test/(1/1) ...moval/group/STRICT/STRICT
2016-05-18 01:57:21,177 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1351)) - Starting DAG submitted via RPC: [D1B573B9BD134678A00FD34E96E9CC3B/B65D6FC1893E4D398478C4DA4D11C859] test/(1/1) ...moval/group/STRICT/STRICT
2016-05-18 01:57:21,177 INFO  app.DAGAppMaster (DAGAppMaster.java:createDAG(985)) - Merging AM credentials into DAG credentials
2016-05-18 01:57:21,178 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(1076)) - Generating DAG graphviz file, dagId=dag_1463536641021_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/D1B573B9BD134678A00FD34E96E9CC3B/B65D6FC1893E4D398478C4DA4D11C859/.tez/application_1463536641021_0001_wd/localmode-log-dir/dag_1463536641021_0001_1.dot
2016-05-18 01:57:21,179 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(1093)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/D1B573B9BD134678A00FD34E96E9CC3B/B65D6FC1893E4D398478C4DA4D11C859/.tez/application_1463536641021_0001_wd/localmode-log-dir/dag_1463536641021_0001_1-tez-dag.pb.txt
2016-05-18 01:57:21,193 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536641021_0001_1
2016-05-18 01:57:21,193 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:21,193 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2399)) - Running DAG: [D1B573B9BD134678A00FD34E96E9CC3B/B65D6FC1893E4D398478C4DA4D11C859] test/(1/1) ...moval/group/STRICT/STRICT
2016-05-18 01:57:21 Running Dag: dag_1463536641021_0001_1
2016-05-18 01:57:21,209 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463536641021_0001_1, submitTime=1463536641177
2016-05-18 01:57:21,210 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/D1B573B9BD134678A00FD34E96E9CC3B/B65D6FC1893E4D398478C4DA4D11C859/.tez/application_1463536641021_0001/tez-conf.pb" } size: 40986 timestamp: 1463536641000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:21,211 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalInputs(3978)) - Setting 1 additional inputs for vertexvertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F]
2016-05-18 01:57:21,211 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:21,217 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/D1B573B9BD134678A00FD34E96E9CC3B/B65D6FC1893E4D398478C4DA4D11C859/.tez/application_1463536641021_0001/tez-conf.pb" } size: 40986 timestamp: 1463536641000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:21,217 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4023)) - Setting 1 additional outputs for vertex vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B]
2016-05-18 01:57:21,217 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:21,217 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1593)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-18 01:57:21,218 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463536641021_0001_1, initTime=1463536641218
2016-05-18 01:57:21,219 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536641021_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-18 01:57:21,219 INFO  impl.DAGImpl (DAGImpl.java:transition(1768)) - Added additional resources : [[]] to classpath
2016-05-18 01:57:21,220 INFO  client.TezClient (TezClient.java:submitDAGSession(545)) - Submitted dag to TezSession, sessionName=(1/1) ...moval/group/STRICT/STRICT, applicationId=application_1463536641021_0001, dagName=[D1B573B9BD134678A00FD34E96E9CC3B/B65D6FC1893E4D398478C4DA4D11C859] test/(1/1) ...moval/group/STRICT/STRICT
2016-05-18 01:57:21,220 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:DAG_STARTED]: dagID=dag_1463536641021_0001_1, startTime=1463536641220
2016-05-18 01:57:21,220 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536641021_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-18 01:57:21,220 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2400)) - Root Inputs exist for Vertex: BB3C5A9C83BA4ECFBA3552FE654E112F : {48D8939E07A84D768C68E927BAFF843D={InputName=48D8939E07A84D768C68E927BAFF843D}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-18 01:57:21,220 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2410)) - Starting root input initializer for input: 48D8939E07A84D768C68E927BAFF843D, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-18 01:57:21,220 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2550)) - Setting vertexManager to RootInputVertexManager for vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F]
2016-05-18 01:57:21,221 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2721)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F]
2016-05-18 01:57:21,221 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2726)) - Vertex will initialize from input initializer. vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F]
2016-05-18 01:57:21,221 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3893)) - Starting 1 inputInitializers for vertex vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F]
2016-05-18 01:57:21,221 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-18 01:57:21,222 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2562)) - Setting vertexManager to ShuffleVertexManager for vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B]
2016-05-18 01:57:21,222 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(272)) - Starting InputInitializer for Input: 48D8939E07A84D768C68E927BAFF843D on vertex vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F]
2016-05-18 01:57:21,224 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(109)) - Input 48D8939E07A84D768C68E927BAFF843D asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7, groupingEnabled: true
2016-05-18 01:57:21,227 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:initialize(1022)) - Shuffle Vertex Manager: settings minFrac:0.25 maxFrac:0.75 auto:false desiredTaskIput:104857600 minTasks:1
2016-05-18 01:57:21,227 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2760)) - Creating 1 tasks for vertex: vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B]
2016-05-18 01:57:21,228 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2779)) - Directly initializing vertex: vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B]
2016-05-18 01:57:21,228 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536641021_0001_1_01, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=null, edgeManagersCount=1, rootInputSpecUpdateCount=0, setParallelismCalledFlag=false
2016-05-18 01:57:21,229 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2187)) - Setting up committers for vertex vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B], numAdditionalOutputs=1
2016-05-18 01:57:21,229 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2202)) - Instantiating committer for output=7923058C9BB241F4844CA0A498F1219E, vertex=vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-18 01:57:21,229 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(168)) - Grouping splits in Tez
2016-05-18 01:57:21,229 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(226)) - Desired splits: 1 too large.  Desired splitLength: 1449 Min splitLength: 52428800 New desired splits: 1 Total length: 1449 Original splits: 2
2016-05-18 01:57:21,229 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(321)) - Desired numSplits: 1 lengthPerGroup: 1449 numLocations: 1 numSplitsPerLocation: 2 numSplitsInGroup: 2 totalLength: 1449 numOriginalSplits: 2 . Grouping by length: true count: false nodeLocalOnly: false
2016-05-18 01:57:21,230 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(539)) - Number of splits desired: 1 created: 1 splitsProcessed: 2
2016-05-18 01:57:21,230 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(308)) - Succeeded InputInitializer for Input: 48D8939E07A84D768C68E927BAFF843D on vertex vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F]
2016-05-18 01:57:21,231 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(121)) - Committer for F2263D459D0743D1B9699CAA2FECEE8B:7923058C9BB241F4844CA0A498F1219E using oldmapred API
2016-05-18 01:57:21,231 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(146)) - OutputCommitter for outputName=7923058C9BB241F4844CA0A498F1219E, vertexName=F2263D459D0743D1B9699CAA2FECEE8B, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-18 01:57:21,233 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F2263D459D0743D1B9699CAA2FECEE8B, vertexId=vertex_1463536641021_0001_1_01, initRequestedTime=1463536641222, initedTime=1463536641229, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=0, initGeneratedEventsCount=0
2016-05-18 01:57:21,233 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B] transitioned from NEW to INITED due to event V_INIT
2016-05-18 01:57:21,234 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:21,234 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1644)) - Got updated RootInputsSpecs: {48D8939E07A84D768C68E927BAFF843D=forAllWorkUnits=true, update=[1]}
2016-05-18 01:57:21,235 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1664)) - Vertex vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F] parallelism set to 1
2016-05-18 01:57:21,235 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:21,236 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:VERTEX_INITIALIZED]: vertexName=BB3C5A9C83BA4ECFBA3552FE654E112F, vertexId=vertex_1463536641021_0001_1_00, initRequestedTime=1463536641220, initedTime=1463536641235, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1, initGeneratedEventsCount=1
2016-05-18 01:57:21,236 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F] with distanceFromRoot: 0
2016-05-18 01:57:21,236 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F] transitioned from INITIALIZING to INITED due to event V_INPUT_DATA_INFORMATION
2016-05-18 01:57:21,237 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536641021_0001_1_00, startRequestedTime=1463536641222, startedTime=1463536641237
2016-05-18 01:57:21,237 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536641021_0001_1_00, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=org.apache.tez.dag.api.VertexLocationHint@b8338fe7, edgeManagersCount=0, rootInputSpecUpdateCount=1, setParallelismCalledFlag=true
2016-05-18 01:57:21,238 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:21,238 INFO  impl.VertexImpl (VertexImpl.java:transition(2932)) - Source vertex started: vertex_1463536641021_0001_1_00 for vertex: vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B] numStartedSources: 1 numSources: 1
2016-05-18 01:57:21,238 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B] with distanceFromRoot: 1
2016-05-18 01:57:21,238 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(100)) - Starting 1 in BB3C5A9C83BA4ECFBA3552FE654E112F
2016-05-18 01:57:21,239 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536641021_0001_1_01, startRequestedTime=1463536641238, startedTime=1463536641239
2016-05-18 01:57:21,239 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:21,239 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F]
2016-05-18 01:57:21,240 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:onVertexStarted(519)) - OnVertexStarted vertex: F2263D459D0743D1B9699CAA2FECEE8B with 0 source tasks and 1 pending tasks
2016-05-18 01:57:21,241 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:TASK_STARTED]: vertexName=BB3C5A9C83BA4ECFBA3552FE654E112F, taskId=task_1463536641021_0001_1_00_000000, scheduledTime=1463536641241, launchTime=1463536641241
2016-05-18 01:57:21,242 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F]
2016-05-18 01:57:21,244 INFO  node.PerSourceNodeTracker (PerSourceNodeTracker.java:nodeSeen(74)) - Adding new node 127.0.0.1:0 to nodeTracker 0
2016-05-18 01:57:21,244 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:handleVertexStateUpdate(1051)) - Received configured notification : CONFIGURED for vertex: BB3C5A9C83BA4ECFBA3552FE654E112F in vertex: F2263D459D0743D1B9699CAA2FECEE8B numBipartiteSourceTasks: 1
2016-05-18 01:57:21,246 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536641021_0001_00_000001, launchTime=1463536641246
2016-05-18 01:57:21,247 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536641021_0001_00_000001
2016-05-18 01:57:21,248 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536641021_0001_1_00_000000_0] started. Is using containerId: [container_1463536641021_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-18 01:57:21,248 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=BB3C5A9C83BA4ECFBA3552FE654E112F, taskAttemptId=attempt_1463536641021_0001_1_00_000000_0, startTime=1463536641248, containerId=container_1463536641021_0001_00_000001, nodeId=127.0.0.1:0
2016-05-18 01:57:21,248 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] submitted tez dag to app master: application_1463536641021_0001, with dag id: dag_1463536641021_0001_1
2016-05-18 01:57:21,250 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536641021_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536641021_0001_1_00_000000_0
2016-05-18 01:57:21 Starting to run new task attempt: attempt_1463536641021_0001_1_00_000000_0
2016-05-18 01:57:21,251 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536641021_0001_1_00_000000_0
2016-05-18 01:57:21,251 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:21,251 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:21,251 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [D1B573B9BD134678A00FD34E96E9CC3B/B65D6FC1893E4D398478C4DA4D11C859] test/(1/1) ...moval/group/STRICT/STRICT, VertexName: BB3C5A9C83BA4ECFBA3552FE654E112F, VertexParallelism: 1, TaskAttemptID:attempt_1463536641021_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=48D8939E07A84D768C68E927BAFF843D, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=F2263D459D0743D1B9699CAA2FECEE8B, physicalEdgeCount=1, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ]
2016-05-18 01:57:21,251 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:21,252 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536641021_0001_1_00_000000_0
2016-05-18 01:57:21,255 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(496)) - TaskAttempt:attempt_1463536641021_0001_1_00_000000_0 sent events: (0-1).
2016-05-18 01:57:21,255 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536641021_0001_1_00_000000_0, eventCount=1 fromEventId=0 nextFromEventId=0
2016-05-18 01:57:21,260 INFO  input.MRInput (MRInput.java:initialize(440)) - 48D8939E07A84D768C68E927BAFF843D using newmapreduce API=false, split via event=true, numPhysicalInputs=1
2016-05-18 01:57:21,260 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:21,260 INFO  input.MRInput (MRInput.java:initializeInternal(494)) - Initialized MRInput: 48D8939E07A84D768C68E927BAFF843D
2016-05-18 01:57:21,269 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: BB3C5A9C83BA4ECFBA3552FE654E112F, ordinal: 0
2016-05-18 01:57:21,269 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BB3C5A9C83BA4ECFBA3552FE654E112F, mem on start (mb), free: 252, total: 372, max: 672
2016-05-18 01:57:21,269 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:21,270 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:21,270 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:21,270 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:21,270 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[48D8939E07A84D768C68E927BAFF843D:INPUT:0:org.apache.tez.mapreduce.input.MRInput], [F2263D459D0743D1B9699CAA2FECEE8B:OUTPUT:104857600:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput]
2016-05-18 01:57:21,270 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:21,273 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:21,273 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 104857600, TotalRequestedScaled: 9.679163076923077E7, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.15
2016-05-18 01:57:21,274 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[48D8939E07A84D768C68E927BAFF843D:org.apache.tez.mapreduce.input.MRInput:INPUT:0:0], [F2263D459D0743D1B9699CAA2FECEE8B:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput:OUTPUT:104857600:104857600]
2016-05-18 01:57:21,275 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:21,275 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: 48D8939E07A84D768C68E927BAFF843D being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:21,276 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:21,277 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:21,275 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: 48D8939E07A84D768C68E927BAFF843D
2016-05-18 01:57:21,278 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:21,279 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536641021_0001_1_00_000000_0
2016-05-18 01:57:21,281 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(174)) - Processing split: TezGroupedSplit{wrappedSplits=[file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:0+724, file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:724+725], wrappedInputFormatName='org.apache.hadoop.mapred.TextInputFormat', locations=[localhost], rack='null', length=1449}
2016-05-18 01:57:21,282 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:21,282 INFO  input.MRInput (MRInput.java:initFromEventInternal(653)) - 48D8939E07A84D768C68E927BAFF843D initialized RecordReader from event
2016-05-18 01:57:21,283 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"] streamed: true, id: 48D8939E07A84D768C68E927BAFF843D
2016-05-18 01:57:21,283 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: GroupBy(test)[by:[{1}:'method']], id: 9ABC81B9CE824B0AB9C5F6727A317659
2016-05-18 01:57:21,283 INFO  element.TezGroupGate (TezGroupGate.java:prepare(98)) - calling OrderedPartitionedKVOutput#start() on: GroupBy(test)[by:[{1}:'method']] 9ABC81B9CE824B0AB9C5F6727A317659
2016-05-18 01:57:21,285 INFO  impl.ExternalSorter (ExternalSorter.java:<init>(199)) - F2263D459D0743D1B9699CAA2FECEE8B using: memoryMb=100, keySerializerClass=class cascading.tuple.io.KeyTuple, valueSerializerClass=cascading.tuple.hadoop.io.ValueTupleSerializer@6feda7c8, comparator=cascading.tuple.hadoop.util.TupleComparator@5ba274e0, partitioner=cascading.tuple.tez.util.TuplePartitioner, serialization=cascading.tuple.hadoop.TupleSerialization,org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
2016-05-18 01:57:21,285 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(170)) - Setting up PipelinedSorter for F2263D459D0743D1B9699CAA2FECEE8B: , UsingHashComparator=false
2016-05-18 01:57:21,297 INFO  impl.PipelinedSorter (PipelinedSorter.java:allocateSpace(245)) - Newly allocated block size=104857600, index=0, Number of buffers=1, currentAllocatableMemory=0, currentBufferSize=104857600, total=104857600
2016-05-18 01:57:21,298 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(189)) - Pre allocating rest of memory buffers upfront
2016-05-18 01:57:21,298 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(207)) - Setting up PipelinedSorter for F2263D459D0743D1B9699CAA2FECEE8B: , UsingHashComparator=false#blocks=1, maxMemUsage=104857600, lazyAllocateMem=false, minBlockSize=2097152000, initial BLOCK_SIZE=104857600, finalMergeEnabled=true, pipelinedShuffle=false, sendEmptyPartitions=true, tez.runtime.io.sort.mb=100
2016-05-18 01:57:21,298 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(882)) - F2263D459D0743D1B9699CAA2FECEE8B: reserved.remaining()=104857600, reserved.metasize=16777216
2016-05-18 01:57:21,298 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:21,299 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: BB3C5A9C83BA4ECFBA3552FE654E112F, all 1 inputs ready in: 00:00:00.000
2016-05-18 01:57:21,302 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536641021_0001_1_00_000000_0
2016-05-18 01:57:21,302 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BB3C5A9C83BA4ECFBA3552FE654E112F, mem on close (mb), free: 150, total: 372, max: 672
2016-05-18 01:57:21,303 INFO  impl.PipelinedSorter (PipelinedSorter.java:flush(629)) - F2263D459D0743D1B9699CAA2FECEE8B: Starting flush of map output
2016-05-18 01:57:21,303 INFO  impl.PipelinedSorter (PipelinedSorter.java:end(995)) - F2263D459D0743D1B9699CAA2FECEE8B: Span0.length = 7, perItem = 99
2016-05-18 01:57:21,303 INFO  impl.PipelinedSorter (PipelinedSorter.java:sort(904)) - F2263D459D0743D1B9699CAA2FECEE8B: done sorting span=0, length=7, time=0
2016-05-18 01:57:21,303 INFO  impl.PipelinedSorter (PipelinedSorter.java:ready(1297)) - F2263D459D0743D1B9699CAA2FECEE8B: Heap = SpanIterator<0:6> (span=Span[16777216,693]),
2016-05-18 01:57:21,304 INFO  impl.PipelinedSorter (PipelinedSorter.java:spill(546)) - F2263D459D0743D1B9699CAA2FECEE8B: Spilling to /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/D1B573B9BD134678A00FD34E96E9CC3B/B65D6FC1893E4D398478C4DA4D11C859/.tez/application_1463536641021_0001_wd/localmode-local-dir/output/attempt_1463536641021_0001_1_00_000000_0_10045_0/file.out
2016-05-18 01:57:21,307 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:21 Completed running task attempt: attempt_1463536641021_0001_1_00_000000_0
2016-05-18 01:57:21,307 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536641021_0001_1_00_000000_0, askedToStop=false
2016-05-18 01:57:21,307 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536641021_0001_1_00_000000_0, stopRequested=false
2016-05-18 01:57:21,308 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536641021_0001_1_00_000000_0: Counters: 18 [[org.apache.tez.common.counters.TaskCounter SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1][cascading.flow.SliceCounters Process_Begin_Time=1463536641299, Process_Duration=3, Process_End_Time=1463536641302, Read_Duration=1, Tuples_Read=10, Tuples_Written=7, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=10]]
2016-05-18 01:57:21,309 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536641021_0001_1_00_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:21,309 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:21,309 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=BB3C5A9C83BA4ECFBA3552FE654E112F, taskAttemptId=attempt_1463536641021_0001_1_00_000000_0, creationTime=1463536641242, allocationTime=1463536641246, startTime=1463536641248, finishTime=1463536641309, timeTaken=61, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:21,310 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536641021_0001_1_00_000000_0
2016-05-18 01:57:21,309 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:21,310 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:21,310 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:TASK_FINISHED]: vertexName=BB3C5A9C83BA4ECFBA3552FE654E112F, taskId=task_1463536641021_0001_1_00_000000, startTime=1463536641248, finishTime=1463536641310, timeTaken=62, status=SUCCEEDED, successfulAttemptID=attempt_1463536641021_0001_1_00_000000_0, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536641299, Process_Duration=3, Process_End_Time=1463536641302, Read_Duration=1, Tuples_Read=10, Tuples_Written=7, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=10
2016-05-18 01:57:21,311 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:21,312 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F]
2016-05-18 01:57:21,311 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536641021_0001_00_000001
2016-05-18 01:57:21,314 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:VERTEX_FINISHED]: vertexName=BB3C5A9C83BA4ECFBA3552FE654E112F, vertexId=vertex_1463536641021_0001_1_00, initRequestedTime=1463536641220, initedTime=1463536641235, startRequestedTime=1463536641222, startedTime=1463536641237, finishTime=1463536641312, timeTaken=75, status=SUCCEEDED, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536641299, Process_Duration=3, Process_End_Time=1463536641302, Read_Duration=1, Tuples_Read=10, Tuples_Written=7, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=10, vertexStats=firstTaskStartTime=1463536641248, firstTasksToStart=[ task_1463536641021_0001_1_00_000000 ], lastTaskFinishTime=1463536641309, lastTasksToFinish=[ task_1463536641021_0001_1_00_000000 ], minTaskDuration=61, maxTaskDuration=61, avgTaskDuration=61.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536641021_0001_1_00_000000 ], longestDurationTasks=[ task_1463536641021_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:21,314 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:21,314 INFO  impl.VertexImpl (VertexImpl.java:transition(3279)) - Source task attempt completed for vertex: vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B] attempt: attempt_1463536641021_0001_1_00_000000_0 with state: SUCCEEDED vertexState: RUNNING
2016-05-18 01:57:21,314 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:schedulePendingTasks(920)) - All source tasks assigned. Ramping up 1 remaining tasks for vertex: F2263D459D0743D1B9699CAA2FECEE8B
2016-05-18 01:57:21,314 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536641021_0001_00_000001, stoppedTime=1463536641314, exitStatus=0
2016-05-18 01:57:21,315 INFO  impl.Edge (Edge.java:routingToBegin(232)) - Routing to begin for edge: EdgeInfo: sourceVertexName=BB3C5A9C83BA4ECFBA3552FE654E112F, destinationVertexName=F2263D459D0743D1B9699CAA2FECEE8B. EdgeProperty: { SCATTER_GATHER : org.apache.tez.runtime.library.input.OrderedGroupedKVInput >> PERSISTED >> org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput >> NullEdgeManager } onDemandRouting: true
2016-05-18 01:57:21,315 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B]
2016-05-18 01:57:21,315 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536641021_0001_1_00 [BB3C5A9C83BA4ECFBA3552FE654E112F] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:21,315 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:21,315 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(262)) - Ignoring stop request for containerId container_1463536641021_0001_00_000001. Relying on regular task shutdown for it to end
2016-05-18 01:57:21,316 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:TASK_STARTED]: vertexName=F2263D459D0743D1B9699CAA2FECEE8B, taskId=task_1463536641021_0001_1_01_000000, scheduledTime=1463536641316, launchTime=1463536641316
2016-05-18 01:57:21,316 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B]
2016-05-18 01:57:21,319 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536641021_0001_00_000002, launchTime=1463536641318
2016-05-18 01:57:21,319 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536641021_0001_00_000002
2016-05-18 01:57:21,322 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536641021_0001_1_01_000000_0] started. Is using containerId: [container_1463536641021_0001_00_000002] on NM: [127.0.0.1:0]
2016-05-18 01:57:21,323 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536641021_0001_00_000002: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536641021_0001_1_01_000000_0
2016-05-18 01:57:21,323 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F2263D459D0743D1B9699CAA2FECEE8B, taskAttemptId=attempt_1463536641021_0001_1_01_000000_0, startTime=1463536641322, containerId=container_1463536641021_0001_00_000002, nodeId=127.0.0.1:0
2016-05-18 01:57:21,323 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536641021_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-18 01:57:21,324 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536641021_0001_00_000001: 12 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:21,324 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536641021_0001_00_000001, Exiting
2016-05-18 01:57:21,324 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536641021_0001_00_000001
2016-05-18 01:57:21,324 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536641021_0001_00_000001
2016-05-18 01:57:21,324 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536641021_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:21,325 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536641021_0001_00_000001 completed successfully
2016-05-18 01:57:21 Starting to run new task attempt: attempt_1463536641021_0001_1_01_000000_0
2016-05-18 01:57:21,326 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536641021_0001_1_01_000000_0
2016-05-18 01:57:21,327 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:21,327 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:21,328 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [D1B573B9BD134678A00FD34E96E9CC3B/B65D6FC1893E4D398478C4DA4D11C859] test/(1/1) ...moval/group/STRICT/STRICT, VertexName: F2263D459D0743D1B9699CAA2FECEE8B, VertexParallelism: 1, TaskAttemptID:attempt_1463536641021_0001_1_01_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=BB3C5A9C83BA4ECFBA3552FE654E112F, physicalEdgeCount=1, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=7923058C9BB241F4844CA0A498F1219E, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-18 01:57:21,328 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:21,329 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536641021_0001_1_01_000000_0
2016-05-18 01:57:21,330 INFO  impl.VertexImpl (VertexImpl.java:getTaskAttemptTezEvents(3662)) - Sending attempt_1463536641021_0001_1_01_000000_0 1 events [0,1) total 1 vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B]
2016-05-18 01:57:21,330 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536641021_0001_1_01_000000_0, eventCount=1 fromEventId=0 nextFromEventId=1
2016-05-18 01:57:21,333 INFO  orderedgrouped.MergeManager (MergeManager.java:getInitialMemoryRequirement(339)) - Initial Memory required for SHUFFLE_BUFFER=211392912 based on INPUT_BUFFER_FACTOR=0.9,  for final merged output=0, using factor: 0.0
2016-05-18 01:57:21,335 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:21,345 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F2263D459D0743D1B9699CAA2FECEE8B, ordinal: 1
2016-05-18 01:57:21,345 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F2263D459D0743D1B9699CAA2FECEE8B, mem on start (mb), free: 143, total: 372, max: 672
2016-05-18 01:57:21,345 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:21,346 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:21,346 INFO  output.MROutput (MROutput.java:initialize(421)) - 7923058C9BB241F4844CA0A498F1219E: outputFormat=org.apache.hadoop.mapred.TextOutputFormat, using newmapreduce API=false
2016-05-18 01:57:21,346 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:21,347 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:21,347 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[7923058C9BB241F4844CA0A498F1219E:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput], [BB3C5A9C83BA4ECFBA3552FE654E112F:INPUT:211392912:org.apache.tez.runtime.library.input.OrderedGroupedKVInput]
2016-05-18 01:57:21,348 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:21,349 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:21,349 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 211392912, TotalRequestedScaled: 1.9513191876923078E8, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.30
2016-05-18 01:57:21,349 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[7923058C9BB241F4844CA0A498F1219E:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0], [BB3C5A9C83BA4ECFBA3552FE654E112F:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:211392912:211392912]
2016-05-18 01:57:21,350 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:21,350 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: BB3C5A9C83BA4ECFBA3552FE654E112F being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:21,351 INFO  orderedgrouped.Shuffle (Shuffle.java:<init>(147)) - BB3C5A9C83BA4ECFBA3552FE654E112F: Shuffle assigned with 1 inputs, codec: None, ifileReadAhead: true
2016-05-18 01:57:21,351 INFO  orderedgrouped.MergeManager (MergeManager.java:<init>(273)) - BB3C5A9C83BA4ECFBA3552FE654E112F: MergerManager: memoryLimit=211392912, maxSingleShuffleLimit=52848228, mergeThreshold=190253616, ioSortFactor=100, postMergeMem=0, memToMemMergeOutputsThreshold=100
2016-05-18 01:57:21,351 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:21,351 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:21,352 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:<init>(353)) - ShuffleScheduler running for sourceVertex: BB3C5A9C83BA4ECFBA3552FE654E112F with configuration: maxFetchFailuresBeforeReporting=5, reportReadErrorImmediately=true, maxFailedUniqueFetches=1, abortFailureLimit=15, maxTaskOutputAtOnce=20, numFetchers=1, hostFailureFraction=0.2, minFailurePerHost=4, maxAllowedFailedFetchFraction=0.5, maxStallTimeFraction=0.5, minReqProgressFraction=0.5, checkFailedFetchSinceLastCompletion=true
2016-05-18 01:57:21,353 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: BB3C5A9C83BA4ECFBA3552FE654E112F
2016-05-18 01:57:21,356 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:21,357 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536641021_0001_1_01_000000_0
2016-05-18 01:57:21,359 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: GroupBy(test)[by:[{1}:'method']]
2016-05-18 01:57:21,359 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - BB3C5A9C83BA4ECFBA3552FE654E112F: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0
2016-05-18 01:57:21,360 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: GroupBy(test)[by:[{1}:'method']] streamed: true, id: 9ABC81B9CE824B0AB9C5F6727A317659
2016-05-18 01:57:21,361 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/STRICT/STRICT"], id: 7923058C9BB241F4844CA0A498F1219E
2016-05-18 01:57:21,361 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/STRICT/STRICT"]
2016-05-18 01:57:21,361 INFO  orderedgrouped.ShuffleScheduler (ShuffleUtils.java:logIndividualFetchComplete(489)) - Completed fetch for attempt: {0, 0, attempt_1463536641021_0001_1_00_000000_0_10045} to DISK_DIRECT, csize=653, dsize=649, EndTime=1463536641361, TimeTaken=1, Rate=0.62 MB/s
2016-05-18 01:57:21,361 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:copySucceeded(551)) - All inputs fetched for input vertex : BB3C5A9C83BA4ECFBA3552FE654E112F
2016-05-18 01:57:21,362 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:21,362 INFO  element.TezGroupGate (TezGroupGate.java:prepare(90)) - calling OrderedGroupedKVInput#start() on: GroupBy(test)[by:[{1}:'method']] 9ABC81B9CE824B0AB9C5F6727A317659, for 1 inputs
2016-05-18 01:57:21,362 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:callInternal(1289)) - Shutting down FetchScheduler for input: BB3C5A9C83BA4ECFBA3552FE654E112F, wasInterrupted=false
2016-05-18 01:57:21,363 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:21,363 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1005)) - finalMerge called with 0 in-memory map-outputs and 1 on-disk map-outputs
2016-05-18 01:57:21,364 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1103)) - Disk file=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/D1B573B9BD134678A00FD34E96E9CC3B/B65D6FC1893E4D398478C4DA4D11C859/.tez/application_1463536641021_0001_wd/localmode-local-dir/output/attempt_1463536641021_0001_1_00_000000_0_10045/file.out, len=653, isLocal=true
2016-05-18 01:57:21,364 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1115)) - Merging 1 files, 653 bytes from disk
2016-05-18 01:57:21,364 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1130)) - Merging 0 segments, 0 bytes from memory into reduce
2016-05-18 01:57:21,364 INFO  impl.TezMerger (TezMerger.java:merge(644)) - Merging 1 sorted segments
2016-05-18 01:57:21,365 INFO  impl.TezMerger (TezMerger.java:merge(749)) - Down to the last merge-pass, with 1 segments left of total size: 633 bytes
2016-05-18 01:57:21,365 INFO  orderedgrouped.Shuffle (Shuffle.java:callInternal(332)) - merge complete for input vertex : BB3C5A9C83BA4ECFBA3552FE654E112F
2016-05-18 01:57:21,365 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F2263D459D0743D1B9699CAA2FECEE8B, all 1 inputs ready in: 00:00:00.003
2016-05-18 01:57:21,365 INFO  orderedgrouped.Shuffle (Shuffle.java:onSuccess(417)) - BB3C5A9C83BA4ECFBA3552FE654E112F: Shuffle Runner thread complete
2016-05-18 01:57:21,366 INFO  input.OrderedGroupedKVInput (OrderedGroupedKVInput.java:createValuesIterator(292)) - BB3C5A9C83BA4ECFBA3552FE654E112F: creating ValuesIterator with comparator=cascading.tuple.hadoop.util.TupleComparator, keyClass=cascading.tuple.io.KeyTuple, valClass=cascading.tuple.io.ValueTuple
2016-05-18 01:57:21,368 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-05-18 01:57:21,368 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-05-18 01:57:21,369 ERROR element.TezGroupByGate (TezGroupByGate.java:reduce(91)) - caught throwable
cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-05-18 01:57:21,370 INFO  output.MROutput (MROutput.java:close(526)) - 7923058C9BB241F4844CA0A498F1219E closed
2016-05-18 01:57:21,371 INFO  impl.TaskImpl (TaskImpl.java:canCommit(671)) - attempt_1463536641021_0001_1_01_000000_0 given a go for committing the task output.
2016-05-18 01:57:21,372 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536641021_0001_1_01_000000_0, stopRequested=false
2016-05-18 01:57:21,372 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536641021_0001_1_01_000000_0: Counters: 33 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=11, MERGE_PHASE_TIME=14, FIRST_EVENT_RECEIVED=8, LAST_EVENT_RECEIVED=8][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][cascading.flow.SliceCounters Process_Begin_Time=1463536641365, Process_Duration=7, Process_End_Time=1463536641372, Read_Duration=0, Tuples_Read=7]]
2016-05-18 01:57:21,372 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(817)) - Joining on EventRouter
2016-05-18 01:57:21,372 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F2263D459D0743D1B9699CAA2FECEE8B, mem on close (mb), free: 139, total: 372, max: 672
2016-05-18 01:57:21,373 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(851)) - Closed processor for vertex=F2263D459D0743D1B9699CAA2FECEE8B, index=1, interruptedStatus=false
2016-05-18 01:57:21,373 INFO  orderedgrouped.Shuffle (Shuffle.java:shutdown(278)) - Shutting down Shuffle for source: BB3C5A9C83BA4ECFBA3552FE654E112F
2016-05-18 01:57:21,373 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - BB3C5A9C83BA4ECFBA3552FE654E112F: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0, updateOnClose
2016-05-18 01:57:21,373 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(887)) - Closed input for vertex=F2263D459D0743D1B9699CAA2FECEE8B, sourceVertex=BB3C5A9C83BA4ECFBA3552FE654E112F, interruptedStatus=true
2016-05-18 01:57:21,373 INFO  output.MROutput (MROutput.java:close(526)) - 7923058C9BB241F4844CA0A498F1219E closed
2016-05-18 01:57:21,373 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(911)) - Closed input for vertex=F2263D459D0743D1B9699CAA2FECEE8B, sourceVertex=7923058C9BB241F4844CA0A498F1219E, interruptedStatus=true
2016-05-18 01:57:21,374 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536641021_0001_1_01_000000_0 : TaskRunner2Result{endReason=TASK_ERROR, error=cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST'], containerShutdownRequested=false}  
2016-05-18 01:57:21,374 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=TASK_ERROR, error=cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST'], containerShutdownRequested=false}
2016-05-18 01:57:21,375 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536641021_0001_00_000002
2016-05-18 01:57:21,375 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F2263D459D0743D1B9699CAA2FECEE8B, taskAttemptId=attempt_1463536641021_0001_1_01_000000_0, creationTime=1463536641316, allocationTime=1463536641318, startTime=1463536641322, finishTime=1463536641374, timeTaken=52, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task: attempt_1463536641021_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 33, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=11, MERGE_PHASE_TIME=14, FIRST_EVENT_RECEIVED=8, LAST_EVENT_RECEIVED=8, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536641365, Process_Duration=7, Process_End_Time=1463536641372, Read_Duration=0, Tuples_Read=7
2016-05-18 01:57:21,375 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536641021_0001_00_000002
2016-05-18 01:57:21,375 INFO  impl.TaskImpl (TaskImpl.java:transition(1170)) - Failing task: task_1463536641021_0001_1_01_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-05-18 01:57:21,375 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536641021_0001_00_000002 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST'], errorMessage='TaskExecutionFailure: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST']'}
2016-05-18 01:57:21,376 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(294)) - Container: container_1463536641021_0001_00_000002 completed but with errors
2016-05-18 01:57:21,375 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:TASK_FINISHED]: vertexName=F2263D459D0743D1B9699CAA2FECEE8B, taskId=task_1463536641021_0001_1_01_000000, startTime=1463536641322, finishTime=1463536641375, timeTaken=53, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task: attempt_1463536641021_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-05-18 01:57:21,378 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(704)) - Container container_1463536641021_0001_00_000002 exited with diagnostics set to TaskExecutionFailure: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
2016-05-18 01:57:21,378 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536641021_0001_00_000002, stoppedTime=1463536641378, exitStatus=1
2016-05-18 01:57:21,378 INFO  impl.VertexImpl (VertexImpl.java:transition(3353)) - Failing vertex: vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B] because task failed: task_1463536641021_0001_1_01_000000
2016-05-18 01:57:21,378 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(2102)) - Killing tasks in vertex: vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B] due to trigger: OWN_TASK_FAILURE
2016-05-18 01:57:21,379 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B], tasks=1, failed=1, killed=0, success=0, completed=1, commits=0, err=OWN_TASK_FAILURE
2016-05-18 01:57:21,379 INFO  impl.VertexImpl (VertexImpl.java:finishWithTerminationCause(2084)) - Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0
2016-05-18 01:57:21,379 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3087)) - Invoking committer abort for vertex, vertexId=vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B]
2016-05-18 01:57:21,379 INFO  impl.VertexImpl (VertexImpl.java:run(3095)) - Invoking committer abort for output=7923058C9BB241F4844CA0A498F1219E, vertexId=vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B]
2016-05-18 01:57:21,382 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:VERTEX_FINISHED]: vertexName=F2263D459D0743D1B9699CAA2FECEE8B, vertexId=vertex_1463536641021_0001_1_01, initRequestedTime=1463536641222, initedTime=1463536641229, startRequestedTime=1463536641238, startedTime=1463536641239, finishTime=1463536641381, timeTaken=142, status=FAILED, diagnostics=Task failed, taskId=task_1463536641021_0001_1_01_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task: attempt_1463536641021_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]]
Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0
Vertex vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B] killed/failed due to:OWN_TASK_FAILURE, counters=Counters: 0, vertexStats=firstTaskStartTime=1463536641322, firstTasksToStart=[ task_1463536641021_0001_1_01_000000 ], lastTaskFinishTime=1463536641374, lastTasksToFinish=[ task_1463536641021_0001_1_01_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-05-18 01:57:21,382 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-05-18 01:57:21,383 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(298)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1463536641021_0001_1_01_000000_0 failed: true container: container_1463536641021_0001_00_000002 numFailedTAs: 0
2016-05-18 01:57:21,383 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B] completed., numCompletedVertices=2, numSuccessfulVertices=1, numFailedVertices=1, numKilledVertices=0, numVertices=2
2016-05-18 01:57:21,383 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=2, numSuccessfulVertices=1, numFailedVertices=1, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=VERTEX_FAILURE
2016-05-18 01:57:21,383 INFO  impl.DAGImpl (DAGImpl.java:finishWithTerminationCause(1350)) - DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0
2016-05-18 01:57:21,387 INFO  recovery.RecoveryService (RecoveryService.java:handle(327)) - DAG completed, dagId=dag_1463536641021_0001_1, queueSize=0
2016-05-18 01:57:21,389 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641021_0001_1][Event:DAG_FINISHED]: dagId=dag_1463536641021_0001_1, startTime=1463536641219, finishTime=1463536641386, timeTaken=167, status=FAILED, diagnostics=Vertex failed, vertexName=F2263D459D0743D1B9699CAA2FECEE8B, vertexId=vertex_1463536641021_0001_1_01, diagnostics=[Task failed, taskId=task_1463536641021_0001_1_01_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task: attempt_1463536641021_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B] killed/failed due to:OWN_TASK_FAILURE]
DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=2, RACK_LOCAL_TASKS=1, AM_CPU_MILLISECONDS=330, AM_GC_TIME_MILLIS=0, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536641299, Process_Duration=3, Process_End_Time=1463536641302, Read_Duration=1, Tuples_Read=10, Tuples_Written=7, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=10
2016-05-18 01:57:21,389 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3082)) - Ignoring multiple aborts for vertex: vertex_1463536641021_0001_1_01 [F2263D459D0743D1B9699CAA2FECEE8B]
2016-05-18 01:57:21,389 INFO  impl.DAGImpl (DAGImpl.java:finished(1405)) - DAG: dag_1463536641021_0001_1 finished with state: FAILED
2016-05-18 01:57:21,389 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536641021_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-05-18 01:57:21 Completed Dag: dag_1463536641021_0001_1
2016-05-18 01:57:21,391 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(751)) - DAG completed, dagId=dag_1463536641021_0001_1, dagState=FAILED
2016-05-18 01:57:21,392 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536641021_0001_1_post
2016-05-18 01:57:21,392 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:21,392 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(800)) - Central Dispatcher queue size after DAG completion, before cleanup: 0
2016-05-18 01:57:21,392 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(802)) - Waiting for next DAG to be submitted.
2016-05-18 01:57:21,392 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(842)) - Cleaning up DAG: name=[D1B573B9BD134678A00FD34E96E9CC3B/B65D6FC1893E4D398478C4DA4D11C859] test/(1/1) ...moval/group/STRICT/STRICT, with id=dag_1463536641021_0001_1
2016-05-18 01:57:21,394 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(852)) - Completed cleanup for DAG: name=[D1B573B9BD134678A00FD34E96E9CC3B/B65D6FC1893E4D398478C4DA4D11C859] test/(1/1) ...moval/group/STRICT/STRICT, with id=dag_1463536641021_0001_1
2016-05-18 01:57:21,404 INFO  client.TezClient (TezClient.java:stop(566)) - Shutting down Tez Session, sessionName=(1/1) ...moval/group/STRICT/STRICT, applicationId=application_1463536641021_0001
2016-05-18 01:57:21,412 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(124)) - Received message to shutdown AM
2016-05-18 01:57:21,412 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:setShouldUnregisterFlag(895)) - TaskScheduler notified that it should unregister from RM
2016-05-18 01:57:21,412 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1301)) - No current running DAG, shutting down the AM
2016-05-18 01:57:21,413 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(907)) - DAGAppMasterShutdownHandler invoked
2016-05-18 01:57:21,413 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(916)) - Handling DAGAppMaster shutdown
2016-05-18 01:57:21,415 INFO  app.DAGAppMaster (DAGAppMaster.java:run(936)) - Sleeping for 5 seconds before shutting down
2016-05-18 01:57:21,416 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(84)) - Stopping HistoryEventHandler
2016-05-18 01:57:21,416 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(196)) - Stopping RecoveryService
2016-05-18 01:57:21,416 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(199)) - Handle the remaining events in queue, queue size=0
2016-05-18 01:57:21,417 INFO  recovery.RecoveryService (RecoveryService.java:run(173)) - EventQueue take interrupted. Returning
2016-05-18 01:57:21,417 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(221)) - Closing Summary Stream
2016-05-18 01:57:21,417 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-18 01:57:21,418 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-18 01:57:21,419 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:serviceStop(678)) - Shutting down AppCallbackExecutor
2016-05-18 01:57:21,422 INFO  app.DAGAppMaster (DAGAppMaster.java:run(2084)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/D1B573B9BD134678A00FD34E96E9CC3B/B65D6FC1893E4D398478C4DA4D11C859/.tez/application_1463536641021_0001
2016-05-18 01:57:21,422 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] stopping all jobs
2016-05-18 01:57:21,423 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] stopping: (1/1) ...moval/group/STRICT/STRICT
2016-05-18 01:57:21,423 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] stopped all jobs
2016-05-18 01:57:21,423 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/STRICT/STRICT/_temporary
2016-05-18 01:57:21,424 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  completed in: 00:00.432
2016-05-18 01:57:21,463 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 01:57:21,463 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-18 01:57:21,514 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-05-18 01:57:21,537 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.045
2016-05-18 01:57:21,538 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:21,538 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:21,538 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 01:57:21,555 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt
2016-05-18 01:57:21,564 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/NONE/VALID
2016-05-18 01:57:21,619 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting
2016-05-18 01:57:21,619 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:21,619 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  sink: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/NONE/VALID"]
2016-05-18 01:57:21,619 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  parallel execution of steps is enabled: false
2016-05-18 01:57:21,619 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  executing total steps: 1
2016-05-18 01:57:21,619 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  allocating management threads: 1
2016-05-18 01:57:21,620 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting step: (1/1) ...sRemoval/group/NONE/VALID
2016-05-18 01:57:21,620 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [test] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-18 01:57:21,635 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tez session mode enabled: true
2016-05-18 01:57:21,639 INFO  client.TezClient (TezClient.java:<init>(174)) - Tez Client Version: [ component=tez-api, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:21,639 INFO  client.TezClient (TezClient.java:start(394)) - Session mode. Starting session.
2016-05-18 01:57:21,640 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(164)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-18 01:57:21,649 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(122)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/9616DB197BDE40C98523CB028C8901F8/A8AD2E424EB244DF9754090E962F717F/.tez/application_1463536641639_0001 doesn't exist and is created
2016-05-18 01:57:21,668 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(332)) - DAGAppMaster thread has been created
2016-05-18 01:57:21,668 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-18 01:57:21,669 INFO  client.LocalClient (LocalClient.java:run(282)) - Using working directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/9616DB197BDE40C98523CB028C8901F8/A8AD2E424EB244DF9754090E962F717F/.tez/application_1463536641639_0001_wd
2016-05-18 01:57:21,684 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(363)) - Created DAGAppMaster for application appattempt_1463536641639_0001_000000, versionInfo=[ component=tez-dag, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:21,685 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(80)) - Trying to locate HadoopShimProvider for hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:21,685 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(139)) - Picked HadoopShim org.apache.tez.hadoop.shim.DefaultHadoopShim, providerName=null, overrideProviderViaConfig=null, hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:21,687 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(436)) - AM Level configured TaskSchedulers: [0:TezUber:null]
2016-05-18 01:57:21,687 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(437)) - AM Level configured ContainerLaunchers: [0:TezUber:null]
2016-05-18 01:57:21,687 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(438)) - AM Level configured TaskCommunicators: [0:TezUber:null]
2016-05-18 01:57:21,687 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(447)) - Comparing client version with AM version, clientVersion=0.8.2, AMVersion=0.8.2
2016-05-18 01:57:21,688 INFO  app.TaskCommunicatorManager (TaskCommunicatorManager.java:createUberTaskCommunicator(192)) - Creating Default Local Task Communicator
2016-05-18 01:57:21,690 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.container.AMContainerEventType for class org.apache.tez.dag.app.rm.container.AMContainerMap
2016-05-18 01:57:21,690 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.node.AMNodeEventType for class org.apache.tez.dag.app.rm.node.AMNodeTracker
2016-05-18 01:57:21,690 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGAppMasterEventType for class org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterEventHandler
2016-05-18 01:57:21,691 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGEventType for class org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher
2016-05-18 01:57:21,691 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.VertexEventType for class org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher
2016-05-18 01:57:21,691 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(529)) - Using concurrent dispatcher: false
2016-05-18 01:57:21,691 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher
2016-05-18 01:57:21,691 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskAttemptEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher
2016-05-18 01:57:21,691 INFO  common.AsyncDispatcher (AsyncDispatcher.java:registerAndCreateDispatcher(262)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for independent dispatch using: class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:21,691 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:21,691 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.AMSchedulerEventType for class org.apache.tez.dag.app.rm.TaskSchedulerManager
2016-05-18 01:57:21,692 INFO  launcher.TezContainerLauncherImpl (ContainerLauncherManager.java:createUberContainerLauncher(134)) - Creating LocalContainerLauncher
2016-05-18 01:57:21,694 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.ContainerLauncherEventType for class org.apache.tez.dag.app.launcher.ContainerLauncherManager
2016-05-18 01:57:21,695 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(78)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1, nodeUpdatesRescheduleEnabled: false
2016-05-18 01:57:21,695 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(57)) - Initializing HistoryEventHandler withrecoveryEnabled=true, historyServiceClassName=org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService
2016-05-18 01:57:21,695 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/9616DB197BDE40C98523CB028C8901F8/A8AD2E424EB244DF9754090E962F717F/.tez/application_1463536641639_0001_wd/localmode-log-dir
2016-05-18 01:57:21,696 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/9616DB197BDE40C98523CB028C8901F8/A8AD2E424EB244DF9754090E962F717F/.tez/application_1463536641639_0001_wd/localmode-log-dir/history.txt.appattempt_1463536641639_0001_000000, maxErrors=10
2016-05-18 01:57:21,696 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(124)) - RecoveryService initialized with recoveryPath=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/9616DB197BDE40C98523CB028C8901F8/A8AD2E424EB244DF9754090E962F717F/.tez/application_1463536641639_0001/recovery/0, bufferSize(bytes)=8192, flushInterval(s)=30, maxUnflushedEvents=100
2016-05-18 01:57:21,696 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463536641639_0001_000000, appSubmitTime=1463536641684, launchTime=1463536641684
2016-05-18 01:57:21,702 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-18 01:57:21,709 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:45043
2016-05-18 01:57:21,711 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:createUberTaskScheduler(557)) - Creating TaskScheduler: Local TaskScheduler with clusterIdentifier=1463536641639
2016-05-18 01:57:21,712 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463536641639_0001_000000, startTime=1463536641712
2016-05-18 01:57:21,712 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1945)) - In Session mode. Waiting for DAG over RPC
2016-05-18 01:57:21,769 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-18 01:57:21,769 INFO  client.TezClient (TezClient.java:start(428)) - The url to track the Tez Session: N/A
2016-05-18 01:57:21,769 INFO  client.TezClient (TezClient.java:submitDAGSession(470)) - Submitting dag to TezSession, sessionName=(1/1) ...sRemoval/group/NONE/VALID, applicationId=application_1463536641639_0001, dagName=[9616DB197BDE40C98523CB028C8901F8/A8AD2E424EB244DF9754090E962F717F] test/(1/1) ...sRemoval/group/NONE/VALID
2016-05-18 01:57:21,788 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1351)) - Starting DAG submitted via RPC: [9616DB197BDE40C98523CB028C8901F8/A8AD2E424EB244DF9754090E962F717F] test/(1/1) ...sRemoval/group/NONE/VALID
2016-05-18 01:57:21,788 INFO  app.DAGAppMaster (DAGAppMaster.java:createDAG(985)) - Merging AM credentials into DAG credentials
2016-05-18 01:57:21,789 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(1076)) - Generating DAG graphviz file, dagId=dag_1463536641639_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/9616DB197BDE40C98523CB028C8901F8/A8AD2E424EB244DF9754090E962F717F/.tez/application_1463536641639_0001_wd/localmode-log-dir/dag_1463536641639_0001_1.dot
2016-05-18 01:57:21,789 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(1093)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/9616DB197BDE40C98523CB028C8901F8/A8AD2E424EB244DF9754090E962F717F/.tez/application_1463536641639_0001_wd/localmode-log-dir/dag_1463536641639_0001_1-tez-dag.pb.txt
2016-05-18 01:57:21,796 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536641639_0001_1
2016-05-18 01:57:21,796 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:21,797 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2399)) - Running DAG: [9616DB197BDE40C98523CB028C8901F8/A8AD2E424EB244DF9754090E962F717F] test/(1/1) ...sRemoval/group/NONE/VALID
2016-05-18 01:57:21 Running Dag: dag_1463536641639_0001_1
2016-05-18 01:57:21,812 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463536641639_0001_1, submitTime=1463536641788
2016-05-18 01:57:21,814 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/9616DB197BDE40C98523CB028C8901F8/A8AD2E424EB244DF9754090E962F717F/.tez/application_1463536641639_0001/tez-conf.pb" } size: 40984 timestamp: 1463536641000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:21,814 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalInputs(3978)) - Setting 1 additional inputs for vertexvertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2]
2016-05-18 01:57:21,814 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:21,815 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/9616DB197BDE40C98523CB028C8901F8/A8AD2E424EB244DF9754090E962F717F/.tez/application_1463536641639_0001/tez-conf.pb" } size: 40984 timestamp: 1463536641000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:21,815 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4023)) - Setting 1 additional outputs for vertex vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF]
2016-05-18 01:57:21,815 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:21,815 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1593)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-18 01:57:21,816 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463536641639_0001_1, initTime=1463536641816
2016-05-18 01:57:21,816 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536641639_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-18 01:57:21,816 INFO  impl.DAGImpl (DAGImpl.java:transition(1768)) - Added additional resources : [[]] to classpath
2016-05-18 01:57:21,817 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:DAG_STARTED]: dagID=dag_1463536641639_0001_1, startTime=1463536641817
2016-05-18 01:57:21,817 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536641639_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-18 01:57:21,817 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2400)) - Root Inputs exist for Vertex: CB7EC7D5462A4919BDF7588CD2651AD2 : {04837A7F8B114521B1338E17A035215D={InputName=04837A7F8B114521B1338E17A035215D}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-18 01:57:21,817 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2410)) - Starting root input initializer for input: 04837A7F8B114521B1338E17A035215D, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-18 01:57:21,817 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2550)) - Setting vertexManager to RootInputVertexManager for vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2]
2016-05-18 01:57:21,817 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2721)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2]
2016-05-18 01:57:21,817 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2726)) - Vertex will initialize from input initializer. vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2]
2016-05-18 01:57:21,818 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3893)) - Starting 1 inputInitializers for vertex vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2]
2016-05-18 01:57:21,818 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-18 01:57:21,818 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2562)) - Setting vertexManager to ShuffleVertexManager for vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF]
2016-05-18 01:57:21,818 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(272)) - Starting InputInitializer for Input: 04837A7F8B114521B1338E17A035215D on vertex vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2]
2016-05-18 01:57:21,819 INFO  client.TezClient (TezClient.java:submitDAGSession(545)) - Submitted dag to TezSession, sessionName=(1/1) ...sRemoval/group/NONE/VALID, applicationId=application_1463536641639_0001, dagName=[9616DB197BDE40C98523CB028C8901F8/A8AD2E424EB244DF9754090E962F717F] test/(1/1) ...sRemoval/group/NONE/VALID
2016-05-18 01:57:21,821 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(109)) - Input 04837A7F8B114521B1338E17A035215D asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7, groupingEnabled: true
2016-05-18 01:57:21,823 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:initialize(1022)) - Shuffle Vertex Manager: settings minFrac:0.25 maxFrac:0.75 auto:false desiredTaskIput:104857600 minTasks:1
2016-05-18 01:57:21,823 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2760)) - Creating 1 tasks for vertex: vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF]
2016-05-18 01:57:21,823 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(168)) - Grouping splits in Tez
2016-05-18 01:57:21,823 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(226)) - Desired splits: 1 too large.  Desired splitLength: 1449 Min splitLength: 52428800 New desired splits: 1 Total length: 1449 Original splits: 2
2016-05-18 01:57:21,824 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2779)) - Directly initializing vertex: vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF]
2016-05-18 01:57:21,824 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(321)) - Desired numSplits: 1 lengthPerGroup: 1449 numLocations: 1 numSplitsPerLocation: 2 numSplitsInGroup: 2 totalLength: 1449 numOriginalSplits: 2 . Grouping by length: true count: false nodeLocalOnly: false
2016-05-18 01:57:21,824 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536641639_0001_1_01, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=null, edgeManagersCount=1, rootInputSpecUpdateCount=0, setParallelismCalledFlag=false
2016-05-18 01:57:21,824 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2187)) - Setting up committers for vertex vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF], numAdditionalOutputs=1
2016-05-18 01:57:21,824 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2202)) - Instantiating committer for output=33FD110E97944420BA673CFB1E67BEF9, vertex=vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-18 01:57:21,824 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(539)) - Number of splits desired: 1 created: 1 splitsProcessed: 2
2016-05-18 01:57:21,826 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(308)) - Succeeded InputInitializer for Input: 04837A7F8B114521B1338E17A035215D on vertex vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2]
2016-05-18 01:57:21,827 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(121)) - Committer for B926720A3F4B4C6EA86FB90B081E66DF:33FD110E97944420BA673CFB1E67BEF9 using oldmapred API
2016-05-18 01:57:21,827 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(146)) - OutputCommitter for outputName=33FD110E97944420BA673CFB1E67BEF9, vertexName=B926720A3F4B4C6EA86FB90B081E66DF, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-18 01:57:21,829 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B926720A3F4B4C6EA86FB90B081E66DF, vertexId=vertex_1463536641639_0001_1_01, initRequestedTime=1463536641818, initedTime=1463536641824, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=0, initGeneratedEventsCount=0
2016-05-18 01:57:21,829 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF] transitioned from NEW to INITED due to event V_INIT
2016-05-18 01:57:21,830 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:21,830 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1644)) - Got updated RootInputsSpecs: {04837A7F8B114521B1338E17A035215D=forAllWorkUnits=true, update=[1]}
2016-05-18 01:57:21,831 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1664)) - Vertex vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2] parallelism set to 1
2016-05-18 01:57:21,831 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:21,832 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:VERTEX_INITIALIZED]: vertexName=CB7EC7D5462A4919BDF7588CD2651AD2, vertexId=vertex_1463536641639_0001_1_00, initRequestedTime=1463536641817, initedTime=1463536641831, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1, initGeneratedEventsCount=1
2016-05-18 01:57:21,832 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2] with distanceFromRoot: 0
2016-05-18 01:57:21,832 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2] transitioned from INITIALIZING to INITED due to event V_INPUT_DATA_INFORMATION
2016-05-18 01:57:21,832 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536641639_0001_1_00, startRequestedTime=1463536641818, startedTime=1463536641832
2016-05-18 01:57:21,833 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536641639_0001_1_00, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=org.apache.tez.dag.api.VertexLocationHint@b8338fe7, edgeManagersCount=0, rootInputSpecUpdateCount=1, setParallelismCalledFlag=true
2016-05-18 01:57:21,833 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:21,833 INFO  impl.VertexImpl (VertexImpl.java:transition(2932)) - Source vertex started: vertex_1463536641639_0001_1_00 for vertex: vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF] numStartedSources: 1 numSources: 1
2016-05-18 01:57:21,833 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF] with distanceFromRoot: 1
2016-05-18 01:57:21,833 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(100)) - Starting 1 in CB7EC7D5462A4919BDF7588CD2651AD2
2016-05-18 01:57:21,834 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2]
2016-05-18 01:57:21,834 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536641639_0001_1_01, startRequestedTime=1463536641833, startedTime=1463536641834
2016-05-18 01:57:21,834 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:21,835 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:TASK_STARTED]: vertexName=CB7EC7D5462A4919BDF7588CD2651AD2, taskId=task_1463536641639_0001_1_00_000000, scheduledTime=1463536641835, launchTime=1463536641835
2016-05-18 01:57:21,835 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2]
2016-05-18 01:57:21,838 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:onVertexStarted(519)) - OnVertexStarted vertex: B926720A3F4B4C6EA86FB90B081E66DF with 0 source tasks and 1 pending tasks
2016-05-18 01:57:21,838 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:handleVertexStateUpdate(1051)) - Received configured notification : CONFIGURED for vertex: CB7EC7D5462A4919BDF7588CD2651AD2 in vertex: B926720A3F4B4C6EA86FB90B081E66DF numBipartiteSourceTasks: 1
2016-05-18 01:57:21,838 INFO  node.PerSourceNodeTracker (PerSourceNodeTracker.java:nodeSeen(74)) - Adding new node 127.0.0.1:0 to nodeTracker 0
2016-05-18 01:57:21,841 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536641639_0001_00_000001, launchTime=1463536641840
2016-05-18 01:57:21,841 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536641639_0001_00_000001
2016-05-18 01:57:21,842 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536641639_0001_1_00_000000_0] started. Is using containerId: [container_1463536641639_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-18 01:57:21,842 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=CB7EC7D5462A4919BDF7588CD2651AD2, taskAttemptId=attempt_1463536641639_0001_1_00_000000_0, startTime=1463536641842, containerId=container_1463536641639_0001_00_000001, nodeId=127.0.0.1:0
2016-05-18 01:57:21,843 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536641639_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536641639_0001_1_00_000000_0
2016-05-18 01:57:21 Starting to run new task attempt: attempt_1463536641639_0001_1_00_000000_0
2016-05-18 01:57:21,844 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536641639_0001_1_00_000000_0
2016-05-18 01:57:21,844 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:21,845 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:21,845 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [9616DB197BDE40C98523CB028C8901F8/A8AD2E424EB244DF9754090E962F717F] test/(1/1) ...sRemoval/group/NONE/VALID, VertexName: CB7EC7D5462A4919BDF7588CD2651AD2, VertexParallelism: 1, TaskAttemptID:attempt_1463536641639_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=04837A7F8B114521B1338E17A035215D, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=B926720A3F4B4C6EA86FB90B081E66DF, physicalEdgeCount=1, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ]
2016-05-18 01:57:21,845 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:21,846 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536641639_0001_1_00_000000_0
2016-05-18 01:57:21,847 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(496)) - TaskAttempt:attempt_1463536641639_0001_1_00_000000_0 sent events: (0-1).
2016-05-18 01:57:21,847 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536641639_0001_1_00_000000_0, eventCount=1 fromEventId=0 nextFromEventId=0
2016-05-18 01:57:21,849 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] submitted tez dag to app master: application_1463536641639_0001, with dag id: dag_1463536641639_0001_1
2016-05-18 01:57:21,852 INFO  input.MRInput (MRInput.java:initialize(440)) - 04837A7F8B114521B1338E17A035215D using newmapreduce API=false, split via event=true, numPhysicalInputs=1
2016-05-18 01:57:21,852 INFO  input.MRInput (MRInput.java:initializeInternal(494)) - Initialized MRInput: 04837A7F8B114521B1338E17A035215D
2016-05-18 01:57:21,853 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:21,861 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: CB7EC7D5462A4919BDF7588CD2651AD2, ordinal: 0
2016-05-18 01:57:21,861 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: CB7EC7D5462A4919BDF7588CD2651AD2, mem on start (mb), free: 257, total: 372, max: 672
2016-05-18 01:57:21,861 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:21,861 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:21,862 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:21,862 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:21,862 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[04837A7F8B114521B1338E17A035215D:INPUT:0:org.apache.tez.mapreduce.input.MRInput], [B926720A3F4B4C6EA86FB90B081E66DF:OUTPUT:104857600:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput]
2016-05-18 01:57:21,862 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:21,863 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:21,863 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 104857600, TotalRequestedScaled: 9.679163076923077E7, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.15
2016-05-18 01:57:21,863 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[04837A7F8B114521B1338E17A035215D:org.apache.tez.mapreduce.input.MRInput:INPUT:0:0], [B926720A3F4B4C6EA86FB90B081E66DF:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput:OUTPUT:104857600:104857600]
2016-05-18 01:57:21,863 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:21,863 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: 04837A7F8B114521B1338E17A035215D being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:21,864 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:21,864 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:21,864 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: 04837A7F8B114521B1338E17A035215D
2016-05-18 01:57:21,865 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:21,865 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536641639_0001_1_00_000000_0
2016-05-18 01:57:21,866 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(174)) - Processing split: TezGroupedSplit{wrappedSplits=[file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:0+724, file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:724+725], wrappedInputFormatName='org.apache.hadoop.mapred.TextInputFormat', locations=[localhost], rack='null', length=1449}
2016-05-18 01:57:21,867 INFO  input.MRInput (MRInput.java:initFromEventInternal(653)) - 04837A7F8B114521B1338E17A035215D initialized RecordReader from event
2016-05-18 01:57:21,868 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:21,869 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"] streamed: true, id: 04837A7F8B114521B1338E17A035215D
2016-05-18 01:57:21,869 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: GroupBy(test)[by:[{1}:'method']], id: B90E9E9BCF5B4B688CC7DC1ECA876132
2016-05-18 01:57:21,869 INFO  element.TezGroupGate (TezGroupGate.java:prepare(98)) - calling OrderedPartitionedKVOutput#start() on: GroupBy(test)[by:[{1}:'method']] B90E9E9BCF5B4B688CC7DC1ECA876132
2016-05-18 01:57:21,871 INFO  impl.ExternalSorter (ExternalSorter.java:<init>(199)) - B926720A3F4B4C6EA86FB90B081E66DF using: memoryMb=100, keySerializerClass=class cascading.tuple.io.KeyTuple, valueSerializerClass=cascading.tuple.hadoop.io.ValueTupleSerializer@557d5003, comparator=cascading.tuple.hadoop.util.TupleComparator@161020ce, partitioner=cascading.tuple.tez.util.TuplePartitioner, serialization=cascading.tuple.hadoop.TupleSerialization,org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
2016-05-18 01:57:21,871 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(170)) - Setting up PipelinedSorter for B926720A3F4B4C6EA86FB90B081E66DF: , UsingHashComparator=false
2016-05-18 01:57:21,884 INFO  impl.PipelinedSorter (PipelinedSorter.java:allocateSpace(245)) - Newly allocated block size=104857600, index=0, Number of buffers=1, currentAllocatableMemory=0, currentBufferSize=104857600, total=104857600
2016-05-18 01:57:21,884 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(189)) - Pre allocating rest of memory buffers upfront
2016-05-18 01:57:21,884 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(207)) - Setting up PipelinedSorter for B926720A3F4B4C6EA86FB90B081E66DF: , UsingHashComparator=false#blocks=1, maxMemUsage=104857600, lazyAllocateMem=false, minBlockSize=2097152000, initial BLOCK_SIZE=104857600, finalMergeEnabled=true, pipelinedShuffle=false, sendEmptyPartitions=true, tez.runtime.io.sort.mb=100
2016-05-18 01:57:21,884 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(882)) - B926720A3F4B4C6EA86FB90B081E66DF: reserved.remaining()=104857600, reserved.metasize=16777216
2016-05-18 01:57:21,885 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:21,885 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: CB7EC7D5462A4919BDF7588CD2651AD2, all 1 inputs ready in: 00:00:00.000
2016-05-18 01:57:21,888 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536641639_0001_1_00_000000_0
2016-05-18 01:57:21,888 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: CB7EC7D5462A4919BDF7588CD2651AD2, mem on close (mb), free: 155, total: 372, max: 672
2016-05-18 01:57:21,888 INFO  impl.PipelinedSorter (PipelinedSorter.java:flush(629)) - B926720A3F4B4C6EA86FB90B081E66DF: Starting flush of map output
2016-05-18 01:57:21,890 INFO  impl.PipelinedSorter (PipelinedSorter.java:end(995)) - B926720A3F4B4C6EA86FB90B081E66DF: Span0.length = 7, perItem = 99
2016-05-18 01:57:21,891 INFO  impl.PipelinedSorter (PipelinedSorter.java:sort(904)) - B926720A3F4B4C6EA86FB90B081E66DF: done sorting span=0, length=7, time=0
2016-05-18 01:57:21,891 INFO  impl.PipelinedSorter (PipelinedSorter.java:ready(1297)) - B926720A3F4B4C6EA86FB90B081E66DF: Heap = SpanIterator<0:6> (span=Span[16777216,693]),
2016-05-18 01:57:21,893 INFO  impl.PipelinedSorter (PipelinedSorter.java:spill(546)) - B926720A3F4B4C6EA86FB90B081E66DF: Spilling to /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/9616DB197BDE40C98523CB028C8901F8/A8AD2E424EB244DF9754090E962F717F/.tez/application_1463536641639_0001_wd/localmode-local-dir/output/attempt_1463536641639_0001_1_00_000000_0_10051_0/file.out
2016-05-18 01:57:21,898 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:21 Completed running task attempt: attempt_1463536641639_0001_1_00_000000_0
2016-05-18 01:57:21,899 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536641639_0001_1_00_000000_0, askedToStop=false
2016-05-18 01:57:21,899 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536641639_0001_1_00_000000_0, stopRequested=false
2016-05-18 01:57:21,900 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536641639_0001_1_00_000000_0: Counters: 18 [[org.apache.tez.common.counters.TaskCounter SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1][cascading.flow.SliceCounters Process_Begin_Time=1463536641886, Process_Duration=2, Process_End_Time=1463536641888, Read_Duration=0, Tuples_Read=10, Tuples_Written=7, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=10]]
2016-05-18 01:57:21,901 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536641639_0001_1_00_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:21,901 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:21,901 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=CB7EC7D5462A4919BDF7588CD2651AD2, taskAttemptId=attempt_1463536641639_0001_1_00_000000_0, creationTime=1463536641835, allocationTime=1463536641839, startTime=1463536641842, finishTime=1463536641901, timeTaken=59, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:21,901 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:21,902 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:21,902 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536641639_0001_1_00_000000_0
2016-05-18 01:57:21,902 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:TASK_FINISHED]: vertexName=CB7EC7D5462A4919BDF7588CD2651AD2, taskId=task_1463536641639_0001_1_00_000000, startTime=1463536641842, finishTime=1463536641902, timeTaken=60, status=SUCCEEDED, successfulAttemptID=attempt_1463536641639_0001_1_00_000000_0, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536641886, Process_Duration=2, Process_End_Time=1463536641888, Read_Duration=0, Tuples_Read=10, Tuples_Written=7, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10
2016-05-18 01:57:21,903 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:21,903 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2]
2016-05-18 01:57:21,905 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:VERTEX_FINISHED]: vertexName=CB7EC7D5462A4919BDF7588CD2651AD2, vertexId=vertex_1463536641639_0001_1_00, initRequestedTime=1463536641817, initedTime=1463536641831, startRequestedTime=1463536641818, startedTime=1463536641832, finishTime=1463536641903, timeTaken=71, status=SUCCEEDED, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536641886, Process_Duration=2, Process_End_Time=1463536641888, Read_Duration=0, Tuples_Read=10, Tuples_Written=7, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10, vertexStats=firstTaskStartTime=1463536641842, firstTasksToStart=[ task_1463536641639_0001_1_00_000000 ], lastTaskFinishTime=1463536641901, lastTasksToFinish=[ task_1463536641639_0001_1_00_000000 ], minTaskDuration=59, maxTaskDuration=59, avgTaskDuration=59.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536641639_0001_1_00_000000 ], longestDurationTasks=[ task_1463536641639_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:21,906 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:21,906 INFO  impl.VertexImpl (VertexImpl.java:transition(3279)) - Source task attempt completed for vertex: vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF] attempt: attempt_1463536641639_0001_1_00_000000_0 with state: SUCCEEDED vertexState: RUNNING
2016-05-18 01:57:21,907 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:schedulePendingTasks(920)) - All source tasks assigned. Ramping up 1 remaining tasks for vertex: B926720A3F4B4C6EA86FB90B081E66DF
2016-05-18 01:57:21,907 INFO  impl.Edge (Edge.java:routingToBegin(232)) - Routing to begin for edge: EdgeInfo: sourceVertexName=CB7EC7D5462A4919BDF7588CD2651AD2, destinationVertexName=B926720A3F4B4C6EA86FB90B081E66DF. EdgeProperty: { SCATTER_GATHER : org.apache.tez.runtime.library.input.OrderedGroupedKVInput >> PERSISTED >> org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput >> NullEdgeManager } onDemandRouting: true
2016-05-18 01:57:21,907 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF]
2016-05-18 01:57:21,908 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536641639_0001_00_000001, stoppedTime=1463536641908, exitStatus=0
2016-05-18 01:57:21,908 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:21,908 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:21,909 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:TASK_STARTED]: vertexName=B926720A3F4B4C6EA86FB90B081E66DF, taskId=task_1463536641639_0001_1_01_000000, scheduledTime=1463536641908, launchTime=1463536641908
2016-05-18 01:57:21,910 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(262)) - Ignoring stop request for containerId container_1463536641639_0001_00_000001. Relying on regular task shutdown for it to end
2016-05-18 01:57:21,910 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536641639_0001_00_000001
2016-05-18 01:57:21,910 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536641639_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-18 01:57:21,910 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536641639_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:21,910 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF]
2016-05-18 01:57:21,911 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536641639_0001_00_000001, Exiting
2016-05-18 01:57:21,911 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536641639_0001_00_000001
2016-05-18 01:57:21,911 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536641639_0001_00_000001
2016-05-18 01:57:21,913 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536641639_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:21,913 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536641639_0001_00_000001 completed successfully
2016-05-18 01:57:21,914 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536641639_0001_00_000002, launchTime=1463536641914
2016-05-18 01:57:21,915 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536641639_0001_00_000002
2016-05-18 01:57:21,916 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536641639_0001_00_000002: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536641639_0001_1_01_000000_0
2016-05-18 01:57:21,916 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536641639_0001_1_01_000000_0] started. Is using containerId: [container_1463536641639_0001_00_000002] on NM: [127.0.0.1:0]
2016-05-18 01:57:21,916 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B926720A3F4B4C6EA86FB90B081E66DF, taskAttemptId=attempt_1463536641639_0001_1_01_000000_0, startTime=1463536641916, containerId=container_1463536641639_0001_00_000002, nodeId=127.0.0.1:0
2016-05-18 01:57:21 Starting to run new task attempt: attempt_1463536641639_0001_1_01_000000_0
2016-05-18 01:57:21,916 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536641639_0001_1_01_000000_0
2016-05-18 01:57:21,916 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:21,917 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:21,917 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [9616DB197BDE40C98523CB028C8901F8/A8AD2E424EB244DF9754090E962F717F] test/(1/1) ...sRemoval/group/NONE/VALID, VertexName: B926720A3F4B4C6EA86FB90B081E66DF, VertexParallelism: 1, TaskAttemptID:attempt_1463536641639_0001_1_01_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=CB7EC7D5462A4919BDF7588CD2651AD2, physicalEdgeCount=1, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=33FD110E97944420BA673CFB1E67BEF9, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-18 01:57:21,917 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:21,918 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536641639_0001_1_01_000000_0
2016-05-18 01:57:21,918 INFO  impl.VertexImpl (VertexImpl.java:getTaskAttemptTezEvents(3662)) - Sending attempt_1463536641639_0001_1_01_000000_0 1 events [0,1) total 1 vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF]
2016-05-18 01:57:21,919 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536641639_0001_1_01_000000_0, eventCount=1 fromEventId=0 nextFromEventId=1
2016-05-18 01:57:21,921 INFO  orderedgrouped.MergeManager (MergeManager.java:getInitialMemoryRequirement(339)) - Initial Memory required for SHUFFLE_BUFFER=211392912 based on INPUT_BUFFER_FACTOR=0.9,  for final merged output=0, using factor: 0.0
2016-05-18 01:57:21,925 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:21,931 INFO  app.DAGAppMaster (DAGAppMaster.java:run(946)) - Calling stop for all the services
2016-05-18 01:57:21,931 INFO  app.DAGAppMaster (DAGAppMaster.java:run(957)) - Exiting DAGAppMaster..GoodBye!
2016-05-18 01:57:21,934 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B926720A3F4B4C6EA86FB90B081E66DF, ordinal: 1
2016-05-18 01:57:21,934 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B926720A3F4B4C6EA86FB90B081E66DF, mem on start (mb), free: 149, total: 372, max: 672
2016-05-18 01:57:21,935 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:21,935 INFO  output.MROutput (MROutput.java:initialize(421)) - 33FD110E97944420BA673CFB1E67BEF9: outputFormat=org.apache.hadoop.mapred.TextOutputFormat, using newmapreduce API=false
2016-05-18 01:57:21,935 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:21,936 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:21,936 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:21,936 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[33FD110E97944420BA673CFB1E67BEF9:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput], [CB7EC7D5462A4919BDF7588CD2651AD2:INPUT:211392912:org.apache.tez.runtime.library.input.OrderedGroupedKVInput]
2016-05-18 01:57:21,937 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:21,937 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:21,937 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 211392912, TotalRequestedScaled: 1.9513191876923078E8, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.30
2016-05-18 01:57:21,938 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[33FD110E97944420BA673CFB1E67BEF9:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0], [CB7EC7D5462A4919BDF7588CD2651AD2:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:211392912:211392912]
2016-05-18 01:57:21,938 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:21,938 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: CB7EC7D5462A4919BDF7588CD2651AD2 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:21,939 INFO  orderedgrouped.Shuffle (Shuffle.java:<init>(147)) - CB7EC7D5462A4919BDF7588CD2651AD2: Shuffle assigned with 1 inputs, codec: None, ifileReadAhead: true
2016-05-18 01:57:21,939 INFO  orderedgrouped.MergeManager (MergeManager.java:<init>(273)) - CB7EC7D5462A4919BDF7588CD2651AD2: MergerManager: memoryLimit=211392912, maxSingleShuffleLimit=52848228, mergeThreshold=190253616, ioSortFactor=100, postMergeMem=0, memToMemMergeOutputsThreshold=100
2016-05-18 01:57:21,939 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:21,939 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:21,940 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:<init>(353)) - ShuffleScheduler running for sourceVertex: CB7EC7D5462A4919BDF7588CD2651AD2 with configuration: maxFetchFailuresBeforeReporting=5, reportReadErrorImmediately=true, maxFailedUniqueFetches=1, abortFailureLimit=15, maxTaskOutputAtOnce=20, numFetchers=1, hostFailureFraction=0.2, minFailurePerHost=4, maxAllowedFailedFetchFraction=0.5, maxStallTimeFraction=0.5, minReqProgressFraction=0.5, checkFailedFetchSinceLastCompletion=true
2016-05-18 01:57:21,941 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: CB7EC7D5462A4919BDF7588CD2651AD2
2016-05-18 01:57:21,942 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:21,942 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536641639_0001_1_01_000000_0
2016-05-18 01:57:21,944 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - CB7EC7D5462A4919BDF7588CD2651AD2: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0
2016-05-18 01:57:21,945 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: GroupBy(test)[by:[{1}:'method']]
2016-05-18 01:57:21,946 INFO  orderedgrouped.ShuffleScheduler (ShuffleUtils.java:logIndividualFetchComplete(489)) - Completed fetch for attempt: {0, 0, attempt_1463536641639_0001_1_00_000000_0_10051} to DISK_DIRECT, csize=653, dsize=649, EndTime=1463536641946, TimeTaken=1, Rate=0.62 MB/s
2016-05-18 01:57:21,946 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:copySucceeded(551)) - All inputs fetched for input vertex : CB7EC7D5462A4919BDF7588CD2651AD2
2016-05-18 01:57:21,946 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: GroupBy(test)[by:[{1}:'method']] streamed: true, id: B90E9E9BCF5B4B688CC7DC1ECA876132
2016-05-18 01:57:21,946 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:21,946 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/NONE/VALID"], id: 33FD110E97944420BA673CFB1E67BEF9
2016-05-18 01:57:21,946 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:callInternal(1289)) - Shutting down FetchScheduler for input: CB7EC7D5462A4919BDF7588CD2651AD2, wasInterrupted=false
2016-05-18 01:57:21,947 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/NONE/VALID"]
2016-05-18 01:57:21,947 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:21,947 INFO  element.TezGroupGate (TezGroupGate.java:prepare(90)) - calling OrderedGroupedKVInput#start() on: GroupBy(test)[by:[{1}:'method']] B90E9E9BCF5B4B688CC7DC1ECA876132, for 1 inputs
2016-05-18 01:57:21,947 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1005)) - finalMerge called with 0 in-memory map-outputs and 1 on-disk map-outputs
2016-05-18 01:57:21,948 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1103)) - Disk file=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/9616DB197BDE40C98523CB028C8901F8/A8AD2E424EB244DF9754090E962F717F/.tez/application_1463536641639_0001_wd/localmode-local-dir/output/attempt_1463536641639_0001_1_00_000000_0_10051/file.out, len=653, isLocal=true
2016-05-18 01:57:21,948 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1115)) - Merging 1 files, 653 bytes from disk
2016-05-18 01:57:21,948 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1130)) - Merging 0 segments, 0 bytes from memory into reduce
2016-05-18 01:57:21,948 INFO  impl.TezMerger (TezMerger.java:merge(644)) - Merging 1 sorted segments
2016-05-18 01:57:21,949 INFO  impl.TezMerger (TezMerger.java:merge(749)) - Down to the last merge-pass, with 1 segments left of total size: 633 bytes
2016-05-18 01:57:21,949 INFO  orderedgrouped.Shuffle (Shuffle.java:callInternal(332)) - merge complete for input vertex : CB7EC7D5462A4919BDF7588CD2651AD2
2016-05-18 01:57:21,949 INFO  orderedgrouped.Shuffle (Shuffle.java:onSuccess(417)) - CB7EC7D5462A4919BDF7588CD2651AD2: Shuffle Runner thread complete
2016-05-18 01:57:21,949 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B926720A3F4B4C6EA86FB90B081E66DF, all 1 inputs ready in: 00:00:00.001
2016-05-18 01:57:21,949 INFO  input.OrderedGroupedKVInput (OrderedGroupedKVInput.java:createValuesIterator(292)) - CB7EC7D5462A4919BDF7588CD2651AD2: creating ValuesIterator with comparator=cascading.tuple.hadoop.util.TupleComparator, keyClass=cascading.tuple.io.KeyTuple, valClass=cascading.tuple.io.ValueTuple
2016-05-18 01:57:21,952 INFO  output.MROutput (MROutput.java:close(526)) - 33FD110E97944420BA673CFB1E67BEF9 closed
2016-05-18 01:57:21,952 INFO  impl.TaskImpl (TaskImpl.java:canCommit(671)) - attempt_1463536641639_0001_1_01_000000_0 given a go for committing the task output.
2016-05-18 01:57:21,953 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536641639_0001_1_01_000000_0
2016-05-18 01:57:21,953 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B926720A3F4B4C6EA86FB90B081E66DF, mem on close (mb), free: 144, total: 372, max: 672
2016-05-18 01:57:21,955 INFO  orderedgrouped.Shuffle (Shuffle.java:shutdown(278)) - Shutting down Shuffle for source: CB7EC7D5462A4919BDF7588CD2651AD2
2016-05-18 01:57:21,955 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - CB7EC7D5462A4919BDF7588CD2651AD2: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0, updateOnClose
2016-05-18 01:57:21,956 INFO  output.MROutput (MROutput.java:close(526)) - 33FD110E97944420BA673CFB1E67BEF9 closed
2016-05-18 01:57:21,956 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:21 Completed running task attempt: attempt_1463536641639_0001_1_01_000000_0
2016-05-18 01:57:21,957 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536641639_0001_1_01_000000_0, askedToStop=false
2016-05-18 01:57:21,957 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536641639_0001_1_01_000000_0, stopRequested=false
2016-05-18 01:57:21,958 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536641639_0001_1_01_000000_0: Counters: 36 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=8, MERGE_PHASE_TIME=10, FIRST_EVENT_RECEIVED=5, LAST_EVENT_RECEIVED=5][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][cascading.flow.SliceCounters Process_Begin_Time=1463536641949, Process_Duration=4, Process_End_Time=1463536641953, Read_Duration=1, Tuples_Read=7, Tuples_Written=1, Write_Duration=0][cascading.flow.StepCounters Tuples_Written=1]]
2016-05-18 01:57:21,959 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536641639_0001_1_01_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:21,959 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:21,959 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B926720A3F4B4C6EA86FB90B081E66DF, taskAttemptId=attempt_1463536641639_0001_1_01_000000_0, creationTime=1463536641909, allocationTime=1463536641912, startTime=1463536641916, finishTime=1463536641959, timeTaken=43, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:21,960 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536641639_0001_1_01_000000_0
2016-05-18 01:57:21,960 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:21,960 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:21,960 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536641639_0001_00_000002
2016-05-18 01:57:21,961 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:TASK_FINISHED]: vertexName=B926720A3F4B4C6EA86FB90B081E66DF, taskId=task_1463536641639_0001_1_01_000000, startTime=1463536641916, finishTime=1463536641960, timeTaken=44, status=SUCCEEDED, successfulAttemptID=attempt_1463536641639_0001_1_01_000000_0, diagnostics=, counters=Counters: 36, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=8, MERGE_PHASE_TIME=10, FIRST_EVENT_RECEIVED=5, LAST_EVENT_RECEIVED=5, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536641949, Process_Duration=4, Process_End_Time=1463536641953, Read_Duration=1, Tuples_Read=7, Tuples_Written=1, Write_Duration=0, cascading.flow.StepCounters, Tuples_Written=1
2016-05-18 01:57:21,961 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:21,961 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF]
2016-05-18 01:57:21,962 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:VERTEX_FINISHED]: vertexName=B926720A3F4B4C6EA86FB90B081E66DF, vertexId=vertex_1463536641639_0001_1_01, initRequestedTime=1463536641818, initedTime=1463536641824, startRequestedTime=1463536641833, startedTime=1463536641834, finishTime=1463536641961, timeTaken=127, status=SUCCEEDED, diagnostics=, counters=Counters: 36, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=8, MERGE_PHASE_TIME=10, FIRST_EVENT_RECEIVED=5, LAST_EVENT_RECEIVED=5, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536641949, Process_Duration=4, Process_End_Time=1463536641953, Read_Duration=1, Tuples_Read=7, Tuples_Written=1, Write_Duration=0, cascading.flow.StepCounters, Tuples_Written=1, vertexStats=firstTaskStartTime=1463536641916, firstTasksToStart=[ task_1463536641639_0001_1_01_000000 ], lastTaskFinishTime=1463536641959, lastTasksToFinish=[ task_1463536641639_0001_1_01_000000 ], minTaskDuration=43, maxTaskDuration=43, avgTaskDuration=43.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536641639_0001_1_01_000000 ], longestDurationTasks=[ task_1463536641639_0001_1_01_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:21,963 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:21,963 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536641639_0001_00_000002, stoppedTime=1463536641963, exitStatus=0
2016-05-18 01:57:21,963 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF] completed., numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:21,963 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:21,963 INFO  impl.DAGImpl (DAGImpl.java:commitOrFinish(1051)) - No output committers for vertex: vertex_1463536641639_0001_1_00 [CB7EC7D5462A4919BDF7588CD2651AD2]
2016-05-18 01:57:21,964 INFO  impl.DAGImpl (DAGImpl.java:commitOrFinish(1098)) - Start writing dag commit event, dag_1463536641639_0001_1
2016-05-18 01:57:21,964 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463536641639_0001_1
2016-05-18 01:57:21,964 INFO  impl.DAGImpl (DAGImpl.java:call(1083)) - Committing output: 33FD110E97944420BA673CFB1E67BEF9 for vertex: vertex_1463536641639_0001_1_01 [B926720A3F4B4C6EA86FB90B081E66DF], outputName: 33FD110E97944420BA673CFB1E67BEF9
2016-05-18 01:57:21,966 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536641639_0001_1 transitioned from RUNNING to COMMITTING due to event DAG_VERTEX_COMPLETED
2016-05-18 01:57:21,967 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(262)) - Ignoring stop request for containerId container_1463536641639_0001_00_000002. Relying on regular task shutdown for it to end
2016-05-18 01:57:21,973 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536641639_0001_00_000002 is valid, but no longer registered, and will be killed
2016-05-18 01:57:21,973 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536641639_0001_00_000002: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:21,973 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536641639_0001_00_000002, Exiting
2016-05-18 01:57:21,973 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536641639_0001_00_000002
2016-05-18 01:57:21,973 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536641639_0001_00_000002
2016-05-18 01:57:21,974 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536641639_0001_00_000002 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:21,974 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536641639_0001_00_000002 completed successfully
2016-05-18 01:57:21,974 INFO  impl.DAGImpl (DAGImpl.java:commitCompleted(2192)) - Commit succeeded for output:outputName:33FD110E97944420BA673CFB1E67BEF9 of vertex/vertexGroup:B926720A3F4B4C6EA86FB90B081E66DF isVertexGroupOutput:false
2016-05-18 01:57:21,974 INFO  impl.DAGImpl (DAGImpl.java:checkCommitsForCompletion(1313)) - Checking commits for DAG completion, numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:21,976 INFO  recovery.RecoveryService (RecoveryService.java:handle(327)) - DAG completed, dagId=dag_1463536641639_0001_1, queueSize=0
2016-05-18 01:57:21,977 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536641639_0001_1][Event:DAG_FINISHED]: dagId=dag_1463536641639_0001_1, startTime=1463536641816, finishTime=1463536641974, timeTaken=158, status=SUCCEEDED, diagnostics=, counters=Counters: 48, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=2, TOTAL_LAUNCHED_TASKS=2, RACK_LOCAL_TASKS=1, AM_CPU_MILLISECONDS=310, AM_GC_TIME_MILLIS=0, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=14, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=8, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=8, MERGE_PHASE_TIME=10, FIRST_EVENT_RECEIVED=5, LAST_EVENT_RECEIVED=5, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=2927073283835, Process_Duration=6, Process_End_Time=2927073283841, Read_Duration=1, Tuples_Read=17, Tuples_Written=8, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10, Tuples_Written=1
2016-05-18 01:57:21,977 INFO  impl.DAGImpl (DAGImpl.java:finished(1405)) - DAG: dag_1463536641639_0001_1 finished with state: SUCCEEDED
2016-05-18 01:57:21,977 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536641639_0001_1 transitioned from COMMITTING to SUCCEEDED due to event DAG_COMMIT_COMPLETED
2016-05-18 01:57:21 Completed Dag: dag_1463536641639_0001_1
2016-05-18 01:57:21,978 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(751)) - DAG completed, dagId=dag_1463536641639_0001_1, dagState=SUCCEEDED
2016-05-18 01:57:21,978 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536641639_0001_1_post
2016-05-18 01:57:21,978 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:21,978 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(800)) - Central Dispatcher queue size after DAG completion, before cleanup: 0
2016-05-18 01:57:21,978 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(802)) - Waiting for next DAG to be submitted.
2016-05-18 01:57:21,978 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(842)) - Cleaning up DAG: name=[9616DB197BDE40C98523CB028C8901F8/A8AD2E424EB244DF9754090E962F717F] test/(1/1) ...sRemoval/group/NONE/VALID, with id=dag_1463536641639_0001_1
2016-05-18 01:57:21,978 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(852)) - Completed cleanup for DAG: name=[9616DB197BDE40C98523CB028C8901F8/A8AD2E424EB244DF9754090E962F717F] test/(1/1) ...sRemoval/group/NONE/VALID, with id=dag_1463536641639_0001_1
2016-05-18 01:57:21,984 INFO  client.TezClient (TezClient.java:stop(566)) - Shutting down Tez Session, sessionName=(1/1) ...sRemoval/group/NONE/VALID, applicationId=application_1463536641639_0001
2016-05-18 01:57:21,991 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(124)) - Received message to shutdown AM
2016-05-18 01:57:21,991 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:setShouldUnregisterFlag(895)) - TaskScheduler notified that it should unregister from RM
2016-05-18 01:57:21,991 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1301)) - No current running DAG, shutting down the AM
2016-05-18 01:57:21,991 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(907)) - DAGAppMasterShutdownHandler invoked
2016-05-18 01:57:21,991 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(916)) - Handling DAGAppMaster shutdown
2016-05-18 01:57:21,992 INFO  app.DAGAppMaster (DAGAppMaster.java:run(936)) - Sleeping for 5 seconds before shutting down
2016-05-18 01:57:21,992 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(84)) - Stopping HistoryEventHandler
2016-05-18 01:57:21,993 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(196)) - Stopping RecoveryService
2016-05-18 01:57:21,993 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(199)) - Handle the remaining events in queue, queue size=0
2016-05-18 01:57:21,993 INFO  recovery.RecoveryService (RecoveryService.java:run(173)) - EventQueue take interrupted. Returning
2016-05-18 01:57:21,993 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(221)) - Closing Summary Stream
2016-05-18 01:57:21,993 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-18 01:57:21,994 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-18 01:57:21,994 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:serviceStop(678)) - Shutting down AppCallbackExecutor
2016-05-18 01:57:21,997 INFO  app.DAGAppMaster (DAGAppMaster.java:run(2084)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/9616DB197BDE40C98523CB028C8901F8/A8AD2E424EB244DF9754090E962F717F/.tez/application_1463536641639_0001
2016-05-18 01:57:21,997 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/NONE/VALID/_temporary
2016-05-18 01:57:21,998 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  completed in: 00:00.378
2016-05-18 01:57:22,075 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 01:57:22,075 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-18 01:57:22,126 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-05-18 01:57:22,136 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.032
2016-05-18 01:57:22,137 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:22,137 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:22,137 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 01:57:22,156 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt
2016-05-18 01:57:22,164 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/VALID/VALID
2016-05-18 01:57:22,220 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting
2016-05-18 01:57:22,220 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:22,221 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  sink: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/VALID/VALID"]
2016-05-18 01:57:22,221 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  parallel execution of steps is enabled: false
2016-05-18 01:57:22,221 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  executing total steps: 1
2016-05-18 01:57:22,221 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  allocating management threads: 1
2016-05-18 01:57:22,222 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting step: (1/1) ...Removal/group/VALID/VALID
2016-05-18 01:57:22,222 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [test] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-18 01:57:22,237 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tez session mode enabled: true
2016-05-18 01:57:22,241 INFO  client.TezClient (TezClient.java:<init>(174)) - Tez Client Version: [ component=tez-api, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:22,242 INFO  client.TezClient (TezClient.java:start(394)) - Session mode. Starting session.
2016-05-18 01:57:22,242 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(164)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-18 01:57:22,250 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(122)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/EAFC07B9A78D41229BA801DFFCD03340/CA290C35F8954C349D952C362BD97A16/.tez/application_1463536642242_0001 doesn't exist and is created
2016-05-18 01:57:22,271 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(332)) - DAGAppMaster thread has been created
2016-05-18 01:57:22,272 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-18 01:57:22,273 INFO  client.LocalClient (LocalClient.java:run(282)) - Using working directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/EAFC07B9A78D41229BA801DFFCD03340/CA290C35F8954C349D952C362BD97A16/.tez/application_1463536642242_0001_wd
2016-05-18 01:57:22,287 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(363)) - Created DAGAppMaster for application appattempt_1463536642242_0001_000000, versionInfo=[ component=tez-dag, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:22,288 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(80)) - Trying to locate HadoopShimProvider for hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:22,288 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(139)) - Picked HadoopShim org.apache.tez.hadoop.shim.DefaultHadoopShim, providerName=null, overrideProviderViaConfig=null, hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:22,289 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(436)) - AM Level configured TaskSchedulers: [0:TezUber:null]
2016-05-18 01:57:22,289 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(437)) - AM Level configured ContainerLaunchers: [0:TezUber:null]
2016-05-18 01:57:22,289 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(438)) - AM Level configured TaskCommunicators: [0:TezUber:null]
2016-05-18 01:57:22,290 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(447)) - Comparing client version with AM version, clientVersion=0.8.2, AMVersion=0.8.2
2016-05-18 01:57:22,290 INFO  app.TaskCommunicatorManager (TaskCommunicatorManager.java:createUberTaskCommunicator(192)) - Creating Default Local Task Communicator
2016-05-18 01:57:22,292 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.container.AMContainerEventType for class org.apache.tez.dag.app.rm.container.AMContainerMap
2016-05-18 01:57:22,292 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.node.AMNodeEventType for class org.apache.tez.dag.app.rm.node.AMNodeTracker
2016-05-18 01:57:22,292 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGAppMasterEventType for class org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterEventHandler
2016-05-18 01:57:22,292 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGEventType for class org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher
2016-05-18 01:57:22,292 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.VertexEventType for class org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher
2016-05-18 01:57:22,293 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(529)) - Using concurrent dispatcher: false
2016-05-18 01:57:22,293 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher
2016-05-18 01:57:22,293 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskAttemptEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher
2016-05-18 01:57:22,293 INFO  common.AsyncDispatcher (AsyncDispatcher.java:registerAndCreateDispatcher(262)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for independent dispatch using: class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:22,293 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:22,293 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.AMSchedulerEventType for class org.apache.tez.dag.app.rm.TaskSchedulerManager
2016-05-18 01:57:22,293 INFO  launcher.TezContainerLauncherImpl (ContainerLauncherManager.java:createUberContainerLauncher(134)) - Creating LocalContainerLauncher
2016-05-18 01:57:22,295 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.ContainerLauncherEventType for class org.apache.tez.dag.app.launcher.ContainerLauncherManager
2016-05-18 01:57:22,295 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(78)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1, nodeUpdatesRescheduleEnabled: false
2016-05-18 01:57:22,295 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(57)) - Initializing HistoryEventHandler withrecoveryEnabled=true, historyServiceClassName=org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService
2016-05-18 01:57:22,296 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/EAFC07B9A78D41229BA801DFFCD03340/CA290C35F8954C349D952C362BD97A16/.tez/application_1463536642242_0001_wd/localmode-log-dir
2016-05-18 01:57:22,296 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/EAFC07B9A78D41229BA801DFFCD03340/CA290C35F8954C349D952C362BD97A16/.tez/application_1463536642242_0001_wd/localmode-log-dir/history.txt.appattempt_1463536642242_0001_000000, maxErrors=10
2016-05-18 01:57:22,298 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(124)) - RecoveryService initialized with recoveryPath=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/EAFC07B9A78D41229BA801DFFCD03340/CA290C35F8954C349D952C362BD97A16/.tez/application_1463536642242_0001/recovery/0, bufferSize(bytes)=8192, flushInterval(s)=30, maxUnflushedEvents=100
2016-05-18 01:57:22,298 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463536642242_0001_000000, appSubmitTime=1463536642287, launchTime=1463536642287
2016-05-18 01:57:22,307 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-18 01:57:22,311 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:46366
2016-05-18 01:57:22,313 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:createUberTaskScheduler(557)) - Creating TaskScheduler: Local TaskScheduler with clusterIdentifier=1463536642242
2016-05-18 01:57:22,318 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463536642242_0001_000000, startTime=1463536642318
2016-05-18 01:57:22,318 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1945)) - In Session mode. Waiting for DAG over RPC
2016-05-18 01:57:22,372 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-18 01:57:22,372 INFO  client.TezClient (TezClient.java:start(428)) - The url to track the Tez Session: N/A
2016-05-18 01:57:22,372 INFO  client.TezClient (TezClient.java:submitDAGSession(470)) - Submitting dag to TezSession, sessionName=(1/1) ...Removal/group/VALID/VALID, applicationId=application_1463536642242_0001, dagName=[EAFC07B9A78D41229BA801DFFCD03340/CA290C35F8954C349D952C362BD97A16] test/(1/1) ...Removal/group/VALID/VALID
2016-05-18 01:57:22,393 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1351)) - Starting DAG submitted via RPC: [EAFC07B9A78D41229BA801DFFCD03340/CA290C35F8954C349D952C362BD97A16] test/(1/1) ...Removal/group/VALID/VALID
2016-05-18 01:57:22,393 INFO  app.DAGAppMaster (DAGAppMaster.java:createDAG(985)) - Merging AM credentials into DAG credentials
2016-05-18 01:57:22,394 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(1076)) - Generating DAG graphviz file, dagId=dag_1463536642242_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/EAFC07B9A78D41229BA801DFFCD03340/CA290C35F8954C349D952C362BD97A16/.tez/application_1463536642242_0001_wd/localmode-log-dir/dag_1463536642242_0001_1.dot
2016-05-18 01:57:22,395 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(1093)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/EAFC07B9A78D41229BA801DFFCD03340/CA290C35F8954C349D952C362BD97A16/.tez/application_1463536642242_0001_wd/localmode-log-dir/dag_1463536642242_0001_1-tez-dag.pb.txt
2016-05-18 01:57:22,402 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536642242_0001_1
2016-05-18 01:57:22,402 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:22,402 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2399)) - Running DAG: [EAFC07B9A78D41229BA801DFFCD03340/CA290C35F8954C349D952C362BD97A16] test/(1/1) ...Removal/group/VALID/VALID
2016-05-18 01:57:22 Running Dag: dag_1463536642242_0001_1
2016-05-18 01:57:22,418 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463536642242_0001_1, submitTime=1463536642393
2016-05-18 01:57:22,419 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/EAFC07B9A78D41229BA801DFFCD03340/CA290C35F8954C349D952C362BD97A16/.tez/application_1463536642242_0001/tez-conf.pb" } size: 40985 timestamp: 1463536642000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:22,419 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalInputs(3978)) - Setting 1 additional inputs for vertexvertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0]
2016-05-18 01:57:22,419 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:22,421 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/EAFC07B9A78D41229BA801DFFCD03340/CA290C35F8954C349D952C362BD97A16/.tez/application_1463536642242_0001/tez-conf.pb" } size: 40985 timestamp: 1463536642000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:22,421 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4023)) - Setting 1 additional outputs for vertex vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188]
2016-05-18 01:57:22,422 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:22,422 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1593)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-18 01:57:22,422 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463536642242_0001_1, initTime=1463536642422
2016-05-18 01:57:22,423 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536642242_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-18 01:57:22,423 INFO  impl.DAGImpl (DAGImpl.java:transition(1768)) - Added additional resources : [[]] to classpath
2016-05-18 01:57:22,423 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:DAG_STARTED]: dagID=dag_1463536642242_0001_1, startTime=1463536642423
2016-05-18 01:57:22,423 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536642242_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-18 01:57:22,423 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2400)) - Root Inputs exist for Vertex: B5C2138E522440BBBEBE9223EB3EB3C0 : {C31C6FFC674B41CC94D2E8B17D859569={InputName=C31C6FFC674B41CC94D2E8B17D859569}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-18 01:57:22,423 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2410)) - Starting root input initializer for input: C31C6FFC674B41CC94D2E8B17D859569, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-18 01:57:22,424 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2550)) - Setting vertexManager to RootInputVertexManager for vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0]
2016-05-18 01:57:22,424 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2721)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0]
2016-05-18 01:57:22,424 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2726)) - Vertex will initialize from input initializer. vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0]
2016-05-18 01:57:22,424 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3893)) - Starting 1 inputInitializers for vertex vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0]
2016-05-18 01:57:22,425 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-18 01:57:22,425 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2562)) - Setting vertexManager to ShuffleVertexManager for vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188]
2016-05-18 01:57:22,427 INFO  client.TezClient (TezClient.java:submitDAGSession(545)) - Submitted dag to TezSession, sessionName=(1/1) ...Removal/group/VALID/VALID, applicationId=application_1463536642242_0001, dagName=[EAFC07B9A78D41229BA801DFFCD03340/CA290C35F8954C349D952C362BD97A16] test/(1/1) ...Removal/group/VALID/VALID
2016-05-18 01:57:22,428 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(272)) - Starting InputInitializer for Input: C31C6FFC674B41CC94D2E8B17D859569 on vertex vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0]
2016-05-18 01:57:22,428 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:initialize(1022)) - Shuffle Vertex Manager: settings minFrac:0.25 maxFrac:0.75 auto:false desiredTaskIput:104857600 minTasks:1
2016-05-18 01:57:22,429 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2760)) - Creating 1 tasks for vertex: vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188]
2016-05-18 01:57:22,429 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2779)) - Directly initializing vertex: vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188]
2016-05-18 01:57:22,429 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536642242_0001_1_01, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=null, edgeManagersCount=1, rootInputSpecUpdateCount=0, setParallelismCalledFlag=false
2016-05-18 01:57:22,429 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2187)) - Setting up committers for vertex vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188], numAdditionalOutputs=1
2016-05-18 01:57:22,429 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2202)) - Instantiating committer for output=5D4EC53E8239453EAB5D725B129064CE, vertex=vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-18 01:57:22,431 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(109)) - Input C31C6FFC674B41CC94D2E8B17D859569 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7, groupingEnabled: true
2016-05-18 01:57:22,432 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(121)) - Committer for F20AD324D66442D9A44EB15383822188:5D4EC53E8239453EAB5D725B129064CE using oldmapred API
2016-05-18 01:57:22,432 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(146)) - OutputCommitter for outputName=5D4EC53E8239453EAB5D725B129064CE, vertexName=F20AD324D66442D9A44EB15383822188, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-18 01:57:22,434 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F20AD324D66442D9A44EB15383822188, vertexId=vertex_1463536642242_0001_1_01, initRequestedTime=1463536642425, initedTime=1463536642429, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=0, initGeneratedEventsCount=0
2016-05-18 01:57:22,434 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188] transitioned from NEW to INITED due to event V_INIT
2016-05-18 01:57:22,434 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(168)) - Grouping splits in Tez
2016-05-18 01:57:22,435 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(226)) - Desired splits: 1 too large.  Desired splitLength: 1449 Min splitLength: 52428800 New desired splits: 1 Total length: 1449 Original splits: 2
2016-05-18 01:57:22,436 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(321)) - Desired numSplits: 1 lengthPerGroup: 1449 numLocations: 1 numSplitsPerLocation: 2 numSplitsInGroup: 2 totalLength: 1449 numOriginalSplits: 2 . Grouping by length: true count: false nodeLocalOnly: false
2016-05-18 01:57:22,436 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(539)) - Number of splits desired: 1 created: 1 splitsProcessed: 2
2016-05-18 01:57:22,436 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(308)) - Succeeded InputInitializer for Input: C31C6FFC674B41CC94D2E8B17D859569 on vertex vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0]
2016-05-18 01:57:22,437 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:22,437 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1644)) - Got updated RootInputsSpecs: {C31C6FFC674B41CC94D2E8B17D859569=forAllWorkUnits=true, update=[1]}
2016-05-18 01:57:22,438 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1664)) - Vertex vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0] parallelism set to 1
2016-05-18 01:57:22,438 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:22,438 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B5C2138E522440BBBEBE9223EB3EB3C0, vertexId=vertex_1463536642242_0001_1_00, initRequestedTime=1463536642423, initedTime=1463536642438, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1, initGeneratedEventsCount=1
2016-05-18 01:57:22,438 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0] with distanceFromRoot: 0
2016-05-18 01:57:22,438 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0] transitioned from INITIALIZING to INITED due to event V_INPUT_DATA_INFORMATION
2016-05-18 01:57:22,439 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536642242_0001_1_00, startRequestedTime=1463536642425, startedTime=1463536642439
2016-05-18 01:57:22,439 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536642242_0001_1_00, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=org.apache.tez.dag.api.VertexLocationHint@b8338fe7, edgeManagersCount=0, rootInputSpecUpdateCount=1, setParallelismCalledFlag=true
2016-05-18 01:57:22,439 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:22,439 INFO  impl.VertexImpl (VertexImpl.java:transition(2932)) - Source vertex started: vertex_1463536642242_0001_1_00 for vertex: vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188] numStartedSources: 1 numSources: 1
2016-05-18 01:57:22,439 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188] with distanceFromRoot: 1
2016-05-18 01:57:22,440 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536642242_0001_1_01, startRequestedTime=1463536642439, startedTime=1463536642440
2016-05-18 01:57:22,440 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:22,442 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:onVertexStarted(519)) - OnVertexStarted vertex: F20AD324D66442D9A44EB15383822188 with 0 source tasks and 1 pending tasks
2016-05-18 01:57:22,443 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:handleVertexStateUpdate(1051)) - Received configured notification : CONFIGURED for vertex: B5C2138E522440BBBEBE9223EB3EB3C0 in vertex: F20AD324D66442D9A44EB15383822188 numBipartiteSourceTasks: 1
2016-05-18 01:57:22,443 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(100)) - Starting 1 in B5C2138E522440BBBEBE9223EB3EB3C0
2016-05-18 01:57:22,445 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0]
2016-05-18 01:57:22,445 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:TASK_STARTED]: vertexName=B5C2138E522440BBBEBE9223EB3EB3C0, taskId=task_1463536642242_0001_1_00_000000, scheduledTime=1463536642445, launchTime=1463536642445
2016-05-18 01:57:22,446 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0]
2016-05-18 01:57:22,446 INFO  node.PerSourceNodeTracker (PerSourceNodeTracker.java:nodeSeen(74)) - Adding new node 127.0.0.1:0 to nodeTracker 0
2016-05-18 01:57:22,448 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536642242_0001_00_000001, launchTime=1463536642448
2016-05-18 01:57:22,449 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536642242_0001_00_000001
2016-05-18 01:57:22,450 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536642242_0001_1_00_000000_0] started. Is using containerId: [container_1463536642242_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-18 01:57:22,450 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B5C2138E522440BBBEBE9223EB3EB3C0, taskAttemptId=attempt_1463536642242_0001_1_00_000000_0, startTime=1463536642450, containerId=container_1463536642242_0001_00_000001, nodeId=127.0.0.1:0
2016-05-18 01:57:22,451 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536642242_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536642242_0001_1_00_000000_0
2016-05-18 01:57:22 Starting to run new task attempt: attempt_1463536642242_0001_1_00_000000_0
2016-05-18 01:57:22,451 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536642242_0001_1_00_000000_0
2016-05-18 01:57:22,451 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:22,451 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:22,452 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [EAFC07B9A78D41229BA801DFFCD03340/CA290C35F8954C349D952C362BD97A16] test/(1/1) ...Removal/group/VALID/VALID, VertexName: B5C2138E522440BBBEBE9223EB3EB3C0, VertexParallelism: 1, TaskAttemptID:attempt_1463536642242_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=C31C6FFC674B41CC94D2E8B17D859569, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=F20AD324D66442D9A44EB15383822188, physicalEdgeCount=1, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ]
2016-05-18 01:57:22,452 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:22,452 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536642242_0001_1_00_000000_0
2016-05-18 01:57:22,453 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] submitted tez dag to app master: application_1463536642242_0001, with dag id: dag_1463536642242_0001_1
2016-05-18 01:57:22,460 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(496)) - TaskAttempt:attempt_1463536642242_0001_1_00_000000_0 sent events: (0-1).
2016-05-18 01:57:22,460 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536642242_0001_1_00_000000_0, eventCount=1 fromEventId=0 nextFromEventId=0
2016-05-18 01:57:22,461 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:22,462 INFO  input.MRInput (MRInput.java:initialize(440)) - C31C6FFC674B41CC94D2E8B17D859569 using newmapreduce API=false, split via event=true, numPhysicalInputs=1
2016-05-18 01:57:22,463 INFO  input.MRInput (MRInput.java:initializeInternal(494)) - Initialized MRInput: C31C6FFC674B41CC94D2E8B17D859569
2016-05-18 01:57:22,469 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B5C2138E522440BBBEBE9223EB3EB3C0, ordinal: 0
2016-05-18 01:57:22,469 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B5C2138E522440BBBEBE9223EB3EB3C0, mem on start (mb), free: 242, total: 361, max: 672
2016-05-18 01:57:22,469 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:22,469 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:22,469 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:22,470 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:22,470 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[F20AD324D66442D9A44EB15383822188:OUTPUT:104857600:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput], [C31C6FFC674B41CC94D2E8B17D859569:INPUT:0:org.apache.tez.mapreduce.input.MRInput]
2016-05-18 01:57:22,470 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:22,470 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:22,470 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 104857600, TotalRequestedScaled: 9.679163076923077E7, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.15
2016-05-18 01:57:22,470 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[F20AD324D66442D9A44EB15383822188:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput:OUTPUT:104857600:104857600], [C31C6FFC674B41CC94D2E8B17D859569:org.apache.tez.mapreduce.input.MRInput:INPUT:0:0]
2016-05-18 01:57:22,471 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:22,471 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: C31C6FFC674B41CC94D2E8B17D859569 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:22,471 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: C31C6FFC674B41CC94D2E8B17D859569
2016-05-18 01:57:22,471 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:22,471 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:22,471 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:22,471 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536642242_0001_1_00_000000_0
2016-05-18 01:57:22,474 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(174)) - Processing split: TezGroupedSplit{wrappedSplits=[file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:0+724, file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:724+725], wrappedInputFormatName='org.apache.hadoop.mapred.TextInputFormat', locations=[localhost], rack='null', length=1449}
2016-05-18 01:57:22,476 INFO  input.MRInput (MRInput.java:initFromEventInternal(653)) - C31C6FFC674B41CC94D2E8B17D859569 initialized RecordReader from event
2016-05-18 01:57:22,475 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:22,477 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"] streamed: true, id: C31C6FFC674B41CC94D2E8B17D859569
2016-05-18 01:57:22,477 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: GroupBy(test)[by:[{1}:'method']], id: 6B9786A9B0594C21924B1F54166CFD45
2016-05-18 01:57:22,477 INFO  element.TezGroupGate (TezGroupGate.java:prepare(98)) - calling OrderedPartitionedKVOutput#start() on: GroupBy(test)[by:[{1}:'method']] 6B9786A9B0594C21924B1F54166CFD45
2016-05-18 01:57:22,478 INFO  impl.ExternalSorter (ExternalSorter.java:<init>(199)) - F20AD324D66442D9A44EB15383822188 using: memoryMb=100, keySerializerClass=class cascading.tuple.io.KeyTuple, valueSerializerClass=cascading.tuple.hadoop.io.ValueTupleSerializer@5b1e3bc, comparator=cascading.tuple.hadoop.util.TupleComparator@61de4e8f, partitioner=cascading.tuple.tez.util.TuplePartitioner, serialization=cascading.tuple.hadoop.TupleSerialization,org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
2016-05-18 01:57:22,479 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(170)) - Setting up PipelinedSorter for F20AD324D66442D9A44EB15383822188: , UsingHashComparator=false
2016-05-18 01:57:22,491 INFO  impl.PipelinedSorter (PipelinedSorter.java:allocateSpace(245)) - Newly allocated block size=104857600, index=0, Number of buffers=1, currentAllocatableMemory=0, currentBufferSize=104857600, total=104857600
2016-05-18 01:57:22,491 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(189)) - Pre allocating rest of memory buffers upfront
2016-05-18 01:57:22,491 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(207)) - Setting up PipelinedSorter for F20AD324D66442D9A44EB15383822188: , UsingHashComparator=false#blocks=1, maxMemUsage=104857600, lazyAllocateMem=false, minBlockSize=2097152000, initial BLOCK_SIZE=104857600, finalMergeEnabled=true, pipelinedShuffle=false, sendEmptyPartitions=true, tez.runtime.io.sort.mb=100
2016-05-18 01:57:22,492 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(882)) - F20AD324D66442D9A44EB15383822188: reserved.remaining()=104857600, reserved.metasize=16777216
2016-05-18 01:57:22,492 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:22,492 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B5C2138E522440BBBEBE9223EB3EB3C0, all 1 inputs ready in: 00:00:00.000
2016-05-18 01:57:22,496 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536642242_0001_1_00_000000_0
2016-05-18 01:57:22,496 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B5C2138E522440BBBEBE9223EB3EB3C0, mem on close (mb), free: 140, total: 361, max: 672
2016-05-18 01:57:22,496 INFO  impl.PipelinedSorter (PipelinedSorter.java:flush(629)) - F20AD324D66442D9A44EB15383822188: Starting flush of map output
2016-05-18 01:57:22,496 INFO  impl.PipelinedSorter (PipelinedSorter.java:end(995)) - F20AD324D66442D9A44EB15383822188: Span0.length = 7, perItem = 99
2016-05-18 01:57:22,497 INFO  impl.PipelinedSorter (PipelinedSorter.java:sort(904)) - F20AD324D66442D9A44EB15383822188: done sorting span=0, length=7, time=1
2016-05-18 01:57:22,497 INFO  impl.PipelinedSorter (PipelinedSorter.java:ready(1297)) - F20AD324D66442D9A44EB15383822188: Heap = SpanIterator<0:6> (span=Span[16777216,693]),
2016-05-18 01:57:22,498 INFO  impl.PipelinedSorter (PipelinedSorter.java:spill(546)) - F20AD324D66442D9A44EB15383822188: Spilling to /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/EAFC07B9A78D41229BA801DFFCD03340/CA290C35F8954C349D952C362BD97A16/.tez/application_1463536642242_0001_wd/localmode-local-dir/output/attempt_1463536642242_0001_1_00_000000_0_10056_0/file.out
2016-05-18 01:57:22,501 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:22 Completed running task attempt: attempt_1463536642242_0001_1_00_000000_0
2016-05-18 01:57:22,502 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536642242_0001_1_00_000000_0, askedToStop=false
2016-05-18 01:57:22,502 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536642242_0001_1_00_000000_0, stopRequested=false
2016-05-18 01:57:22,502 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536642242_0001_1_00_000000_0: Counters: 18 [[org.apache.tez.common.counters.TaskCounter SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1][cascading.flow.SliceCounters Process_Begin_Time=1463536642492, Process_Duration=4, Process_End_Time=1463536642496, Read_Duration=2, Tuples_Read=10, Tuples_Written=7, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=10]]
2016-05-18 01:57:22,505 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536642242_0001_1_00_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:22,505 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:22,505 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:22,505 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:22,505 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536642242_0001_00_000001
2016-05-18 01:57:22,505 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B5C2138E522440BBBEBE9223EB3EB3C0, taskAttemptId=attempt_1463536642242_0001_1_00_000000_0, creationTime=1463536642446, allocationTime=1463536642447, startTime=1463536642450, finishTime=1463536642505, timeTaken=55, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:22,506 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536642242_0001_1_00_000000_0
2016-05-18 01:57:22,506 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:TASK_FINISHED]: vertexName=B5C2138E522440BBBEBE9223EB3EB3C0, taskId=task_1463536642242_0001_1_00_000000, startTime=1463536642450, finishTime=1463536642506, timeTaken=56, status=SUCCEEDED, successfulAttemptID=attempt_1463536642242_0001_1_00_000000_0, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536642492, Process_Duration=4, Process_End_Time=1463536642496, Read_Duration=2, Tuples_Read=10, Tuples_Written=7, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10
2016-05-18 01:57:22,507 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:22,507 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0]
2016-05-18 01:57:22,510 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:VERTEX_FINISHED]: vertexName=B5C2138E522440BBBEBE9223EB3EB3C0, vertexId=vertex_1463536642242_0001_1_00, initRequestedTime=1463536642423, initedTime=1463536642438, startRequestedTime=1463536642425, startedTime=1463536642439, finishTime=1463536642507, timeTaken=68, status=SUCCEEDED, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536642492, Process_Duration=4, Process_End_Time=1463536642496, Read_Duration=2, Tuples_Read=10, Tuples_Written=7, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10, vertexStats=firstTaskStartTime=1463536642450, firstTasksToStart=[ task_1463536642242_0001_1_00_000000 ], lastTaskFinishTime=1463536642505, lastTasksToFinish=[ task_1463536642242_0001_1_00_000000 ], minTaskDuration=55, maxTaskDuration=55, avgTaskDuration=55.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536642242_0001_1_00_000000 ], longestDurationTasks=[ task_1463536642242_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:22,510 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:22,511 INFO  impl.VertexImpl (VertexImpl.java:transition(3279)) - Source task attempt completed for vertex: vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188] attempt: attempt_1463536642242_0001_1_00_000000_0 with state: SUCCEEDED vertexState: RUNNING
2016-05-18 01:57:22,511 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:schedulePendingTasks(920)) - All source tasks assigned. Ramping up 1 remaining tasks for vertex: F20AD324D66442D9A44EB15383822188
2016-05-18 01:57:22,511 INFO  impl.Edge (Edge.java:routingToBegin(232)) - Routing to begin for edge: EdgeInfo: sourceVertexName=B5C2138E522440BBBEBE9223EB3EB3C0, destinationVertexName=F20AD324D66442D9A44EB15383822188. EdgeProperty: { SCATTER_GATHER : org.apache.tez.runtime.library.input.OrderedGroupedKVInput >> PERSISTED >> org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput >> NullEdgeManager } onDemandRouting: true
2016-05-18 01:57:22,511 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536642242_0001_00_000001, stoppedTime=1463536642511, exitStatus=0
2016-05-18 01:57:22,511 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188]
2016-05-18 01:57:22,511 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536642242_0001_1_00 [B5C2138E522440BBBEBE9223EB3EB3C0] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:22,511 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:22,512 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:TASK_STARTED]: vertexName=F20AD324D66442D9A44EB15383822188, taskId=task_1463536642242_0001_1_01_000000, scheduledTime=1463536642511, launchTime=1463536642511
2016-05-18 01:57:22,512 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(262)) - Ignoring stop request for containerId container_1463536642242_0001_00_000001. Relying on regular task shutdown for it to end
2016-05-18 01:57:22,512 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188]
2016-05-18 01:57:22,516 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536642242_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-18 01:57:22,516 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536642242_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:22,516 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536642242_0001_00_000001, Exiting
2016-05-18 01:57:22,516 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536642242_0001_00_000001
2016-05-18 01:57:22,517 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536642242_0001_00_000001
2016-05-18 01:57:22,517 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536642242_0001_00_000002, launchTime=1463536642517
2016-05-18 01:57:22,518 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536642242_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:22,519 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536642242_0001_00_000001 completed successfully
2016-05-18 01:57:22,519 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536642242_0001_00_000002
2016-05-18 01:57:22,521 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536642242_0001_1_01_000000_0] started. Is using containerId: [container_1463536642242_0001_00_000002] on NM: [127.0.0.1:0]
2016-05-18 01:57:22,521 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F20AD324D66442D9A44EB15383822188, taskAttemptId=attempt_1463536642242_0001_1_01_000000_0, startTime=1463536642521, containerId=container_1463536642242_0001_00_000002, nodeId=127.0.0.1:0
2016-05-18 01:57:22,522 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536642242_0001_00_000002: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536642242_0001_1_01_000000_0
2016-05-18 01:57:22 Starting to run new task attempt: attempt_1463536642242_0001_1_01_000000_0
2016-05-18 01:57:22,523 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536642242_0001_1_01_000000_0
2016-05-18 01:57:22,523 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:22,523 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:22,523 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [EAFC07B9A78D41229BA801DFFCD03340/CA290C35F8954C349D952C362BD97A16] test/(1/1) ...Removal/group/VALID/VALID, VertexName: F20AD324D66442D9A44EB15383822188, VertexParallelism: 1, TaskAttemptID:attempt_1463536642242_0001_1_01_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=B5C2138E522440BBBEBE9223EB3EB3C0, physicalEdgeCount=1, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=5D4EC53E8239453EAB5D725B129064CE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-18 01:57:22,523 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:22,525 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536642242_0001_1_01_000000_0
2016-05-18 01:57:22,526 INFO  impl.VertexImpl (VertexImpl.java:getTaskAttemptTezEvents(3662)) - Sending attempt_1463536642242_0001_1_01_000000_0 1 events [0,1) total 1 vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188]
2016-05-18 01:57:22,526 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536642242_0001_1_01_000000_0, eventCount=1 fromEventId=0 nextFromEventId=1
2016-05-18 01:57:22,530 INFO  orderedgrouped.MergeManager (MergeManager.java:getInitialMemoryRequirement(339)) - Initial Memory required for SHUFFLE_BUFFER=211392912 based on INPUT_BUFFER_FACTOR=0.9,  for final merged output=0, using factor: 0.0
2016-05-18 01:57:22,532 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:22,543 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F20AD324D66442D9A44EB15383822188, ordinal: 1
2016-05-18 01:57:22,544 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F20AD324D66442D9A44EB15383822188, mem on start (mb), free: 133, total: 361, max: 672
2016-05-18 01:57:22,544 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:22,544 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:22,544 INFO  output.MROutput (MROutput.java:initialize(421)) - 5D4EC53E8239453EAB5D725B129064CE: outputFormat=org.apache.hadoop.mapred.TextOutputFormat, using newmapreduce API=false
2016-05-18 01:57:22,544 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:22,545 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:22,545 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[5D4EC53E8239453EAB5D725B129064CE:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput], [B5C2138E522440BBBEBE9223EB3EB3C0:INPUT:211392912:org.apache.tez.runtime.library.input.OrderedGroupedKVInput]
2016-05-18 01:57:22,545 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:22,546 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:22,546 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 211392912, TotalRequestedScaled: 1.9513191876923078E8, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.30
2016-05-18 01:57:22,546 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[5D4EC53E8239453EAB5D725B129064CE:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0], [B5C2138E522440BBBEBE9223EB3EB3C0:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:211392912:211392912]
2016-05-18 01:57:22,546 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:22,547 INFO  orderedgrouped.Shuffle (Shuffle.java:<init>(147)) - B5C2138E522440BBBEBE9223EB3EB3C0: Shuffle assigned with 1 inputs, codec: None, ifileReadAhead: true
2016-05-18 01:57:22,547 INFO  orderedgrouped.MergeManager (MergeManager.java:<init>(273)) - B5C2138E522440BBBEBE9223EB3EB3C0: MergerManager: memoryLimit=211392912, maxSingleShuffleLimit=52848228, mergeThreshold=190253616, ioSortFactor=100, postMergeMem=0, memToMemMergeOutputsThreshold=100
2016-05-18 01:57:22,548 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:<init>(353)) - ShuffleScheduler running for sourceVertex: B5C2138E522440BBBEBE9223EB3EB3C0 with configuration: maxFetchFailuresBeforeReporting=5, reportReadErrorImmediately=true, maxFailedUniqueFetches=1, abortFailureLimit=15, maxTaskOutputAtOnce=20, numFetchers=1, hostFailureFraction=0.2, minFailurePerHost=4, maxAllowedFailedFetchFraction=0.5, maxStallTimeFraction=0.5, minReqProgressFraction=0.5, checkFailedFetchSinceLastCompletion=true
2016-05-18 01:57:22,549 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: B5C2138E522440BBBEBE9223EB3EB3C0
2016-05-18 01:57:22,549 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: B5C2138E522440BBBEBE9223EB3EB3C0 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:22,552 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:22,552 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:22,552 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:22,552 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536642242_0001_1_01_000000_0
2016-05-18 01:57:22,554 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - B5C2138E522440BBBEBE9223EB3EB3C0: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0
2016-05-18 01:57:22,556 INFO  orderedgrouped.ShuffleScheduler (ShuffleUtils.java:logIndividualFetchComplete(489)) - Completed fetch for attempt: {0, 0, attempt_1463536642242_0001_1_00_000000_0_10056} to DISK_DIRECT, csize=653, dsize=649, EndTime=1463536642556, TimeTaken=1, Rate=0.62 MB/s
2016-05-18 01:57:22,556 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:copySucceeded(551)) - All inputs fetched for input vertex : B5C2138E522440BBBEBE9223EB3EB3C0
2016-05-18 01:57:22,556 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: GroupBy(test)[by:[{1}:'method']]
2016-05-18 01:57:22,556 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:22,557 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:callInternal(1289)) - Shutting down FetchScheduler for input: B5C2138E522440BBBEBE9223EB3EB3C0, wasInterrupted=false
2016-05-18 01:57:22,557 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: GroupBy(test)[by:[{1}:'method']] streamed: true, id: 6B9786A9B0594C21924B1F54166CFD45
2016-05-18 01:57:22,557 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:22,558 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/VALID/VALID"], id: 5D4EC53E8239453EAB5D725B129064CE
2016-05-18 01:57:22,559 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1005)) - finalMerge called with 0 in-memory map-outputs and 1 on-disk map-outputs
2016-05-18 01:57:22,560 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/VALID/VALID"]
2016-05-18 01:57:22,560 INFO  element.TezGroupGate (TezGroupGate.java:prepare(90)) - calling OrderedGroupedKVInput#start() on: GroupBy(test)[by:[{1}:'method']] 6B9786A9B0594C21924B1F54166CFD45, for 1 inputs
2016-05-18 01:57:22,559 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:onSuccess(1328)) - B5C2138E522440BBBEBE9223EB3EB3C0: Already shutdown. Ignoring fetch complete
2016-05-18 01:57:22,560 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1103)) - Disk file=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/EAFC07B9A78D41229BA801DFFCD03340/CA290C35F8954C349D952C362BD97A16/.tez/application_1463536642242_0001_wd/localmode-local-dir/output/attempt_1463536642242_0001_1_00_000000_0_10056/file.out, len=653, isLocal=true
2016-05-18 01:57:22,561 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1115)) - Merging 1 files, 653 bytes from disk
2016-05-18 01:57:22,561 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1130)) - Merging 0 segments, 0 bytes from memory into reduce
2016-05-18 01:57:22,561 INFO  impl.TezMerger (TezMerger.java:merge(644)) - Merging 1 sorted segments
2016-05-18 01:57:22,561 INFO  impl.TezMerger (TezMerger.java:merge(749)) - Down to the last merge-pass, with 1 segments left of total size: 633 bytes
2016-05-18 01:57:22,561 INFO  orderedgrouped.Shuffle (Shuffle.java:callInternal(332)) - merge complete for input vertex : B5C2138E522440BBBEBE9223EB3EB3C0
2016-05-18 01:57:22,561 INFO  orderedgrouped.Shuffle (Shuffle.java:onSuccess(417)) - B5C2138E522440BBBEBE9223EB3EB3C0: Shuffle Runner thread complete
2016-05-18 01:57:22,562 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F20AD324D66442D9A44EB15383822188, all 1 inputs ready in: 00:00:00.002
2016-05-18 01:57:22,562 INFO  input.OrderedGroupedKVInput (OrderedGroupedKVInput.java:createValuesIterator(292)) - B5C2138E522440BBBEBE9223EB3EB3C0: creating ValuesIterator with comparator=cascading.tuple.hadoop.util.TupleComparator, keyClass=cascading.tuple.io.KeyTuple, valClass=cascading.tuple.io.ValueTuple
2016-05-18 01:57:22,564 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-05-18 01:57:22,565 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-05-18 01:57:22,565 ERROR element.TezGroupByGate (TezGroupByGate.java:reduce(91)) - caught throwable
cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-05-18 01:57:22,566 INFO  output.MROutput (MROutput.java:close(526)) - 5D4EC53E8239453EAB5D725B129064CE closed
2016-05-18 01:57:22,567 INFO  impl.TaskImpl (TaskImpl.java:canCommit(671)) - attempt_1463536642242_0001_1_01_000000_0 given a go for committing the task output.
2016-05-18 01:57:22,568 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536642242_0001_1_01_000000_0, stopRequested=false
2016-05-18 01:57:22,568 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536642242_0001_1_01_000000_0: Counters: 33 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=10, MERGE_PHASE_TIME=14, FIRST_EVENT_RECEIVED=7, LAST_EVENT_RECEIVED=7][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][cascading.flow.SliceCounters Process_Begin_Time=1463536642562, Process_Duration=6, Process_End_Time=1463536642568, Read_Duration=0, Tuples_Read=7]]
2016-05-18 01:57:22,568 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(817)) - Joining on EventRouter
2016-05-18 01:57:22,569 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F20AD324D66442D9A44EB15383822188, mem on close (mb), free: 128, total: 361, max: 672
2016-05-18 01:57:22,569 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(851)) - Closed processor for vertex=F20AD324D66442D9A44EB15383822188, index=1, interruptedStatus=false
2016-05-18 01:57:22,569 INFO  orderedgrouped.Shuffle (Shuffle.java:shutdown(278)) - Shutting down Shuffle for source: B5C2138E522440BBBEBE9223EB3EB3C0
2016-05-18 01:57:22,569 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - B5C2138E522440BBBEBE9223EB3EB3C0: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0, updateOnClose
2016-05-18 01:57:22,569 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(887)) - Closed input for vertex=F20AD324D66442D9A44EB15383822188, sourceVertex=B5C2138E522440BBBEBE9223EB3EB3C0, interruptedStatus=true
2016-05-18 01:57:22,569 INFO  output.MROutput (MROutput.java:close(526)) - 5D4EC53E8239453EAB5D725B129064CE closed
2016-05-18 01:57:22,570 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(911)) - Closed input for vertex=F20AD324D66442D9A44EB15383822188, sourceVertex=5D4EC53E8239453EAB5D725B129064CE, interruptedStatus=true
2016-05-18 01:57:22,571 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536642242_0001_1_01_000000_0 : TaskRunner2Result{endReason=TASK_ERROR, error=cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST'], containerShutdownRequested=false}  
2016-05-18 01:57:22,571 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=TASK_ERROR, error=cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST'], containerShutdownRequested=false}
2016-05-18 01:57:22,571 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536642242_0001_00_000002
2016-05-18 01:57:22,572 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536642242_0001_00_000002
2016-05-18 01:57:22,572 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F20AD324D66442D9A44EB15383822188, taskAttemptId=attempt_1463536642242_0001_1_01_000000_0, creationTime=1463536642512, allocationTime=1463536642515, startTime=1463536642521, finishTime=1463536642571, timeTaken=50, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task: attempt_1463536642242_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 33, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=10, MERGE_PHASE_TIME=14, FIRST_EVENT_RECEIVED=7, LAST_EVENT_RECEIVED=7, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536642562, Process_Duration=6, Process_End_Time=1463536642568, Read_Duration=0, Tuples_Read=7
2016-05-18 01:57:22,572 INFO  impl.TaskImpl (TaskImpl.java:transition(1170)) - Failing task: task_1463536642242_0001_1_01_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-05-18 01:57:22,572 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:TASK_FINISHED]: vertexName=F20AD324D66442D9A44EB15383822188, taskId=task_1463536642242_0001_1_01_000000, startTime=1463536642521, finishTime=1463536642572, timeTaken=51, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task: attempt_1463536642242_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-05-18 01:57:22,573 INFO  impl.VertexImpl (VertexImpl.java:transition(3353)) - Failing vertex: vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188] because task failed: task_1463536642242_0001_1_01_000000
2016-05-18 01:57:22,573 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(2102)) - Killing tasks in vertex: vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188] due to trigger: OWN_TASK_FAILURE
2016-05-18 01:57:22,573 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188], tasks=1, failed=1, killed=0, success=0, completed=1, commits=0, err=OWN_TASK_FAILURE
2016-05-18 01:57:22,573 INFO  impl.VertexImpl (VertexImpl.java:finishWithTerminationCause(2084)) - Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0
2016-05-18 01:57:22,573 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3087)) - Invoking committer abort for vertex, vertexId=vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188]
2016-05-18 01:57:22,573 INFO  impl.VertexImpl (VertexImpl.java:run(3095)) - Invoking committer abort for output=5D4EC53E8239453EAB5D725B129064CE, vertexId=vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188]
2016-05-18 01:57:22,574 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536642242_0001_00_000002 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST'], errorMessage='TaskExecutionFailure: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST']'}
2016-05-18 01:57:22,574 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(294)) - Container: container_1463536642242_0001_00_000002 completed but with errors
2016-05-18 01:57:22,575 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:VERTEX_FINISHED]: vertexName=F20AD324D66442D9A44EB15383822188, vertexId=vertex_1463536642242_0001_1_01, initRequestedTime=1463536642425, initedTime=1463536642429, startRequestedTime=1463536642439, startedTime=1463536642440, finishTime=1463536642574, timeTaken=134, status=FAILED, diagnostics=Task failed, taskId=task_1463536642242_0001_1_01_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task: attempt_1463536642242_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]]
Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0
Vertex vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188] killed/failed due to:OWN_TASK_FAILURE, counters=Counters: 0, vertexStats=firstTaskStartTime=1463536642521, firstTasksToStart=[ task_1463536642242_0001_1_01_000000 ], lastTaskFinishTime=1463536642571, lastTasksToFinish=[ task_1463536642242_0001_1_01_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-05-18 01:57:22,575 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-05-18 01:57:22,575 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536642242_0001_00_000002, stoppedTime=1463536642575, exitStatus=-1000
2016-05-18 01:57:22,576 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(298)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1463536642242_0001_1_01_000000_0 failed: true container: container_1463536642242_0001_00_000002 numFailedTAs: 0
2016-05-18 01:57:22,577 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188] completed., numCompletedVertices=2, numSuccessfulVertices=1, numFailedVertices=1, numKilledVertices=0, numVertices=2
2016-05-18 01:57:22,577 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=2, numSuccessfulVertices=1, numFailedVertices=1, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=VERTEX_FAILURE
2016-05-18 01:57:22,577 INFO  impl.DAGImpl (DAGImpl.java:finishWithTerminationCause(1350)) - DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0
2016-05-18 01:57:22,578 INFO  recovery.RecoveryService (RecoveryService.java:handle(327)) - DAG completed, dagId=dag_1463536642242_0001_1, queueSize=0
2016-05-18 01:57:22,579 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642242_0001_1][Event:DAG_FINISHED]: dagId=dag_1463536642242_0001_1, startTime=1463536642423, finishTime=1463536642578, timeTaken=155, status=FAILED, diagnostics=Vertex failed, vertexName=F20AD324D66442D9A44EB15383822188, vertexId=vertex_1463536642242_0001_1_01, diagnostics=[Task failed, taskId=task_1463536642242_0001_1_01_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task: attempt_1463536642242_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188] killed/failed due to:OWN_TASK_FAILURE]
DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=2, RACK_LOCAL_TASKS=1, AM_CPU_MILLISECONDS=320, AM_GC_TIME_MILLIS=0, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536642492, Process_Duration=4, Process_End_Time=1463536642496, Read_Duration=2, Tuples_Read=10, Tuples_Written=7, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10
2016-05-18 01:57:22,579 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3082)) - Ignoring multiple aborts for vertex: vertex_1463536642242_0001_1_01 [F20AD324D66442D9A44EB15383822188]
2016-05-18 01:57:22,579 INFO  impl.DAGImpl (DAGImpl.java:finished(1405)) - DAG: dag_1463536642242_0001_1 finished with state: FAILED
2016-05-18 01:57:22,580 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536642242_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-05-18 01:57:22,580 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(993)) - Container container_1463536642242_0001_00_000002 exited with diagnostics set to TaskExecutionFailure: [cascading.operation.assertion.AppliedAssertionsPlatformTest.runGroupAssertions(AppliedAssertionsPlatformTest.java:283)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
2016-05-18 01:57:22,580 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(260)) - Ignoring stop request for containerId: container_1463536642242_0001_00_000002
2016-05-18 01:57:22 Completed Dag: dag_1463536642242_0001_1
2016-05-18 01:57:22,580 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(751)) - DAG completed, dagId=dag_1463536642242_0001_1, dagState=FAILED
2016-05-18 01:57:22,580 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536642242_0001_1_post
2016-05-18 01:57:22,580 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:22,581 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(800)) - Central Dispatcher queue size after DAG completion, before cleanup: 2
2016-05-18 01:57:22,581 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(802)) - Waiting for next DAG to be submitted.
2016-05-18 01:57:22,581 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(842)) - Cleaning up DAG: name=[EAFC07B9A78D41229BA801DFFCD03340/CA290C35F8954C349D952C362BD97A16] test/(1/1) ...Removal/group/VALID/VALID, with id=dag_1463536642242_0001_1
2016-05-18 01:57:22,581 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(852)) - Completed cleanup for DAG: name=[EAFC07B9A78D41229BA801DFFCD03340/CA290C35F8954C349D952C362BD97A16] test/(1/1) ...Removal/group/VALID/VALID, with id=dag_1463536642242_0001_1
2016-05-18 01:57:22,592 INFO  client.TezClient (TezClient.java:stop(566)) - Shutting down Tez Session, sessionName=(1/1) ...Removal/group/VALID/VALID, applicationId=application_1463536642242_0001
2016-05-18 01:57:22,594 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(124)) - Received message to shutdown AM
2016-05-18 01:57:22,595 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:setShouldUnregisterFlag(895)) - TaskScheduler notified that it should unregister from RM
2016-05-18 01:57:22,595 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1301)) - No current running DAG, shutting down the AM
2016-05-18 01:57:22,595 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(907)) - DAGAppMasterShutdownHandler invoked
2016-05-18 01:57:22,595 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(916)) - Handling DAGAppMaster shutdown
2016-05-18 01:57:22,596 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(84)) - Stopping HistoryEventHandler
2016-05-18 01:57:22,597 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(196)) - Stopping RecoveryService
2016-05-18 01:57:22,597 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(199)) - Handle the remaining events in queue, queue size=0
2016-05-18 01:57:22,597 INFO  recovery.RecoveryService (RecoveryService.java:run(173)) - EventQueue take interrupted. Returning
2016-05-18 01:57:22,597 INFO  app.DAGAppMaster (DAGAppMaster.java:run(936)) - Sleeping for 5 seconds before shutting down
2016-05-18 01:57:22,597 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(221)) - Closing Summary Stream
2016-05-18 01:57:22,598 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-18 01:57:22,599 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-18 01:57:22,599 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:serviceStop(678)) - Shutting down AppCallbackExecutor
2016-05-18 01:57:22,602 INFO  app.DAGAppMaster (DAGAppMaster.java:run(2084)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/EAFC07B9A78D41229BA801DFFCD03340/CA290C35F8954C349D952C362BD97A16/.tez/application_1463536642242_0001
2016-05-18 01:57:22,603 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] stopping all jobs
2016-05-18 01:57:22,603 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] stopping: (1/1) ...Removal/group/VALID/VALID
2016-05-18 01:57:22,604 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] stopped all jobs
2016-05-18 01:57:22,604 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/VALID/VALID/_temporary
2016-05-18 01:57:22,604 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  completed in: 00:00.384
2016-05-18 01:57:22,605 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output//hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/VALID/VALID
2016-05-18 01:57:22,605 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output//hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/NONE/STRICT
2016-05-18 01:57:22,605 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output//hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/STRICT/STRICT
2016-05-18 01:57:22,605 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output//hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/VALID/STRICT
2016-05-18 01:57:22,605 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output//hadoop2-tez/appliedassertionsplatform/testGroupAssertionsRemoval/group/NONE/VALID
2016-05-18 01:57:22,667 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 01:57:22,668 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-18 01:57:22,726 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-05-18 01:57:22,747 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.039
2016-05-18 01:57:22,747 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:22,747 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:22,748 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 01:57:22,766 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt
2016-05-18 01:57:22,773 INFO  app.DAGAppMaster (DAGAppMaster.java:run(946)) - Calling stop for all the services
2016-05-18 01:57:22,773 INFO  app.DAGAppMaster (DAGAppMaster.java:run(957)) - Exiting DAGAppMaster..GoodBye!
2016-05-18 01:57:22,774 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsFail/fail
2016-05-18 01:57:22,837 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting
2016-05-18 01:57:22,837 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:22,838 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  sink: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsFail/fail"]
2016-05-18 01:57:22,838 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  parallel execution of steps is enabled: false
2016-05-18 01:57:22,838 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  executing total steps: 1
2016-05-18 01:57:22,838 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  allocating management threads: 1
2016-05-18 01:57:22,839 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting step: (1/1) ...tGroupAssertionsFail/fail
2016-05-18 01:57:22,839 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [test] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-18 01:57:22,854 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tez session mode enabled: true
2016-05-18 01:57:22,858 INFO  client.TezClient (TezClient.java:<init>(174)) - Tez Client Version: [ component=tez-api, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:22,859 INFO  client.TezClient (TezClient.java:start(394)) - Session mode. Starting session.
2016-05-18 01:57:22,859 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(164)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-18 01:57:22,869 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(122)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/56892825FEEA4453AEB4DCFA82B26FCA/BDCA43DC0CFB41B39DCEF9BE33F42A36/.tez/application_1463536642859_0001 doesn't exist and is created
2016-05-18 01:57:22,890 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(332)) - DAGAppMaster thread has been created
2016-05-18 01:57:22,890 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-18 01:57:22,891 INFO  client.LocalClient (LocalClient.java:run(282)) - Using working directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/56892825FEEA4453AEB4DCFA82B26FCA/BDCA43DC0CFB41B39DCEF9BE33F42A36/.tez/application_1463536642859_0001_wd
2016-05-18 01:57:22,905 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(363)) - Created DAGAppMaster for application appattempt_1463536642859_0001_000000, versionInfo=[ component=tez-dag, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:22,906 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(80)) - Trying to locate HadoopShimProvider for hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:22,906 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(139)) - Picked HadoopShim org.apache.tez.hadoop.shim.DefaultHadoopShim, providerName=null, overrideProviderViaConfig=null, hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:22,908 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(436)) - AM Level configured TaskSchedulers: [0:TezUber:null]
2016-05-18 01:57:22,908 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(437)) - AM Level configured ContainerLaunchers: [0:TezUber:null]
2016-05-18 01:57:22,908 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(438)) - AM Level configured TaskCommunicators: [0:TezUber:null]
2016-05-18 01:57:22,908 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(447)) - Comparing client version with AM version, clientVersion=0.8.2, AMVersion=0.8.2
2016-05-18 01:57:22,909 INFO  app.TaskCommunicatorManager (TaskCommunicatorManager.java:createUberTaskCommunicator(192)) - Creating Default Local Task Communicator
2016-05-18 01:57:22,911 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.container.AMContainerEventType for class org.apache.tez.dag.app.rm.container.AMContainerMap
2016-05-18 01:57:22,911 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.node.AMNodeEventType for class org.apache.tez.dag.app.rm.node.AMNodeTracker
2016-05-18 01:57:22,911 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGAppMasterEventType for class org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterEventHandler
2016-05-18 01:57:22,912 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGEventType for class org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher
2016-05-18 01:57:22,912 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.VertexEventType for class org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher
2016-05-18 01:57:22,912 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(529)) - Using concurrent dispatcher: false
2016-05-18 01:57:22,912 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher
2016-05-18 01:57:22,913 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskAttemptEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher
2016-05-18 01:57:22,913 INFO  common.AsyncDispatcher (AsyncDispatcher.java:registerAndCreateDispatcher(262)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for independent dispatch using: class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:22,913 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:22,914 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.AMSchedulerEventType for class org.apache.tez.dag.app.rm.TaskSchedulerManager
2016-05-18 01:57:22,914 INFO  launcher.TezContainerLauncherImpl (ContainerLauncherManager.java:createUberContainerLauncher(134)) - Creating LocalContainerLauncher
2016-05-18 01:57:22,916 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.ContainerLauncherEventType for class org.apache.tez.dag.app.launcher.ContainerLauncherManager
2016-05-18 01:57:22,917 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(78)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1, nodeUpdatesRescheduleEnabled: false
2016-05-18 01:57:22,917 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(57)) - Initializing HistoryEventHandler withrecoveryEnabled=true, historyServiceClassName=org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService
2016-05-18 01:57:22,917 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/56892825FEEA4453AEB4DCFA82B26FCA/BDCA43DC0CFB41B39DCEF9BE33F42A36/.tez/application_1463536642859_0001_wd/localmode-log-dir
2016-05-18 01:57:22,918 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/56892825FEEA4453AEB4DCFA82B26FCA/BDCA43DC0CFB41B39DCEF9BE33F42A36/.tez/application_1463536642859_0001_wd/localmode-log-dir/history.txt.appattempt_1463536642859_0001_000000, maxErrors=10
2016-05-18 01:57:22,918 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(124)) - RecoveryService initialized with recoveryPath=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/56892825FEEA4453AEB4DCFA82B26FCA/BDCA43DC0CFB41B39DCEF9BE33F42A36/.tez/application_1463536642859_0001/recovery/0, bufferSize(bytes)=8192, flushInterval(s)=30, maxUnflushedEvents=100
2016-05-18 01:57:22,918 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463536642859_0001_000000, appSubmitTime=1463536642905, launchTime=1463536642905
2016-05-18 01:57:22,924 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-18 01:57:22,928 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:51235
2016-05-18 01:57:22,928 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:createUberTaskScheduler(557)) - Creating TaskScheduler: Local TaskScheduler with clusterIdentifier=1463536642859
2016-05-18 01:57:22,931 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463536642859_0001_000000, startTime=1463536642931
2016-05-18 01:57:22,931 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1945)) - In Session mode. Waiting for DAG over RPC
2016-05-18 01:57:22,990 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-18 01:57:22,990 INFO  client.TezClient (TezClient.java:start(428)) - The url to track the Tez Session: N/A
2016-05-18 01:57:22,991 INFO  client.TezClient (TezClient.java:submitDAGSession(470)) - Submitting dag to TezSession, sessionName=(1/1) ...tGroupAssertionsFail/fail, applicationId=application_1463536642859_0001, dagName=[56892825FEEA4453AEB4DCFA82B26FCA/BDCA43DC0CFB41B39DCEF9BE33F42A36] test/(1/1) ...tGroupAssertionsFail/fail
2016-05-18 01:57:23,008 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1351)) - Starting DAG submitted via RPC: [56892825FEEA4453AEB4DCFA82B26FCA/BDCA43DC0CFB41B39DCEF9BE33F42A36] test/(1/1) ...tGroupAssertionsFail/fail
2016-05-18 01:57:23,009 INFO  app.DAGAppMaster (DAGAppMaster.java:createDAG(985)) - Merging AM credentials into DAG credentials
2016-05-18 01:57:23,010 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(1076)) - Generating DAG graphviz file, dagId=dag_1463536642859_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/56892825FEEA4453AEB4DCFA82B26FCA/BDCA43DC0CFB41B39DCEF9BE33F42A36/.tez/application_1463536642859_0001_wd/localmode-log-dir/dag_1463536642859_0001_1.dot
2016-05-18 01:57:23,010 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(1093)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/56892825FEEA4453AEB4DCFA82B26FCA/BDCA43DC0CFB41B39DCEF9BE33F42A36/.tez/application_1463536642859_0001_wd/localmode-log-dir/dag_1463536642859_0001_1-tez-dag.pb.txt
2016-05-18 01:57:23,017 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536642859_0001_1
2016-05-18 01:57:23,017 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:23,017 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2399)) - Running DAG: [56892825FEEA4453AEB4DCFA82B26FCA/BDCA43DC0CFB41B39DCEF9BE33F42A36] test/(1/1) ...tGroupAssertionsFail/fail
2016-05-18 01:57:23 Running Dag: dag_1463536642859_0001_1
2016-05-18 01:57:23,034 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463536642859_0001_1, submitTime=1463536643009
2016-05-18 01:57:23,035 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/56892825FEEA4453AEB4DCFA82B26FCA/BDCA43DC0CFB41B39DCEF9BE33F42A36/.tez/application_1463536642859_0001/tez-conf.pb" } size: 40936 timestamp: 1463536642000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:23,035 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalInputs(3978)) - Setting 1 additional inputs for vertexvertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A]
2016-05-18 01:57:23,036 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:23,036 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/56892825FEEA4453AEB4DCFA82B26FCA/BDCA43DC0CFB41B39DCEF9BE33F42A36/.tez/application_1463536642859_0001/tez-conf.pb" } size: 40936 timestamp: 1463536642000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:23,036 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4023)) - Setting 1 additional outputs for vertex vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F]
2016-05-18 01:57:23,037 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:23,037 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1593)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-18 01:57:23,037 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463536642859_0001_1, initTime=1463536643037
2016-05-18 01:57:23,038 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536642859_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-18 01:57:23,038 INFO  impl.DAGImpl (DAGImpl.java:transition(1768)) - Added additional resources : [[]] to classpath
2016-05-18 01:57:23,038 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:DAG_STARTED]: dagID=dag_1463536642859_0001_1, startTime=1463536643038
2016-05-18 01:57:23,038 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536642859_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-18 01:57:23,038 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2400)) - Root Inputs exist for Vertex: EAEA3BD7FC604EA29998BD339F9AD79A : {26157B5953B04F27846AB12A7B1BAA3B={InputName=26157B5953B04F27846AB12A7B1BAA3B}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-18 01:57:23,038 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2410)) - Starting root input initializer for input: 26157B5953B04F27846AB12A7B1BAA3B, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-18 01:57:23,038 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2550)) - Setting vertexManager to RootInputVertexManager for vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A]
2016-05-18 01:57:23,039 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2721)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A]
2016-05-18 01:57:23,039 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2726)) - Vertex will initialize from input initializer. vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A]
2016-05-18 01:57:23,039 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3893)) - Starting 1 inputInitializers for vertex vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A]
2016-05-18 01:57:23,039 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-18 01:57:23,039 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(272)) - Starting InputInitializer for Input: 26157B5953B04F27846AB12A7B1BAA3B on vertex vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A]
2016-05-18 01:57:23,039 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2562)) - Setting vertexManager to ShuffleVertexManager for vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F]
2016-05-18 01:57:23,044 INFO  client.TezClient (TezClient.java:submitDAGSession(545)) - Submitted dag to TezSession, sessionName=(1/1) ...tGroupAssertionsFail/fail, applicationId=application_1463536642859_0001, dagName=[56892825FEEA4453AEB4DCFA82B26FCA/BDCA43DC0CFB41B39DCEF9BE33F42A36] test/(1/1) ...tGroupAssertionsFail/fail
2016-05-18 01:57:23,045 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(109)) - Input 26157B5953B04F27846AB12A7B1BAA3B asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7, groupingEnabled: true
2016-05-18 01:57:23,045 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:initialize(1022)) - Shuffle Vertex Manager: settings minFrac:0.25 maxFrac:0.75 auto:false desiredTaskIput:104857600 minTasks:1
2016-05-18 01:57:23,045 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2760)) - Creating 1 tasks for vertex: vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F]
2016-05-18 01:57:23,045 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2779)) - Directly initializing vertex: vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F]
2016-05-18 01:57:23,045 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536642859_0001_1_01, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=null, edgeManagersCount=1, rootInputSpecUpdateCount=0, setParallelismCalledFlag=false
2016-05-18 01:57:23,046 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2187)) - Setting up committers for vertex vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F], numAdditionalOutputs=1
2016-05-18 01:57:23,046 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2202)) - Instantiating committer for output=621BBC100C7243C5897D7ECAA42A8A8B, vertex=vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-18 01:57:23,048 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(121)) - Committer for DEBE5059D7294BFE8A9FFF882FE5645F:621BBC100C7243C5897D7ECAA42A8A8B using oldmapred API
2016-05-18 01:57:23,049 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(146)) - OutputCommitter for outputName=621BBC100C7243C5897D7ECAA42A8A8B, vertexName=DEBE5059D7294BFE8A9FFF882FE5645F, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-18 01:57:23,049 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(168)) - Grouping splits in Tez
2016-05-18 01:57:23,050 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(226)) - Desired splits: 1 too large.  Desired splitLength: 1449 Min splitLength: 52428800 New desired splits: 1 Total length: 1449 Original splits: 2
2016-05-18 01:57:23,050 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(321)) - Desired numSplits: 1 lengthPerGroup: 1449 numLocations: 1 numSplitsPerLocation: 2 numSplitsInGroup: 2 totalLength: 1449 numOriginalSplits: 2 . Grouping by length: true count: false nodeLocalOnly: false
2016-05-18 01:57:23,050 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(539)) - Number of splits desired: 1 created: 1 splitsProcessed: 2
2016-05-18 01:57:23,050 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(308)) - Succeeded InputInitializer for Input: 26157B5953B04F27846AB12A7B1BAA3B on vertex vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A]
2016-05-18 01:57:23,050 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:VERTEX_INITIALIZED]: vertexName=DEBE5059D7294BFE8A9FFF882FE5645F, vertexId=vertex_1463536642859_0001_1_01, initRequestedTime=1463536643039, initedTime=1463536643046, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=0, initGeneratedEventsCount=0
2016-05-18 01:57:23,051 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F] transitioned from NEW to INITED due to event V_INIT
2016-05-18 01:57:23,052 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:23,052 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1644)) - Got updated RootInputsSpecs: {26157B5953B04F27846AB12A7B1BAA3B=forAllWorkUnits=true, update=[1]}
2016-05-18 01:57:23,053 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1664)) - Vertex vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A] parallelism set to 1
2016-05-18 01:57:23,053 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:23,054 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:VERTEX_INITIALIZED]: vertexName=EAEA3BD7FC604EA29998BD339F9AD79A, vertexId=vertex_1463536642859_0001_1_00, initRequestedTime=1463536643038, initedTime=1463536643054, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1, initGeneratedEventsCount=1
2016-05-18 01:57:23,054 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A] with distanceFromRoot: 0
2016-05-18 01:57:23,055 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A] transitioned from INITIALIZING to INITED due to event V_INPUT_DATA_INFORMATION
2016-05-18 01:57:23,055 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536642859_0001_1_00, startRequestedTime=1463536643039, startedTime=1463536643055
2016-05-18 01:57:23,056 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536642859_0001_1_00, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=org.apache.tez.dag.api.VertexLocationHint@b8338fe7, edgeManagersCount=0, rootInputSpecUpdateCount=1, setParallelismCalledFlag=true
2016-05-18 01:57:23,056 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:23,057 INFO  impl.VertexImpl (VertexImpl.java:transition(2932)) - Source vertex started: vertex_1463536642859_0001_1_00 for vertex: vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F] numStartedSources: 1 numSources: 1
2016-05-18 01:57:23,057 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F] with distanceFromRoot: 1
2016-05-18 01:57:23,057 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(100)) - Starting 1 in EAEA3BD7FC604EA29998BD339F9AD79A
2016-05-18 01:57:23,058 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536642859_0001_1_01, startRequestedTime=1463536643057, startedTime=1463536643057
2016-05-18 01:57:23,058 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:23,058 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A]
2016-05-18 01:57:23,059 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:TASK_STARTED]: vertexName=EAEA3BD7FC604EA29998BD339F9AD79A, taskId=task_1463536642859_0001_1_00_000000, scheduledTime=1463536643058, launchTime=1463536643058
2016-05-18 01:57:23,059 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A]
2016-05-18 01:57:23,060 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:onVertexStarted(519)) - OnVertexStarted vertex: DEBE5059D7294BFE8A9FFF882FE5645F with 0 source tasks and 1 pending tasks
2016-05-18 01:57:23,060 INFO  node.PerSourceNodeTracker (PerSourceNodeTracker.java:nodeSeen(74)) - Adding new node 127.0.0.1:0 to nodeTracker 0
2016-05-18 01:57:23,062 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:handleVertexStateUpdate(1051)) - Received configured notification : CONFIGURED for vertex: EAEA3BD7FC604EA29998BD339F9AD79A in vertex: DEBE5059D7294BFE8A9FFF882FE5645F numBipartiteSourceTasks: 1
2016-05-18 01:57:23,062 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536642859_0001_00_000001, launchTime=1463536643062
2016-05-18 01:57:23,063 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536642859_0001_00_000001
2016-05-18 01:57:23,064 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536642859_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536642859_0001_1_00_000000_0
2016-05-18 01:57:23,064 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536642859_0001_1_00_000000_0] started. Is using containerId: [container_1463536642859_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-18 01:57:23,065 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=EAEA3BD7FC604EA29998BD339F9AD79A, taskAttemptId=attempt_1463536642859_0001_1_00_000000_0, startTime=1463536643064, containerId=container_1463536642859_0001_00_000001, nodeId=127.0.0.1:0
2016-05-18 01:57:23 Starting to run new task attempt: attempt_1463536642859_0001_1_00_000000_0
2016-05-18 01:57:23,065 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536642859_0001_1_00_000000_0
2016-05-18 01:57:23,066 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:23,066 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:23,066 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [56892825FEEA4453AEB4DCFA82B26FCA/BDCA43DC0CFB41B39DCEF9BE33F42A36] test/(1/1) ...tGroupAssertionsFail/fail, VertexName: EAEA3BD7FC604EA29998BD339F9AD79A, VertexParallelism: 1, TaskAttemptID:attempt_1463536642859_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=26157B5953B04F27846AB12A7B1BAA3B, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=DEBE5059D7294BFE8A9FFF882FE5645F, physicalEdgeCount=1, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ]
2016-05-18 01:57:23,067 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:23,067 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536642859_0001_1_00_000000_0
2016-05-18 01:57:23,068 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(496)) - TaskAttempt:attempt_1463536642859_0001_1_00_000000_0 sent events: (0-1).
2016-05-18 01:57:23,068 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536642859_0001_1_00_000000_0, eventCount=1 fromEventId=0 nextFromEventId=0
2016-05-18 01:57:23,069 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] submitted tez dag to app master: application_1463536642859_0001, with dag id: dag_1463536642859_0001_1
2016-05-18 01:57:23,077 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:23,080 INFO  input.MRInput (MRInput.java:initialize(440)) - 26157B5953B04F27846AB12A7B1BAA3B using newmapreduce API=false, split via event=true, numPhysicalInputs=1
2016-05-18 01:57:23,081 INFO  input.MRInput (MRInput.java:initializeInternal(494)) - Initialized MRInput: 26157B5953B04F27846AB12A7B1BAA3B
2016-05-18 01:57:23,085 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: EAEA3BD7FC604EA29998BD339F9AD79A, ordinal: 0
2016-05-18 01:57:23,085 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: EAEA3BD7FC604EA29998BD339F9AD79A, mem on start (mb), free: 254, total: 372, max: 672
2016-05-18 01:57:23,085 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:23,085 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:23,085 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:23,085 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:23,086 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[26157B5953B04F27846AB12A7B1BAA3B:INPUT:0:org.apache.tez.mapreduce.input.MRInput], [DEBE5059D7294BFE8A9FFF882FE5645F:OUTPUT:104857600:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput]
2016-05-18 01:57:23,086 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:23,086 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:23,087 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 104857600, TotalRequestedScaled: 9.679163076923077E7, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.15
2016-05-18 01:57:23,087 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[26157B5953B04F27846AB12A7B1BAA3B:org.apache.tez.mapreduce.input.MRInput:INPUT:0:0], [DEBE5059D7294BFE8A9FFF882FE5645F:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput:OUTPUT:104857600:104857600]
2016-05-18 01:57:23,087 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:23,087 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: 26157B5953B04F27846AB12A7B1BAA3B being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:23,087 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: 26157B5953B04F27846AB12A7B1BAA3B
2016-05-18 01:57:23,088 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:23,088 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:23,088 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:23,089 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536642859_0001_1_00_000000_0
2016-05-18 01:57:23,090 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(174)) - Processing split: TezGroupedSplit{wrappedSplits=[file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:0+724, file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:724+725], wrappedInputFormatName='org.apache.hadoop.mapred.TextInputFormat', locations=[localhost], rack='null', length=1449}
2016-05-18 01:57:23,090 INFO  input.MRInput (MRInput.java:initFromEventInternal(653)) - 26157B5953B04F27846AB12A7B1BAA3B initialized RecordReader from event
2016-05-18 01:57:23,092 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:23,092 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"] streamed: true, id: 26157B5953B04F27846AB12A7B1BAA3B
2016-05-18 01:57:23,093 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: GroupBy(test)[by:[{1}:'method']], id: 9696062D28554D06B8FD79EF254C3EBF
2016-05-18 01:57:23,093 INFO  element.TezGroupGate (TezGroupGate.java:prepare(98)) - calling OrderedPartitionedKVOutput#start() on: GroupBy(test)[by:[{1}:'method']] 9696062D28554D06B8FD79EF254C3EBF
2016-05-18 01:57:23,094 INFO  impl.ExternalSorter (ExternalSorter.java:<init>(199)) - DEBE5059D7294BFE8A9FFF882FE5645F using: memoryMb=100, keySerializerClass=class cascading.tuple.io.KeyTuple, valueSerializerClass=cascading.tuple.hadoop.io.ValueTupleSerializer@1e6923ba, comparator=cascading.tuple.hadoop.util.TupleComparator@8a897ef, partitioner=cascading.tuple.tez.util.TuplePartitioner, serialization=cascading.tuple.hadoop.TupleSerialization,org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
2016-05-18 01:57:23,095 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(170)) - Setting up PipelinedSorter for DEBE5059D7294BFE8A9FFF882FE5645F: , UsingHashComparator=false
2016-05-18 01:57:23,107 INFO  impl.PipelinedSorter (PipelinedSorter.java:allocateSpace(245)) - Newly allocated block size=104857600, index=0, Number of buffers=1, currentAllocatableMemory=0, currentBufferSize=104857600, total=104857600
2016-05-18 01:57:23,108 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(189)) - Pre allocating rest of memory buffers upfront
2016-05-18 01:57:23,108 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(207)) - Setting up PipelinedSorter for DEBE5059D7294BFE8A9FFF882FE5645F: , UsingHashComparator=false#blocks=1, maxMemUsage=104857600, lazyAllocateMem=false, minBlockSize=2097152000, initial BLOCK_SIZE=104857600, finalMergeEnabled=true, pipelinedShuffle=false, sendEmptyPartitions=true, tez.runtime.io.sort.mb=100
2016-05-18 01:57:23,108 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(882)) - DEBE5059D7294BFE8A9FFF882FE5645F: reserved.remaining()=104857600, reserved.metasize=16777216
2016-05-18 01:57:23,108 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:23,109 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: EAEA3BD7FC604EA29998BD339F9AD79A, all 1 inputs ready in: 00:00:00.000
2016-05-18 01:57:23,112 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536642859_0001_1_00_000000_0
2016-05-18 01:57:23,112 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: EAEA3BD7FC604EA29998BD339F9AD79A, mem on close (mb), free: 152, total: 372, max: 672
2016-05-18 01:57:23,112 INFO  impl.PipelinedSorter (PipelinedSorter.java:flush(629)) - DEBE5059D7294BFE8A9FFF882FE5645F: Starting flush of map output
2016-05-18 01:57:23,113 INFO  impl.PipelinedSorter (PipelinedSorter.java:end(995)) - DEBE5059D7294BFE8A9FFF882FE5645F: Span0.length = 7, perItem = 99
2016-05-18 01:57:23,113 INFO  impl.PipelinedSorter (PipelinedSorter.java:sort(904)) - DEBE5059D7294BFE8A9FFF882FE5645F: done sorting span=0, length=7, time=0
2016-05-18 01:57:23,113 INFO  impl.PipelinedSorter (PipelinedSorter.java:ready(1297)) - DEBE5059D7294BFE8A9FFF882FE5645F: Heap = SpanIterator<0:6> (span=Span[16777216,693]),
2016-05-18 01:57:23,114 INFO  impl.PipelinedSorter (PipelinedSorter.java:spill(546)) - DEBE5059D7294BFE8A9FFF882FE5645F: Spilling to /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/56892825FEEA4453AEB4DCFA82B26FCA/BDCA43DC0CFB41B39DCEF9BE33F42A36/.tez/application_1463536642859_0001_wd/localmode-local-dir/output/attempt_1463536642859_0001_1_00_000000_0_10063_0/file.out
2016-05-18 01:57:23,117 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:23 Completed running task attempt: attempt_1463536642859_0001_1_00_000000_0
2016-05-18 01:57:23,119 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536642859_0001_1_00_000000_0, askedToStop=false
2016-05-18 01:57:23,119 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536642859_0001_1_00_000000_0, stopRequested=false
2016-05-18 01:57:23,119 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536642859_0001_1_00_000000_0: Counters: 18 [[org.apache.tez.common.counters.TaskCounter SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1][cascading.flow.SliceCounters Process_Begin_Time=1463536643109, Process_Duration=3, Process_End_Time=1463536643112, Read_Duration=0, Tuples_Read=10, Tuples_Written=7, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=10]]
2016-05-18 01:57:23,121 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536642859_0001_1_00_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:23,121 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:23,121 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:23,121 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:23,121 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536642859_0001_00_000001
2016-05-18 01:57:23,121 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=EAEA3BD7FC604EA29998BD339F9AD79A, taskAttemptId=attempt_1463536642859_0001_1_00_000000_0, creationTime=1463536643059, allocationTime=1463536643061, startTime=1463536643064, finishTime=1463536643121, timeTaken=57, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:23,122 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536642859_0001_1_00_000000_0
2016-05-18 01:57:23,124 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:TASK_FINISHED]: vertexName=EAEA3BD7FC604EA29998BD339F9AD79A, taskId=task_1463536642859_0001_1_00_000000, startTime=1463536643064, finishTime=1463536643123, timeTaken=59, status=SUCCEEDED, successfulAttemptID=attempt_1463536642859_0001_1_00_000000_0, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536643109, Process_Duration=3, Process_End_Time=1463536643112, Read_Duration=0, Tuples_Read=10, Tuples_Written=7, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=10
2016-05-18 01:57:23,125 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:23,125 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A]
2016-05-18 01:57:23,126 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:VERTEX_FINISHED]: vertexName=EAEA3BD7FC604EA29998BD339F9AD79A, vertexId=vertex_1463536642859_0001_1_00, initRequestedTime=1463536643038, initedTime=1463536643054, startRequestedTime=1463536643039, startedTime=1463536643055, finishTime=1463536643125, timeTaken=70, status=SUCCEEDED, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536643109, Process_Duration=3, Process_End_Time=1463536643112, Read_Duration=0, Tuples_Read=10, Tuples_Written=7, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=10, vertexStats=firstTaskStartTime=1463536643064, firstTasksToStart=[ task_1463536642859_0001_1_00_000000 ], lastTaskFinishTime=1463536643121, lastTasksToFinish=[ task_1463536642859_0001_1_00_000000 ], minTaskDuration=57, maxTaskDuration=57, avgTaskDuration=57.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536642859_0001_1_00_000000 ], longestDurationTasks=[ task_1463536642859_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:23,126 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:23,127 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536642859_0001_00_000001, stoppedTime=1463536643127, exitStatus=0
2016-05-18 01:57:23,127 INFO  impl.VertexImpl (VertexImpl.java:transition(3279)) - Source task attempt completed for vertex: vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F] attempt: attempt_1463536642859_0001_1_00_000000_0 with state: SUCCEEDED vertexState: RUNNING
2016-05-18 01:57:23,127 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:schedulePendingTasks(920)) - All source tasks assigned. Ramping up 1 remaining tasks for vertex: DEBE5059D7294BFE8A9FFF882FE5645F
2016-05-18 01:57:23,127 INFO  impl.Edge (Edge.java:routingToBegin(232)) - Routing to begin for edge: EdgeInfo: sourceVertexName=EAEA3BD7FC604EA29998BD339F9AD79A, destinationVertexName=DEBE5059D7294BFE8A9FFF882FE5645F. EdgeProperty: { SCATTER_GATHER : org.apache.tez.runtime.library.input.OrderedGroupedKVInput >> PERSISTED >> org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput >> NullEdgeManager } onDemandRouting: true
2016-05-18 01:57:23,127 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536642859_0001_1_00 [EAEA3BD7FC604EA29998BD339F9AD79A] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:23,128 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:23,128 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F]
2016-05-18 01:57:23,128 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(262)) - Ignoring stop request for containerId container_1463536642859_0001_00_000001. Relying on regular task shutdown for it to end
2016-05-18 01:57:23,130 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:TASK_STARTED]: vertexName=DEBE5059D7294BFE8A9FFF882FE5645F, taskId=task_1463536642859_0001_1_01_000000, scheduledTime=1463536643130, launchTime=1463536643130
2016-05-18 01:57:23,131 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F]
2016-05-18 01:57:23,133 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536642859_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-18 01:57:23,134 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536642859_0001_00_000001: 13 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:23,134 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536642859_0001_00_000002, launchTime=1463536643133
2016-05-18 01:57:23,134 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536642859_0001_00_000001, Exiting
2016-05-18 01:57:23,135 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536642859_0001_00_000001
2016-05-18 01:57:23,135 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536642859_0001_00_000001
2016-05-18 01:57:23,135 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536642859_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:23,136 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536642859_0001_00_000001 completed successfully
2016-05-18 01:57:23,136 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536642859_0001_00_000002
2016-05-18 01:57:23,137 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536642859_0001_1_01_000000_0] started. Is using containerId: [container_1463536642859_0001_00_000002] on NM: [127.0.0.1:0]
2016-05-18 01:57:23,137 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=DEBE5059D7294BFE8A9FFF882FE5645F, taskAttemptId=attempt_1463536642859_0001_1_01_000000_0, startTime=1463536643137, containerId=container_1463536642859_0001_00_000002, nodeId=127.0.0.1:0
2016-05-18 01:57:23,138 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536642859_0001_00_000002: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536642859_0001_1_01_000000_0
2016-05-18 01:57:23 Starting to run new task attempt: attempt_1463536642859_0001_1_01_000000_0
2016-05-18 01:57:23,139 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536642859_0001_1_01_000000_0
2016-05-18 01:57:23,139 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:23,139 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:23,140 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [56892825FEEA4453AEB4DCFA82B26FCA/BDCA43DC0CFB41B39DCEF9BE33F42A36] test/(1/1) ...tGroupAssertionsFail/fail, VertexName: DEBE5059D7294BFE8A9FFF882FE5645F, VertexParallelism: 1, TaskAttemptID:attempt_1463536642859_0001_1_01_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=EAEA3BD7FC604EA29998BD339F9AD79A, physicalEdgeCount=1, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=621BBC100C7243C5897D7ECAA42A8A8B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-18 01:57:23,140 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:23,141 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536642859_0001_1_01_000000_0
2016-05-18 01:57:23,141 INFO  impl.VertexImpl (VertexImpl.java:getTaskAttemptTezEvents(3662)) - Sending attempt_1463536642859_0001_1_01_000000_0 1 events [0,1) total 1 vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F]
2016-05-18 01:57:23,142 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536642859_0001_1_01_000000_0, eventCount=1 fromEventId=0 nextFromEventId=1
2016-05-18 01:57:23,147 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:23,148 INFO  orderedgrouped.MergeManager (MergeManager.java:getInitialMemoryRequirement(339)) - Initial Memory required for SHUFFLE_BUFFER=211392912 based on INPUT_BUFFER_FACTOR=0.9,  for final merged output=0, using factor: 0.0
2016-05-18 01:57:23,158 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: DEBE5059D7294BFE8A9FFF882FE5645F, ordinal: 1
2016-05-18 01:57:23,158 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DEBE5059D7294BFE8A9FFF882FE5645F, mem on start (mb), free: 145, total: 372, max: 672
2016-05-18 01:57:23,158 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:23,158 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:23,158 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:23,159 INFO  output.MROutput (MROutput.java:initialize(421)) - 621BBC100C7243C5897D7ECAA42A8A8B: outputFormat=org.apache.hadoop.mapred.TextOutputFormat, using newmapreduce API=false
2016-05-18 01:57:23,159 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:23,159 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[621BBC100C7243C5897D7ECAA42A8A8B:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput], [EAEA3BD7FC604EA29998BD339F9AD79A:INPUT:211392912:org.apache.tez.runtime.library.input.OrderedGroupedKVInput]
2016-05-18 01:57:23,159 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:23,159 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:23,159 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 211392912, TotalRequestedScaled: 1.9513191876923078E8, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.30
2016-05-18 01:57:23,160 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[621BBC100C7243C5897D7ECAA42A8A8B:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0], [EAEA3BD7FC604EA29998BD339F9AD79A:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:211392912:211392912]
2016-05-18 01:57:23,160 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:23,160 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: EAEA3BD7FC604EA29998BD339F9AD79A being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:23,160 INFO  orderedgrouped.Shuffle (Shuffle.java:<init>(147)) - EAEA3BD7FC604EA29998BD339F9AD79A: Shuffle assigned with 1 inputs, codec: None, ifileReadAhead: true
2016-05-18 01:57:23,161 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:23,161 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:23,161 INFO  orderedgrouped.MergeManager (MergeManager.java:<init>(273)) - EAEA3BD7FC604EA29998BD339F9AD79A: MergerManager: memoryLimit=211392912, maxSingleShuffleLimit=52848228, mergeThreshold=190253616, ioSortFactor=100, postMergeMem=0, memToMemMergeOutputsThreshold=100
2016-05-18 01:57:23,162 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:<init>(353)) - ShuffleScheduler running for sourceVertex: EAEA3BD7FC604EA29998BD339F9AD79A with configuration: maxFetchFailuresBeforeReporting=5, reportReadErrorImmediately=true, maxFailedUniqueFetches=1, abortFailureLimit=15, maxTaskOutputAtOnce=20, numFetchers=1, hostFailureFraction=0.2, minFailurePerHost=4, maxAllowedFailedFetchFraction=0.5, maxStallTimeFraction=0.5, minReqProgressFraction=0.5, checkFailedFetchSinceLastCompletion=true
2016-05-18 01:57:23,162 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: EAEA3BD7FC604EA29998BD339F9AD79A
2016-05-18 01:57:23,162 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:23,163 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536642859_0001_1_01_000000_0
2016-05-18 01:57:23,165 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: GroupBy(test)[by:[{1}:'method']]
2016-05-18 01:57:23,166 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: GroupBy(test)[by:[{1}:'method']] streamed: true, id: 9696062D28554D06B8FD79EF254C3EBF
2016-05-18 01:57:23,166 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsFail/fail"], id: 621BBC100C7243C5897D7ECAA42A8A8B
2016-05-18 01:57:23,167 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsFail/fail"]
2016-05-18 01:57:23,167 INFO  element.TezGroupGate (TezGroupGate.java:prepare(90)) - calling OrderedGroupedKVInput#start() on: GroupBy(test)[by:[{1}:'method']] 9696062D28554D06B8FD79EF254C3EBF, for 1 inputs
2016-05-18 01:57:23,167 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - EAEA3BD7FC604EA29998BD339F9AD79A: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0
2016-05-18 01:57:23,169 INFO  orderedgrouped.ShuffleScheduler (ShuffleUtils.java:logIndividualFetchComplete(489)) - Completed fetch for attempt: {0, 0, attempt_1463536642859_0001_1_00_000000_0_10063} to DISK_DIRECT, csize=653, dsize=649, EndTime=1463536643169, TimeTaken=1, Rate=0.62 MB/s
2016-05-18 01:57:23,169 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:copySucceeded(551)) - All inputs fetched for input vertex : EAEA3BD7FC604EA29998BD339F9AD79A
2016-05-18 01:57:23,170 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:23,170 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:callInternal(1289)) - Shutting down FetchScheduler for input: EAEA3BD7FC604EA29998BD339F9AD79A, wasInterrupted=false
2016-05-18 01:57:23,170 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:23,171 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1005)) - finalMerge called with 0 in-memory map-outputs and 1 on-disk map-outputs
2016-05-18 01:57:23,171 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:onSuccess(1328)) - EAEA3BD7FC604EA29998BD339F9AD79A: Already shutdown. Ignoring fetch complete
2016-05-18 01:57:23,171 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1103)) - Disk file=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/56892825FEEA4453AEB4DCFA82B26FCA/BDCA43DC0CFB41B39DCEF9BE33F42A36/.tez/application_1463536642859_0001_wd/localmode-local-dir/output/attempt_1463536642859_0001_1_00_000000_0_10063/file.out, len=653, isLocal=true
2016-05-18 01:57:23,171 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1115)) - Merging 1 files, 653 bytes from disk
2016-05-18 01:57:23,172 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1130)) - Merging 0 segments, 0 bytes from memory into reduce
2016-05-18 01:57:23,172 INFO  impl.TezMerger (TezMerger.java:merge(644)) - Merging 1 sorted segments
2016-05-18 01:57:23,172 INFO  impl.TezMerger (TezMerger.java:merge(749)) - Down to the last merge-pass, with 1 segments left of total size: 633 bytes
2016-05-18 01:57:23,172 INFO  orderedgrouped.Shuffle (Shuffle.java:callInternal(332)) - merge complete for input vertex : EAEA3BD7FC604EA29998BD339F9AD79A
2016-05-18 01:57:23,172 INFO  orderedgrouped.Shuffle (Shuffle.java:onSuccess(417)) - EAEA3BD7FC604EA29998BD339F9AD79A: Shuffle Runner thread complete
2016-05-18 01:57:23,173 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: DEBE5059D7294BFE8A9FFF882FE5645F, all 1 inputs ready in: 00:00:00.006
2016-05-18 01:57:23,173 INFO  input.OrderedGroupedKVInput (OrderedGroupedKVInput.java:createValuesIterator(292)) - EAEA3BD7FC604EA29998BD339F9AD79A: creating ValuesIterator with comparator=cascading.tuple.hadoop.util.TupleComparator, keyClass=cascading.tuple.io.KeyTuple, valClass=cascading.tuple.io.ValueTuple
2016-05-18 01:57:23,175 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testGroupAssertionsFail(AppliedAssertionsPlatformTest.java:236)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-05-18 01:57:23,176 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testGroupAssertionsFail(AppliedAssertionsPlatformTest.java:236)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-05-18 01:57:23,176 ERROR element.TezGroupByGate (TezGroupByGate.java:reduce(91)) - caught throwable
cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testGroupAssertionsFail(AppliedAssertionsPlatformTest.java:236)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-05-18 01:57:23,177 INFO  output.MROutput (MROutput.java:close(526)) - 621BBC100C7243C5897D7ECAA42A8A8B closed
2016-05-18 01:57:23,178 INFO  impl.TaskImpl (TaskImpl.java:canCommit(671)) - attempt_1463536642859_0001_1_01_000000_0 given a go for committing the task output.
2016-05-18 01:57:23,178 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536642859_0001_1_01_000000_0, stopRequested=false
2016-05-18 01:57:23,179 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536642859_0001_1_01_000000_0: Counters: 33 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=9, MERGE_PHASE_TIME=11, FIRST_EVENT_RECEIVED=6, LAST_EVENT_RECEIVED=6][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][cascading.flow.SliceCounters Process_Begin_Time=1463536643173, Process_Duration=5, Process_End_Time=1463536643178, Read_Duration=1, Tuples_Read=7]]
2016-05-18 01:57:23,179 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(817)) - Joining on EventRouter
2016-05-18 01:57:23,179 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DEBE5059D7294BFE8A9FFF882FE5645F, mem on close (mb), free: 140, total: 372, max: 672
2016-05-18 01:57:23,180 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(851)) - Closed processor for vertex=DEBE5059D7294BFE8A9FFF882FE5645F, index=1, interruptedStatus=false
2016-05-18 01:57:23,180 INFO  orderedgrouped.Shuffle (Shuffle.java:shutdown(278)) - Shutting down Shuffle for source: EAEA3BD7FC604EA29998BD339F9AD79A
2016-05-18 01:57:23,180 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - EAEA3BD7FC604EA29998BD339F9AD79A: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0, updateOnClose
2016-05-18 01:57:23,180 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(887)) - Closed input for vertex=DEBE5059D7294BFE8A9FFF882FE5645F, sourceVertex=EAEA3BD7FC604EA29998BD339F9AD79A, interruptedStatus=true
2016-05-18 01:57:23,180 INFO  output.MROutput (MROutput.java:close(526)) - 621BBC100C7243C5897D7ECAA42A8A8B closed
2016-05-18 01:57:23,180 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(911)) - Closed input for vertex=DEBE5059D7294BFE8A9FFF882FE5645F, sourceVertex=621BBC100C7243C5897D7ECAA42A8A8B, interruptedStatus=true
2016-05-18 01:57:23,182 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536642859_0001_1_01_000000_0 : TaskRunner2Result{endReason=TASK_ERROR, error=cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testGroupAssertionsFail(AppliedAssertionsPlatformTest.java:236)] group size: 7, is not equal to: 0, in group ['method']: ['POST'], containerShutdownRequested=false}  
2016-05-18 01:57:23,182 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=TASK_ERROR, error=cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testGroupAssertionsFail(AppliedAssertionsPlatformTest.java:236)] group size: 7, is not equal to: 0, in group ['method']: ['POST'], containerShutdownRequested=false}
2016-05-18 01:57:23,182 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536642859_0001_00_000002
2016-05-18 01:57:23,182 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536642859_0001_00_000002
2016-05-18 01:57:23,182 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=DEBE5059D7294BFE8A9FFF882FE5645F, taskAttemptId=attempt_1463536642859_0001_1_01_000000_0, creationTime=1463536643131, allocationTime=1463536643132, startTime=1463536643137, finishTime=1463536643182, timeTaken=45, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task: attempt_1463536642859_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testGroupAssertionsFail(AppliedAssertionsPlatformTest.java:236)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 33, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=9, MERGE_PHASE_TIME=11, FIRST_EVENT_RECEIVED=6, LAST_EVENT_RECEIVED=6, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536643173, Process_Duration=5, Process_End_Time=1463536643178, Read_Duration=1, Tuples_Read=7
2016-05-18 01:57:23,182 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536642859_0001_00_000002 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testGroupAssertionsFail(AppliedAssertionsPlatformTest.java:236)] group size: 7, is not equal to: 0, in group ['method']: ['POST'], errorMessage='TaskExecutionFailure: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testGroupAssertionsFail(AppliedAssertionsPlatformTest.java:236)] group size: 7, is not equal to: 0, in group ['method']: ['POST']'}
2016-05-18 01:57:23,183 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(294)) - Container: container_1463536642859_0001_00_000002 completed but with errors
2016-05-18 01:57:23,183 INFO  impl.TaskImpl (TaskImpl.java:transition(1170)) - Failing task: task_1463536642859_0001_1_01_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-05-18 01:57:23,183 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:TASK_FINISHED]: vertexName=DEBE5059D7294BFE8A9FFF882FE5645F, taskId=task_1463536642859_0001_1_01_000000, startTime=1463536643137, finishTime=1463536643183, timeTaken=46, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task: attempt_1463536642859_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testGroupAssertionsFail(AppliedAssertionsPlatformTest.java:236)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-05-18 01:57:23,184 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(704)) - Container container_1463536642859_0001_00_000002 exited with diagnostics set to TaskExecutionFailure: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testGroupAssertionsFail(AppliedAssertionsPlatformTest.java:236)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
2016-05-18 01:57:23,184 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536642859_0001_00_000002, stoppedTime=1463536643184, exitStatus=1
2016-05-18 01:57:23,184 INFO  impl.VertexImpl (VertexImpl.java:transition(3353)) - Failing vertex: vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F] because task failed: task_1463536642859_0001_1_01_000000
2016-05-18 01:57:23,184 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(2102)) - Killing tasks in vertex: vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F] due to trigger: OWN_TASK_FAILURE
2016-05-18 01:57:23,184 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F], tasks=1, failed=1, killed=0, success=0, completed=1, commits=0, err=OWN_TASK_FAILURE
2016-05-18 01:57:23,184 INFO  impl.VertexImpl (VertexImpl.java:finishWithTerminationCause(2084)) - Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0
2016-05-18 01:57:23,185 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3087)) - Invoking committer abort for vertex, vertexId=vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F]
2016-05-18 01:57:23,185 INFO  impl.VertexImpl (VertexImpl.java:run(3095)) - Invoking committer abort for output=621BBC100C7243C5897D7ECAA42A8A8B, vertexId=vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F]
2016-05-18 01:57:23,187 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:VERTEX_FINISHED]: vertexName=DEBE5059D7294BFE8A9FFF882FE5645F, vertexId=vertex_1463536642859_0001_1_01, initRequestedTime=1463536643039, initedTime=1463536643046, startRequestedTime=1463536643057, startedTime=1463536643057, finishTime=1463536643186, timeTaken=129, status=FAILED, diagnostics=Task failed, taskId=task_1463536642859_0001_1_01_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task: attempt_1463536642859_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testGroupAssertionsFail(AppliedAssertionsPlatformTest.java:236)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]]
Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0
Vertex vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F] killed/failed due to:OWN_TASK_FAILURE, counters=Counters: 0, vertexStats=firstTaskStartTime=1463536643137, firstTasksToStart=[ task_1463536642859_0001_1_01_000000 ], lastTaskFinishTime=1463536643182, lastTasksToFinish=[ task_1463536642859_0001_1_01_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-05-18 01:57:23,187 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-05-18 01:57:23,187 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(298)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1463536642859_0001_1_01_000000_0 failed: true container: container_1463536642859_0001_00_000002 numFailedTAs: 0
2016-05-18 01:57:23,188 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F] completed., numCompletedVertices=2, numSuccessfulVertices=1, numFailedVertices=1, numKilledVertices=0, numVertices=2
2016-05-18 01:57:23,188 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=2, numSuccessfulVertices=1, numFailedVertices=1, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=VERTEX_FAILURE
2016-05-18 01:57:23,188 INFO  impl.DAGImpl (DAGImpl.java:finishWithTerminationCause(1350)) - DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0
2016-05-18 01:57:23,191 INFO  recovery.RecoveryService (RecoveryService.java:handle(327)) - DAG completed, dagId=dag_1463536642859_0001_1, queueSize=0
2016-05-18 01:57:23,193 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536642859_0001_1][Event:DAG_FINISHED]: dagId=dag_1463536642859_0001_1, startTime=1463536643038, finishTime=1463536643191, timeTaken=153, status=FAILED, diagnostics=Vertex failed, vertexName=DEBE5059D7294BFE8A9FFF882FE5645F, vertexId=vertex_1463536642859_0001_1_01, diagnostics=[Task failed, taskId=task_1463536642859_0001_1_01_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task: attempt_1463536642859_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testGroupAssertionsFail(AppliedAssertionsPlatformTest.java:236)] group size: 7, is not equal to: 0, in group ['method']: ['POST']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertGroupBase.doAssert(AssertGroupBase.java:172)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:127)
	at cascading.flow.stream.element.GroupAssertionEveryStage.completeGroup(GroupAssertionEveryStage.java:36)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F] killed/failed due to:OWN_TASK_FAILURE]
DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=2, RACK_LOCAL_TASKS=1, AM_CPU_MILLISECONDS=290, AM_GC_TIME_MILLIS=0, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536643109, Process_Duration=3, Process_End_Time=1463536643112, Read_Duration=0, Tuples_Read=10, Tuples_Written=7, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=10
2016-05-18 01:57:23,193 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3082)) - Ignoring multiple aborts for vertex: vertex_1463536642859_0001_1_01 [DEBE5059D7294BFE8A9FFF882FE5645F]
2016-05-18 01:57:23,193 INFO  impl.DAGImpl (DAGImpl.java:finished(1405)) - DAG: dag_1463536642859_0001_1 finished with state: FAILED
2016-05-18 01:57:23,193 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536642859_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-05-18 01:57:23 Completed Dag: dag_1463536642859_0001_1
2016-05-18 01:57:23,194 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(751)) - DAG completed, dagId=dag_1463536642859_0001_1, dagState=FAILED
2016-05-18 01:57:23,194 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536642859_0001_1_post
2016-05-18 01:57:23,194 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:23,194 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(800)) - Central Dispatcher queue size after DAG completion, before cleanup: 0
2016-05-18 01:57:23,194 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(802)) - Waiting for next DAG to be submitted.
2016-05-18 01:57:23,194 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(842)) - Cleaning up DAG: name=[56892825FEEA4453AEB4DCFA82B26FCA/BDCA43DC0CFB41B39DCEF9BE33F42A36] test/(1/1) ...tGroupAssertionsFail/fail, with id=dag_1463536642859_0001_1
2016-05-18 01:57:23,195 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(852)) - Completed cleanup for DAG: name=[56892825FEEA4453AEB4DCFA82B26FCA/BDCA43DC0CFB41B39DCEF9BE33F42A36] test/(1/1) ...tGroupAssertionsFail/fail, with id=dag_1463536642859_0001_1
2016-05-18 01:57:23,202 INFO  client.TezClient (TezClient.java:stop(566)) - Shutting down Tez Session, sessionName=(1/1) ...tGroupAssertionsFail/fail, applicationId=application_1463536642859_0001
2016-05-18 01:57:23,208 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(124)) - Received message to shutdown AM
2016-05-18 01:57:23,208 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:setShouldUnregisterFlag(895)) - TaskScheduler notified that it should unregister from RM
2016-05-18 01:57:23,208 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1301)) - No current running DAG, shutting down the AM
2016-05-18 01:57:23,209 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(907)) - DAGAppMasterShutdownHandler invoked
2016-05-18 01:57:23,209 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(916)) - Handling DAGAppMaster shutdown
2016-05-18 01:57:23,210 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(84)) - Stopping HistoryEventHandler
2016-05-18 01:57:23,210 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(196)) - Stopping RecoveryService
2016-05-18 01:57:23,210 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(199)) - Handle the remaining events in queue, queue size=0
2016-05-18 01:57:23,211 INFO  recovery.RecoveryService (RecoveryService.java:run(173)) - EventQueue take interrupted. Returning
2016-05-18 01:57:23,210 INFO  app.DAGAppMaster (DAGAppMaster.java:run(936)) - Sleeping for 5 seconds before shutting down
2016-05-18 01:57:23,211 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(221)) - Closing Summary Stream
2016-05-18 01:57:23,212 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-18 01:57:23,212 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-18 01:57:23,213 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:serviceStop(678)) - Shutting down AppCallbackExecutor
2016-05-18 01:57:23,220 INFO  app.DAGAppMaster (DAGAppMaster.java:run(2084)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/56892825FEEA4453AEB4DCFA82B26FCA/BDCA43DC0CFB41B39DCEF9BE33F42A36/.tez/application_1463536642859_0001
2016-05-18 01:57:23,221 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] stopping all jobs
2016-05-18 01:57:23,221 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] stopping: (1/1) ...tGroupAssertionsFail/fail
2016-05-18 01:57:23,222 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] stopped all jobs
2016-05-18 01:57:23,222 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsFail/fail/_temporary
2016-05-18 01:57:23,223 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  completed in: 00:00.385
2016-05-18 01:57:23,224 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output//hadoop2-tez/appliedassertionsplatform/testGroupAssertionsFail/fail
2016-05-18 01:57:23,266 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 01:57:23,266 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-18 01:57:23,335 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-05-18 01:57:23,351 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.036
2016-05-18 01:57:23,351 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:23,351 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:23,352 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 01:57:23,370 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt
2016-05-18 01:57:23,378 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsPass/pass
2016-05-18 01:57:23,433 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting
2016-05-18 01:57:23,433 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:23,434 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  sink: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsPass/pass"]
2016-05-18 01:57:23,434 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  parallel execution of steps is enabled: false
2016-05-18 01:57:23,434 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  executing total steps: 1
2016-05-18 01:57:23,434 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  allocating management threads: 1
2016-05-18 01:57:23,435 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting step: (1/1) ...tGroupAssertionsPass/pass
2016-05-18 01:57:23,435 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [test] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-18 01:57:23,450 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tez session mode enabled: true
2016-05-18 01:57:23,454 INFO  client.TezClient (TezClient.java:<init>(174)) - Tez Client Version: [ component=tez-api, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:23,455 INFO  client.TezClient (TezClient.java:start(394)) - Session mode. Starting session.
2016-05-18 01:57:23,455 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(164)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-18 01:57:23,465 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(122)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/74D6C12839EE41899D9B836FE786C136/C95A7B84C16544CCA7C9979A73EC5723/.tez/application_1463536643455_0001 doesn't exist and is created
2016-05-18 01:57:23,485 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(332)) - DAGAppMaster thread has been created
2016-05-18 01:57:23,486 INFO  app.DAGAppMaster (DAGAppMaster.java:run(946)) - Calling stop for all the services
2016-05-18 01:57:23,486 INFO  app.DAGAppMaster (DAGAppMaster.java:run(957)) - Exiting DAGAppMaster..GoodBye!
2016-05-18 01:57:23,486 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-18 01:57:23,487 INFO  client.LocalClient (LocalClient.java:run(282)) - Using working directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/74D6C12839EE41899D9B836FE786C136/C95A7B84C16544CCA7C9979A73EC5723/.tez/application_1463536643455_0001_wd
2016-05-18 01:57:23,503 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(363)) - Created DAGAppMaster for application appattempt_1463536643455_0001_000000, versionInfo=[ component=tez-dag, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:23,503 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(80)) - Trying to locate HadoopShimProvider for hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:23,504 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(139)) - Picked HadoopShim org.apache.tez.hadoop.shim.DefaultHadoopShim, providerName=null, overrideProviderViaConfig=null, hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:23,505 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(436)) - AM Level configured TaskSchedulers: [0:TezUber:null]
2016-05-18 01:57:23,505 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(437)) - AM Level configured ContainerLaunchers: [0:TezUber:null]
2016-05-18 01:57:23,505 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(438)) - AM Level configured TaskCommunicators: [0:TezUber:null]
2016-05-18 01:57:23,505 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(447)) - Comparing client version with AM version, clientVersion=0.8.2, AMVersion=0.8.2
2016-05-18 01:57:23,506 INFO  app.TaskCommunicatorManager (TaskCommunicatorManager.java:createUberTaskCommunicator(192)) - Creating Default Local Task Communicator
2016-05-18 01:57:23,508 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.container.AMContainerEventType for class org.apache.tez.dag.app.rm.container.AMContainerMap
2016-05-18 01:57:23,508 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.node.AMNodeEventType for class org.apache.tez.dag.app.rm.node.AMNodeTracker
2016-05-18 01:57:23,508 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGAppMasterEventType for class org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterEventHandler
2016-05-18 01:57:23,508 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGEventType for class org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher
2016-05-18 01:57:23,508 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.VertexEventType for class org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher
2016-05-18 01:57:23,508 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(529)) - Using concurrent dispatcher: false
2016-05-18 01:57:23,508 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher
2016-05-18 01:57:23,508 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskAttemptEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher
2016-05-18 01:57:23,509 INFO  common.AsyncDispatcher (AsyncDispatcher.java:registerAndCreateDispatcher(262)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for independent dispatch using: class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:23,509 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:23,509 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.AMSchedulerEventType for class org.apache.tez.dag.app.rm.TaskSchedulerManager
2016-05-18 01:57:23,510 INFO  launcher.TezContainerLauncherImpl (ContainerLauncherManager.java:createUberContainerLauncher(134)) - Creating LocalContainerLauncher
2016-05-18 01:57:23,512 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.ContainerLauncherEventType for class org.apache.tez.dag.app.launcher.ContainerLauncherManager
2016-05-18 01:57:23,513 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(78)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1, nodeUpdatesRescheduleEnabled: false
2016-05-18 01:57:23,513 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(57)) - Initializing HistoryEventHandler withrecoveryEnabled=true, historyServiceClassName=org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService
2016-05-18 01:57:23,513 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/74D6C12839EE41899D9B836FE786C136/C95A7B84C16544CCA7C9979A73EC5723/.tez/application_1463536643455_0001_wd/localmode-log-dir
2016-05-18 01:57:23,513 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/74D6C12839EE41899D9B836FE786C136/C95A7B84C16544CCA7C9979A73EC5723/.tez/application_1463536643455_0001_wd/localmode-log-dir/history.txt.appattempt_1463536643455_0001_000000, maxErrors=10
2016-05-18 01:57:23,514 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(124)) - RecoveryService initialized with recoveryPath=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/74D6C12839EE41899D9B836FE786C136/C95A7B84C16544CCA7C9979A73EC5723/.tez/application_1463536643455_0001/recovery/0, bufferSize(bytes)=8192, flushInterval(s)=30, maxUnflushedEvents=100
2016-05-18 01:57:23,514 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463536643455_0001_000000, appSubmitTime=1463536643503, launchTime=1463536643503
2016-05-18 01:57:23,518 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-18 01:57:23,524 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:47693
2016-05-18 01:57:23,524 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:createUberTaskScheduler(557)) - Creating TaskScheduler: Local TaskScheduler with clusterIdentifier=1463536643455
2016-05-18 01:57:23,526 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463536643455_0001_000000, startTime=1463536643526
2016-05-18 01:57:23,526 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1945)) - In Session mode. Waiting for DAG over RPC
2016-05-18 01:57:23,587 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-18 01:57:23,587 INFO  client.TezClient (TezClient.java:start(428)) - The url to track the Tez Session: N/A
2016-05-18 01:57:23,587 INFO  client.TezClient (TezClient.java:submitDAGSession(470)) - Submitting dag to TezSession, sessionName=(1/1) ...tGroupAssertionsPass/pass, applicationId=application_1463536643455_0001, dagName=[74D6C12839EE41899D9B836FE786C136/C95A7B84C16544CCA7C9979A73EC5723] test/(1/1) ...tGroupAssertionsPass/pass
2016-05-18 01:57:23,607 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1351)) - Starting DAG submitted via RPC: [74D6C12839EE41899D9B836FE786C136/C95A7B84C16544CCA7C9979A73EC5723] test/(1/1) ...tGroupAssertionsPass/pass
2016-05-18 01:57:23,608 INFO  app.DAGAppMaster (DAGAppMaster.java:createDAG(985)) - Merging AM credentials into DAG credentials
2016-05-18 01:57:23,609 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(1076)) - Generating DAG graphviz file, dagId=dag_1463536643455_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/74D6C12839EE41899D9B836FE786C136/C95A7B84C16544CCA7C9979A73EC5723/.tez/application_1463536643455_0001_wd/localmode-log-dir/dag_1463536643455_0001_1.dot
2016-05-18 01:57:23,609 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(1093)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/74D6C12839EE41899D9B836FE786C136/C95A7B84C16544CCA7C9979A73EC5723/.tez/application_1463536643455_0001_wd/localmode-log-dir/dag_1463536643455_0001_1-tez-dag.pb.txt
2016-05-18 01:57:23,616 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536643455_0001_1
2016-05-18 01:57:23,617 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:23,617 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2399)) - Running DAG: [74D6C12839EE41899D9B836FE786C136/C95A7B84C16544CCA7C9979A73EC5723] test/(1/1) ...tGroupAssertionsPass/pass
2016-05-18 01:57:23 Running Dag: dag_1463536643455_0001_1
2016-05-18 01:57:23,634 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463536643455_0001_1, submitTime=1463536643607
2016-05-18 01:57:23,636 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/74D6C12839EE41899D9B836FE786C136/C95A7B84C16544CCA7C9979A73EC5723/.tez/application_1463536643455_0001/tez-conf.pb" } size: 40936 timestamp: 1463536643000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:23,636 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalInputs(3978)) - Setting 1 additional inputs for vertexvertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB]
2016-05-18 01:57:23,636 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:23,639 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/74D6C12839EE41899D9B836FE786C136/C95A7B84C16544CCA7C9979A73EC5723/.tez/application_1463536643455_0001/tez-conf.pb" } size: 40936 timestamp: 1463536643000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:23,639 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4023)) - Setting 1 additional outputs for vertex vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002]
2016-05-18 01:57:23,639 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:23,640 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1593)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-18 01:57:23,640 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463536643455_0001_1, initTime=1463536643640
2016-05-18 01:57:23,641 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536643455_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-18 01:57:23,641 INFO  impl.DAGImpl (DAGImpl.java:transition(1768)) - Added additional resources : [[]] to classpath
2016-05-18 01:57:23,642 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:DAG_STARTED]: dagID=dag_1463536643455_0001_1, startTime=1463536643641
2016-05-18 01:57:23,642 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536643455_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-18 01:57:23,642 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2400)) - Root Inputs exist for Vertex: E5E7A6D6427641DCB3530CF22DF379DB : {4677533584DB4E6EAC3F45FC04733150={InputName=4677533584DB4E6EAC3F45FC04733150}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-18 01:57:23,642 INFO  client.TezClient (TezClient.java:submitDAGSession(545)) - Submitted dag to TezSession, sessionName=(1/1) ...tGroupAssertionsPass/pass, applicationId=application_1463536643455_0001, dagName=[74D6C12839EE41899D9B836FE786C136/C95A7B84C16544CCA7C9979A73EC5723] test/(1/1) ...tGroupAssertionsPass/pass
2016-05-18 01:57:23,642 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2410)) - Starting root input initializer for input: 4677533584DB4E6EAC3F45FC04733150, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-18 01:57:23,642 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2550)) - Setting vertexManager to RootInputVertexManager for vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB]
2016-05-18 01:57:23,642 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2721)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB]
2016-05-18 01:57:23,643 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2726)) - Vertex will initialize from input initializer. vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB]
2016-05-18 01:57:23,643 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3893)) - Starting 1 inputInitializers for vertex vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB]
2016-05-18 01:57:23,643 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-18 01:57:23,644 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2562)) - Setting vertexManager to ShuffleVertexManager for vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002]
2016-05-18 01:57:23,647 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:initialize(1022)) - Shuffle Vertex Manager: settings minFrac:0.25 maxFrac:0.75 auto:false desiredTaskIput:104857600 minTasks:1
2016-05-18 01:57:23,648 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2760)) - Creating 1 tasks for vertex: vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002]
2016-05-18 01:57:23,648 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2779)) - Directly initializing vertex: vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002]
2016-05-18 01:57:23,649 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536643455_0001_1_01, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=null, edgeManagersCount=1, rootInputSpecUpdateCount=0, setParallelismCalledFlag=false
2016-05-18 01:57:23,649 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2187)) - Setting up committers for vertex vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002], numAdditionalOutputs=1
2016-05-18 01:57:23,649 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2202)) - Instantiating committer for output=BF72A446A9D54C629F4F252A8EEB8F02, vertex=vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-18 01:57:23,651 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(272)) - Starting InputInitializer for Input: 4677533584DB4E6EAC3F45FC04733150 on vertex vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB]
2016-05-18 01:57:23,652 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(121)) - Committer for D79BB7AE92724A9A9BCCFCED57151002:BF72A446A9D54C629F4F252A8EEB8F02 using oldmapred API
2016-05-18 01:57:23,652 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(146)) - OutputCommitter for outputName=BF72A446A9D54C629F4F252A8EEB8F02, vertexName=D79BB7AE92724A9A9BCCFCED57151002, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-18 01:57:23,654 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:VERTEX_INITIALIZED]: vertexName=D79BB7AE92724A9A9BCCFCED57151002, vertexId=vertex_1463536643455_0001_1_01, initRequestedTime=1463536643644, initedTime=1463536643649, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=0, initGeneratedEventsCount=0
2016-05-18 01:57:23,654 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002] transitioned from NEW to INITED due to event V_INIT
2016-05-18 01:57:23,656 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(109)) - Input 4677533584DB4E6EAC3F45FC04733150 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7, groupingEnabled: true
2016-05-18 01:57:23,659 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(168)) - Grouping splits in Tez
2016-05-18 01:57:23,660 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(226)) - Desired splits: 1 too large.  Desired splitLength: 1449 Min splitLength: 52428800 New desired splits: 1 Total length: 1449 Original splits: 2
2016-05-18 01:57:23,660 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(321)) - Desired numSplits: 1 lengthPerGroup: 1449 numLocations: 1 numSplitsPerLocation: 2 numSplitsInGroup: 2 totalLength: 1449 numOriginalSplits: 2 . Grouping by length: true count: false nodeLocalOnly: false
2016-05-18 01:57:23,660 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(539)) - Number of splits desired: 1 created: 1 splitsProcessed: 2
2016-05-18 01:57:23,661 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(308)) - Succeeded InputInitializer for Input: 4677533584DB4E6EAC3F45FC04733150 on vertex vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB]
2016-05-18 01:57:23,662 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] submitted tez dag to app master: application_1463536643455_0001, with dag id: dag_1463536643455_0001_1
2016-05-18 01:57:23,666 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:23,667 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1644)) - Got updated RootInputsSpecs: {4677533584DB4E6EAC3F45FC04733150=forAllWorkUnits=true, update=[1]}
2016-05-18 01:57:23,667 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1664)) - Vertex vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB] parallelism set to 1
2016-05-18 01:57:23,667 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:23,668 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E5E7A6D6427641DCB3530CF22DF379DB, vertexId=vertex_1463536643455_0001_1_00, initRequestedTime=1463536643642, initedTime=1463536643668, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1, initGeneratedEventsCount=1
2016-05-18 01:57:23,668 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB] with distanceFromRoot: 0
2016-05-18 01:57:23,668 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB] transitioned from INITIALIZING to INITED due to event V_INPUT_DATA_INFORMATION
2016-05-18 01:57:23,668 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536643455_0001_1_00, startRequestedTime=1463536643644, startedTime=1463536643668
2016-05-18 01:57:23,669 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536643455_0001_1_00, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=org.apache.tez.dag.api.VertexLocationHint@b8338fe7, edgeManagersCount=0, rootInputSpecUpdateCount=1, setParallelismCalledFlag=true
2016-05-18 01:57:23,669 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:23,669 INFO  impl.VertexImpl (VertexImpl.java:transition(2932)) - Source vertex started: vertex_1463536643455_0001_1_00 for vertex: vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002] numStartedSources: 1 numSources: 1
2016-05-18 01:57:23,670 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002] with distanceFromRoot: 1
2016-05-18 01:57:23,670 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536643455_0001_1_01, startRequestedTime=1463536643669, startedTime=1463536643670
2016-05-18 01:57:23,670 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:23,673 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:onVertexStarted(519)) - OnVertexStarted vertex: D79BB7AE92724A9A9BCCFCED57151002 with 0 source tasks and 1 pending tasks
2016-05-18 01:57:23,673 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(100)) - Starting 1 in E5E7A6D6427641DCB3530CF22DF379DB
2016-05-18 01:57:23,673 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB]
2016-05-18 01:57:23,673 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:handleVertexStateUpdate(1051)) - Received configured notification : CONFIGURED for vertex: E5E7A6D6427641DCB3530CF22DF379DB in vertex: D79BB7AE92724A9A9BCCFCED57151002 numBipartiteSourceTasks: 1
2016-05-18 01:57:23,676 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:TASK_STARTED]: vertexName=E5E7A6D6427641DCB3530CF22DF379DB, taskId=task_1463536643455_0001_1_00_000000, scheduledTime=1463536643676, launchTime=1463536643676
2016-05-18 01:57:23,677 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB]
2016-05-18 01:57:23,678 INFO  node.PerSourceNodeTracker (PerSourceNodeTracker.java:nodeSeen(74)) - Adding new node 127.0.0.1:0 to nodeTracker 0
2016-05-18 01:57:23,680 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536643455_0001_00_000001, launchTime=1463536643680
2016-05-18 01:57:23,681 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536643455_0001_00_000001
2016-05-18 01:57:23,682 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536643455_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536643455_0001_1_00_000000_0
2016-05-18 01:57:23,682 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536643455_0001_1_00_000000_0] started. Is using containerId: [container_1463536643455_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-18 01:57:23,682 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E5E7A6D6427641DCB3530CF22DF379DB, taskAttemptId=attempt_1463536643455_0001_1_00_000000_0, startTime=1463536643682, containerId=container_1463536643455_0001_00_000001, nodeId=127.0.0.1:0
2016-05-18 01:57:23 Starting to run new task attempt: attempt_1463536643455_0001_1_00_000000_0
2016-05-18 01:57:23,682 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536643455_0001_1_00_000000_0
2016-05-18 01:57:23,683 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:23,683 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:23,683 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [74D6C12839EE41899D9B836FE786C136/C95A7B84C16544CCA7C9979A73EC5723] test/(1/1) ...tGroupAssertionsPass/pass, VertexName: E5E7A6D6427641DCB3530CF22DF379DB, VertexParallelism: 1, TaskAttemptID:attempt_1463536643455_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=4677533584DB4E6EAC3F45FC04733150, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D79BB7AE92724A9A9BCCFCED57151002, physicalEdgeCount=1, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ]
2016-05-18 01:57:23,683 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:23,684 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536643455_0001_1_00_000000_0
2016-05-18 01:57:23,685 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(496)) - TaskAttempt:attempt_1463536643455_0001_1_00_000000_0 sent events: (0-1).
2016-05-18 01:57:23,685 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536643455_0001_1_00_000000_0, eventCount=1 fromEventId=0 nextFromEventId=0
2016-05-18 01:57:23,687 INFO  input.MRInput (MRInput.java:initialize(440)) - 4677533584DB4E6EAC3F45FC04733150 using newmapreduce API=false, split via event=true, numPhysicalInputs=1
2016-05-18 01:57:23,688 INFO  input.MRInput (MRInput.java:initializeInternal(494)) - Initialized MRInput: 4677533584DB4E6EAC3F45FC04733150
2016-05-18 01:57:23,689 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:23,698 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E5E7A6D6427641DCB3530CF22DF379DB, ordinal: 0
2016-05-18 01:57:23,698 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E5E7A6D6427641DCB3530CF22DF379DB, mem on start (mb), free: 256, total: 371, max: 672
2016-05-18 01:57:23,699 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:23,699 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:23,699 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:23,699 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:23,699 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[4677533584DB4E6EAC3F45FC04733150:INPUT:0:org.apache.tez.mapreduce.input.MRInput], [D79BB7AE92724A9A9BCCFCED57151002:OUTPUT:104857600:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput]
2016-05-18 01:57:23,699 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:23,700 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:23,700 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 104857600, TotalRequestedScaled: 9.679163076923077E7, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.15
2016-05-18 01:57:23,700 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[4677533584DB4E6EAC3F45FC04733150:org.apache.tez.mapreduce.input.MRInput:INPUT:0:0], [D79BB7AE92724A9A9BCCFCED57151002:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput:OUTPUT:104857600:104857600]
2016-05-18 01:57:23,700 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:23,700 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: 4677533584DB4E6EAC3F45FC04733150 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:23,700 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:23,701 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:23,700 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: 4677533584DB4E6EAC3F45FC04733150
2016-05-18 01:57:23,701 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:23,701 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536643455_0001_1_00_000000_0
2016-05-18 01:57:23,703 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(174)) - Processing split: TezGroupedSplit{wrappedSplits=[file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:0+724, file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:724+725], wrappedInputFormatName='org.apache.hadoop.mapred.TextInputFormat', locations=[localhost], rack='null', length=1449}
2016-05-18 01:57:23,703 INFO  input.MRInput (MRInput.java:initFromEventInternal(653)) - 4677533584DB4E6EAC3F45FC04733150 initialized RecordReader from event
2016-05-18 01:57:23,706 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:23,707 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"] streamed: true, id: 4677533584DB4E6EAC3F45FC04733150
2016-05-18 01:57:23,707 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: GroupBy(test)[by:[{1}:'method']], id: 08D190603FA844C3A223D0DF9E328644
2016-05-18 01:57:23,707 INFO  element.TezGroupGate (TezGroupGate.java:prepare(98)) - calling OrderedPartitionedKVOutput#start() on: GroupBy(test)[by:[{1}:'method']] 08D190603FA844C3A223D0DF9E328644
2016-05-18 01:57:23,709 INFO  impl.ExternalSorter (ExternalSorter.java:<init>(199)) - D79BB7AE92724A9A9BCCFCED57151002 using: memoryMb=100, keySerializerClass=class cascading.tuple.io.KeyTuple, valueSerializerClass=cascading.tuple.hadoop.io.ValueTupleSerializer@191dc4a8, comparator=cascading.tuple.hadoop.util.TupleComparator@7159fe79, partitioner=cascading.tuple.tez.util.TuplePartitioner, serialization=cascading.tuple.hadoop.TupleSerialization,org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
2016-05-18 01:57:23,709 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(170)) - Setting up PipelinedSorter for D79BB7AE92724A9A9BCCFCED57151002: , UsingHashComparator=false
2016-05-18 01:57:23,723 INFO  impl.PipelinedSorter (PipelinedSorter.java:allocateSpace(245)) - Newly allocated block size=104857600, index=0, Number of buffers=1, currentAllocatableMemory=0, currentBufferSize=104857600, total=104857600
2016-05-18 01:57:23,724 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(189)) - Pre allocating rest of memory buffers upfront
2016-05-18 01:57:23,724 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(207)) - Setting up PipelinedSorter for D79BB7AE92724A9A9BCCFCED57151002: , UsingHashComparator=false#blocks=1, maxMemUsage=104857600, lazyAllocateMem=false, minBlockSize=2097152000, initial BLOCK_SIZE=104857600, finalMergeEnabled=true, pipelinedShuffle=false, sendEmptyPartitions=true, tez.runtime.io.sort.mb=100
2016-05-18 01:57:23,724 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(882)) - D79BB7AE92724A9A9BCCFCED57151002: reserved.remaining()=104857600, reserved.metasize=16777216
2016-05-18 01:57:23,725 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:23,725 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E5E7A6D6427641DCB3530CF22DF379DB, all 1 inputs ready in: 00:00:00.000
2016-05-18 01:57:23,729 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536643455_0001_1_00_000000_0
2016-05-18 01:57:23,729 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E5E7A6D6427641DCB3530CF22DF379DB, mem on close (mb), free: 154, total: 371, max: 672
2016-05-18 01:57:23,729 INFO  impl.PipelinedSorter (PipelinedSorter.java:flush(629)) - D79BB7AE92724A9A9BCCFCED57151002: Starting flush of map output
2016-05-18 01:57:23,729 INFO  impl.PipelinedSorter (PipelinedSorter.java:end(995)) - D79BB7AE92724A9A9BCCFCED57151002: Span0.length = 7, perItem = 99
2016-05-18 01:57:23,730 INFO  impl.PipelinedSorter (PipelinedSorter.java:sort(904)) - D79BB7AE92724A9A9BCCFCED57151002: done sorting span=0, length=7, time=0
2016-05-18 01:57:23,730 INFO  impl.PipelinedSorter (PipelinedSorter.java:ready(1297)) - D79BB7AE92724A9A9BCCFCED57151002: Heap = SpanIterator<0:6> (span=Span[16777216,693]),
2016-05-18 01:57:23,732 INFO  impl.PipelinedSorter (PipelinedSorter.java:spill(546)) - D79BB7AE92724A9A9BCCFCED57151002: Spilling to /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/74D6C12839EE41899D9B836FE786C136/C95A7B84C16544CCA7C9979A73EC5723/.tez/application_1463536643455_0001_wd/localmode-local-dir/output/attempt_1463536643455_0001_1_00_000000_0_10069_0/file.out
2016-05-18 01:57:23,735 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:23 Completed running task attempt: attempt_1463536643455_0001_1_00_000000_0
2016-05-18 01:57:23,736 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536643455_0001_1_00_000000_0, askedToStop=false
2016-05-18 01:57:23,736 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536643455_0001_1_00_000000_0, stopRequested=false
2016-05-18 01:57:23,737 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536643455_0001_1_00_000000_0: Counters: 18 [[org.apache.tez.common.counters.TaskCounter SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1][cascading.flow.SliceCounters Process_Begin_Time=1463536643725, Process_Duration=3, Process_End_Time=1463536643728, Read_Duration=2, Tuples_Read=10, Tuples_Written=7, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=10]]
2016-05-18 01:57:23,738 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536643455_0001_1_00_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:23,738 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:23,739 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:23,739 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:23,739 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E5E7A6D6427641DCB3530CF22DF379DB, taskAttemptId=attempt_1463536643455_0001_1_00_000000_0, creationTime=1463536643677, allocationTime=1463536643679, startTime=1463536643682, finishTime=1463536643739, timeTaken=57, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:23,739 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536643455_0001_1_00_000000_0
2016-05-18 01:57:23,740 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536643455_0001_00_000001
2016-05-18 01:57:23,740 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:TASK_FINISHED]: vertexName=E5E7A6D6427641DCB3530CF22DF379DB, taskId=task_1463536643455_0001_1_00_000000, startTime=1463536643682, finishTime=1463536643740, timeTaken=58, status=SUCCEEDED, successfulAttemptID=attempt_1463536643455_0001_1_00_000000_0, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536643725, Process_Duration=3, Process_End_Time=1463536643728, Read_Duration=2, Tuples_Read=10, Tuples_Written=7, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10
2016-05-18 01:57:23,741 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:23,741 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB]
2016-05-18 01:57:23,742 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:VERTEX_FINISHED]: vertexName=E5E7A6D6427641DCB3530CF22DF379DB, vertexId=vertex_1463536643455_0001_1_00, initRequestedTime=1463536643642, initedTime=1463536643668, startRequestedTime=1463536643644, startedTime=1463536643668, finishTime=1463536643741, timeTaken=73, status=SUCCEEDED, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536643725, Process_Duration=3, Process_End_Time=1463536643728, Read_Duration=2, Tuples_Read=10, Tuples_Written=7, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10, vertexStats=firstTaskStartTime=1463536643682, firstTasksToStart=[ task_1463536643455_0001_1_00_000000 ], lastTaskFinishTime=1463536643739, lastTasksToFinish=[ task_1463536643455_0001_1_00_000000 ], minTaskDuration=57, maxTaskDuration=57, avgTaskDuration=57.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536643455_0001_1_00_000000 ], longestDurationTasks=[ task_1463536643455_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:23,742 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:23,742 INFO  impl.VertexImpl (VertexImpl.java:transition(3279)) - Source task attempt completed for vertex: vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002] attempt: attempt_1463536643455_0001_1_00_000000_0 with state: SUCCEEDED vertexState: RUNNING
2016-05-18 01:57:23,742 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:schedulePendingTasks(920)) - All source tasks assigned. Ramping up 1 remaining tasks for vertex: D79BB7AE92724A9A9BCCFCED57151002
2016-05-18 01:57:23,742 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536643455_0001_00_000001, stoppedTime=1463536643742, exitStatus=0
2016-05-18 01:57:23,742 INFO  impl.Edge (Edge.java:routingToBegin(232)) - Routing to begin for edge: EdgeInfo: sourceVertexName=E5E7A6D6427641DCB3530CF22DF379DB, destinationVertexName=D79BB7AE92724A9A9BCCFCED57151002. EdgeProperty: { SCATTER_GATHER : org.apache.tez.runtime.library.input.OrderedGroupedKVInput >> PERSISTED >> org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput >> NullEdgeManager } onDemandRouting: true
2016-05-18 01:57:23,743 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002]
2016-05-18 01:57:23,743 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:23,744 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:23,744 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(262)) - Ignoring stop request for containerId container_1463536643455_0001_00_000001. Relying on regular task shutdown for it to end
2016-05-18 01:57:23,744 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:TASK_STARTED]: vertexName=D79BB7AE92724A9A9BCCFCED57151002, taskId=task_1463536643455_0001_1_01_000000, scheduledTime=1463536643744, launchTime=1463536643744
2016-05-18 01:57:23,745 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002]
2016-05-18 01:57:23,747 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536643455_0001_00_000002, launchTime=1463536643747
2016-05-18 01:57:23,748 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536643455_0001_00_000002
2016-05-18 01:57:23,748 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536643455_0001_00_000002: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536643455_0001_1_01_000000_0
2016-05-18 01:57:23,749 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536643455_0001_1_01_000000_0] started. Is using containerId: [container_1463536643455_0001_00_000002] on NM: [127.0.0.1:0]
2016-05-18 01:57:23 Starting to run new task attempt: attempt_1463536643455_0001_1_01_000000_0
2016-05-18 01:57:23,749 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536643455_0001_1_01_000000_0
2016-05-18 01:57:23,749 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:23,749 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:23,750 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [74D6C12839EE41899D9B836FE786C136/C95A7B84C16544CCA7C9979A73EC5723] test/(1/1) ...tGroupAssertionsPass/pass, VertexName: D79BB7AE92724A9A9BCCFCED57151002, VertexParallelism: 1, TaskAttemptID:attempt_1463536643455_0001_1_01_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=E5E7A6D6427641DCB3530CF22DF379DB, physicalEdgeCount=1, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=BF72A446A9D54C629F4F252A8EEB8F02, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-18 01:57:23,750 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:23,750 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536643455_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-18 01:57:23,750 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536643455_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:23,751 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536643455_0001_00_000001, Exiting
2016-05-18 01:57:23,751 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536643455_0001_00_000001
2016-05-18 01:57:23,751 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536643455_0001_00_000001
2016-05-18 01:57:23,752 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536643455_0001_1_01_000000_0
2016-05-18 01:57:23,749 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=D79BB7AE92724A9A9BCCFCED57151002, taskAttemptId=attempt_1463536643455_0001_1_01_000000_0, startTime=1463536643748, containerId=container_1463536643455_0001_00_000002, nodeId=127.0.0.1:0
2016-05-18 01:57:23,753 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536643455_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:23,753 INFO  impl.VertexImpl (VertexImpl.java:getTaskAttemptTezEvents(3662)) - Sending attempt_1463536643455_0001_1_01_000000_0 1 events [0,1) total 1 vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002]
2016-05-18 01:57:23,753 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536643455_0001_1_01_000000_0, eventCount=1 fromEventId=0 nextFromEventId=1
2016-05-18 01:57:23,754 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536643455_0001_00_000001 completed successfully
2016-05-18 01:57:23,758 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:23,764 INFO  orderedgrouped.MergeManager (MergeManager.java:getInitialMemoryRequirement(339)) - Initial Memory required for SHUFFLE_BUFFER=211392912 based on INPUT_BUFFER_FACTOR=0.9,  for final merged output=0, using factor: 0.0
2016-05-18 01:57:23,769 INFO  output.MROutput (MROutput.java:initialize(421)) - BF72A446A9D54C629F4F252A8EEB8F02: outputFormat=org.apache.hadoop.mapred.TextOutputFormat, using newmapreduce API=false
2016-05-18 01:57:23,770 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: D79BB7AE92724A9A9BCCFCED57151002, ordinal: 1
2016-05-18 01:57:23,770 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D79BB7AE92724A9A9BCCFCED57151002, mem on start (mb), free: 147, total: 371, max: 672
2016-05-18 01:57:23,770 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:23,771 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:23,771 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:23,771 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:23,772 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[BF72A446A9D54C629F4F252A8EEB8F02:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput], [E5E7A6D6427641DCB3530CF22DF379DB:INPUT:211392912:org.apache.tez.runtime.library.input.OrderedGroupedKVInput]
2016-05-18 01:57:23,772 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:23,772 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:23,773 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 211392912, TotalRequestedScaled: 1.9513191876923078E8, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.30
2016-05-18 01:57:23,773 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[BF72A446A9D54C629F4F252A8EEB8F02:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0], [E5E7A6D6427641DCB3530CF22DF379DB:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:211392912:211392912]
2016-05-18 01:57:23,773 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:23,774 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: E5E7A6D6427641DCB3530CF22DF379DB being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:23,774 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:23,775 INFO  orderedgrouped.Shuffle (Shuffle.java:<init>(147)) - E5E7A6D6427641DCB3530CF22DF379DB: Shuffle assigned with 1 inputs, codec: None, ifileReadAhead: true
2016-05-18 01:57:23,775 INFO  orderedgrouped.MergeManager (MergeManager.java:<init>(273)) - E5E7A6D6427641DCB3530CF22DF379DB: MergerManager: memoryLimit=211392912, maxSingleShuffleLimit=52848228, mergeThreshold=190253616, ioSortFactor=100, postMergeMem=0, memToMemMergeOutputsThreshold=100
2016-05-18 01:57:23,776 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:23,776 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:<init>(353)) - ShuffleScheduler running for sourceVertex: E5E7A6D6427641DCB3530CF22DF379DB with configuration: maxFetchFailuresBeforeReporting=5, reportReadErrorImmediately=true, maxFailedUniqueFetches=1, abortFailureLimit=15, maxTaskOutputAtOnce=20, numFetchers=1, hostFailureFraction=0.2, minFailurePerHost=4, maxAllowedFailedFetchFraction=0.5, maxStallTimeFraction=0.5, minReqProgressFraction=0.5, checkFailedFetchSinceLastCompletion=true
2016-05-18 01:57:23,779 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: E5E7A6D6427641DCB3530CF22DF379DB
2016-05-18 01:57:23,779 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:23,780 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536643455_0001_1_01_000000_0
2016-05-18 01:57:23,781 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - E5E7A6D6427641DCB3530CF22DF379DB: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0
2016-05-18 01:57:23,782 INFO  orderedgrouped.ShuffleScheduler (ShuffleUtils.java:logIndividualFetchComplete(489)) - Completed fetch for attempt: {0, 0, attempt_1463536643455_0001_1_00_000000_0_10069} to DISK_DIRECT, csize=653, dsize=649, EndTime=1463536643782, TimeTaken=1, Rate=0.62 MB/s
2016-05-18 01:57:23,783 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:copySucceeded(551)) - All inputs fetched for input vertex : E5E7A6D6427641DCB3530CF22DF379DB
2016-05-18 01:57:23,783 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:23,784 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: GroupBy(test)[by:[{1}:'method']]
2016-05-18 01:57:23,784 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:callInternal(1289)) - Shutting down FetchScheduler for input: E5E7A6D6427641DCB3530CF22DF379DB, wasInterrupted=false
2016-05-18 01:57:23,784 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: GroupBy(test)[by:[{1}:'method']] streamed: true, id: 08D190603FA844C3A223D0DF9E328644
2016-05-18 01:57:23,785 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:23,785 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsPass/pass"], id: BF72A446A9D54C629F4F252A8EEB8F02
2016-05-18 01:57:23,786 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsPass/pass"]
2016-05-18 01:57:23,786 INFO  element.TezGroupGate (TezGroupGate.java:prepare(90)) - calling OrderedGroupedKVInput#start() on: GroupBy(test)[by:[{1}:'method']] 08D190603FA844C3A223D0DF9E328644, for 1 inputs
2016-05-18 01:57:23,788 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1005)) - finalMerge called with 0 in-memory map-outputs and 1 on-disk map-outputs
2016-05-18 01:57:23,788 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1103)) - Disk file=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/74D6C12839EE41899D9B836FE786C136/C95A7B84C16544CCA7C9979A73EC5723/.tez/application_1463536643455_0001_wd/localmode-local-dir/output/attempt_1463536643455_0001_1_00_000000_0_10069/file.out, len=653, isLocal=true
2016-05-18 01:57:23,788 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1115)) - Merging 1 files, 653 bytes from disk
2016-05-18 01:57:23,788 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1130)) - Merging 0 segments, 0 bytes from memory into reduce
2016-05-18 01:57:23,788 INFO  impl.TezMerger (TezMerger.java:merge(644)) - Merging 1 sorted segments
2016-05-18 01:57:23,789 INFO  impl.TezMerger (TezMerger.java:merge(749)) - Down to the last merge-pass, with 1 segments left of total size: 633 bytes
2016-05-18 01:57:23,789 INFO  orderedgrouped.Shuffle (Shuffle.java:callInternal(332)) - merge complete for input vertex : E5E7A6D6427641DCB3530CF22DF379DB
2016-05-18 01:57:23,789 INFO  orderedgrouped.Shuffle (Shuffle.java:onSuccess(417)) - E5E7A6D6427641DCB3530CF22DF379DB: Shuffle Runner thread complete
2016-05-18 01:57:23,789 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: D79BB7AE92724A9A9BCCFCED57151002, all 1 inputs ready in: 00:00:00.002
2016-05-18 01:57:23,790 INFO  input.OrderedGroupedKVInput (OrderedGroupedKVInput.java:createValuesIterator(292)) - E5E7A6D6427641DCB3530CF22DF379DB: creating ValuesIterator with comparator=cascading.tuple.hadoop.util.TupleComparator, keyClass=cascading.tuple.io.KeyTuple, valClass=cascading.tuple.io.ValueTuple
2016-05-18 01:57:23,793 INFO  output.MROutput (MROutput.java:close(526)) - BF72A446A9D54C629F4F252A8EEB8F02 closed
2016-05-18 01:57:23,794 INFO  impl.TaskImpl (TaskImpl.java:canCommit(671)) - attempt_1463536643455_0001_1_01_000000_0 given a go for committing the task output.
2016-05-18 01:57:23,795 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536643455_0001_1_01_000000_0
2016-05-18 01:57:23,795 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D79BB7AE92724A9A9BCCFCED57151002, mem on close (mb), free: 143, total: 371, max: 672
2016-05-18 01:57:23,795 INFO  orderedgrouped.Shuffle (Shuffle.java:shutdown(278)) - Shutting down Shuffle for source: E5E7A6D6427641DCB3530CF22DF379DB
2016-05-18 01:57:23,796 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - E5E7A6D6427641DCB3530CF22DF379DB: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0, updateOnClose
2016-05-18 01:57:23,796 INFO  output.MROutput (MROutput.java:close(526)) - BF72A446A9D54C629F4F252A8EEB8F02 closed
2016-05-18 01:57:23,797 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:23 Completed running task attempt: attempt_1463536643455_0001_1_01_000000_0
2016-05-18 01:57:23,799 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536643455_0001_1_01_000000_0, askedToStop=false
2016-05-18 01:57:23,799 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536643455_0001_1_01_000000_0, stopRequested=false
2016-05-18 01:57:23,800 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536643455_0001_1_01_000000_0: Counters: 36 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=9, MERGE_PHASE_TIME=14, FIRST_EVENT_RECEIVED=6, LAST_EVENT_RECEIVED=6][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][cascading.flow.SliceCounters Process_Begin_Time=1463536643790, Process_Duration=5, Process_End_Time=1463536643795, Read_Duration=0, Tuples_Read=7, Tuples_Written=1, Write_Duration=0][cascading.flow.StepCounters Tuples_Written=1]]
2016-05-18 01:57:23,801 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536643455_0001_1_01_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:23,801 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=D79BB7AE92724A9A9BCCFCED57151002, taskAttemptId=attempt_1463536643455_0001_1_01_000000_0, creationTime=1463536643744, allocationTime=1463536643746, startTime=1463536643748, finishTime=1463536643801, timeTaken=53, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:23,801 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:23,802 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:23,802 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:23,802 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536643455_0001_1_01_000000_0
2016-05-18 01:57:23,803 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:TASK_FINISHED]: vertexName=D79BB7AE92724A9A9BCCFCED57151002, taskId=task_1463536643455_0001_1_01_000000, startTime=1463536643748, finishTime=1463536643802, timeTaken=54, status=SUCCEEDED, successfulAttemptID=attempt_1463536643455_0001_1_01_000000_0, diagnostics=, counters=Counters: 36, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=9, MERGE_PHASE_TIME=14, FIRST_EVENT_RECEIVED=6, LAST_EVENT_RECEIVED=6, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536643790, Process_Duration=5, Process_End_Time=1463536643795, Read_Duration=0, Tuples_Read=7, Tuples_Written=1, Write_Duration=0, cascading.flow.StepCounters, Tuples_Written=1
2016-05-18 01:57:23,803 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:23,803 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002]
2016-05-18 01:57:23,804 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536643455_0001_00_000002
2016-05-18 01:57:23,804 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:VERTEX_FINISHED]: vertexName=D79BB7AE92724A9A9BCCFCED57151002, vertexId=vertex_1463536643455_0001_1_01, initRequestedTime=1463536643644, initedTime=1463536643649, startRequestedTime=1463536643669, startedTime=1463536643670, finishTime=1463536643803, timeTaken=133, status=SUCCEEDED, diagnostics=, counters=Counters: 36, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=9, MERGE_PHASE_TIME=14, FIRST_EVENT_RECEIVED=6, LAST_EVENT_RECEIVED=6, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536643790, Process_Duration=5, Process_End_Time=1463536643795, Read_Duration=0, Tuples_Read=7, Tuples_Written=1, Write_Duration=0, cascading.flow.StepCounters, Tuples_Written=1, vertexStats=firstTaskStartTime=1463536643748, firstTasksToStart=[ task_1463536643455_0001_1_01_000000 ], lastTaskFinishTime=1463536643801, lastTasksToFinish=[ task_1463536643455_0001_1_01_000000 ], minTaskDuration=53, maxTaskDuration=53, avgTaskDuration=53.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536643455_0001_1_01_000000 ], longestDurationTasks=[ task_1463536643455_0001_1_01_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:23,805 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:23,805 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536643455_0001_00_000002, stoppedTime=1463536643805, exitStatus=0
2016-05-18 01:57:23,805 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002] completed., numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:23,805 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:23,805 INFO  impl.DAGImpl (DAGImpl.java:commitOrFinish(1051)) - No output committers for vertex: vertex_1463536643455_0001_1_00 [E5E7A6D6427641DCB3530CF22DF379DB]
2016-05-18 01:57:23,806 INFO  impl.DAGImpl (DAGImpl.java:commitOrFinish(1098)) - Start writing dag commit event, dag_1463536643455_0001_1
2016-05-18 01:57:23,806 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463536643455_0001_1
2016-05-18 01:57:23,806 INFO  impl.DAGImpl (DAGImpl.java:call(1083)) - Committing output: BF72A446A9D54C629F4F252A8EEB8F02 for vertex: vertex_1463536643455_0001_1_01 [D79BB7AE92724A9A9BCCFCED57151002], outputName: BF72A446A9D54C629F4F252A8EEB8F02
2016-05-18 01:57:23,809 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536643455_0001_1 transitioned from RUNNING to COMMITTING due to event DAG_VERTEX_COMPLETED
2016-05-18 01:57:23,809 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(262)) - Ignoring stop request for containerId container_1463536643455_0001_00_000002. Relying on regular task shutdown for it to end
2016-05-18 01:57:23,816 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536643455_0001_00_000002 is valid, but no longer registered, and will be killed
2016-05-18 01:57:23,816 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536643455_0001_00_000002: 12 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:23,816 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536643455_0001_00_000002, Exiting
2016-05-18 01:57:23,816 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536643455_0001_00_000002
2016-05-18 01:57:23,816 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536643455_0001_00_000002
2016-05-18 01:57:23,819 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536643455_0001_00_000002 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:23,819 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536643455_0001_00_000002 completed successfully
2016-05-18 01:57:23,820 INFO  impl.DAGImpl (DAGImpl.java:commitCompleted(2192)) - Commit succeeded for output:outputName:BF72A446A9D54C629F4F252A8EEB8F02 of vertex/vertexGroup:D79BB7AE92724A9A9BCCFCED57151002 isVertexGroupOutput:false
2016-05-18 01:57:23,820 INFO  impl.DAGImpl (DAGImpl.java:checkCommitsForCompletion(1313)) - Checking commits for DAG completion, numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:23,823 INFO  recovery.RecoveryService (RecoveryService.java:handle(327)) - DAG completed, dagId=dag_1463536643455_0001_1, queueSize=0
2016-05-18 01:57:23,824 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536643455_0001_1][Event:DAG_FINISHED]: dagId=dag_1463536643455_0001_1, startTime=1463536643641, finishTime=1463536643820, timeTaken=179, status=SUCCEEDED, diagnostics=, counters=Counters: 48, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=2, TOTAL_LAUNCHED_TASKS=2, RACK_LOCAL_TASKS=1, AM_CPU_MILLISECONDS=440, AM_GC_TIME_MILLIS=0, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=14, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=8, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=9, MERGE_PHASE_TIME=14, FIRST_EVENT_RECEIVED=6, LAST_EVENT_RECEIVED=6, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=2927073287515, Process_Duration=8, Process_End_Time=2927073287523, Read_Duration=2, Tuples_Read=17, Tuples_Written=8, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10, Tuples_Written=1
2016-05-18 01:57:23,825 INFO  impl.DAGImpl (DAGImpl.java:finished(1405)) - DAG: dag_1463536643455_0001_1 finished with state: SUCCEEDED
2016-05-18 01:57:23,825 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536643455_0001_1 transitioned from COMMITTING to SUCCEEDED due to event DAG_COMMIT_COMPLETED
2016-05-18 01:57:23 Completed Dag: dag_1463536643455_0001_1
2016-05-18 01:57:23,827 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(751)) - DAG completed, dagId=dag_1463536643455_0001_1, dagState=SUCCEEDED
2016-05-18 01:57:23,827 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536643455_0001_1_post
2016-05-18 01:57:23,827 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:23,828 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(800)) - Central Dispatcher queue size after DAG completion, before cleanup: 0
2016-05-18 01:57:23,828 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(802)) - Waiting for next DAG to be submitted.
2016-05-18 01:57:23,829 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(842)) - Cleaning up DAG: name=[74D6C12839EE41899D9B836FE786C136/C95A7B84C16544CCA7C9979A73EC5723] test/(1/1) ...tGroupAssertionsPass/pass, with id=dag_1463536643455_0001_1
2016-05-18 01:57:23,829 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(852)) - Completed cleanup for DAG: name=[74D6C12839EE41899D9B836FE786C136/C95A7B84C16544CCA7C9979A73EC5723] test/(1/1) ...tGroupAssertionsPass/pass, with id=dag_1463536643455_0001_1
2016-05-18 01:57:23,834 INFO  client.TezClient (TezClient.java:stop(566)) - Shutting down Tez Session, sessionName=(1/1) ...tGroupAssertionsPass/pass, applicationId=application_1463536643455_0001
2016-05-18 01:57:23,836 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(124)) - Received message to shutdown AM
2016-05-18 01:57:23,837 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:setShouldUnregisterFlag(895)) - TaskScheduler notified that it should unregister from RM
2016-05-18 01:57:23,837 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1301)) - No current running DAG, shutting down the AM
2016-05-18 01:57:23,837 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(907)) - DAGAppMasterShutdownHandler invoked
2016-05-18 01:57:23,837 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(916)) - Handling DAGAppMaster shutdown
2016-05-18 01:57:23,837 INFO  app.DAGAppMaster (DAGAppMaster.java:run(936)) - Sleeping for 5 seconds before shutting down
2016-05-18 01:57:23,838 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(84)) - Stopping HistoryEventHandler
2016-05-18 01:57:23,838 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(196)) - Stopping RecoveryService
2016-05-18 01:57:23,838 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(199)) - Handle the remaining events in queue, queue size=0
2016-05-18 01:57:23,839 INFO  recovery.RecoveryService (RecoveryService.java:run(173)) - EventQueue take interrupted. Returning
2016-05-18 01:57:23,840 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(221)) - Closing Summary Stream
2016-05-18 01:57:23,840 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-18 01:57:23,840 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-18 01:57:23,840 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:serviceStop(678)) - Shutting down AppCallbackExecutor
2016-05-18 01:57:23,845 INFO  app.DAGAppMaster (DAGAppMaster.java:run(2084)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/74D6C12839EE41899D9B836FE786C136/C95A7B84C16544CCA7C9979A73EC5723/.tez/application_1463536643455_0001
2016-05-18 01:57:23,845 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testGroupAssertionsPass/pass/_temporary
2016-05-18 01:57:23,845 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  completed in: 00:00.412
2016-05-18 01:57:23,885 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output//hadoop2-tez/appliedassertionsplatform/testGroupAssertionsPass/pass
2016-05-18 01:57:23,924 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 01:57:23,924 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-18 01:57:23,965 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.013
2016-05-18 01:57:23,984 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.032
2016-05-18 01:57:23,985 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:23,985 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:23,985 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 01:57:24,004 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt
2016-05-18 01:57:24,013 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsFail/value/fail
2016-05-18 01:57:24,070 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting
2016-05-18 01:57:24,070 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:24,070 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  sink: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsFail/value/fail"]
2016-05-18 01:57:24,070 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  parallel execution of steps is enabled: false
2016-05-18 01:57:24,071 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  executing total steps: 1
2016-05-18 01:57:24,071 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  allocating management threads: 1
2016-05-18 01:57:24,072 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting step: (1/1) ...AssertionsFail/value/fail
2016-05-18 01:57:24,072 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [test] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-18 01:57:24,087 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tez session mode enabled: true
2016-05-18 01:57:24,092 INFO  client.TezClient (TezClient.java:<init>(174)) - Tez Client Version: [ component=tez-api, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:24,092 INFO  client.TezClient (TezClient.java:start(394)) - Session mode. Starting session.
2016-05-18 01:57:24,092 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(164)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-18 01:57:24,103 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(122)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/6C2E1F987F384CB789C79555266BCB8A/A7FFE11D12E04AB3AAFF74F33AF5BDBE/.tez/application_1463536644092_0001 doesn't exist and is created
2016-05-18 01:57:24,124 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(332)) - DAGAppMaster thread has been created
2016-05-18 01:57:24,125 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-18 01:57:24,125 INFO  client.LocalClient (LocalClient.java:run(282)) - Using working directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/6C2E1F987F384CB789C79555266BCB8A/A7FFE11D12E04AB3AAFF74F33AF5BDBE/.tez/application_1463536644092_0001_wd
2016-05-18 01:57:24,143 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(363)) - Created DAGAppMaster for application appattempt_1463536644092_0001_000000, versionInfo=[ component=tez-dag, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:24,143 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(80)) - Trying to locate HadoopShimProvider for hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:24,143 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(139)) - Picked HadoopShim org.apache.tez.hadoop.shim.DefaultHadoopShim, providerName=null, overrideProviderViaConfig=null, hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:24,145 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(436)) - AM Level configured TaskSchedulers: [0:TezUber:null]
2016-05-18 01:57:24,145 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(437)) - AM Level configured ContainerLaunchers: [0:TezUber:null]
2016-05-18 01:57:24,145 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(438)) - AM Level configured TaskCommunicators: [0:TezUber:null]
2016-05-18 01:57:24,145 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(447)) - Comparing client version with AM version, clientVersion=0.8.2, AMVersion=0.8.2
2016-05-18 01:57:24,147 INFO  app.TaskCommunicatorManager (TaskCommunicatorManager.java:createUberTaskCommunicator(192)) - Creating Default Local Task Communicator
2016-05-18 01:57:24,149 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.container.AMContainerEventType for class org.apache.tez.dag.app.rm.container.AMContainerMap
2016-05-18 01:57:24,149 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.node.AMNodeEventType for class org.apache.tez.dag.app.rm.node.AMNodeTracker
2016-05-18 01:57:24,149 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGAppMasterEventType for class org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterEventHandler
2016-05-18 01:57:24,149 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGEventType for class org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher
2016-05-18 01:57:24,150 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.VertexEventType for class org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher
2016-05-18 01:57:24,150 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(529)) - Using concurrent dispatcher: false
2016-05-18 01:57:24,150 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher
2016-05-18 01:57:24,150 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskAttemptEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher
2016-05-18 01:57:24,150 INFO  common.AsyncDispatcher (AsyncDispatcher.java:registerAndCreateDispatcher(262)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for independent dispatch using: class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:24,151 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:24,151 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.AMSchedulerEventType for class org.apache.tez.dag.app.rm.TaskSchedulerManager
2016-05-18 01:57:24,151 INFO  launcher.TezContainerLauncherImpl (ContainerLauncherManager.java:createUberContainerLauncher(134)) - Creating LocalContainerLauncher
2016-05-18 01:57:24,153 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.ContainerLauncherEventType for class org.apache.tez.dag.app.launcher.ContainerLauncherManager
2016-05-18 01:57:24,154 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(78)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1, nodeUpdatesRescheduleEnabled: false
2016-05-18 01:57:24,155 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(57)) - Initializing HistoryEventHandler withrecoveryEnabled=true, historyServiceClassName=org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService
2016-05-18 01:57:24,155 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/6C2E1F987F384CB789C79555266BCB8A/A7FFE11D12E04AB3AAFF74F33AF5BDBE/.tez/application_1463536644092_0001_wd/localmode-log-dir
2016-05-18 01:57:24,155 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/6C2E1F987F384CB789C79555266BCB8A/A7FFE11D12E04AB3AAFF74F33AF5BDBE/.tez/application_1463536644092_0001_wd/localmode-log-dir/history.txt.appattempt_1463536644092_0001_000000, maxErrors=10
2016-05-18 01:57:24,156 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(124)) - RecoveryService initialized with recoveryPath=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/6C2E1F987F384CB789C79555266BCB8A/A7FFE11D12E04AB3AAFF74F33AF5BDBE/.tez/application_1463536644092_0001/recovery/0, bufferSize(bytes)=8192, flushInterval(s)=30, maxUnflushedEvents=100
2016-05-18 01:57:24,156 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463536644092_0001_000000, appSubmitTime=1463536644142, launchTime=1463536644142
2016-05-18 01:57:24,165 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-18 01:57:24,171 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:53109
2016-05-18 01:57:24,174 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:createUberTaskScheduler(557)) - Creating TaskScheduler: Local TaskScheduler with clusterIdentifier=1463536644092
2016-05-18 01:57:24,177 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463536644092_0001_000000, startTime=1463536644176
2016-05-18 01:57:24,177 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1945)) - In Session mode. Waiting for DAG over RPC
2016-05-18 01:57:24,212 INFO  app.DAGAppMaster (DAGAppMaster.java:run(946)) - Calling stop for all the services
2016-05-18 01:57:24,213 INFO  app.DAGAppMaster (DAGAppMaster.java:run(957)) - Exiting DAGAppMaster..GoodBye!
2016-05-18 01:57:24,225 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-18 01:57:24,225 INFO  client.TezClient (TezClient.java:start(428)) - The url to track the Tez Session: N/A
2016-05-18 01:57:24,226 INFO  client.TezClient (TezClient.java:submitDAGSession(470)) - Submitting dag to TezSession, sessionName=(1/1) ...AssertionsFail/value/fail, applicationId=application_1463536644092_0001, dagName=[6C2E1F987F384CB789C79555266BCB8A/A7FFE11D12E04AB3AAFF74F33AF5BDBE] test/(1/1) ...AssertionsFail/value/fail
2016-05-18 01:57:24,246 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1351)) - Starting DAG submitted via RPC: [6C2E1F987F384CB789C79555266BCB8A/A7FFE11D12E04AB3AAFF74F33AF5BDBE] test/(1/1) ...AssertionsFail/value/fail
2016-05-18 01:57:24,247 INFO  app.DAGAppMaster (DAGAppMaster.java:createDAG(985)) - Merging AM credentials into DAG credentials
2016-05-18 01:57:24,247 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(1076)) - Generating DAG graphviz file, dagId=dag_1463536644092_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/6C2E1F987F384CB789C79555266BCB8A/A7FFE11D12E04AB3AAFF74F33AF5BDBE/.tez/application_1463536644092_0001_wd/localmode-log-dir/dag_1463536644092_0001_1.dot
2016-05-18 01:57:24,248 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(1093)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/6C2E1F987F384CB789C79555266BCB8A/A7FFE11D12E04AB3AAFF74F33AF5BDBE/.tez/application_1463536644092_0001_wd/localmode-log-dir/dag_1463536644092_0001_1-tez-dag.pb.txt
2016-05-18 01:57:24,256 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536644092_0001_1
2016-05-18 01:57:24,256 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:24,256 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2399)) - Running DAG: [6C2E1F987F384CB789C79555266BCB8A/A7FFE11D12E04AB3AAFF74F33AF5BDBE] test/(1/1) ...AssertionsFail/value/fail
2016-05-18 01:57:24 Running Dag: dag_1463536644092_0001_1
2016-05-18 01:57:24,272 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463536644092_0001_1, submitTime=1463536644246
2016-05-18 01:57:24,274 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/6C2E1F987F384CB789C79555266BCB8A/A7FFE11D12E04AB3AAFF74F33AF5BDBE/.tez/application_1463536644092_0001/tez-conf.pb" } size: 40936 timestamp: 1463536644000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:24,274 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalInputs(3978)) - Setting 1 additional inputs for vertexvertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01]
2016-05-18 01:57:24,274 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:24,275 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/6C2E1F987F384CB789C79555266BCB8A/A7FFE11D12E04AB3AAFF74F33AF5BDBE/.tez/application_1463536644092_0001/tez-conf.pb" } size: 40936 timestamp: 1463536644000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:24,275 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4023)) - Setting 1 additional outputs for vertex vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5]
2016-05-18 01:57:24,275 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:24,275 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1593)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-18 01:57:24,276 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463536644092_0001_1, initTime=1463536644275
2016-05-18 01:57:24,276 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536644092_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-18 01:57:24,276 INFO  impl.DAGImpl (DAGImpl.java:transition(1768)) - Added additional resources : [[]] to classpath
2016-05-18 01:57:24,276 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:DAG_STARTED]: dagID=dag_1463536644092_0001_1, startTime=1463536644276
2016-05-18 01:57:24,276 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536644092_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-18 01:57:24,277 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2400)) - Root Inputs exist for Vertex: D1E9183E824B482DACB737CD778A1E01 : {7827B9B63ED94A39B6C613E4E7FB2182={InputName=7827B9B63ED94A39B6C613E4E7FB2182}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-18 01:57:24,277 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2410)) - Starting root input initializer for input: 7827B9B63ED94A39B6C613E4E7FB2182, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-18 01:57:24,277 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2550)) - Setting vertexManager to RootInputVertexManager for vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01]
2016-05-18 01:57:24,277 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2721)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01]
2016-05-18 01:57:24,277 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2726)) - Vertex will initialize from input initializer. vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01]
2016-05-18 01:57:24,277 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3893)) - Starting 1 inputInitializers for vertex vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01]
2016-05-18 01:57:24,278 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-18 01:57:24,278 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2562)) - Setting vertexManager to ShuffleVertexManager for vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5]
2016-05-18 01:57:24,278 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(272)) - Starting InputInitializer for Input: 7827B9B63ED94A39B6C613E4E7FB2182 on vertex vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01]
2016-05-18 01:57:24,280 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(109)) - Input 7827B9B63ED94A39B6C613E4E7FB2182 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7, groupingEnabled: true
2016-05-18 01:57:24,282 INFO  client.TezClient (TezClient.java:submitDAGSession(545)) - Submitted dag to TezSession, sessionName=(1/1) ...AssertionsFail/value/fail, applicationId=application_1463536644092_0001, dagName=[6C2E1F987F384CB789C79555266BCB8A/A7FFE11D12E04AB3AAFF74F33AF5BDBE] test/(1/1) ...AssertionsFail/value/fail
2016-05-18 01:57:24,282 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:initialize(1022)) - Shuffle Vertex Manager: settings minFrac:0.25 maxFrac:0.75 auto:false desiredTaskIput:104857600 minTasks:1
2016-05-18 01:57:24,282 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2760)) - Creating 1 tasks for vertex: vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5]
2016-05-18 01:57:24,282 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2779)) - Directly initializing vertex: vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5]
2016-05-18 01:57:24,283 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536644092_0001_1_01, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=null, edgeManagersCount=1, rootInputSpecUpdateCount=0, setParallelismCalledFlag=false
2016-05-18 01:57:24,283 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2187)) - Setting up committers for vertex vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5], numAdditionalOutputs=1
2016-05-18 01:57:24,283 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2202)) - Instantiating committer for output=E23049447D7E4B8E85549ED6A48FBADA, vertex=vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-18 01:57:24,282 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(168)) - Grouping splits in Tez
2016-05-18 01:57:24,284 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(226)) - Desired splits: 1 too large.  Desired splitLength: 1449 Min splitLength: 52428800 New desired splits: 1 Total length: 1449 Original splits: 2
2016-05-18 01:57:24,284 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(321)) - Desired numSplits: 1 lengthPerGroup: 1449 numLocations: 1 numSplitsPerLocation: 2 numSplitsInGroup: 2 totalLength: 1449 numOriginalSplits: 2 . Grouping by length: true count: false nodeLocalOnly: false
2016-05-18 01:57:24,284 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(539)) - Number of splits desired: 1 created: 1 splitsProcessed: 2
2016-05-18 01:57:24,285 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(308)) - Succeeded InputInitializer for Input: 7827B9B63ED94A39B6C613E4E7FB2182 on vertex vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01]
2016-05-18 01:57:24,286 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(121)) - Committer for B354724702A44A1F93E536C18C60FED5:E23049447D7E4B8E85549ED6A48FBADA using oldmapred API
2016-05-18 01:57:24,286 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(146)) - OutputCommitter for outputName=E23049447D7E4B8E85549ED6A48FBADA, vertexName=B354724702A44A1F93E536C18C60FED5, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-18 01:57:24,289 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B354724702A44A1F93E536C18C60FED5, vertexId=vertex_1463536644092_0001_1_01, initRequestedTime=1463536644278, initedTime=1463536644283, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=0, initGeneratedEventsCount=0
2016-05-18 01:57:24,290 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5] transitioned from NEW to INITED due to event V_INIT
2016-05-18 01:57:24,291 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:24,291 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1644)) - Got updated RootInputsSpecs: {7827B9B63ED94A39B6C613E4E7FB2182=forAllWorkUnits=true, update=[1]}
2016-05-18 01:57:24,293 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1664)) - Vertex vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01] parallelism set to 1
2016-05-18 01:57:24,293 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:24,293 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:VERTEX_INITIALIZED]: vertexName=D1E9183E824B482DACB737CD778A1E01, vertexId=vertex_1463536644092_0001_1_00, initRequestedTime=1463536644277, initedTime=1463536644293, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1, initGeneratedEventsCount=1
2016-05-18 01:57:24,294 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01] with distanceFromRoot: 0
2016-05-18 01:57:24,294 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01] transitioned from INITIALIZING to INITED due to event V_INPUT_DATA_INFORMATION
2016-05-18 01:57:24,294 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536644092_0001_1_00, startRequestedTime=1463536644278, startedTime=1463536644294
2016-05-18 01:57:24,294 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536644092_0001_1_00, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=org.apache.tez.dag.api.VertexLocationHint@b8338fe7, edgeManagersCount=0, rootInputSpecUpdateCount=1, setParallelismCalledFlag=true
2016-05-18 01:57:24,294 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:24,294 INFO  impl.VertexImpl (VertexImpl.java:transition(2932)) - Source vertex started: vertex_1463536644092_0001_1_00 for vertex: vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5] numStartedSources: 1 numSources: 1
2016-05-18 01:57:24,294 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5] with distanceFromRoot: 1
2016-05-18 01:57:24,295 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536644092_0001_1_01, startRequestedTime=1463536644294, startedTime=1463536644294
2016-05-18 01:57:24,295 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:24,298 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:onVertexStarted(519)) - OnVertexStarted vertex: B354724702A44A1F93E536C18C60FED5 with 0 source tasks and 1 pending tasks
2016-05-18 01:57:24,298 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:handleVertexStateUpdate(1051)) - Received configured notification : CONFIGURED for vertex: D1E9183E824B482DACB737CD778A1E01 in vertex: B354724702A44A1F93E536C18C60FED5 numBipartiteSourceTasks: 1
2016-05-18 01:57:24,303 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(100)) - Starting 1 in D1E9183E824B482DACB737CD778A1E01
2016-05-18 01:57:24,303 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01]
2016-05-18 01:57:24,304 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:TASK_STARTED]: vertexName=D1E9183E824B482DACB737CD778A1E01, taskId=task_1463536644092_0001_1_00_000000, scheduledTime=1463536644304, launchTime=1463536644304
2016-05-18 01:57:24,304 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01]
2016-05-18 01:57:24,305 INFO  node.PerSourceNodeTracker (PerSourceNodeTracker.java:nodeSeen(74)) - Adding new node 127.0.0.1:0 to nodeTracker 0
2016-05-18 01:57:24,306 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536644092_0001_00_000001, launchTime=1463536644306
2016-05-18 01:57:24,307 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536644092_0001_00_000001
2016-05-18 01:57:24,308 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536644092_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536644092_0001_1_00_000000_0
2016-05-18 01:57:24,308 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536644092_0001_1_00_000000_0] started. Is using containerId: [container_1463536644092_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-18 01:57:24,308 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=D1E9183E824B482DACB737CD778A1E01, taskAttemptId=attempt_1463536644092_0001_1_00_000000_0, startTime=1463536644308, containerId=container_1463536644092_0001_00_000001, nodeId=127.0.0.1:0
2016-05-18 01:57:24 Starting to run new task attempt: attempt_1463536644092_0001_1_00_000000_0
2016-05-18 01:57:24,309 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] submitted tez dag to app master: application_1463536644092_0001, with dag id: dag_1463536644092_0001_1
2016-05-18 01:57:24,310 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536644092_0001_1_00_000000_0
2016-05-18 01:57:24,310 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:24,310 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:24,310 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [6C2E1F987F384CB789C79555266BCB8A/A7FFE11D12E04AB3AAFF74F33AF5BDBE] test/(1/1) ...AssertionsFail/value/fail, VertexName: D1E9183E824B482DACB737CD778A1E01, VertexParallelism: 1, TaskAttemptID:attempt_1463536644092_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=7827B9B63ED94A39B6C613E4E7FB2182, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=B354724702A44A1F93E536C18C60FED5, physicalEdgeCount=1, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ]
2016-05-18 01:57:24,311 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:24,312 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536644092_0001_1_00_000000_0
2016-05-18 01:57:24,313 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(496)) - TaskAttempt:attempt_1463536644092_0001_1_00_000000_0 sent events: (0-1).
2016-05-18 01:57:24,313 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536644092_0001_1_00_000000_0, eventCount=1 fromEventId=0 nextFromEventId=0
2016-05-18 01:57:24,317 INFO  input.MRInput (MRInput.java:initialize(440)) - 7827B9B63ED94A39B6C613E4E7FB2182 using newmapreduce API=false, split via event=true, numPhysicalInputs=1
2016-05-18 01:57:24,317 INFO  input.MRInput (MRInput.java:initializeInternal(494)) - Initialized MRInput: 7827B9B63ED94A39B6C613E4E7FB2182
2016-05-18 01:57:24,317 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:24,324 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: D1E9183E824B482DACB737CD778A1E01, ordinal: 0
2016-05-18 01:57:24,324 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D1E9183E824B482DACB737CD778A1E01, mem on start (mb), free: 248, total: 371, max: 672
2016-05-18 01:57:24,324 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:24,324 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:24,324 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:24,324 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:24,324 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[7827B9B63ED94A39B6C613E4E7FB2182:INPUT:0:org.apache.tez.mapreduce.input.MRInput], [B354724702A44A1F93E536C18C60FED5:OUTPUT:104857600:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput]
2016-05-18 01:57:24,324 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:24,326 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:24,326 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 104857600, TotalRequestedScaled: 9.679163076923077E7, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.15
2016-05-18 01:57:24,327 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[7827B9B63ED94A39B6C613E4E7FB2182:org.apache.tez.mapreduce.input.MRInput:INPUT:0:0], [B354724702A44A1F93E536C18C60FED5:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput:OUTPUT:104857600:104857600]
2016-05-18 01:57:24,327 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:24,327 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: 7827B9B63ED94A39B6C613E4E7FB2182 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:24,327 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:24,327 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:24,327 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: 7827B9B63ED94A39B6C613E4E7FB2182
2016-05-18 01:57:24,328 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:24,328 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536644092_0001_1_00_000000_0
2016-05-18 01:57:24,332 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:24,332 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(174)) - Processing split: TezGroupedSplit{wrappedSplits=[file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:0+724, file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:724+725], wrappedInputFormatName='org.apache.hadoop.mapred.TextInputFormat', locations=[localhost], rack='null', length=1449}
2016-05-18 01:57:24,332 INFO  input.MRInput (MRInput.java:initFromEventInternal(653)) - 7827B9B63ED94A39B6C613E4E7FB2182 initialized RecordReader from event
2016-05-18 01:57:24,333 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"] streamed: true, id: 7827B9B63ED94A39B6C613E4E7FB2182
2016-05-18 01:57:24,333 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: GroupBy(test)[by:[{1}:'method']], id: 9E2802359450428291AA45D2C645803A
2016-05-18 01:57:24,333 INFO  element.TezGroupGate (TezGroupGate.java:prepare(98)) - calling OrderedPartitionedKVOutput#start() on: GroupBy(test)[by:[{1}:'method']] 9E2802359450428291AA45D2C645803A
2016-05-18 01:57:24,334 INFO  impl.ExternalSorter (ExternalSorter.java:<init>(199)) - B354724702A44A1F93E536C18C60FED5 using: memoryMb=100, keySerializerClass=class cascading.tuple.io.KeyTuple, valueSerializerClass=cascading.tuple.hadoop.io.ValueTupleSerializer@3eecf6f, comparator=cascading.tuple.hadoop.util.TupleComparator@3374826d, partitioner=cascading.tuple.tez.util.TuplePartitioner, serialization=cascading.tuple.hadoop.TupleSerialization,org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
2016-05-18 01:57:24,335 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(170)) - Setting up PipelinedSorter for B354724702A44A1F93E536C18C60FED5: , UsingHashComparator=false
2016-05-18 01:57:24,347 INFO  impl.PipelinedSorter (PipelinedSorter.java:allocateSpace(245)) - Newly allocated block size=104857600, index=0, Number of buffers=1, currentAllocatableMemory=0, currentBufferSize=104857600, total=104857600
2016-05-18 01:57:24,348 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(189)) - Pre allocating rest of memory buffers upfront
2016-05-18 01:57:24,348 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(207)) - Setting up PipelinedSorter for B354724702A44A1F93E536C18C60FED5: , UsingHashComparator=false#blocks=1, maxMemUsage=104857600, lazyAllocateMem=false, minBlockSize=2097152000, initial BLOCK_SIZE=104857600, finalMergeEnabled=true, pipelinedShuffle=false, sendEmptyPartitions=true, tez.runtime.io.sort.mb=100
2016-05-18 01:57:24,348 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(882)) - B354724702A44A1F93E536C18C60FED5: reserved.remaining()=104857600, reserved.metasize=16777216
2016-05-18 01:57:24,349 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:24,349 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: D1E9183E824B482DACB737CD778A1E01, all 1 inputs ready in: 00:00:00.000
2016-05-18 01:57:24,352 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536644092_0001_1_00_000000_0
2016-05-18 01:57:24,352 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D1E9183E824B482DACB737CD778A1E01, mem on close (mb), free: 146, total: 371, max: 672
2016-05-18 01:57:24,352 INFO  impl.PipelinedSorter (PipelinedSorter.java:flush(629)) - B354724702A44A1F93E536C18C60FED5: Starting flush of map output
2016-05-18 01:57:24,353 INFO  impl.PipelinedSorter (PipelinedSorter.java:end(995)) - B354724702A44A1F93E536C18C60FED5: Span0.length = 7, perItem = 99
2016-05-18 01:57:24,353 INFO  impl.PipelinedSorter (PipelinedSorter.java:sort(904)) - B354724702A44A1F93E536C18C60FED5: done sorting span=0, length=7, time=0
2016-05-18 01:57:24,353 INFO  impl.PipelinedSorter (PipelinedSorter.java:ready(1297)) - B354724702A44A1F93E536C18C60FED5: Heap = SpanIterator<0:6> (span=Span[16777216,693]),
2016-05-18 01:57:24,355 INFO  impl.PipelinedSorter (PipelinedSorter.java:spill(546)) - B354724702A44A1F93E536C18C60FED5: Spilling to /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/6C2E1F987F384CB789C79555266BCB8A/A7FFE11D12E04AB3AAFF74F33AF5BDBE/.tez/application_1463536644092_0001_wd/localmode-local-dir/output/attempt_1463536644092_0001_1_00_000000_0_10075_0/file.out
2016-05-18 01:57:24,358 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:24 Completed running task attempt: attempt_1463536644092_0001_1_00_000000_0
2016-05-18 01:57:24,359 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536644092_0001_1_00_000000_0, askedToStop=false
2016-05-18 01:57:24,359 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536644092_0001_1_00_000000_0, stopRequested=false
2016-05-18 01:57:24,360 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536644092_0001_1_00_000000_0: Counters: 18 [[org.apache.tez.common.counters.TaskCounter SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1][cascading.flow.SliceCounters Process_Begin_Time=1463536644349, Process_Duration=3, Process_End_Time=1463536644352, Read_Duration=2, Tuples_Read=10, Tuples_Written=7, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=10]]
2016-05-18 01:57:24,361 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536644092_0001_1_00_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:24,361 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=D1E9183E824B482DACB737CD778A1E01, taskAttemptId=attempt_1463536644092_0001_1_00_000000_0, creationTime=1463536644304, allocationTime=1463536644305, startTime=1463536644308, finishTime=1463536644361, timeTaken=53, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:24,361 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:24,361 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:24,361 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:24,361 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536644092_0001_1_00_000000_0
2016-05-18 01:57:24,363 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536644092_0001_00_000001
2016-05-18 01:57:24,365 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:TASK_FINISHED]: vertexName=D1E9183E824B482DACB737CD778A1E01, taskId=task_1463536644092_0001_1_00_000000, startTime=1463536644308, finishTime=1463536644362, timeTaken=54, status=SUCCEEDED, successfulAttemptID=attempt_1463536644092_0001_1_00_000000_0, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536644349, Process_Duration=3, Process_End_Time=1463536644352, Read_Duration=2, Tuples_Read=10, Tuples_Written=7, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10
2016-05-18 01:57:24,365 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:24,365 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01]
2016-05-18 01:57:24,367 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:VERTEX_FINISHED]: vertexName=D1E9183E824B482DACB737CD778A1E01, vertexId=vertex_1463536644092_0001_1_00, initRequestedTime=1463536644277, initedTime=1463536644293, startRequestedTime=1463536644278, startedTime=1463536644294, finishTime=1463536644366, timeTaken=72, status=SUCCEEDED, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536644349, Process_Duration=3, Process_End_Time=1463536644352, Read_Duration=2, Tuples_Read=10, Tuples_Written=7, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10, vertexStats=firstTaskStartTime=1463536644308, firstTasksToStart=[ task_1463536644092_0001_1_00_000000 ], lastTaskFinishTime=1463536644361, lastTasksToFinish=[ task_1463536644092_0001_1_00_000000 ], minTaskDuration=53, maxTaskDuration=53, avgTaskDuration=53.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536644092_0001_1_00_000000 ], longestDurationTasks=[ task_1463536644092_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:24,367 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:24,367 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536644092_0001_00_000001, stoppedTime=1463536644367, exitStatus=0
2016-05-18 01:57:24,367 INFO  impl.VertexImpl (VertexImpl.java:transition(3279)) - Source task attempt completed for vertex: vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5] attempt: attempt_1463536644092_0001_1_00_000000_0 with state: SUCCEEDED vertexState: RUNNING
2016-05-18 01:57:24,368 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536644092_0001_1_00 [D1E9183E824B482DACB737CD778A1E01] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:24,368 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:schedulePendingTasks(920)) - All source tasks assigned. Ramping up 1 remaining tasks for vertex: B354724702A44A1F93E536C18C60FED5
2016-05-18 01:57:24,368 INFO  impl.Edge (Edge.java:routingToBegin(232)) - Routing to begin for edge: EdgeInfo: sourceVertexName=D1E9183E824B482DACB737CD778A1E01, destinationVertexName=B354724702A44A1F93E536C18C60FED5. EdgeProperty: { SCATTER_GATHER : org.apache.tez.runtime.library.input.OrderedGroupedKVInput >> PERSISTED >> org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput >> NullEdgeManager } onDemandRouting: true
2016-05-18 01:57:24,368 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5]
2016-05-18 01:57:24,368 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:24,372 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(262)) - Ignoring stop request for containerId container_1463536644092_0001_00_000001. Relying on regular task shutdown for it to end
2016-05-18 01:57:24,372 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:TASK_STARTED]: vertexName=B354724702A44A1F93E536C18C60FED5, taskId=task_1463536644092_0001_1_01_000000, scheduledTime=1463536644372, launchTime=1463536644372
2016-05-18 01:57:24,373 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5]
2016-05-18 01:57:24,374 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536644092_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-18 01:57:24,374 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536644092_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:24,374 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536644092_0001_00_000001, Exiting
2016-05-18 01:57:24,375 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536644092_0001_00_000001
2016-05-18 01:57:24,375 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536644092_0001_00_000001
2016-05-18 01:57:24,377 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536644092_0001_00_000002, launchTime=1463536644377
2016-05-18 01:57:24,378 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536644092_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:24,378 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536644092_0001_00_000001 completed successfully
2016-05-18 01:57:24,379 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536644092_0001_00_000002
2016-05-18 01:57:24,380 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536644092_0001_00_000002: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536644092_0001_1_01_000000_0
2016-05-18 01:57:24,380 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536644092_0001_1_01_000000_0] started. Is using containerId: [container_1463536644092_0001_00_000002] on NM: [127.0.0.1:0]
2016-05-18 01:57:24,380 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B354724702A44A1F93E536C18C60FED5, taskAttemptId=attempt_1463536644092_0001_1_01_000000_0, startTime=1463536644380, containerId=container_1463536644092_0001_00_000002, nodeId=127.0.0.1:0
2016-05-18 01:57:24 Starting to run new task attempt: attempt_1463536644092_0001_1_01_000000_0
2016-05-18 01:57:24,381 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536644092_0001_1_01_000000_0
2016-05-18 01:57:24,381 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:24,381 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:24,381 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [6C2E1F987F384CB789C79555266BCB8A/A7FFE11D12E04AB3AAFF74F33AF5BDBE] test/(1/1) ...AssertionsFail/value/fail, VertexName: B354724702A44A1F93E536C18C60FED5, VertexParallelism: 1, TaskAttemptID:attempt_1463536644092_0001_1_01_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=D1E9183E824B482DACB737CD778A1E01, physicalEdgeCount=1, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=E23049447D7E4B8E85549ED6A48FBADA, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-18 01:57:24,381 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:24,382 INFO  impl.VertexImpl (VertexImpl.java:getTaskAttemptTezEvents(3662)) - Sending attempt_1463536644092_0001_1_01_000000_0 1 events [0,1) total 1 vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5]
2016-05-18 01:57:24,383 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536644092_0001_1_01_000000_0
2016-05-18 01:57:24,385 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536644092_0001_1_01_000000_0, eventCount=1 fromEventId=0 nextFromEventId=1
2016-05-18 01:57:24,386 INFO  orderedgrouped.MergeManager (MergeManager.java:getInitialMemoryRequirement(339)) - Initial Memory required for SHUFFLE_BUFFER=211392912 based on INPUT_BUFFER_FACTOR=0.9,  for final merged output=0, using factor: 0.0
2016-05-18 01:57:24,390 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:24,398 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B354724702A44A1F93E536C18C60FED5, ordinal: 1
2016-05-18 01:57:24,398 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B354724702A44A1F93E536C18C60FED5, mem on start (mb), free: 138, total: 371, max: 672
2016-05-18 01:57:24,399 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:24,399 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:24,399 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:24,402 INFO  output.MROutput (MROutput.java:initialize(421)) - E23049447D7E4B8E85549ED6A48FBADA: outputFormat=org.apache.hadoop.mapred.TextOutputFormat, using newmapreduce API=false
2016-05-18 01:57:24,402 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:24,402 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[D1E9183E824B482DACB737CD778A1E01:INPUT:211392912:org.apache.tez.runtime.library.input.OrderedGroupedKVInput], [E23049447D7E4B8E85549ED6A48FBADA:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput]
2016-05-18 01:57:24,402 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:24,403 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:24,403 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 211392912, TotalRequestedScaled: 1.9513191876923078E8, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.30
2016-05-18 01:57:24,403 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[D1E9183E824B482DACB737CD778A1E01:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:211392912:211392912], [E23049447D7E4B8E85549ED6A48FBADA:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0]
2016-05-18 01:57:24,403 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:24,403 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: D1E9183E824B482DACB737CD778A1E01 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:24,403 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:24,403 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:24,403 INFO  orderedgrouped.Shuffle (Shuffle.java:<init>(147)) - D1E9183E824B482DACB737CD778A1E01: Shuffle assigned with 1 inputs, codec: None, ifileReadAhead: true
2016-05-18 01:57:24,404 INFO  orderedgrouped.MergeManager (MergeManager.java:<init>(273)) - D1E9183E824B482DACB737CD778A1E01: MergerManager: memoryLimit=211392912, maxSingleShuffleLimit=52848228, mergeThreshold=190253616, ioSortFactor=100, postMergeMem=0, memToMemMergeOutputsThreshold=100
2016-05-18 01:57:24,405 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:<init>(353)) - ShuffleScheduler running for sourceVertex: D1E9183E824B482DACB737CD778A1E01 with configuration: maxFetchFailuresBeforeReporting=5, reportReadErrorImmediately=true, maxFailedUniqueFetches=1, abortFailureLimit=15, maxTaskOutputAtOnce=20, numFetchers=1, hostFailureFraction=0.2, minFailurePerHost=4, maxAllowedFailedFetchFraction=0.5, maxStallTimeFraction=0.5, minReqProgressFraction=0.5, checkFailedFetchSinceLastCompletion=true
2016-05-18 01:57:24,407 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: D1E9183E824B482DACB737CD778A1E01
2016-05-18 01:57:24,407 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:24,407 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536644092_0001_1_01_000000_0
2016-05-18 01:57:24,407 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - D1E9183E824B482DACB737CD778A1E01: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0
2016-05-18 01:57:24,409 INFO  orderedgrouped.ShuffleScheduler (ShuffleUtils.java:logIndividualFetchComplete(489)) - Completed fetch for attempt: {0, 0, attempt_1463536644092_0001_1_00_000000_0_10075} to DISK_DIRECT, csize=653, dsize=649, EndTime=1463536644409, TimeTaken=1, Rate=0.62 MB/s
2016-05-18 01:57:24,410 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:copySucceeded(551)) - All inputs fetched for input vertex : D1E9183E824B482DACB737CD778A1E01
2016-05-18 01:57:24,410 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:24,410 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:callInternal(1289)) - Shutting down FetchScheduler for input: D1E9183E824B482DACB737CD778A1E01, wasInterrupted=false
2016-05-18 01:57:24,411 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: GroupBy(test)[by:[{1}:'method']]
2016-05-18 01:57:24,411 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:24,411 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: GroupBy(test)[by:[{1}:'method']] streamed: true, id: 9E2802359450428291AA45D2C645803A
2016-05-18 01:57:24,412 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1005)) - finalMerge called with 0 in-memory map-outputs and 1 on-disk map-outputs
2016-05-18 01:57:24,412 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsFail/value/fail"], id: E23049447D7E4B8E85549ED6A48FBADA
2016-05-18 01:57:24,412 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsFail/value/fail"]
2016-05-18 01:57:24,412 INFO  element.TezGroupGate (TezGroupGate.java:prepare(90)) - calling OrderedGroupedKVInput#start() on: GroupBy(test)[by:[{1}:'method']] 9E2802359450428291AA45D2C645803A, for 1 inputs
2016-05-18 01:57:24,412 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1103)) - Disk file=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/6C2E1F987F384CB789C79555266BCB8A/A7FFE11D12E04AB3AAFF74F33AF5BDBE/.tez/application_1463536644092_0001_wd/localmode-local-dir/output/attempt_1463536644092_0001_1_00_000000_0_10075/file.out, len=653, isLocal=true
2016-05-18 01:57:24,413 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1115)) - Merging 1 files, 653 bytes from disk
2016-05-18 01:57:24,413 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1130)) - Merging 0 segments, 0 bytes from memory into reduce
2016-05-18 01:57:24,413 INFO  impl.TezMerger (TezMerger.java:merge(644)) - Merging 1 sorted segments
2016-05-18 01:57:24,413 INFO  impl.TezMerger (TezMerger.java:merge(749)) - Down to the last merge-pass, with 1 segments left of total size: 633 bytes
2016-05-18 01:57:24,413 INFO  orderedgrouped.Shuffle (Shuffle.java:callInternal(332)) - merge complete for input vertex : D1E9183E824B482DACB737CD778A1E01
2016-05-18 01:57:24,414 INFO  orderedgrouped.Shuffle (Shuffle.java:onSuccess(417)) - D1E9183E824B482DACB737CD778A1E01: Shuffle Runner thread complete
2016-05-18 01:57:24,414 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B354724702A44A1F93E536C18C60FED5, all 1 inputs ready in: 00:00:00.001
2016-05-18 01:57:24,416 INFO  input.OrderedGroupedKVInput (OrderedGroupedKVInput.java:createValuesIterator(292)) - D1E9183E824B482DACB737CD778A1E01: creating ValuesIterator with comparator=cascading.tuple.hadoop.util.TupleComparator, keyClass=cascading.tuple.io.KeyTuple, valClass=cascading.tuple.io.ValueTuple
2016-05-18 01:57:24,417 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testValueAssertionsFail(AppliedAssertionsPlatformTest.java:111)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-05-18 01:57:24,418 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testValueAssertionsFail(AppliedAssertionsPlatformTest.java:111)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-05-18 01:57:24,418 ERROR element.TezGroupByGate (TezGroupByGate.java:reduce(91)) - caught throwable
cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testValueAssertionsFail(AppliedAssertionsPlatformTest.java:111)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-05-18 01:57:24,419 INFO  output.MROutput (MROutput.java:close(526)) - E23049447D7E4B8E85549ED6A48FBADA closed
2016-05-18 01:57:24,419 INFO  impl.TaskImpl (TaskImpl.java:canCommit(671)) - attempt_1463536644092_0001_1_01_000000_0 given a go for committing the task output.
2016-05-18 01:57:24,420 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536644092_0001_1_01_000000_0, stopRequested=false
2016-05-18 01:57:24,420 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536644092_0001_1_01_000000_0: Counters: 33 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=6, MERGE_PHASE_TIME=9, FIRST_EVENT_RECEIVED=3, LAST_EVENT_RECEIVED=3][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][cascading.flow.SliceCounters Process_Begin_Time=1463536644415, Process_Duration=5, Process_End_Time=1463536644420, Read_Duration=0, Tuples_Read=7]]
2016-05-18 01:57:24,420 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(817)) - Joining on EventRouter
2016-05-18 01:57:24,420 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B354724702A44A1F93E536C18C60FED5, mem on close (mb), free: 133, total: 371, max: 672
2016-05-18 01:57:24,420 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(851)) - Closed processor for vertex=B354724702A44A1F93E536C18C60FED5, index=1, interruptedStatus=false
2016-05-18 01:57:24,420 INFO  orderedgrouped.Shuffle (Shuffle.java:shutdown(278)) - Shutting down Shuffle for source: D1E9183E824B482DACB737CD778A1E01
2016-05-18 01:57:24,421 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - D1E9183E824B482DACB737CD778A1E01: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0, updateOnClose
2016-05-18 01:57:24,421 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(887)) - Closed input for vertex=B354724702A44A1F93E536C18C60FED5, sourceVertex=D1E9183E824B482DACB737CD778A1E01, interruptedStatus=true
2016-05-18 01:57:24,421 INFO  output.MROutput (MROutput.java:close(526)) - E23049447D7E4B8E85549ED6A48FBADA closed
2016-05-18 01:57:24,421 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(911)) - Closed input for vertex=B354724702A44A1F93E536C18C60FED5, sourceVertex=E23049447D7E4B8E85549ED6A48FBADA, interruptedStatus=true
2016-05-18 01:57:24,423 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536644092_0001_1_01_000000_0 : TaskRunner2Result{endReason=TASK_ERROR, error=cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testValueAssertionsFail(AppliedAssertionsPlatformTest.java:111)] argument tuple: ['7'] was not equal to values: ['0'], containerShutdownRequested=false}  
2016-05-18 01:57:24,423 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=TASK_ERROR, error=cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testValueAssertionsFail(AppliedAssertionsPlatformTest.java:111)] argument tuple: ['7'] was not equal to values: ['0'], containerShutdownRequested=false}
2016-05-18 01:57:24,424 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536644092_0001_00_000002
2016-05-18 01:57:24,424 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536644092_0001_00_000002
2016-05-18 01:57:24,424 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536644092_0001_00_000002 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testValueAssertionsFail(AppliedAssertionsPlatformTest.java:111)] argument tuple: ['7'] was not equal to values: ['0'], errorMessage='TaskExecutionFailure: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testValueAssertionsFail(AppliedAssertionsPlatformTest.java:111)] argument tuple: ['7'] was not equal to values: ['0']'}
2016-05-18 01:57:24,424 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(294)) - Container: container_1463536644092_0001_00_000002 completed but with errors
2016-05-18 01:57:24,424 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B354724702A44A1F93E536C18C60FED5, taskAttemptId=attempt_1463536644092_0001_1_01_000000_0, creationTime=1463536644373, allocationTime=1463536644374, startTime=1463536644380, finishTime=1463536644424, timeTaken=44, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task: attempt_1463536644092_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testValueAssertionsFail(AppliedAssertionsPlatformTest.java:111)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 33, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=6, MERGE_PHASE_TIME=9, FIRST_EVENT_RECEIVED=3, LAST_EVENT_RECEIVED=3, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536644415, Process_Duration=5, Process_End_Time=1463536644420, Read_Duration=0, Tuples_Read=7
2016-05-18 01:57:24,425 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(704)) - Container container_1463536644092_0001_00_000002 exited with diagnostics set to TaskExecutionFailure: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testValueAssertionsFail(AppliedAssertionsPlatformTest.java:111)] argument tuple: ['7'] was not equal to values: ['0']
2016-05-18 01:57:24,425 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536644092_0001_00_000002, stoppedTime=1463536644425, exitStatus=1
2016-05-18 01:57:24,425 INFO  impl.TaskImpl (TaskImpl.java:transition(1170)) - Failing task: task_1463536644092_0001_1_01_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-05-18 01:57:24,425 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:TASK_FINISHED]: vertexName=B354724702A44A1F93E536C18C60FED5, taskId=task_1463536644092_0001_1_01_000000, startTime=1463536644380, finishTime=1463536644425, timeTaken=45, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task: attempt_1463536644092_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testValueAssertionsFail(AppliedAssertionsPlatformTest.java:111)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-05-18 01:57:24,426 INFO  impl.VertexImpl (VertexImpl.java:transition(3353)) - Failing vertex: vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5] because task failed: task_1463536644092_0001_1_01_000000
2016-05-18 01:57:24,426 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(2102)) - Killing tasks in vertex: vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5] due to trigger: OWN_TASK_FAILURE
2016-05-18 01:57:24,426 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5], tasks=1, failed=1, killed=0, success=0, completed=1, commits=0, err=OWN_TASK_FAILURE
2016-05-18 01:57:24,426 INFO  impl.VertexImpl (VertexImpl.java:finishWithTerminationCause(2084)) - Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0
2016-05-18 01:57:24,426 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3087)) - Invoking committer abort for vertex, vertexId=vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5]
2016-05-18 01:57:24,426 INFO  impl.VertexImpl (VertexImpl.java:run(3095)) - Invoking committer abort for output=E23049447D7E4B8E85549ED6A48FBADA, vertexId=vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5]
2016-05-18 01:57:24,428 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:VERTEX_FINISHED]: vertexName=B354724702A44A1F93E536C18C60FED5, vertexId=vertex_1463536644092_0001_1_01, initRequestedTime=1463536644278, initedTime=1463536644283, startRequestedTime=1463536644294, startedTime=1463536644294, finishTime=1463536644428, timeTaken=134, status=FAILED, diagnostics=Task failed, taskId=task_1463536644092_0001_1_01_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task: attempt_1463536644092_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testValueAssertionsFail(AppliedAssertionsPlatformTest.java:111)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]]
Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0
Vertex vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5] killed/failed due to:OWN_TASK_FAILURE, counters=Counters: 0, vertexStats=firstTaskStartTime=1463536644380, firstTasksToStart=[ task_1463536644092_0001_1_01_000000 ], lastTaskFinishTime=1463536644424, lastTasksToFinish=[ task_1463536644092_0001_1_01_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-05-18 01:57:24,430 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-05-18 01:57:24,430 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(298)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1463536644092_0001_1_01_000000_0 failed: true container: container_1463536644092_0001_00_000002 numFailedTAs: 0
2016-05-18 01:57:24,430 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5] completed., numCompletedVertices=2, numSuccessfulVertices=1, numFailedVertices=1, numKilledVertices=0, numVertices=2
2016-05-18 01:57:24,430 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=2, numSuccessfulVertices=1, numFailedVertices=1, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=VERTEX_FAILURE
2016-05-18 01:57:24,431 INFO  impl.DAGImpl (DAGImpl.java:finishWithTerminationCause(1350)) - DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0
2016-05-18 01:57:24,433 INFO  recovery.RecoveryService (RecoveryService.java:handle(327)) - DAG completed, dagId=dag_1463536644092_0001_1, queueSize=0
2016-05-18 01:57:24,434 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644092_0001_1][Event:DAG_FINISHED]: dagId=dag_1463536644092_0001_1, startTime=1463536644276, finishTime=1463536644432, timeTaken=156, status=FAILED, diagnostics=Vertex failed, vertexName=B354724702A44A1F93E536C18C60FED5, vertexId=vertex_1463536644092_0001_1_01, diagnostics=[Task failed, taskId=task_1463536644092_0001_1_01_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task: attempt_1463536644092_0001_1_01_000000_0:cascading.operation.AssertionException: [cascading.operation.assertion.AppliedAssertionsPlatformTest.testValueAssertionsFail(AppliedAssertionsPlatformTest.java:111)] argument tuple: ['7'] was not equal to values: ['0']
	at cascading.operation.assertion.BaseAssertion.throwFail(BaseAssertion.java:107)
	at cascading.operation.assertion.BaseAssertion.fail(BaseAssertion.java:86)
	at cascading.operation.assertion.AssertEquals.doAssert(AssertEquals.java:77)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:71)
	at cascading.flow.stream.element.ValueAssertionEachStage.receive(ValueAssertionEachStage.java:35)
	at cascading.flow.stream.duct.CloseReducingDuct.completeGroup(CloseReducingDuct.java:47)
	at cascading.flow.stream.element.AggregatorEveryStage$1.collect(AggregatorEveryStage.java:69)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.operation.aggregator.Count.complete(Count.java:82)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
	at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:147)
	at cascading.flow.tez.stream.element.TezGroupByGate.reduce(TezGroupByGate.java:83)
	at cascading.flow.tez.stream.element.TezGroupGate.run(TezGroupGate.java:114)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:351)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:59)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:59)
	at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:36)
	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5] killed/failed due to:OWN_TASK_FAILURE]
DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=2, RACK_LOCAL_TASKS=1, AM_CPU_MILLISECONDS=280, AM_GC_TIME_MILLIS=0, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536644349, Process_Duration=3, Process_End_Time=1463536644352, Read_Duration=2, Tuples_Read=10, Tuples_Written=7, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=10
2016-05-18 01:57:24,434 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3082)) - Ignoring multiple aborts for vertex: vertex_1463536644092_0001_1_01 [B354724702A44A1F93E536C18C60FED5]
2016-05-18 01:57:24,434 INFO  impl.DAGImpl (DAGImpl.java:finished(1405)) - DAG: dag_1463536644092_0001_1 finished with state: FAILED
2016-05-18 01:57:24,434 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536644092_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-05-18 01:57:24 Completed Dag: dag_1463536644092_0001_1
2016-05-18 01:57:24,438 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(751)) - DAG completed, dagId=dag_1463536644092_0001_1, dagState=FAILED
2016-05-18 01:57:24,438 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536644092_0001_1_post
2016-05-18 01:57:24,440 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:24,440 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(800)) - Central Dispatcher queue size after DAG completion, before cleanup: 0
2016-05-18 01:57:24,440 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(802)) - Waiting for next DAG to be submitted.
2016-05-18 01:57:24,440 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(842)) - Cleaning up DAG: name=[6C2E1F987F384CB789C79555266BCB8A/A7FFE11D12E04AB3AAFF74F33AF5BDBE] test/(1/1) ...AssertionsFail/value/fail, with id=dag_1463536644092_0001_1
2016-05-18 01:57:24,440 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(852)) - Completed cleanup for DAG: name=[6C2E1F987F384CB789C79555266BCB8A/A7FFE11D12E04AB3AAFF74F33AF5BDBE] test/(1/1) ...AssertionsFail/value/fail, with id=dag_1463536644092_0001_1
2016-05-18 01:57:24,449 INFO  client.TezClient (TezClient.java:stop(566)) - Shutting down Tez Session, sessionName=(1/1) ...AssertionsFail/value/fail, applicationId=application_1463536644092_0001
2016-05-18 01:57:24,453 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(124)) - Received message to shutdown AM
2016-05-18 01:57:24,453 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:setShouldUnregisterFlag(895)) - TaskScheduler notified that it should unregister from RM
2016-05-18 01:57:24,454 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1301)) - No current running DAG, shutting down the AM
2016-05-18 01:57:24,454 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(907)) - DAGAppMasterShutdownHandler invoked
2016-05-18 01:57:24,454 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(916)) - Handling DAGAppMaster shutdown
2016-05-18 01:57:24,456 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(84)) - Stopping HistoryEventHandler
2016-05-18 01:57:24,456 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(196)) - Stopping RecoveryService
2016-05-18 01:57:24,456 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(199)) - Handle the remaining events in queue, queue size=0
2016-05-18 01:57:24,456 INFO  recovery.RecoveryService (RecoveryService.java:run(173)) - EventQueue take interrupted. Returning
2016-05-18 01:57:24,456 INFO  app.DAGAppMaster (DAGAppMaster.java:run(936)) - Sleeping for 5 seconds before shutting down
2016-05-18 01:57:24,456 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(221)) - Closing Summary Stream
2016-05-18 01:57:24,457 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-18 01:57:24,457 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-18 01:57:24,457 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:serviceStop(678)) - Shutting down AppCallbackExecutor
2016-05-18 01:57:24,464 INFO  app.DAGAppMaster (DAGAppMaster.java:run(2084)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/6C2E1F987F384CB789C79555266BCB8A/A7FFE11D12E04AB3AAFF74F33AF5BDBE/.tez/application_1463536644092_0001
2016-05-18 01:57:24,465 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] stopping all jobs
2016-05-18 01:57:24,465 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] stopping: (1/1) ...AssertionsFail/value/fail
2016-05-18 01:57:24,465 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] stopped all jobs
2016-05-18 01:57:24,466 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsFail/value/fail/_temporary
2016-05-18 01:57:24,466 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  completed in: 00:00.396
2016-05-18 01:57:24,466 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output//hadoop2-tez/appliedassertionsplatform/testValueAssertionsFail/value/fail
2016-05-18 01:57:24,494 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 01:57:24,495 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-18 01:57:24,557 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-05-18 01:57:24,562 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-05-18 01:57:24,562 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:24,563 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-05-18 01:57:24,563 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 01:57:24,583 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt
2016-05-18 01:57:24,591 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsPass/value/pass
2016-05-18 01:57:24,647 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting
2016-05-18 01:57:24,647 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:24,647 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  sink: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsPass/value/pass"]
2016-05-18 01:57:24,647 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  parallel execution of steps is enabled: false
2016-05-18 01:57:24,647 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  executing total steps: 1
2016-05-18 01:57:24,648 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  allocating management threads: 1
2016-05-18 01:57:24,650 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] starting step: (1/1) ...AssertionsPass/value/pass
2016-05-18 01:57:24,650 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [test] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-18 01:57:24,665 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] tez session mode enabled: true
2016-05-18 01:57:24,670 INFO  client.TezClient (TezClient.java:<init>(174)) - Tez Client Version: [ component=tez-api, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:24,670 INFO  client.TezClient (TezClient.java:start(394)) - Session mode. Starting session.
2016-05-18 01:57:24,670 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(164)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-18 01:57:24,681 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(122)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/3B6192C5908843C7895CCBE305FDBEF8/FABF977519EF41D6B1BD63C20E236100/.tez/application_1463536644670_0001 doesn't exist and is created
2016-05-18 01:57:24,703 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(332)) - DAGAppMaster thread has been created
2016-05-18 01:57:24,703 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-18 01:57:24,705 INFO  client.LocalClient (LocalClient.java:run(282)) - Using working directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/3B6192C5908843C7895CCBE305FDBEF8/FABF977519EF41D6B1BD63C20E236100/.tez/application_1463536644670_0001_wd
2016-05-18 01:57:24,720 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(363)) - Created DAGAppMaster for application appattempt_1463536644670_0001_000000, versionInfo=[ component=tez-dag, version=0.8.2, revision=2d46dcefa492a6957cfa972007039f7e188760ce, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160112-1834 ]
2016-05-18 01:57:24,720 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(80)) - Trying to locate HadoopShimProvider for hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:24,720 INFO  shim.HadoopShimsLoader (HadoopShimsLoader.java:<init>(139)) - Picked HadoopShim org.apache.tez.hadoop.shim.DefaultHadoopShim, providerName=null, overrideProviderViaConfig=null, hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2016-05-18 01:57:24,722 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(436)) - AM Level configured TaskSchedulers: [0:TezUber:null]
2016-05-18 01:57:24,722 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(437)) - AM Level configured ContainerLaunchers: [0:TezUber:null]
2016-05-18 01:57:24,722 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(438)) - AM Level configured TaskCommunicators: [0:TezUber:null]
2016-05-18 01:57:24,722 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(447)) - Comparing client version with AM version, clientVersion=0.8.2, AMVersion=0.8.2
2016-05-18 01:57:24,723 INFO  app.TaskCommunicatorManager (TaskCommunicatorManager.java:createUberTaskCommunicator(192)) - Creating Default Local Task Communicator
2016-05-18 01:57:24,724 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.container.AMContainerEventType for class org.apache.tez.dag.app.rm.container.AMContainerMap
2016-05-18 01:57:24,724 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.node.AMNodeEventType for class org.apache.tez.dag.app.rm.node.AMNodeTracker
2016-05-18 01:57:24,724 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGAppMasterEventType for class org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterEventHandler
2016-05-18 01:57:24,724 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.DAGEventType for class org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher
2016-05-18 01:57:24,725 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.VertexEventType for class org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher
2016-05-18 01:57:24,725 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(529)) - Using concurrent dispatcher: false
2016-05-18 01:57:24,725 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher
2016-05-18 01:57:24,725 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.TaskAttemptEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher
2016-05-18 01:57:24,725 INFO  common.AsyncDispatcher (AsyncDispatcher.java:registerAndCreateDispatcher(262)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for independent dispatch using: class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:24,725 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
2016-05-18 01:57:24,726 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.AMSchedulerEventType for class org.apache.tez.dag.app.rm.TaskSchedulerManager
2016-05-18 01:57:24,726 INFO  launcher.TezContainerLauncherImpl (ContainerLauncherManager.java:createUberContainerLauncher(134)) - Creating LocalContainerLauncher
2016-05-18 01:57:24,727 INFO  common.AsyncDispatcher (AsyncDispatcher.java:register(236)) - Registering class org.apache.tez.dag.app.rm.ContainerLauncherEventType for class org.apache.tez.dag.app.launcher.ContainerLauncherManager
2016-05-18 01:57:24,728 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(78)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1, nodeUpdatesRescheduleEnabled: false
2016-05-18 01:57:24,728 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(57)) - Initializing HistoryEventHandler withrecoveryEnabled=true, historyServiceClassName=org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService
2016-05-18 01:57:24,728 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/3B6192C5908843C7895CCBE305FDBEF8/FABF977519EF41D6B1BD63C20E236100/.tez/application_1463536644670_0001_wd/localmode-log-dir
2016-05-18 01:57:24,729 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/3B6192C5908843C7895CCBE305FDBEF8/FABF977519EF41D6B1BD63C20E236100/.tez/application_1463536644670_0001_wd/localmode-log-dir/history.txt.appattempt_1463536644670_0001_000000, maxErrors=10
2016-05-18 01:57:24,729 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(124)) - RecoveryService initialized with recoveryPath=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/3B6192C5908843C7895CCBE305FDBEF8/FABF977519EF41D6B1BD63C20E236100/.tez/application_1463536644670_0001/recovery/0, bufferSize(bytes)=8192, flushInterval(s)=30, maxUnflushedEvents=100
2016-05-18 01:57:24,729 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463536644670_0001_000000, appSubmitTime=1463536644719, launchTime=1463536644719
2016-05-18 01:57:24,733 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-18 01:57:24,744 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:41619
2016-05-18 01:57:24,745 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:createUberTaskScheduler(557)) - Creating TaskScheduler: Local TaskScheduler with clusterIdentifier=1463536644670
2016-05-18 01:57:24,747 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463536644670_0001_000000, startTime=1463536644747
2016-05-18 01:57:24,747 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1945)) - In Session mode. Waiting for DAG over RPC
2016-05-18 01:57:24,803 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-18 01:57:24,804 INFO  client.TezClient (TezClient.java:start(428)) - The url to track the Tez Session: N/A
2016-05-18 01:57:24,804 INFO  client.TezClient (TezClient.java:submitDAGSession(470)) - Submitting dag to TezSession, sessionName=(1/1) ...AssertionsPass/value/pass, applicationId=application_1463536644670_0001, dagName=[3B6192C5908843C7895CCBE305FDBEF8/FABF977519EF41D6B1BD63C20E236100] test/(1/1) ...AssertionsPass/value/pass
2016-05-18 01:57:24,822 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1351)) - Starting DAG submitted via RPC: [3B6192C5908843C7895CCBE305FDBEF8/FABF977519EF41D6B1BD63C20E236100] test/(1/1) ...AssertionsPass/value/pass
2016-05-18 01:57:24,823 INFO  app.DAGAppMaster (DAGAppMaster.java:createDAG(985)) - Merging AM credentials into DAG credentials
2016-05-18 01:57:24,824 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(1076)) - Generating DAG graphviz file, dagId=dag_1463536644670_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/3B6192C5908843C7895CCBE305FDBEF8/FABF977519EF41D6B1BD63C20E236100/.tez/application_1463536644670_0001_wd/localmode-log-dir/dag_1463536644670_0001_1.dot
2016-05-18 01:57:24,824 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(1093)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/3B6192C5908843C7895CCBE305FDBEF8/FABF977519EF41D6B1BD63C20E236100/.tez/application_1463536644670_0001_wd/localmode-log-dir/dag_1463536644670_0001_1-tez-dag.pb.txt
2016-05-18 01:57:24,831 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536644670_0001_1
2016-05-18 01:57:24,831 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:24,831 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2399)) - Running DAG: [3B6192C5908843C7895CCBE305FDBEF8/FABF977519EF41D6B1BD63C20E236100] test/(1/1) ...AssertionsPass/value/pass
2016-05-18 01:57:24 Running Dag: dag_1463536644670_0001_1
2016-05-18 01:57:24,836 INFO  app.DAGAppMaster (DAGAppMaster.java:run(946)) - Calling stop for all the services
2016-05-18 01:57:24,836 INFO  app.DAGAppMaster (DAGAppMaster.java:run(957)) - Exiting DAGAppMaster..GoodBye!
2016-05-18 01:57:24,847 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463536644670_0001_1, submitTime=1463536644822
2016-05-18 01:57:24,848 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/3B6192C5908843C7895CCBE305FDBEF8/FABF977519EF41D6B1BD63C20E236100/.tez/application_1463536644670_0001/tez-conf.pb" } size: 40936 timestamp: 1463536644000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:24,848 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalInputs(3978)) - Setting 1 additional inputs for vertexvertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39]
2016-05-18 01:57:24,849 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:24,849 INFO  impl.VertexImpl (VertexImpl.java:<init>(928)) - Default container context for vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974]=LocalResources: [[ name=tez-conf.pb, value=resource { scheme: "file" port: -1 file: "/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/3B6192C5908843C7895CCBE305FDBEF8/FABF977519EF41D6B1BD63C20E236100/.tez/application_1463536644670_0001/tez-conf.pb" } size: 40936 timestamp: 1463536644000 type: FILE visibility: APPLICATION],], environment: [[ CLASSPATH=$PWD/cascading-hadoop2-tez-3.1.0.jar/:$PWD/cascading-hadoop2-tez-3.1.0.jar/classes/:$PWD/cascading-hadoop2-tez-3.1.0.jar/lib/*::$PWD:$PWD/*:$HADOOP_CONF_DIR: ],[ LD_LIBRARY_PATH=$PWD:$PWD:$HADOOP_COMMON_HOME/lib/native/ ],], credentials(token kinds): [tez.job,], javaOpts: -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC  -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dtez.root.logger=INFO,CLA, vertex: vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974], Default Resources=<memory:1024, vCores:1>
2016-05-18 01:57:24,849 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4023)) - Setting 1 additional outputs for vertex vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974]
2016-05-18 01:57:24,850 INFO  impl.VertexImpl (VertexImpl.java:<init>(1016)) - Running vertex: vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974] : TaskScheduler=0:TezUber, ContainerLauncher=0:TezUber, TaskCommunicator=0:TezUber
2016-05-18 01:57:24,850 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1593)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-18 01:57:24,850 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463536644670_0001_1, initTime=1463536644850
2016-05-18 01:57:24,851 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536644670_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-18 01:57:24,851 INFO  impl.DAGImpl (DAGImpl.java:transition(1768)) - Added additional resources : [[]] to classpath
2016-05-18 01:57:24,851 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:DAG_STARTED]: dagID=dag_1463536644670_0001_1, startTime=1463536644851
2016-05-18 01:57:24,851 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536644670_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-18 01:57:24,851 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2400)) - Root Inputs exist for Vertex: FDC385EDD25043C980DEF6EF298D2A39 : {3032DDE75E71403F83A4F58A70FC3A69={InputName=3032DDE75E71403F83A4F58A70FC3A69}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-18 01:57:24,852 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2410)) - Starting root input initializer for input: 3032DDE75E71403F83A4F58A70FC3A69, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-18 01:57:24,852 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2550)) - Setting vertexManager to RootInputVertexManager for vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39]
2016-05-18 01:57:24,852 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2721)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39]
2016-05-18 01:57:24,852 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2726)) - Vertex will initialize from input initializer. vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39]
2016-05-18 01:57:24,852 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3893)) - Starting 1 inputInitializers for vertex vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39]
2016-05-18 01:57:24,855 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-18 01:57:24,855 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(272)) - Starting InputInitializer for Input: 3032DDE75E71403F83A4F58A70FC3A69 on vertex vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39]
2016-05-18 01:57:24,855 INFO  client.TezClient (TezClient.java:submitDAGSession(545)) - Submitted dag to TezSession, sessionName=(1/1) ...AssertionsPass/value/pass, applicationId=application_1463536644670_0001, dagName=[3B6192C5908843C7895CCBE305FDBEF8/FABF977519EF41D6B1BD63C20E236100] test/(1/1) ...AssertionsPass/value/pass
2016-05-18 01:57:24,855 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2562)) - Setting vertexManager to ShuffleVertexManager for vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974]
2016-05-18 01:57:24,858 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(109)) - Input 3032DDE75E71403F83A4F58A70FC3A69 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7, groupingEnabled: true
2016-05-18 01:57:24,860 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(168)) - Grouping splits in Tez
2016-05-18 01:57:24,860 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(226)) - Desired splits: 1 too large.  Desired splitLength: 1449 Min splitLength: 52428800 New desired splits: 1 Total length: 1449 Original splits: 2
2016-05-18 01:57:24,860 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(321)) - Desired numSplits: 1 lengthPerGroup: 1449 numLocations: 1 numSplitsPerLocation: 2 numSplitsInGroup: 2 totalLength: 1449 numOriginalSplits: 2 . Grouping by length: true count: false nodeLocalOnly: false
2016-05-18 01:57:24,860 INFO  grouper.TezSplitGrouper (TezSplitGrouper.java:getGroupedSplits(539)) - Number of splits desired: 1 created: 1 splitsProcessed: 2
2016-05-18 01:57:24,861 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(308)) - Succeeded InputInitializer for Input: 3032DDE75E71403F83A4F58A70FC3A69 on vertex vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39]
2016-05-18 01:57:24,862 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:initialize(1022)) - Shuffle Vertex Manager: settings minFrac:0.25 maxFrac:0.75 auto:false desiredTaskIput:104857600 minTasks:1
2016-05-18 01:57:24,863 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2760)) - Creating 1 tasks for vertex: vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974]
2016-05-18 01:57:24,863 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2779)) - Directly initializing vertex: vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974]
2016-05-18 01:57:24,864 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536644670_0001_1_01, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=null, edgeManagersCount=1, rootInputSpecUpdateCount=0, setParallelismCalledFlag=false
2016-05-18 01:57:24,864 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2187)) - Setting up committers for vertex vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974], numAdditionalOutputs=1
2016-05-18 01:57:24,864 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(2202)) - Instantiating committer for output=D70AD8CCAABF447E8506CE0AE79AB29B, vertex=vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-18 01:57:24,866 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(121)) - Committer for FF8B10418FA540B5AADBF14C13195974:D70AD8CCAABF447E8506CE0AE79AB29B using oldmapred API
2016-05-18 01:57:24,866 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(146)) - OutputCommitter for outputName=D70AD8CCAABF447E8506CE0AE79AB29B, vertexName=FF8B10418FA540B5AADBF14C13195974, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-18 01:57:24,867 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:VERTEX_INITIALIZED]: vertexName=FF8B10418FA540B5AADBF14C13195974, vertexId=vertex_1463536644670_0001_1_01, initRequestedTime=1463536644855, initedTime=1463536644864, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=0, initGeneratedEventsCount=0
2016-05-18 01:57:24,868 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974] transitioned from NEW to INITED due to event V_INIT
2016-05-18 01:57:24,868 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:24,868 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1644)) - Got updated RootInputsSpecs: {3032DDE75E71403F83A4F58A70FC3A69=forAllWorkUnits=true, update=[1]}
2016-05-18 01:57:24,869 INFO  impl.VertexImpl (VertexImpl.java:setParallelismWrapper(1664)) - Vertex vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39] parallelism set to 1
2016-05-18 01:57:24,869 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(2972)) - Cannot init vertex: vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: true
2016-05-18 01:57:24,870 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:VERTEX_INITIALIZED]: vertexName=FDC385EDD25043C980DEF6EF298D2A39, vertexId=vertex_1463536644670_0001_1_00, initRequestedTime=1463536644851, initedTime=1463536644869, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1, initGeneratedEventsCount=1
2016-05-18 01:57:24,870 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39] with distanceFromRoot: 0
2016-05-18 01:57:24,870 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39] transitioned from INITIALIZING to INITED due to event V_INPUT_DATA_INFORMATION
2016-05-18 01:57:24,870 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536644670_0001_1_00, startRequestedTime=1463536644855, startedTime=1463536644870
2016-05-18 01:57:24,871 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:VERTEX_CONFIGURE_DONE]: vertexId=vertex_1463536644670_0001_1_00, reconfigureDoneTime=0, numTasks=1, vertexLocationHint=org.apache.tez.dag.api.VertexLocationHint@b8338fe7, edgeManagersCount=0, rootInputSpecUpdateCount=1, setParallelismCalledFlag=true
2016-05-18 01:57:24,871 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:24,871 INFO  impl.VertexImpl (VertexImpl.java:transition(2932)) - Source vertex started: vertex_1463536644670_0001_1_00 for vertex: vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974] numStartedSources: 1 numSources: 1
2016-05-18 01:57:24,872 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(2814)) - Triggering start event for vertex: vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974] with distanceFromRoot: 1
2016-05-18 01:57:24,871 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(100)) - Starting 1 in FDC385EDD25043C980DEF6EF298D2A39
2016-05-18 01:57:24,872 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39]
2016-05-18 01:57:24,872 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463536644670_0001_1_01, startRequestedTime=1463536644871, startedTime=1463536644872
2016-05-18 01:57:24,873 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974] transitioned from INITED to RUNNING due to event V_START
2016-05-18 01:57:24,874 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:TASK_STARTED]: vertexName=FDC385EDD25043C980DEF6EF298D2A39, taskId=task_1463536644670_0001_1_00_000000, scheduledTime=1463536644873, launchTime=1463536644873
2016-05-18 01:57:24,874 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:onVertexStarted(519)) - OnVertexStarted vertex: FF8B10418FA540B5AADBF14C13195974 with 0 source tasks and 1 pending tasks
2016-05-18 01:57:24,874 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39]
2016-05-18 01:57:24,875 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:handleVertexStateUpdate(1051)) - Received configured notification : CONFIGURED for vertex: FDC385EDD25043C980DEF6EF298D2A39 in vertex: FF8B10418FA540B5AADBF14C13195974 numBipartiteSourceTasks: 1
2016-05-18 01:57:24,876 INFO  node.PerSourceNodeTracker (PerSourceNodeTracker.java:nodeSeen(74)) - Adding new node 127.0.0.1:0 to nodeTracker 0
2016-05-18 01:57:24,877 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536644670_0001_00_000001, launchTime=1463536644877
2016-05-18 01:57:24,878 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536644670_0001_00_000001
2016-05-18 01:57:24,878 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536644670_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536644670_0001_1_00_000000_0
2016-05-18 01:57:24,878 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536644670_0001_1_00_000000_0] started. Is using containerId: [container_1463536644670_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-18 01:57:24,878 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test] submitted tez dag to app master: application_1463536644670_0001, with dag id: dag_1463536644670_0001_1
2016-05-18 01:57:24,879 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=FDC385EDD25043C980DEF6EF298D2A39, taskAttemptId=attempt_1463536644670_0001_1_00_000000_0, startTime=1463536644878, containerId=container_1463536644670_0001_00_000001, nodeId=127.0.0.1:0
2016-05-18 01:57:24 Starting to run new task attempt: attempt_1463536644670_0001_1_00_000000_0
2016-05-18 01:57:24,879 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536644670_0001_1_00_000000_0
2016-05-18 01:57:24,881 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:24,882 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:24,883 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [3B6192C5908843C7895CCBE305FDBEF8/FABF977519EF41D6B1BD63C20E236100] test/(1/1) ...AssertionsPass/value/pass, VertexName: FDC385EDD25043C980DEF6EF298D2A39, VertexParallelism: 1, TaskAttemptID:attempt_1463536644670_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=3032DDE75E71403F83A4F58A70FC3A69, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=FF8B10418FA540B5AADBF14C13195974, physicalEdgeCount=1, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ]
2016-05-18 01:57:24,883 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:24,883 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536644670_0001_1_00_000000_0
2016-05-18 01:57:24,884 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(496)) - TaskAttempt:attempt_1463536644670_0001_1_00_000000_0 sent events: (0-1).
2016-05-18 01:57:24,886 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536644670_0001_1_00_000000_0, eventCount=1 fromEventId=0 nextFromEventId=0
2016-05-18 01:57:24,887 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:24,888 INFO  input.MRInput (MRInput.java:initialize(440)) - 3032DDE75E71403F83A4F58A70FC3A69 using newmapreduce API=false, split via event=true, numPhysicalInputs=1
2016-05-18 01:57:24,888 INFO  input.MRInput (MRInput.java:initializeInternal(494)) - Initialized MRInput: 3032DDE75E71403F83A4F58A70FC3A69
2016-05-18 01:57:24,894 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: FDC385EDD25043C980DEF6EF298D2A39, ordinal: 0
2016-05-18 01:57:24,894 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FDC385EDD25043C980DEF6EF298D2A39, mem on start (mb), free: 247, total: 372, max: 672
2016-05-18 01:57:24,894 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:24,894 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:24,894 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:24,894 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:24,895 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[3032DDE75E71403F83A4F58A70FC3A69:INPUT:0:org.apache.tez.mapreduce.input.MRInput], [FF8B10418FA540B5AADBF14C13195974:OUTPUT:104857600:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput]
2016-05-18 01:57:24,895 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:24,895 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:24,895 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 104857600, TotalRequestedScaled: 9.679163076923077E7, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.15
2016-05-18 01:57:24,895 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[3032DDE75E71403F83A4F58A70FC3A69:org.apache.tez.mapreduce.input.MRInput:INPUT:0:0], [FF8B10418FA540B5AADBF14C13195974:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput:OUTPUT:104857600:104857600]
2016-05-18 01:57:24,895 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:24,896 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: 3032DDE75E71403F83A4F58A70FC3A69 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:24,896 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:24,896 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:24,896 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: 3032DDE75E71403F83A4F58A70FC3A69
2016-05-18 01:57:24,896 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:24,897 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536644670_0001_1_00_000000_0
2016-05-18 01:57:24,898 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(174)) - Processing split: TezGroupedSplit{wrappedSplits=[file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:0+724, file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt:724+725], wrappedInputFormatName='org.apache.hadoop.mapred.TextInputFormat', locations=[localhost], rack='null', length=1449}
2016-05-18 01:57:24,898 INFO  input.MRInput (MRInput.java:initFromEventInternal(653)) - 3032DDE75E71403F83A4F58A70FC3A69 initialized RecordReader from event
2016-05-18 01:57:24,901 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:24,902 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"] streamed: true, id: 3032DDE75E71403F83A4F58A70FC3A69
2016-05-18 01:57:24,902 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: GroupBy(test)[by:[{1}:'method']], id: A1874E1767174DBAA49BDD67D6A32ACC
2016-05-18 01:57:24,902 INFO  element.TezGroupGate (TezGroupGate.java:prepare(98)) - calling OrderedPartitionedKVOutput#start() on: GroupBy(test)[by:[{1}:'method']] A1874E1767174DBAA49BDD67D6A32ACC
2016-05-18 01:57:24,903 INFO  impl.ExternalSorter (ExternalSorter.java:<init>(199)) - FF8B10418FA540B5AADBF14C13195974 using: memoryMb=100, keySerializerClass=class cascading.tuple.io.KeyTuple, valueSerializerClass=cascading.tuple.hadoop.io.ValueTupleSerializer@4ec5571b, comparator=cascading.tuple.hadoop.util.TupleComparator@7dd9d603, partitioner=cascading.tuple.tez.util.TuplePartitioner, serialization=cascading.tuple.hadoop.TupleSerialization,org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
2016-05-18 01:57:24,903 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(170)) - Setting up PipelinedSorter for FF8B10418FA540B5AADBF14C13195974: , UsingHashComparator=false
2016-05-18 01:57:24,918 INFO  impl.PipelinedSorter (PipelinedSorter.java:allocateSpace(245)) - Newly allocated block size=104857600, index=0, Number of buffers=1, currentAllocatableMemory=0, currentBufferSize=104857600, total=104857600
2016-05-18 01:57:24,918 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(189)) - Pre allocating rest of memory buffers upfront
2016-05-18 01:57:24,918 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(207)) - Setting up PipelinedSorter for FF8B10418FA540B5AADBF14C13195974: , UsingHashComparator=false#blocks=1, maxMemUsage=104857600, lazyAllocateMem=false, minBlockSize=2097152000, initial BLOCK_SIZE=104857600, finalMergeEnabled=true, pipelinedShuffle=false, sendEmptyPartitions=true, tez.runtime.io.sort.mb=100
2016-05-18 01:57:24,918 INFO  impl.PipelinedSorter (PipelinedSorter.java:<init>(882)) - FF8B10418FA540B5AADBF14C13195974: reserved.remaining()=104857600, reserved.metasize=16777216
2016-05-18 01:57:24,918 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/classes/test/data/apache.10.txt"]
2016-05-18 01:57:24,918 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: FDC385EDD25043C980DEF6EF298D2A39, all 1 inputs ready in: 00:00:00.000
2016-05-18 01:57:24,921 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536644670_0001_1_00_000000_0
2016-05-18 01:57:24,921 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FDC385EDD25043C980DEF6EF298D2A39, mem on close (mb), free: 145, total: 372, max: 672
2016-05-18 01:57:24,921 INFO  impl.PipelinedSorter (PipelinedSorter.java:flush(629)) - FF8B10418FA540B5AADBF14C13195974: Starting flush of map output
2016-05-18 01:57:24,921 INFO  impl.PipelinedSorter (PipelinedSorter.java:end(995)) - FF8B10418FA540B5AADBF14C13195974: Span0.length = 7, perItem = 99
2016-05-18 01:57:24,922 INFO  impl.PipelinedSorter (PipelinedSorter.java:sort(904)) - FF8B10418FA540B5AADBF14C13195974: done sorting span=0, length=7, time=1
2016-05-18 01:57:24,922 INFO  impl.PipelinedSorter (PipelinedSorter.java:ready(1297)) - FF8B10418FA540B5AADBF14C13195974: Heap = SpanIterator<0:6> (span=Span[16777216,693]),
2016-05-18 01:57:24,923 INFO  impl.PipelinedSorter (PipelinedSorter.java:spill(546)) - FF8B10418FA540B5AADBF14C13195974: Spilling to /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/3B6192C5908843C7895CCBE305FDBEF8/FABF977519EF41D6B1BD63C20E236100/.tez/application_1463536644670_0001_wd/localmode-local-dir/output/attempt_1463536644670_0001_1_00_000000_0_10080_0/file.out
2016-05-18 01:57:24,927 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:24 Completed running task attempt: attempt_1463536644670_0001_1_00_000000_0
2016-05-18 01:57:24,928 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536644670_0001_1_00_000000_0, askedToStop=false
2016-05-18 01:57:24,928 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536644670_0001_1_00_000000_0, stopRequested=false
2016-05-18 01:57:24,928 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536644670_0001_1_00_000000_0: Counters: 18 [[org.apache.tez.common.counters.TaskCounter SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1][cascading.flow.SliceCounters Process_Begin_Time=1463536644919, Process_Duration=2, Process_End_Time=1463536644921, Read_Duration=0, Tuples_Read=10, Tuples_Written=7, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=10]]
2016-05-18 01:57:24,930 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536644670_0001_1_00_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:24,930 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:24,931 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:24,931 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:24,931 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536644670_0001_00_000001
2016-05-18 01:57:24,931 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=FDC385EDD25043C980DEF6EF298D2A39, taskAttemptId=attempt_1463536644670_0001_1_00_000000_0, creationTime=1463536644874, allocationTime=1463536644876, startTime=1463536644878, finishTime=1463536644931, timeTaken=53, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:24,932 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536644670_0001_1_00_000000_0
2016-05-18 01:57:24,933 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:TASK_FINISHED]: vertexName=FDC385EDD25043C980DEF6EF298D2A39, taskId=task_1463536644670_0001_1_00_000000, startTime=1463536644878, finishTime=1463536644932, timeTaken=54, status=SUCCEEDED, successfulAttemptID=attempt_1463536644670_0001_1_00_000000_0, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536644919, Process_Duration=2, Process_End_Time=1463536644921, Read_Duration=0, Tuples_Read=10, Tuples_Written=7, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=10
2016-05-18 01:57:24,933 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:24,933 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39]
2016-05-18 01:57:24,934 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:VERTEX_FINISHED]: vertexName=FDC385EDD25043C980DEF6EF298D2A39, vertexId=vertex_1463536644670_0001_1_00, initRequestedTime=1463536644851, initedTime=1463536644869, startRequestedTime=1463536644855, startedTime=1463536644870, finishTime=1463536644933, timeTaken=63, status=SUCCEEDED, diagnostics=, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, org.apache.tez.common.counters.TaskCounter, SPILLED_RECORDS=7, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=7, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, cascading.flow.SliceCounters, Process_Begin_Time=1463536644919, Process_Duration=2, Process_End_Time=1463536644921, Read_Duration=0, Tuples_Read=10, Tuples_Written=7, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=10, vertexStats=firstTaskStartTime=1463536644878, firstTasksToStart=[ task_1463536644670_0001_1_00_000000 ], lastTaskFinishTime=1463536644931, lastTasksToFinish=[ task_1463536644670_0001_1_00_000000 ], minTaskDuration=53, maxTaskDuration=53, avgTaskDuration=53.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536644670_0001_1_00_000000 ], longestDurationTasks=[ task_1463536644670_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:24,934 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:24,935 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536644670_0001_00_000001, stoppedTime=1463536644935, exitStatus=0
2016-05-18 01:57:24,935 INFO  impl.VertexImpl (VertexImpl.java:transition(3279)) - Source task attempt completed for vertex: vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974] attempt: attempt_1463536644670_0001_1_00_000000_0 with state: SUCCEEDED vertexState: RUNNING
2016-05-18 01:57:24,935 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:24,935 INFO  vertexmanager.ShuffleVertexManager (ShuffleVertexManager.java:schedulePendingTasks(920)) - All source tasks assigned. Ramping up 1 remaining tasks for vertex: FF8B10418FA540B5AADBF14C13195974
2016-05-18 01:57:24,935 INFO  impl.Edge (Edge.java:routingToBegin(232)) - Routing to begin for edge: EdgeInfo: sourceVertexName=FDC385EDD25043C980DEF6EF298D2A39, destinationVertexName=FF8B10418FA540B5AADBF14C13195974. EdgeProperty: { SCATTER_GATHER : org.apache.tez.runtime.library.input.OrderedGroupedKVInput >> PERSISTED >> org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput >> NullEdgeManager } onDemandRouting: true
2016-05-18 01:57:24,935 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:24,936 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(262)) - Ignoring stop request for containerId container_1463536644670_0001_00_000001. Relying on regular task shutdown for it to end
2016-05-18 01:57:24,935 INFO  impl.VertexImpl (VertexImpl.java:unsetTasksNotYetScheduled(1466)) - Routing pending task events for vertex: vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974]
2016-05-18 01:57:24,936 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:TASK_STARTED]: vertexName=FF8B10418FA540B5AADBF14C13195974, taskId=task_1463536644670_0001_1_01_000000, scheduledTime=1463536644936, launchTime=1463536644936
2016-05-18 01:57:24,936 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTaskEx(106)) - Scheduled vertex: vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974]
2016-05-18 01:57:24,938 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:N/A][Event:CONTAINER_LAUNCHED]: containerId=container_1463536644670_0001_00_000002, launchTime=1463536644938
2016-05-18 01:57:24,939 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536644670_0001_00_000002
2016-05-18 01:57:24,940 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1322)) - TaskAttempt: [attempt_1463536644670_0001_1_01_000000_0] started. Is using containerId: [container_1463536644670_0001_00_000002] on NM: [127.0.0.1:0]
2016-05-18 01:57:24,940 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=FF8B10418FA540B5AADBF14C13195974, taskAttemptId=attempt_1463536644670_0001_1_01_000000_0, startTime=1463536644939, containerId=container_1463536644670_0001_00_000002, nodeId=127.0.0.1:0
2016-05-18 01:57:24,940 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536644670_0001_00_000002: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463536644670_0001_1_01_000000_0
2016-05-18 01:57:24 Starting to run new task attempt: attempt_1463536644670_0001_1_01_000000_0
2016-05-18 01:57:24,940 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: attempt_1463536644670_0001_1_01_000000_0
2016-05-18 01:57:24,941 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:24,941 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(306)) - Refreshing UGI since Credentials have changed. Credentials : #Tokens=1, #SecretKeys=0
2016-05-18 01:57:24,941 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(166)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [3B6192C5908843C7895CCBE305FDBEF8/FABF977519EF41D6B1BD63C20E236100] test/(1/1) ...AssertionsPass/value/pass, VertexName: FF8B10418FA540B5AADBF14C13195974, VertexParallelism: 1, TaskAttemptID:attempt_1463536644670_0001_1_01_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=FDC385EDD25043C980DEF6EF298D2A39, physicalEdgeCount=1, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=D70AD8CCAABF447E8506CE0AE79AB29B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-18 01:57:24,941 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(93)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-18 01:57:24,941 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(65)) - Initializing task, taskAttemptId=attempt_1463536644670_0001_1_01_000000_0
2016-05-18 01:57:24,942 INFO  impl.VertexImpl (VertexImpl.java:getTaskAttemptTezEvents(3662)) - Sending attempt_1463536644670_0001_1_01_000000_0 1 events [0,1) total 1 vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974]
2016-05-18 01:57:24,942 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536644670_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-18 01:57:24,942 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536644670_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:24,943 INFO  task.TaskReporter (TaskReporter.java:heartbeat(292)) - Routing events from heartbeat response to task, currentTaskAttemptId=attempt_1463536644670_0001_1_01_000000_0, eventCount=1 fromEventId=0 nextFromEventId=1
2016-05-18 01:57:24,943 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536644670_0001_00_000001, Exiting
2016-05-18 01:57:24,943 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536644670_0001_00_000001
2016-05-18 01:57:24,943 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536644670_0001_00_000001
2016-05-18 01:57:24,944 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536644670_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:24,944 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536644670_0001_00_000001 completed successfully
2016-05-18 01:57:24,946 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-18 01:57:24,946 INFO  orderedgrouped.MergeManager (MergeManager.java:getInitialMemoryRequirement(339)) - Initial Memory required for SHUFFLE_BUFFER=211392912 based on INPUT_BUFFER_FACTOR=0.9,  for final merged output=0, using factor: 0.0
2016-05-18 01:57:24,955 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: FF8B10418FA540B5AADBF14C13195974, ordinal: 1
2016-05-18 01:57:24,955 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FF8B10418FA540B5AADBF14C13195974, mem on start (mb), free: 138, total: 372, max: 672
2016-05-18 01:57:24,955 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(562)) - Initialized processor
2016-05-18 01:57:24,955 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 2 initializers to finish
2016-05-18 01:57:24,955 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(239)) - Waiting for 1 initializers to finish
2016-05-18 01:57:24,959 INFO  output.MROutput (MROutput.java:initialize(421)) - D70AD8CCAABF447E8506CE0AE79AB29B: outputFormat=org.apache.hadoop.mapred.TextOutputFormat, using newmapreduce API=false
2016-05-18 01:57:24,959 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(252)) - All initializers finished
2016-05-18 01:57:24,959 INFO  resources.MemoryDistributor (MemoryDistributor.java:logInitialRequests(275)) - InitialRequests=[D70AD8CCAABF447E8506CE0AE79AB29B:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput], [FDC385EDD25043C980DEF6EF298D2A39:INPUT:211392912:org.apache.tez.runtime.library.input.OrderedGroupedKVInput]
2016-05-18 01:57:24,960 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:populateTypeScaleMap(239)) - ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1]
2016-05-18 01:57:24,960 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(266)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-18 01:57:24,960 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 211392912, TotalRequestedScaled: 1.9513191876923078E8, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.30
2016-05-18 01:57:24,960 INFO  resources.MemoryDistributor (MemoryDistributor.java:logFinalAllocations(297)) - Allocations=[D70AD8CCAABF447E8506CE0AE79AB29B:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0], [FDC385EDD25043C980DEF6EF298D2A39:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:211392912:211392912]
2016-05-18 01:57:24,960 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(274)) - Starting Inputs/Outputs
2016-05-18 01:57:24,960 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(287)) - Input: FDC385EDD25043C980DEF6EF298D2A39 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-18 01:57:24,960 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(308)) - Num IOs determined for AutoStart: 1
2016-05-18 01:57:24,960 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(310)) - Waiting for 1 IOs to start
2016-05-18 01:57:24,961 INFO  orderedgrouped.Shuffle (Shuffle.java:<init>(147)) - FDC385EDD25043C980DEF6EF298D2A39: Shuffle assigned with 1 inputs, codec: None, ifileReadAhead: true
2016-05-18 01:57:24,961 INFO  orderedgrouped.MergeManager (MergeManager.java:<init>(273)) - FDC385EDD25043C980DEF6EF298D2A39: MergerManager: memoryLimit=211392912, maxSingleShuffleLimit=52848228, mergeThreshold=190253616, ioSortFactor=100, postMergeMem=0, memToMemMergeOutputsThreshold=100
2016-05-18 01:57:24,962 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:<init>(353)) - ShuffleScheduler running for sourceVertex: FDC385EDD25043C980DEF6EF298D2A39 with configuration: maxFetchFailuresBeforeReporting=5, reportReadErrorImmediately=true, maxFailedUniqueFetches=1, abortFailureLimit=15, maxTaskOutputAtOnce=20, numFetchers=1, hostFailureFraction=0.2, minFailurePerHost=4, maxAllowedFailedFetchFraction=0.5, maxStallTimeFraction=0.5, minReqProgressFraction=0.5, checkFailedFetchSinceLastCompletion=true
2016-05-18 01:57:24,963 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:_callInternal(474)) - Started Input with src edge: FDC385EDD25043C980DEF6EF298D2A39
2016-05-18 01:57:24,963 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(323)) - AutoStartComplete
2016-05-18 01:57:24,964 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(70)) - Running task, taskAttemptId=attempt_1463536644670_0001_1_01_000000_0
2016-05-18 01:57:24,967 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - FDC385EDD25043C980DEF6EF298D2A39: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0
2016-05-18 01:57:24,968 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: GroupBy(test)[by:[{1}:'method']]
2016-05-18 01:57:24,968 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: GroupBy(test)[by:[{1}:'method']] streamed: true, id: A1874E1767174DBAA49BDD67D6A32ACC
2016-05-18 01:57:24,969 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsPass/value/pass"], id: D70AD8CCAABF447E8506CE0AE79AB29B
2016-05-18 01:57:24,969 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsPass/value/pass"]
2016-05-18 01:57:24,969 INFO  element.TezGroupGate (TezGroupGate.java:prepare(90)) - calling OrderedGroupedKVInput#start() on: GroupBy(test)[by:[{1}:'method']] A1874E1767174DBAA49BDD67D6A32ACC, for 1 inputs
2016-05-18 01:57:24,971 INFO  orderedgrouped.ShuffleScheduler (ShuffleUtils.java:logIndividualFetchComplete(489)) - Completed fetch for attempt: {0, 0, attempt_1463536644670_0001_1_00_000000_0_10080} to DISK_DIRECT, csize=653, dsize=649, EndTime=1463536644971, TimeTaken=1, Rate=0.62 MB/s
2016-05-18 01:57:24,971 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:copySucceeded(551)) - All inputs fetched for input vertex : FDC385EDD25043C980DEF6EF298D2A39
2016-05-18 01:57:24,972 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:24,972 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:callInternal(1289)) - Shutting down FetchScheduler for input: FDC385EDD25043C980DEF6EF298D2A39, wasInterrupted=false
2016-05-18 01:57:24,973 INFO  orderedgrouped.ShuffleScheduler (ShuffleScheduler.java:logProgress(618)) - copy(1 (spillsFetched=1) of 1. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.00 MB/s)
2016-05-18 01:57:24,974 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1005)) - finalMerge called with 0 in-memory map-outputs and 1 on-disk map-outputs
2016-05-18 01:57:24,975 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1103)) - Disk file=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/3B6192C5908843C7895CCBE305FDBEF8/FABF977519EF41D6B1BD63C20E236100/.tez/application_1463536644670_0001_wd/localmode-local-dir/output/attempt_1463536644670_0001_1_00_000000_0_10080/file.out, len=653, isLocal=true
2016-05-18 01:57:24,975 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1115)) - Merging 1 files, 653 bytes from disk
2016-05-18 01:57:24,975 INFO  orderedgrouped.MergeManager (MergeManager.java:finalMerge(1130)) - Merging 0 segments, 0 bytes from memory into reduce
2016-05-18 01:57:24,975 INFO  impl.TezMerger (TezMerger.java:merge(644)) - Merging 1 sorted segments
2016-05-18 01:57:24,975 INFO  impl.TezMerger (TezMerger.java:merge(749)) - Down to the last merge-pass, with 1 segments left of total size: 633 bytes
2016-05-18 01:57:24,976 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: FF8B10418FA540B5AADBF14C13195974, all 1 inputs ready in: 00:00:00.006
2016-05-18 01:57:24,976 INFO  orderedgrouped.Shuffle (Shuffle.java:callInternal(332)) - merge complete for input vertex : FDC385EDD25043C980DEF6EF298D2A39
2016-05-18 01:57:24,976 INFO  input.OrderedGroupedKVInput (OrderedGroupedKVInput.java:createValuesIterator(292)) - FDC385EDD25043C980DEF6EF298D2A39: creating ValuesIterator with comparator=cascading.tuple.hadoop.util.TupleComparator, keyClass=cascading.tuple.io.KeyTuple, valClass=cascading.tuple.io.ValueTuple
2016-05-18 01:57:24,977 INFO  orderedgrouped.Shuffle (Shuffle.java:onSuccess(417)) - FDC385EDD25043C980DEF6EF298D2A39: Shuffle Runner thread complete
2016-05-18 01:57:24,979 INFO  output.MROutput (MROutput.java:close(526)) - D70AD8CCAABF447E8506CE0AE79AB29B closed
2016-05-18 01:57:24,979 INFO  impl.TaskImpl (TaskImpl.java:canCommit(671)) - attempt_1463536644670_0001_1_01_000000_0 given a go for committing the task output.
2016-05-18 01:57:24,980 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(79)) - Closing task, taskAttemptId=attempt_1463536644670_0001_1_01_000000_0
2016-05-18 01:57:24,980 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FF8B10418FA540B5AADBF14C13195974, mem on close (mb), free: 134, total: 372, max: 672
2016-05-18 01:57:24,981 INFO  orderedgrouped.Shuffle (Shuffle.java:shutdown(278)) - Shutting down Shuffle for source: FDC385EDD25043C980DEF6EF298D2A39
2016-05-18 01:57:24,981 INFO  orderedgrouped.ShuffleInputEventHandlerOrderedGrouped (ShuffleInputEventHandlerOrderedGrouped.java:logProgress(76)) - FDC385EDD25043C980DEF6EF298D2A39: numDmeEventsSeen=1, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0, updateOnClose
2016-05-18 01:57:24,981 INFO  output.MROutput (MROutput.java:close(526)) - D70AD8CCAABF447E8506CE0AE79AB29B closed
2016-05-18 01:57:24,981 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:close(387)) - Joining on EventRouter
2016-05-18 01:57:24 Completed running task attempt: attempt_1463536644670_0001_1_01_000000_0
2016-05-18 01:57:24,982 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:run(86)) - Task completed, taskAttemptId=attempt_1463536644670_0001_1_01_000000_0, askedToStop=false
2016-05-18 01:57:24,982 INFO  task.TaskRunner2Callable (TaskRunner2Callable.java:callInternal(104)) - Cleaning up task attempt_1463536644670_0001_1_01_000000_0, stopRequested=false
2016-05-18 01:57:24,983 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(813)) - Final Counters for attempt_1463536644670_0001_1_01_000000_0: Counters: 36 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=12, MERGE_PHASE_TIME=14, FIRST_EVENT_RECEIVED=6, LAST_EVENT_RECEIVED=6][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][cascading.flow.SliceCounters Process_Begin_Time=1463536644976, Process_Duration=4, Process_End_Time=1463536644980, Read_Duration=0, Tuples_Read=7, Tuples_Written=1, Write_Duration=0][cascading.flow.StepCounters Tuples_Written=1]]
2016-05-18 01:57:24,984 INFO  task.TezTaskRunner2 (TezTaskRunner2.java:logAndReturnEndResult(473)) - TaskRunnerResult for attempt_1463536644670_0001_1_01_000000_0 : TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}  
2016-05-18 01:57:24,984 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=FF8B10418FA540B5AADBF14C13195974, taskAttemptId=attempt_1463536644670_0001_1_01_000000_0, creationTime=1463536644936, allocationTime=1463536644937, startTime=1463536644939, finishTime=1463536644984, timeTaken=45, status=SUCCEEDED, errorEnum=, diagnostics=
2016-05-18 01:57:24,984 INFO  task.TezChild (TezChild.java:run(265)) - TaskRunner2Result: TaskRunner2Result{endReason=SUCCESS, error=null, containerShutdownRequested=false}
2016-05-18 01:57:24,985 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: 
2016-05-18 01:57:24,985 INFO  impl.TaskImpl (TaskImpl.java:transition(1057)) - Task succeeded with attempt attempt_1463536644670_0001_1_01_000000_0
2016-05-18 01:57:24,985 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:24,985 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:TASK_FINISHED]: vertexName=FF8B10418FA540B5AADBF14C13195974, taskId=task_1463536644670_0001_1_01_000000, startTime=1463536644939, finishTime=1463536644985, timeTaken=46, status=SUCCEEDED, successfulAttemptID=attempt_1463536644670_0001_1_01_000000_0, diagnostics=, counters=Counters: 36, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=12, MERGE_PHASE_TIME=14, FIRST_EVENT_RECEIVED=6, LAST_EVENT_RECEIVED=6, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536644976, Process_Duration=4, Process_End_Time=1463536644980, Read_Duration=0, Tuples_Read=7, Tuples_Written=1, Write_Duration=0, cascading.flow.StepCounters, Tuples_Written=1
2016-05-18 01:57:24,986 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2024)) - Task Completion: vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974], tasks=1, failed=0, killed=0, success=1, completed=1, commits=0, err=null
2016-05-18 01:57:24,986 INFO  impl.VertexImpl (VertexImpl.java:checkTasksForCompletion(2037)) - All tasks have succeeded, vertex:vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974]
2016-05-18 01:57:24,986 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(57)) - Attempting to fetch new task for container container_1463536644670_0001_00_000002
2016-05-18 01:57:24,987 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:VERTEX_FINISHED]: vertexName=FF8B10418FA540B5AADBF14C13195974, vertexId=vertex_1463536644670_0001_1_01, initRequestedTime=1463536644855, initedTime=1463536644864, startRequestedTime=1463536644871, startedTime=1463536644872, finishTime=1463536644986, timeTaken=114, status=SUCCEEDED, diagnostics=, counters=Counters: 36, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=7, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, OUTPUT_RECORDS=1, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=12, MERGE_PHASE_TIME=14, FIRST_EVENT_RECEIVED=6, LAST_EVENT_RECEIVED=6, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=1463536644976, Process_Duration=4, Process_End_Time=1463536644980, Read_Duration=0, Tuples_Read=7, Tuples_Written=1, Write_Duration=0, cascading.flow.StepCounters, Tuples_Written=1, vertexStats=firstTaskStartTime=1463536644939, firstTasksToStart=[ task_1463536644670_0001_1_01_000000 ], lastTaskFinishTime=1463536644984, lastTasksToFinish=[ task_1463536644670_0001_1_01_000000 ], minTaskDuration=45, maxTaskDuration=45, avgTaskDuration=45.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463536644670_0001_1_01_000000 ], longestDurationTasks=[ task_1463536644670_0001_1_01_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-18 01:57:24,987 INFO  impl.VertexImpl (VertexImpl.java:handle(1823)) - vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-18 01:57:24,987 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463536644670_0001_00_000002, stoppedTime=1463536644987, exitStatus=0
2016-05-18 01:57:24,988 INFO  impl.DAGImpl (DAGImpl.java:transition(1927)) - Vertex vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974] completed., numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2
2016-05-18 01:57:24,988 INFO  impl.DAGImpl (DAGImpl.java:checkVerticesForCompletion(1261)) - Checking vertices for DAG completion, numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:24,988 INFO  impl.DAGImpl (DAGImpl.java:commitOrFinish(1051)) - No output committers for vertex: vertex_1463536644670_0001_1_00 [FDC385EDD25043C980DEF6EF298D2A39]
2016-05-18 01:57:24,988 INFO  impl.DAGImpl (DAGImpl.java:commitOrFinish(1098)) - Start writing dag commit event, dag_1463536644670_0001_1
2016-05-18 01:57:24,988 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463536644670_0001_1
2016-05-18 01:57:24,988 INFO  impl.DAGImpl (DAGImpl.java:call(1083)) - Committing output: D70AD8CCAABF447E8506CE0AE79AB29B for vertex: vertex_1463536644670_0001_1_01 [FF8B10418FA540B5AADBF14C13195974], outputName: D70AD8CCAABF447E8506CE0AE79AB29B
2016-05-18 01:57:24,988 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536644670_0001_1 transitioned from RUNNING to COMMITTING due to event DAG_VERTEX_COMPLETED
2016-05-18 01:57:24,989 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(262)) - Ignoring stop request for containerId container_1463536644670_0001_00_000002. Relying on regular task shutdown for it to end
2016-05-18 01:57:24,997 INFO  app.TezTaskCommunicatorImpl (TezTaskCommunicatorImpl.java:getContainerTask(416)) - Container with id: container_1463536644670_0001_00_000002 is valid, but no longer registered, and will be killed
2016-05-18 01:57:24,997 INFO  task.ContainerReporter (ContainerReporter.java:callInternal(67)) - Got TaskUpdate for containerId= container_1463536644670_0001_00_000002: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-18 01:57:24,998 INFO  task.TezChild (TezChild.java:run(235)) - ContainerTask returned shouldDie=true for container container_1463536644670_0001_00_000002, Exiting
2016-05-18 01:57:24,998 INFO  task.TezChild (TezChild.java:shutdown(381)) - Shutdown invoked for container container_1463536644670_0001_00_000002
2016-05-18 01:57:24,998 INFO  task.TezChild (TezChild.java:shutdown(383)) - Shutting down container container_1463536644670_0001_00_000002
2016-05-18 01:57:24,998 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(285)) - ContainerExecutionResult for: container_1463536644670_0001_00_000002 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-18 01:57:24,998 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(289)) - Container: container_1463536644670_0001_00_000002 completed successfully
2016-05-18 01:57:25,002 INFO  impl.DAGImpl (DAGImpl.java:commitCompleted(2192)) - Commit succeeded for output:outputName:D70AD8CCAABF447E8506CE0AE79AB29B of vertex/vertexGroup:FF8B10418FA540B5AADBF14C13195974 isVertexGroupOutput:false
2016-05-18 01:57:25,002 INFO  impl.DAGImpl (DAGImpl.java:checkCommitsForCompletion(1313)) - Checking commits for DAG completion, numCompletedVertices=2, numSuccessfulVertices=2, numFailedVertices=0, numKilledVertices=0, numVertices=2, commitInProgress=0, terminationCause=null
2016-05-18 01:57:25,005 INFO  recovery.RecoveryService (RecoveryService.java:handle(327)) - DAG completed, dagId=dag_1463536644670_0001_1, queueSize=0
2016-05-18 01:57:25,006 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(115)) - [HISTORY][DAG:dag_1463536644670_0001_1][Event:DAG_FINISHED]: dagId=dag_1463536644670_0001_1, startTime=1463536644851, finishTime=1463536645003, timeTaken=152, status=SUCCEEDED, diagnostics=, counters=Counters: 48, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=2, TOTAL_LAUNCHED_TASKS=2, RACK_LOCAL_TASKS=1, AM_CPU_MILLISECONDS=300, AM_GC_TIME_MILLIS=0, org.apache.tez.common.counters.TaskCounter, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=7, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=14, NUM_SHUFFLED_INPUTS=1, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=1, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=8, OUTPUT_BYTES=693, OUTPUT_BYTES_WITH_OVERHEAD=649, OUTPUT_BYTES_PHYSICAL=653, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=653, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, SHUFFLE_BYTES=653, SHUFFLE_BYTES_DECOMPRESSED=649, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=653, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=12, MERGE_PHASE_TIME=14, FIRST_EVENT_RECEIVED=6, LAST_EVENT_RECEIVED=6, Shuffle Errors, BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0, cascading.flow.SliceCounters, Process_Begin_Time=2927073289895, Process_Duration=6, Process_End_Time=2927073289901, Read_Duration=0, Tuples_Read=17, Tuples_Written=8, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=10, Tuples_Written=1
2016-05-18 01:57:25,006 INFO  impl.DAGImpl (DAGImpl.java:finished(1405)) - DAG: dag_1463536644670_0001_1 finished with state: SUCCEEDED
2016-05-18 01:57:25,006 INFO  impl.DAGImpl (DAGImpl.java:handle(1170)) - dag_1463536644670_0001_1 transitioned from COMMITTING to SUCCEEDED due to event DAG_COMMIT_COMPLETED
2016-05-18 01:57:25 Completed Dag: dag_1463536644670_0001_1
2016-05-18 01:57:25,006 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(751)) - DAG completed, dagId=dag_1463536644670_0001_1, dagState=SUCCEEDED
2016-05-18 01:57:25,007 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(188)) - Redirecting log file based on addend: dag_1463536644670_0001_1_post
2016-05-18 01:57:25,008 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(203)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-18 01:57:25,008 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(800)) - Central Dispatcher queue size after DAG completion, before cleanup: 0
2016-05-18 01:57:25,008 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(802)) - Waiting for next DAG to be submitted.
2016-05-18 01:57:25,009 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(842)) - Cleaning up DAG: name=[3B6192C5908843C7895CCBE305FDBEF8/FABF977519EF41D6B1BD63C20E236100] test/(1/1) ...AssertionsPass/value/pass, with id=dag_1463536644670_0001_1
2016-05-18 01:57:25,009 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(852)) - Completed cleanup for DAG: name=[3B6192C5908843C7895CCBE305FDBEF8/FABF977519EF41D6B1BD63C20E236100] test/(1/1) ...AssertionsPass/value/pass, with id=dag_1463536644670_0001_1
2016-05-18 01:57:25,014 INFO  client.TezClient (TezClient.java:stop(566)) - Shutting down Tez Session, sessionName=(1/1) ...AssertionsPass/value/pass, applicationId=application_1463536644670_0001
2016-05-18 01:57:25,017 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(124)) - Received message to shutdown AM
2016-05-18 01:57:25,017 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:setShouldUnregisterFlag(895)) - TaskScheduler notified that it should unregister from RM
2016-05-18 01:57:25,017 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1301)) - No current running DAG, shutting down the AM
2016-05-18 01:57:25,017 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(907)) - DAGAppMasterShutdownHandler invoked
2016-05-18 01:57:25,017 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(916)) - Handling DAGAppMaster shutdown
2016-05-18 01:57:25,018 INFO  app.DAGAppMaster (DAGAppMaster.java:run(936)) - Sleeping for 5 seconds before shutting down
2016-05-18 01:57:25,019 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(84)) - Stopping HistoryEventHandler
2016-05-18 01:57:25,020 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(196)) - Stopping RecoveryService
2016-05-18 01:57:25,020 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(199)) - Handle the remaining events in queue, queue size=0
2016-05-18 01:57:25,020 INFO  recovery.RecoveryService (RecoveryService.java:run(173)) - EventQueue take interrupted. Returning
2016-05-18 01:57:25,021 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(221)) - Closing Summary Stream
2016-05-18 01:57:25,021 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-18 01:57:25,021 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-18 01:57:25,022 INFO  rm.TaskSchedulerManager (TaskSchedulerManager.java:serviceStop(678)) - Shutting down AppCallbackExecutor
2016-05-18 01:57:25,028 INFO  app.DAGAppMaster (DAGAppMaster.java:run(2084)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/tmp/.staging/3B6192C5908843C7895CCBE305FDBEF8/FABF977519EF41D6B1BD63C20E236100/.tez/application_1463536644670_0001
2016-05-18 01:57:25,028 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output/hadoop2-tez/appliedassertionsplatform/testValueAssertionsPass/value/pass/_temporary
2016-05-18 01:57:25,029 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [test]  completed in: 00:00.381
2016-05-18 01:57:25,084 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.7.x-tez-0.8.x/build/test/output//hadoop2-tez/appliedassertionsplatform/testValueAssertionsPass/value/pass

Standard error

2016-05-18 01:57:14 Running Dag: dag_1463536633960_0001_1
2016-05-18 01:57:15 Starting to run new task attempt: attempt_1463536633960_0001_1_00_000000_0
2016-05-18 01:57:15 Completed running task attempt: attempt_1463536633960_0001_1_00_000000_0
2016-05-18 01:57:15 Starting to run new task attempt: attempt_1463536633960_0001_1_01_000000_0
2016-05-18 01:57:15 Completed running task attempt: attempt_1463536633960_0001_1_01_000000_0
2016-05-18 01:57:15 Completed Dag: dag_1463536633960_0001_1
2016-05-18 01:57:16 Running Dag: dag_1463536636368_0001_1
2016-05-18 01:57:16 Starting to run new task attempt: attempt_1463536636368_0001_1_00_000000_0
2016-05-18 01:57:16 Completed running task attempt: attempt_1463536636368_0001_1_00_000000_0
2016-05-18 01:57:16 Starting to run new task attempt: attempt_1463536636368_0001_1_01_000000_0
2016-05-18 01:57:16 Completed running task attempt: attempt_1463536636368_0001_1_01_000000_0
2016-05-18 01:57:16 Completed Dag: dag_1463536636368_0001_1
2016-05-18 01:57:17 Running Dag: dag_1463536637269_0001_1
2016-05-18 01:57:17 Starting to run new task attempt: attempt_1463536637269_0001_1_00_000000_0
2016-05-18 01:57:17 Completed running task attempt: attempt_1463536637269_0001_1_00_000000_0
2016-05-18 01:57:17 Starting to run new task attempt: attempt_1463536637269_0001_1_01_000000_0
2016-05-18 01:57:17 Completed Dag: dag_1463536637269_0001_1
2016-05-18 01:57:18 Running Dag: dag_1463536638086_0001_1
2016-05-18 01:57:18 Starting to run new task attempt: attempt_1463536638086_0001_1_00_000000_0
2016-05-18 01:57:18 Completed running task attempt: attempt_1463536638086_0001_1_00_000000_0
2016-05-18 01:57:18 Starting to run new task attempt: attempt_1463536638086_0001_1_01_000000_0
2016-05-18 01:57:18 Completed running task attempt: attempt_1463536638086_0001_1_01_000000_0
2016-05-18 01:57:18 Completed Dag: dag_1463536638086_0001_1
2016-05-18 01:57:18 Running Dag: dag_1463536638797_0001_1
2016-05-18 01:57:19 Starting to run new task attempt: attempt_1463536638797_0001_1_00_000000_0
2016-05-18 01:57:19 Completed running task attempt: attempt_1463536638797_0001_1_00_000000_0
2016-05-18 01:57:19 Starting to run new task attempt: attempt_1463536638797_0001_1_01_000000_0
2016-05-18 01:57:19 Completed Dag: dag_1463536638797_0001_1
2016-05-18 01:57:19 Running Dag: dag_1463536639459_0001_1
2016-05-18 01:57:19 Starting to run new task attempt: attempt_1463536639459_0001_1_00_000000_0
2016-05-18 01:57:19 Completed running task attempt: attempt_1463536639459_0001_1_00_000000_0
2016-05-18 01:57:19 Starting to run new task attempt: attempt_1463536639459_0001_1_01_000000_0
2016-05-18 01:57:19 Completed running task attempt: attempt_1463536639459_0001_1_01_000000_0
2016-05-18 01:57:19 Completed Dag: dag_1463536639459_0001_1
2016-05-18 01:57:20 Running Dag: dag_1463536640114_0001_1
2016-05-18 01:57:20 Starting to run new task attempt: attempt_1463536640114_0001_1_00_000000_0
2016-05-18 01:57:20 Completed running task attempt: attempt_1463536640114_0001_1_00_000000_0
2016-05-18 01:57:20 Starting to run new task attempt: attempt_1463536640114_0001_1_01_000000_0
2016-05-18 01:57:20 Completed running task attempt: attempt_1463536640114_0001_1_01_000000_0
2016-05-18 01:57:20 Completed Dag: dag_1463536640114_0001_1
2016-05-18 01:57:21 Running Dag: dag_1463536641021_0001_1
2016-05-18 01:57:21 Starting to run new task attempt: attempt_1463536641021_0001_1_00_000000_0
2016-05-18 01:57:21 Completed running task attempt: attempt_1463536641021_0001_1_00_000000_0
2016-05-18 01:57:21 Starting to run new task attempt: attempt_1463536641021_0001_1_01_000000_0
2016-05-18 01:57:21 Completed Dag: dag_1463536641021_0001_1
2016-05-18 01:57:21 Running Dag: dag_1463536641639_0001_1
2016-05-18 01:57:21 Starting to run new task attempt: attempt_1463536641639_0001_1_00_000000_0
2016-05-18 01:57:21 Completed running task attempt: attempt_1463536641639_0001_1_00_000000_0
2016-05-18 01:57:21 Starting to run new task attempt: attempt_1463536641639_0001_1_01_000000_0
2016-05-18 01:57:21 Completed running task attempt: attempt_1463536641639_0001_1_01_000000_0
2016-05-18 01:57:21 Completed Dag: dag_1463536641639_0001_1
2016-05-18 01:57:22 Running Dag: dag_1463536642242_0001_1
2016-05-18 01:57:22 Starting to run new task attempt: attempt_1463536642242_0001_1_00_000000_0
2016-05-18 01:57:22 Completed running task attempt: attempt_1463536642242_0001_1_00_000000_0
2016-05-18 01:57:22 Starting to run new task attempt: attempt_1463536642242_0001_1_01_000000_0
2016-05-18 01:57:22 Completed Dag: dag_1463536642242_0001_1
2016-05-18 01:57:23 Running Dag: dag_1463536642859_0001_1
2016-05-18 01:57:23 Starting to run new task attempt: attempt_1463536642859_0001_1_00_000000_0
2016-05-18 01:57:23 Completed running task attempt: attempt_1463536642859_0001_1_00_000000_0
2016-05-18 01:57:23 Starting to run new task attempt: attempt_1463536642859_0001_1_01_000000_0
2016-05-18 01:57:23 Completed Dag: dag_1463536642859_0001_1
2016-05-18 01:57:23 Running Dag: dag_1463536643455_0001_1
2016-05-18 01:57:23 Starting to run new task attempt: attempt_1463536643455_0001_1_00_000000_0
2016-05-18 01:57:23 Completed running task attempt: attempt_1463536643455_0001_1_00_000000_0
2016-05-18 01:57:23 Starting to run new task attempt: attempt_1463536643455_0001_1_01_000000_0
2016-05-18 01:57:23 Completed running task attempt: attempt_1463536643455_0001_1_01_000000_0
2016-05-18 01:57:23 Completed Dag: dag_1463536643455_0001_1
2016-05-18 01:57:24 Running Dag: dag_1463536644092_0001_1
2016-05-18 01:57:24 Starting to run new task attempt: attempt_1463536644092_0001_1_00_000000_0
2016-05-18 01:57:24 Completed running task attempt: attempt_1463536644092_0001_1_00_000000_0
2016-05-18 01:57:24 Starting to run new task attempt: attempt_1463536644092_0001_1_01_000000_0
2016-05-18 01:57:24 Completed Dag: dag_1463536644092_0001_1
2016-05-18 01:57:24 Running Dag: dag_1463536644670_0001_1
2016-05-18 01:57:24 Starting to run new task attempt: attempt_1463536644670_0001_1_00_000000_0
2016-05-18 01:57:24 Completed running task attempt: attempt_1463536644670_0001_1_00_000000_0
2016-05-18 01:57:24 Starting to run new task attempt: attempt_1463536644670_0001_1_01_000000_0
2016-05-18 01:57:24 Completed running task attempt: attempt_1463536644670_0001_1_01_000000_0
2016-05-18 01:57:25 Completed Dag: dag_1463536644670_0001_1