2016-05-18 11:49:25,388 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(197)) - found 1 test platforms from classpath
2016-05-18 11:49:25,418 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(246)) - adding test: cascading.stats.hadoop.HadoopStatsPlatformTest, with platform: hadoop2-mr1
2016-05-18 11:49:25,447 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-05-18 11:49:26,667 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-05-18 11:49:27,358 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(125)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-05-18 11:49:31,905 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 11:49:32,115 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 11:49:32,293 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 11:49:32,471 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 11:49:51,064 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(75)) - platform property overrides:
2016-05-18 11:49:51,162 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 11:49:51,163 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 11:49:51,227 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: 008102C199D54F97B39C31789AAE9829
2016-05-18 11:49:51,405 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.135
2016-05-18 11:49:51,409 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 4
2016-05-18 11:49:51,409 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 11:49:51,610 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 11:49:51,610 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 11:49:51,715 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.095
2016-05-18 11:49:51,717 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 4
2016-05-18 11:49:51,718 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 11:49:51,768 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.1.0
2016-05-18 11:49:51,768 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [stats1 test+stats2 test] starting
2016-05-18 11:49:51,771 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [stats1 test+stats2 test] parallel execution of flows is enabled: true
2016-05-18 11:49:51,771 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [stats1 test+stats2 test] executing total flows: 2
2016-05-18 11:49:51,772 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [stats1 test+stats2 test] allocating management threads: 2
2016-05-18 11:49:51,772 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [stats1 test+stats2 test] starting flow: stats2 test
2016-05-18 11:49:51,772 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] at least one sink is marked for delete
2016-05-18 11:49:51,772 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [stats1 test+stats2 test] starting flow: stats1 test
2016-05-18 11:49:51,773 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] at least one sink is marked for delete
2016-05-18 11:49:51,773 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 11:49:51,773 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 11:49:51,804 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] starting
2016-05-18 11:49:51,804 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] starting
2016-05-18 11:49:51,805 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/apache.10.txt"]
2016-05-18 11:49:51,805 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] sink: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/hadoopstatsplatform/testStatsCounters/flowstats1"]
2016-05-18 11:49:51,805 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] parallel execution of steps is enabled: true
2016-05-18 11:49:51,805 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] executing total steps: 2
2016-05-18 11:49:51,805 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] allocating management threads: 2
2016-05-18 11:49:51,807 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/apache.10.txt"]
2016-05-18 11:49:51,807 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] starting step: (1/2)
2016-05-18 11:49:51,808 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] sink: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/hadoopstatsplatform/testStatsCounters/flowstats2"]
2016-05-18 11:49:51,809 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] parallel execution of steps is enabled: true
2016-05-18 11:49:51,809 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] executing total steps: 2
2016-05-18 11:49:51,809 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] allocating management threads: 2
2016-05-18 11:49:51,812 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] starting step: (1/2)
2016-05-18 11:49:52,864 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] submitted hadoop job: job_1463572185562_0001
2016-05-18 11:49:52,864 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] submitted hadoop job: job_1463572185562_0002
2016-05-18 11:49:52,864 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] tracking url: http://ip-10-158-37-203:48714/proxy/application_1463572185562_0001/
2016-05-18 11:49:52,864 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] tracking url: http://ip-10-158-37-203:48714/proxy/application_1463572185562_0002/
2016-05-18 11:50:13,408 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463572185562_0002_01_000005 is : 143
2016-05-18 11:50:13,474 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463572185562_0002_01_000002 is : 143
2016-05-18 11:50:13,554 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463572185562_0002_01_000003 is : 143
2016-05-18 11:50:20,053 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463572185562_0002_01_000006 is : 143
2016-05-18 11:50:21,275 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] starting step: (2/2) ...tStatsCounters/flowstats1
2016-05-18 11:50:21,454 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] submitted hadoop job: job_1463572185562_0003
2016-05-18 11:50:21,454 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] tracking url: http://ip-10-158-37-203:48714/proxy/application_1463572185562_0003/
2016-05-18 11:50:26,413 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1080)) - Event EventType: KILL_CONTAINER sent to absent container container_1463572185562_0002_01_000001
2016-05-18 11:50:44,451 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463572185562_0001_01_000003 is : 143
2016-05-18 11:50:44,519 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463572185562_0001_01_000002 is : 143
2016-05-18 11:50:44,672 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463572185562_0001_01_000004 is : 143
2016-05-18 11:50:44,942 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463572185562_0001_01_000005 is : 143
2016-05-18 11:50:51,165 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463572185562_0001_01_000006 is : 143
2016-05-18 11:50:52,321 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] starting step: (2/2) ...tStatsCounters/flowstats2
2016-05-18 11:50:52,512 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] submitted hadoop job: job_1463572185562_0004
2016-05-18 11:50:52,512 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] tracking url: http://ip-10-158-37-203:48714/proxy/application_1463572185562_0004/
2016-05-18 11:51:10,244 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463572185562_0003_01_000002 is : 143
2016-05-18 11:51:16,775 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463572185562_0003_01_000003 is : 143
2016-05-18 11:51:17,985 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/hadoopstatsplatform/testStatsCounters/flowstats1/_temporary
2016-05-18 11:51:17,987 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] completed in: 01:26.170, using cpu time: 00:08.370
2016-05-18 11:51:17,987 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [stats1 test+stats2 test] completed flow: stats1 test
2016-05-18 11:51:23,745 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1080)) - Event EventType: KILL_CONTAINER sent to absent container container_1463572185562_0003_01_000001
2016-05-18 11:51:35,948 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463572185562_0004_01_000002 is : 143
2016-05-18 11:51:43,104 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463572185562_0004_01_000003 is : 143
2016-05-18 11:51:44,285 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/hadoopstatsplatform/testStatsCounters/flowstats2/_temporary
2016-05-18 11:51:44,287 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] completed in: 01:52.478, using cpu time: 00:08.190
2016-05-18 11:51:44,288 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [stats1 test+stats2 test] completed flow: stats2 test
2016-05-18 11:51:47,693 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] [node:BD9C6] retrieved task reports: 4
2016-05-18 11:51:47,696 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] [node:BD9C6] added 4, updated: 0 slices, with duration: 00:00.003, total fetched: 4
2016-05-18 11:51:47,696 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] [node:BD9C6] all 4 children are in finished state, have captured final details: true
2016-05-18 11:51:47,708 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] [node:F339F] retrieved task reports: 1
2016-05-18 11:51:47,709 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] [node:F339F] added 1, updated: 0 slices, with duration: 00:00.000, total fetched: 1
2016-05-18 11:51:47,709 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] [node:F339F] all 1 children are in finished state, have captured final details: true
2016-05-18 11:51:47,757 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] [node:CDDB1] retrieved task reports: 1
2016-05-18 11:51:47,758 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] [node:CDDB1] added 1, updated: 0 slices, with duration: 00:00.001, total fetched: 1
2016-05-18 11:51:47,758 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] [node:CDDB1] all 1 children are in finished state, have captured final details: true
2016-05-18 11:51:47,763 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] [node:B526C] retrieved task reports: 1
2016-05-18 11:51:47,764 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] [node:B526C] added 1, updated: 0 slices, with duration: 00:00.001, total fetched: 1
2016-05-18 11:51:47,764 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats2 test] [node:B526C] all 1 children are in finished state, have captured final details: true
2016-05-18 11:51:51,015 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] [node:DCF1C] retrieved task reports: 4
2016-05-18 11:51:51,017 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] [node:DCF1C] added 4, updated: 0 slices, with duration: 00:00.002, total fetched: 4
2016-05-18 11:51:51,017 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] [node:DCF1C] all 4 children are in finished state, have captured final details: true
2016-05-18 11:51:51,030 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] [node:BB782] retrieved task reports: 1
2016-05-18 11:51:51,030 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] [node:BB782] added 1, updated: 0 slices, with duration: 00:00.000, total fetched: 1
2016-05-18 11:51:51,031 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] [node:BB782] all 1 children are in finished state, have captured final details: true
2016-05-18 11:51:54,190 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] [node:EC801] retrieved task reports: 1
2016-05-18 11:51:54,190 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] [node:EC801] added 1, updated: 0 slices, with duration: 00:00.000, total fetched: 1
2016-05-18 11:51:54,191 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] [node:EC801] all 1 children are in finished state, have captured final details: true
2016-05-18 11:51:54,200 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] [node:E4098] retrieved task reports: 1
2016-05-18 11:51:54,201 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] [node:E4098] added 1, updated: 0 slices, with duration: 00:00.001, total fetched: 1
2016-05-18 11:51:54,201 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [stats1 test] [node:E4098] all 1 children are in finished state, have captured final details: true
2016-05-18 11:51:54,207 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output//hadoop2-mr1/hadoopstatsplatform/testStatsCounters/flowstats2
2016-05-18 11:51:54,214 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output//hadoop2-mr1/hadoopstatsplatform/testStatsCounters/flowstats1