2016-01-14 19:32:28,960 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 19:32:28,988 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.tap.hadoop.HadoopTapPlatformTest, with platform: hadoop2-mr1
2016-01-14 19:32:29,026 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-01-14 19:32:29,815 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-01-14 19:32:30,380 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-01-14 19:32:31,021 WARN server.AuthenticationFilter (AuthenticationFilter.java:init(158)) - 'signature.secret' configuration not set, using a random value as secret
2016-01-14 19:32:33,957 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 19:32:34,099 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 19:32:34,216 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 19:32:34,333 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 19:32:51,410 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2016-01-14 19:32:51,506 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:32:51,507 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:32:51,573 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: 68A1638B91D24819A64DA20C52214794
2016-01-14 19:32:51,686 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.079
2016-01-14 19:32:51,690 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 19:32:51,691 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 19:32:51,807 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 19:32:51,808 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting
2016-01-14 19:32:51,809 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] source: Hfs["CommentScheme[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/comments+lower.txt"]
2016-01-14 19:32:51,809 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testNullsFromScheme/testnulls"]
2016-01-14 19:32:51,811 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] parallel execution of steps is enabled: true
2016-01-14 19:32:51,812 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executing total steps: 1
2016-01-14 19:32:51,812 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] allocating management threads: 1
2016-01-14 19:32:51,813 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting step: (1/1) ...NullsFromScheme/testnulls
2016-01-14 19:32:52,746 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] submitted hadoop job: job_1452799965907_0001
2016-01-14 19:32:52,746 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] tracking url: http://ip-10-167-78-165.ec2.internal:41960/proxy/application_1452799965907_0001/
2016-01-14 19:33:03,759 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0001_01_000002 is : 143
2016-01-14 19:33:05,090 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testNullsFromScheme/testnulls/_temporary
2016-01-14 19:33:05,092 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] completed in: 00:13.276, using cpu time: 00:00.760
2016-01-14 19:33:05,192 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/hadooptapplatform/testNullsFromScheme/testnulls
2016-01-14 19:33:05,250 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:33:05,250 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:33:05,324 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.067
2016-01-14 19:33:05,326 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 19:33:05,326 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 19:33:05,330 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/hadooptapplatform/testMissingInputFormat/missinginputformat
2016-01-14 19:33:05,483 INFO hadoop.Hfs (Hfs.java:makeLocal(428)) - forcing job to local mode, via source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/upper.txt"]
2016-01-14 19:33:05,543 INFO hadoop.Hfs (Hfs.java:makeLocal(428)) - forcing job to local mode, via source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/lower.txt"]
2016-01-14 19:33:05,602 INFO hadoop.Hfs (Hfs.java:makeLocal(428)) - forcing job to local mode, via source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/lower.txt"]
2016-01-14 19:33:05,664 INFO hadoop.Hfs (Hfs.java:makeLocal(428)) - forcing job to local mode, via source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/upper.txt"]
2016-01-14 19:33:05,696 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:33:05,696 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:33:05,733 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.030
2016-01-14 19:33:05,738 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 19:33:05,738 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 19:33:05,764 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting
2016-01-14 19:33:05,764 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/lower.txt"]
2016-01-14 19:33:05,765 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] sink: Hfs["ResolvedScheme[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testResolvedSinkFields/resolvedfields"]
2016-01-14 19:33:05,766 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] parallel execution of steps is enabled: true
2016-01-14 19:33:05,766 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executing total steps: 1
2016-01-14 19:33:05,766 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] allocating management threads: 1
2016-01-14 19:33:05,767 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting step: (1/1) ...SinkFields/resolvedfields
2016-01-14 19:33:05,996 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] submitted hadoop job: job_1452799965907_0002
2016-01-14 19:33:05,996 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] tracking url: http://ip-10-167-78-165.ec2.internal:41960/proxy/application_1452799965907_0002/
2016-01-14 19:33:23,955 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0002_01_000003 is : 143
2016-01-14 19:33:24,169 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0002_01_000002 is : 143
2016-01-14 19:33:24,919 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0002_01_000006 is : 143
2016-01-14 19:33:24,964 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0002_01_000005 is : 143
2016-01-14 19:33:25,159 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0002_01_000004 is : 143
2016-01-14 19:33:26,407 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testResolvedSinkFields/resolvedfields/_temporary
2016-01-14 19:33:26,409 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] completed in: 00:20.641, using cpu time: 00:05.130
2016-01-14 19:33:26,457 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/hadooptapplatform/testResolvedSinkFields/resolvedfields
2016-01-14 19:33:26,513 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:33:26,513 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:33:26,547 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.030
2016-01-14 19:33:26,548 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 19:33:26,548 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 19:33:26,550 INFO hadoop.Hfs (Hfs.java:makeLocal(428)) - forcing job to local mode, via source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/lower.txt"]
2016-01-14 19:33:26,571 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:33:26,571 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:33:26,600 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.024
2016-01-14 19:33:26,601 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 19:33:26,601 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 19:33:26,636 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second] starting
2016-01-14 19:33:26,638 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second] parallel execution of flows is enabled: true
2016-01-14 19:33:26,638 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second] executing total flows: 2
2016-01-14 19:33:26,638 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second] allocating management threads: 2
2016-01-14 19:33:26,639 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second] starting flow: first
2016-01-14 19:33:26,639 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] at least one sink is marked for delete
2016-01-14 19:33:26,640 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 19:33:26,643 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-14 19:33:26,643 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] source: GlobHfs[/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/?{ppe[_r],owe?}.txt]
2016-01-14 19:33:26,644 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testGlobHfs/glob"]
2016-01-14 19:33:26,644 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] parallel execution of steps is enabled: true
2016-01-14 19:33:26,644 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executing total steps: 1
2016-01-14 19:33:26,645 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] allocating management threads: 1
2016-01-14 19:33:26,645 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) ...platform/testGlobHfs/glob
2016-01-14 19:33:26,748 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/tmp/mapred/staging/teamcity1017376457/.staging/job_local1017376457_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 19:33:26,756 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/tmp/mapred/staging/teamcity1017376457/.staging/job_local1017376457_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 19:33:26,929 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1017376457_0001/job_local1017376457_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 19:33:26,932 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1017376457_0001/job_local1017376457_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 19:33:26,935 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted hadoop job: job_local1017376457_0001
2016-01-14 19:33:26,935 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tracking url: http://localhost:8080/
2016-01-14 19:33:26,983 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/lower.txt
2016-01-14 19:33:26,999 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 19:33:26,999 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx512m
2016-01-14 19:33:27,016 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E5A730E463DC45ABB2E37180C2DB61C0, ordinal: 0
2016-01-14 19:33:27,057 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: GlobHfs[/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/?{ppe[_r],owe?}.txt]
2016-01-14 19:33:27,057 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testGlobHfs/glob"]
2016-01-14 19:33:27,058 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E5A730E463DC45ABB2E37180C2DB61C0, mem on start (mb), free: 230, total: 363, max: 672
2016-01-14 19:33:27,069 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E5A730E463DC45ABB2E37180C2DB61C0, mem on close (mb), free: 229, total: 363, max: 672
2016-01-14 19:33:27,102 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/upper.txt
2016-01-14 19:33:27,109 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 19:33:27,109 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx512m
2016-01-14 19:33:27,123 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E5A730E463DC45ABB2E37180C2DB61C0, ordinal: 0
2016-01-14 19:33:27,124 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: GlobHfs[/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/?{ppe[_r],owe?}.txt]
2016-01-14 19:33:27,124 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testGlobHfs/glob"]
2016-01-14 19:33:27,124 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E5A730E463DC45ABB2E37180C2DB61C0, mem on start (mb), free: 227, total: 363, max: 672
2016-01-14 19:33:27,127 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E5A730E463DC45ABB2E37180C2DB61C0, mem on close (mb), free: 227, total: 363, max: 672
2016-01-14 19:33:27,191 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testGlobHfs/glob/_temporary
2016-01-14 19:33:27,192 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] completed in: 00:00.547
2016-01-14 19:33:27,192 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second] completed flow: first
2016-01-14 19:33:27,193 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second] starting flow: second
2016-01-14 19:33:27,193 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] at least one sink is marked for delete
2016-01-14 19:33:27,193 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 19:33:27,197 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting
2016-01-14 19:33:27,197 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testGlobHfs/glob"]
2016-01-14 19:33:27,197 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testGlobHfs/glob2"]
2016-01-14 19:33:27,197 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] parallel execution of steps is enabled: true
2016-01-14 19:33:27,197 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executing total steps: 1
2016-01-14 19:33:27,197 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] allocating management threads: 1
2016-01-14 19:33:27,199 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting step: (1/1) ...latform/testGlobHfs/glob2
2016-01-14 19:33:27,390 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] submitted hadoop job: job_1452799965907_0003
2016-01-14 19:33:27,391 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tracking url: http://ip-10-167-78-165.ec2.internal:41960/proxy/application_1452799965907_0003/
2016-01-14 19:33:43,065 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0003_01_000002 is : 143
2016-01-14 19:33:43,473 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0003_01_000003 is : 143
2016-01-14 19:33:43,646 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0003_01_000005 is : 143
2016-01-14 19:33:43,746 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0003_01_000004 is : 143
2016-01-14 19:33:44,998 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testGlobHfs/glob2/_temporary
2016-01-14 19:33:44,999 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] completed in: 00:17.798, using cpu time: 00:04.180
2016-01-14 19:33:44,999 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second] completed flow: second
2016-01-14 19:33:45,020 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/hadooptapplatform/testGlobHfs/glob
2016-01-14 19:33:45,029 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/hadooptapplatform/testGlobHfs/glob2
2016-01-14 19:33:45,056 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:33:45,056 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:33:45,102 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.042
2016-01-14 19:33:45,105 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 19:33:45,105 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 19:33:45,140 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting
2016-01-14 19:33:45,140 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] source: ["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/apache.10.txt"]
2016-01-14 19:33:45,140 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] sink: ["TextDelimited[['ip', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testPrepareResource/preparetap"]
2016-01-14 19:33:45,140 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] parallel execution of steps is enabled: true
2016-01-14 19:33:45,140 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executing total steps: 1
2016-01-14 19:33:45,140 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] allocating management threads: 1
2016-01-14 19:33:45,142 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting step: (1/1) ...repareResource/preparetap
2016-01-14 19:33:45,282 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] submitted hadoop job: job_1452799965907_0004
2016-01-14 19:33:45,282 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] tracking url: http://ip-10-167-78-165.ec2.internal:41960/proxy/application_1452799965907_0004/
2016-01-14 19:34:01,209 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0004_01_000004 is : 143
2016-01-14 19:34:01,432 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0004_01_000003 is : 143
2016-01-14 19:34:01,476 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0004_01_000005 is : 143
2016-01-14 19:34:01,545 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0004_01_000002 is : 143
2016-01-14 19:34:08,467 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0004_01_000006 is : 143
2016-01-14 19:34:09,689 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testPrepareResource/preparetap/_temporary
2016-01-14 19:34:09,690 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] completed in: 00:24.546, using cpu time: 00:05.370
2016-01-14 19:34:09,709 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/hadooptapplatform/testPrepareResource/preparetap
2016-01-14 19:34:09,737 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:34:09,738 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:34:09,792 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.048
2016-01-14 19:34:09,795 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 19:34:09,795 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 19:34:09,812 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting
2016-01-14 19:34:09,813 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["DupeConfigScheme[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/upper.txt"]
2016-01-14 19:34:09,813 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/lower.txt"]
2016-01-14 19:34:09,813 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testDupeConfigFromScheme/dupeconfig"]
2016-01-14 19:34:09,813 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] parallel execution of steps is enabled: true
2016-01-14 19:34:09,813 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executing total steps: 1
2016-01-14 19:34:09,813 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] allocating management threads: 1
2016-01-14 19:34:09,814 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting step: (1/1) ...nfigFromScheme/dupeconfig
2016-01-14 19:34:09,973 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] submitted hadoop job: job_1452799965907_0005
2016-01-14 19:34:09,973 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] tracking url: http://ip-10-167-78-165.ec2.internal:41960/proxy/application_1452799965907_0005/
2016-01-14 19:34:27,881 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0005_01_000005 is : 143
2016-01-14 19:34:27,935 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0005_01_000002 is : 143
2016-01-14 19:34:28,406 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0005_01_000006 is : 143
2016-01-14 19:34:28,599 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0005_01_000004 is : 143
2016-01-14 19:34:28,935 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0005_01_000003 is : 143
2016-01-14 19:34:30,179 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testDupeConfigFromScheme/dupeconfig/_temporary
2016-01-14 19:34:30,181 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] completed in: 00:20.365, using cpu time: 00:05.670
2016-01-14 19:34:30,232 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/hadooptapplatform/testDupeConfigFromScheme/dupeconfig
2016-01-14 19:34:30,260 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:34:30,260 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:34:30,287 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.023
2016-01-14 19:34:30,288 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 19:34:30,288 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 19:34:30,319 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:34:30,320 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:34:30,345 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.021
2016-01-14 19:34:30,346 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 19:34:30,346 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 19:34:30,400 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second] starting
2016-01-14 19:34:30,401 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second] parallel execution of flows is enabled: true
2016-01-14 19:34:30,401 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second] executing total flows: 2
2016-01-14 19:34:30,401 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second] allocating management threads: 2
2016-01-14 19:34:30,402 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second] starting flow: first
2016-01-14 19:34:30,402 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] at least one sink is marked for delete
2016-01-14 19:34:30,402 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 19:34:30,405 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-14 19:34:30,405 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] source: MultiSourceTap[2:[GlobHfs[/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/?{ppe[_r]}.txt], GlobHfs[/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/?{owe?}.txt]]]
2016-01-14 19:34:30,405 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testNestedMultiSourceGlobHfs/globmultisource"]
2016-01-14 19:34:30,406 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] parallel execution of steps is enabled: true
2016-01-14 19:34:30,406 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executing total steps: 1
2016-01-14 19:34:30,406 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] allocating management threads: 1
2016-01-14 19:34:30,407 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) ...ceGlobHfs/globmultisource
2016-01-14 19:34:30,545 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted hadoop job: job_1452799965907_0006
2016-01-14 19:34:30,545 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tracking url: http://ip-10-167-78-165.ec2.internal:41960/proxy/application_1452799965907_0006/
2016-01-14 19:34:49,870 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0006_01_000007 is : 143
2016-01-14 19:34:50,198 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0006_01_000004 is : 143
2016-01-14 19:34:50,255 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0006_01_000006 is : 143
2016-01-14 19:34:50,628 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0006_01_000005 is : 143
2016-01-14 19:34:50,660 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0006_01_000003 is : 143
2016-01-14 19:34:50,851 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0006_01_000002 is : 143
2016-01-14 19:34:52,096 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testNestedMultiSourceGlobHfs/globmultisource/_temporary
2016-01-14 19:34:52,098 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] completed in: 00:21.689, using cpu time: 00:06.000
2016-01-14 19:34:52,098 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second] completed flow: first
2016-01-14 19:34:52,098 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second] starting flow: second
2016-01-14 19:34:52,099 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] at least one sink is marked for delete
2016-01-14 19:34:52,099 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 19:34:52,102 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting
2016-01-14 19:34:52,102 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testNestedMultiSourceGlobHfs/globmultisource"]
2016-01-14 19:34:52,102 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testNestedMultiSourceGlobHfs/globmultiource2"]
2016-01-14 19:34:52,102 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] parallel execution of steps is enabled: true
2016-01-14 19:34:52,103 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executing total steps: 1
2016-01-14 19:34:52,103 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] allocating management threads: 1
2016-01-14 19:34:52,104 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting step: (1/1) ...ceGlobHfs/globmultiource2
2016-01-14 19:34:52,270 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] submitted hadoop job: job_1452799965907_0007
2016-01-14 19:34:52,270 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tracking url: http://ip-10-167-78-165.ec2.internal:41960/proxy/application_1452799965907_0007/
2016-01-14 19:35:16,229 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0007_01_000002 is : 143
2016-01-14 19:35:16,470 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0007_01_000003 is : 143
2016-01-14 19:35:17,067 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0007_01_000008 is : 143
2016-01-14 19:35:17,225 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0007_01_000007 is : 143
2016-01-14 19:35:17,337 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0007_01_000009 is : 143
2016-01-14 19:35:17,509 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0007_01_000005 is : 143
2016-01-14 19:35:17,597 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0007_01_000006 is : 143
2016-01-14 19:35:17,812 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0007_01_000004 is : 143
2016-01-14 19:35:19,091 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testNestedMultiSourceGlobHfs/globmultiource2/_temporary
2016-01-14 19:35:19,092 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] completed in: 00:26.987, using cpu time: 00:07.650
2016-01-14 19:35:19,092 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second] completed flow: second
2016-01-14 19:35:19,117 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/hadooptapplatform/testNestedMultiSourceGlobHfs/globmultisource
2016-01-14 19:35:19,129 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/hadooptapplatform/testNestedMultiSourceGlobHfs/globmultiource2
2016-01-14 19:35:19,187 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:35:19,187 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:35:19,230 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.039
2016-01-14 19:35:19,232 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 19:35:19,232 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 19:35:19,259 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting
2016-01-14 19:35:19,259 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/apache.10.txt"]
2016-01-14 19:35:19,259 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] sink: ["TextDelimited[['ip', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testPrepareResourceForWriteFails/preparewritetapfail"]
2016-01-14 19:35:19,259 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] parallel execution of steps is enabled: true
2016-01-14 19:35:19,260 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executing total steps: 1
2016-01-14 19:35:19,260 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] allocating management threads: 1
2016-01-14 19:35:19,261 ERROR flow.Flow (BaseFlow.java:logError(1469)) - [test] unable to prepare tap for write: hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testPrepareResourceForWriteFails/preparewritetapfail
java.io.IOException: failed intentionally
at cascading.tap.hadoop.HadoopTapPlatformTest$7.prepareResourceForWrite(HadoopTapPlatformTest.java:774)
at cascading.tap.hadoop.HadoopTapPlatformTest$7.prepareResourceForWrite(HadoopTapPlatformTest.java:770)
at cascading.flow.planner.BaseFlowStep.prepareResource(BaseFlowStep.java:567)
at cascading.flow.planner.BaseFlowStep.prepareResources(BaseFlowStep.java:549)
at cascading.flow.planner.BaseFlowStep.prepareResources(BaseFlowStep.java:535)
at cascading.flow.planner.FlowStepJob.prepareResources(FlowStepJob.java:221)
at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:180)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:146)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:48)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 19:35:19,266 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] stopping all jobs
2016-01-14 19:35:19,267 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] stopping: (1/1) ...Fails/preparewritetapfail
2016-01-14 19:35:19,267 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] stopped all jobs
2016-01-14 19:35:19,268 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] completed in: 00:00.008
2016-01-14 19:35:19,269 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/hadooptapplatform/testPrepareResourceForWriteFails/preparewritetapfail
2016-01-14 19:35:19,283 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:35:19,283 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:35:19,324 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.038
2016-01-14 19:35:19,325 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 19:35:19,326 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 19:35:19,346 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting
2016-01-14 19:35:19,346 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] source: ["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/apache.10.txt"]
2016-01-14 19:35:19,346 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] sink: Hfs["TextDelimited[['ip', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testPrepareResourceForReadFails/preparereadtapfail"]
2016-01-14 19:35:19,346 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] parallel execution of steps is enabled: true
2016-01-14 19:35:19,346 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executing total steps: 1
2016-01-14 19:35:19,346 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] allocating management threads: 1
2016-01-14 19:35:19,347 ERROR flow.Flow (BaseFlow.java:logError(1469)) - [test] unable to prepare tap for read: hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/apache.10.txt
java.io.IOException: failed intentionally
at cascading.tap.hadoop.HadoopTapPlatformTest$6.prepareResourceForRead(HadoopTapPlatformTest.java:726)
at cascading.tap.hadoop.HadoopTapPlatformTest$6.prepareResourceForRead(HadoopTapPlatformTest.java:722)
at cascading.flow.planner.BaseFlowStep.prepareResource(BaseFlowStep.java:569)
at cascading.flow.planner.BaseFlowStep.prepareResources(BaseFlowStep.java:549)
at cascading.flow.planner.BaseFlowStep.prepareResources(BaseFlowStep.java:532)
at cascading.flow.planner.FlowStepJob.prepareResources(FlowStepJob.java:221)
at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:180)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:146)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:48)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 19:35:19,348 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] stopping all jobs
2016-01-14 19:35:19,348 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] stopping: (1/1) ...dFails/preparereadtapfail
2016-01-14 19:35:19,348 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] stopped all jobs
2016-01-14 19:35:19,348 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] shutting down job executor
2016-01-14 19:35:19,349 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] shutdown complete
2016-01-14 19:35:19,350 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] completed in: 00:00.003
2016-01-14 19:35:19,350 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/hadooptapplatform/testPrepareResourceForReadFails/preparereadtapfail
2016-01-14 19:35:19,365 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:35:19,366 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:35:19,408 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.039
2016-01-14 19:35:19,409 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 19:35:19,410 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 19:35:19,426 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting
2016-01-14 19:35:19,426 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/apache.10.txt"]
2016-01-14 19:35:19,426 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] sink: ["TextDelimited[['ip', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testCommitResourceFails/committapfail"]
2016-01-14 19:35:19,426 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] parallel execution of steps is enabled: true
2016-01-14 19:35:19,427 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executing total steps: 1
2016-01-14 19:35:19,427 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] allocating management threads: 1
2016-01-14 19:35:19,428 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting step: (1/1) ...sourceFails/committapfail
2016-01-14 19:35:19,555 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] submitted hadoop job: job_1452799965907_0008
2016-01-14 19:35:19,555 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] tracking url: http://ip-10-167-78-165.ec2.internal:41960/proxy/application_1452799965907_0008/
2016-01-14 19:35:35,414 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0008_01_000002 is : 143
2016-01-14 19:35:35,489 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0008_01_000005 is : 143
2016-01-14 19:35:35,564 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0008_01_000003 is : 143
2016-01-14 19:35:35,698 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0008_01_000004 is : 143
2016-01-14 19:35:41,402 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0008_01_000006 is : 143
2016-01-14 19:35:42,574 ERROR flow.Flow (BaseFlow.java:logError(1469)) - [test] unable to commit sink: hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testCommitResourceFails/committapfail
java.io.IOException: failed intentionally
at cascading.tap.hadoop.HadoopTapPlatformTest$2.commitResource(HadoopTapPlatformTest.java:400)
at cascading.tap.hadoop.HadoopTapPlatformTest$2.commitResource(HadoopTapPlatformTest.java:396)
at cascading.flow.planner.BaseFlowStep.commitResource(BaseFlowStep.java:613)
at cascading.flow.planner.BaseFlowStep.commitSinks(BaseFlowStep.java:601)
at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:301)
at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:184)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:146)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:48)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 19:35:42,610 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] stopping all jobs
2016-01-14 19:35:42,611 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] stopping: (1/1) ...sourceFails/committapfail
2016-01-14 19:35:42,613 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] stopped all jobs
2016-01-14 19:35:42,615 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testCommitResourceFails/committapfail/_temporary
2016-01-14 19:35:42,616 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] completed in: 00:23.187, using cpu time: 00:05.060
2016-01-14 19:35:42,617 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/hadooptapplatform/testCommitResourceFails/committapfail
2016-01-14 19:35:42,636 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:35:42,636 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:35:42,672 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.033
2016-01-14 19:35:42,673 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 19:35:42,673 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 19:35:42,691 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting
2016-01-14 19:35:42,691 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/apache.10.txt"]
2016-01-14 19:35:42,691 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] sink: ["TextDelimited[['ip', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testCommitResource/committap"]
2016-01-14 19:35:42,692 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] parallel execution of steps is enabled: true
2016-01-14 19:35:42,692 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executing total steps: 1
2016-01-14 19:35:42,692 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] allocating management threads: 1
2016-01-14 19:35:42,693 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting step: (1/1) ...tCommitResource/committap
2016-01-14 19:35:42,831 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] submitted hadoop job: job_1452799965907_0009
2016-01-14 19:35:42,831 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] tracking url: http://ip-10-167-78-165.ec2.internal:41960/proxy/application_1452799965907_0009/
2016-01-14 19:35:58,211 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0009_01_000003 is : 143
2016-01-14 19:35:58,393 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0009_01_000002 is : 143
2016-01-14 19:35:58,576 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0009_01_000004 is : 143
2016-01-14 19:35:58,613 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0009_01_000005 is : 143
2016-01-14 19:36:04,187 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799965907_0009_01_000006 is : 143
2016-01-14 19:36:05,401 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testCommitResource/committap/_temporary
2016-01-14 19:36:05,403 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] completed in: 00:22.708, using cpu time: 00:04.960
2016-01-14 19:36:05,418 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/hadooptapplatform/testCommitResource/committap
2016-01-14 19:36:05,447 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(105)) - setting up task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/multifiles/A/_temporary/_attempt_002147483647_0000_m_000000_0
2016-01-14 19:36:05,447 INFO io.TapOutputCollector (TapOutputCollector.java:initialize(117)) - creating path: part-00000
2016-01-14 19:36:05,450 INFO io.TapOutputCollector (TapOutputCollector.java:close(150)) - closing tap collector for: /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/multifiles/A/part-00000
2016-01-14 19:36:05,463 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(162)) - committing task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/multifiles/A/_temporary/_attempt_002147483647_0000_m_000000_0
2016-01-14 19:36:05,470 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(179)) - saved output of task 'attempt_002147483647_0000_m_000000_0' to hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/multifiles/A
2016-01-14 19:36:05,471 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/multifiles/A/_temporary
2016-01-14 19:36:05,477 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(105)) - setting up task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/multifiles/B/_temporary/_attempt_002147483647_0000_m_000000_0
2016-01-14 19:36:05,477 INFO io.TapOutputCollector (TapOutputCollector.java:initialize(117)) - creating path: part-00000
2016-01-14 19:36:05,480 INFO io.TapOutputCollector (TapOutputCollector.java:close(150)) - closing tap collector for: /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/multifiles/B/part-00000
2016-01-14 19:36:05,493 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(162)) - committing task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/multifiles/B/_temporary/_attempt_002147483647_0000_m_000000_0
2016-01-14 19:36:05,500 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(179)) - saved output of task 'attempt_002147483647_0000_m_000000_0' to hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/multifiles/B
2016-01-14 19:36:05,500 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/multifiles/B/_temporary
2016-01-14 19:36:05,534 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(105)) - setting up task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/hiddenfiles/A/_temporary/_attempt_002147483647_0000_m_000000_0
2016-01-14 19:36:05,535 INFO io.TapOutputCollector (TapOutputCollector.java:initialize(117)) - creating path: part-00000
2016-01-14 19:36:05,537 INFO io.TapOutputCollector (TapOutputCollector.java:close(150)) - closing tap collector for: /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/hiddenfiles/A/part-00000
2016-01-14 19:36:05,549 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(162)) - committing task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/hiddenfiles/A/_temporary/_attempt_002147483647_0000_m_000000_0
2016-01-14 19:36:05,557 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(179)) - saved output of task 'attempt_002147483647_0000_m_000000_0' to hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/hiddenfiles/A
2016-01-14 19:36:05,557 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/hiddenfiles/A/_temporary
2016-01-14 19:36:05,564 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(105)) - setting up task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/hiddenfiles/B/_temporary/_attempt_002147483647_0000_m_000000_0
2016-01-14 19:36:05,564 INFO io.TapOutputCollector (TapOutputCollector.java:initialize(117)) - creating path: part-00000
2016-01-14 19:36:05,567 INFO io.TapOutputCollector (TapOutputCollector.java:close(150)) - closing tap collector for: /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/hiddenfiles/B/part-00000
2016-01-14 19:36:05,579 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(162)) - committing task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/hiddenfiles/B/_temporary/_attempt_002147483647_0000_m_000000_0
2016-01-14 19:36:05,587 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(179)) - saved output of task 'attempt_002147483647_0000_m_000000_0' to hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/hiddenfiles/B
2016-01-14 19:36:05,587 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/hiddenfiles/B/_temporary
2016-01-14 19:36:05,593 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(105)) - setting up task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/hiddenfiles/.hidden/_temporary/_attempt_002147483647_0000_m_000000_0
2016-01-14 19:36:05,594 INFO io.TapOutputCollector (TapOutputCollector.java:initialize(117)) - creating path: part-00000
2016-01-14 19:36:05,596 INFO io.TapOutputCollector (TapOutputCollector.java:close(150)) - closing tap collector for: /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/hiddenfiles/.hidden/part-00000
2016-01-14 19:36:05,608 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(162)) - committing task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/hiddenfiles/.hidden/_temporary/_attempt_002147483647_0000_m_000000_0
2016-01-14 19:36:05,614 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(179)) - saved output of task 'attempt_002147483647_0000_m_000000_0' to hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/hiddenfiles/.hidden
2016-01-14 19:36:05,615 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:57080/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/hadooptapplatform/testChildIdentifiers/hiddenfiles/.hidden/_temporary
2016-01-14 19:36:05,631 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/hadooptapplatform/testChildIdentifiers/hiddenfiles/A
2016-01-14 19:36:05,636 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/hadooptapplatform/testChildIdentifiers/hiddenfiles/B
2016-01-14 19:36:05,640 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/hadooptapplatform/testChildIdentifiers/multifiles/A
2016-01-14 19:36:05,645 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/hadooptapplatform/testChildIdentifiers/hiddenfiles
2016-01-14 19:36:05,651 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/hadooptapplatform/testChildIdentifiers/multifiles/B
2016-01-14 19:36:05,655 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/hadooptapplatform/testChildIdentifiers/hiddenfiles/.hidden
2016-01-14 19:36:05,659 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/hadooptapplatform/testChildIdentifiers/multifiles