2016-01-15 02:38:07,457 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-15 02:38:07,490 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.JoinFieldedPipesPlatformTest, with platform: hadoop2-mr1
2016-01-15 02:38:07,531 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-01-15 02:38:08,624 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-01-15 02:38:09,379 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(125)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-01-15 02:38:13,830 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-15 02:38:14,045 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-15 02:38:14,229 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-15 02:38:14,412 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-15 02:38:31,508 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2016-01-15 02:38:31,647 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:38:31,648 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:38:31,712 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: 00634A5855AB4867B6FF610B156A1144
2016-01-15 02:38:31,855 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.093
2016-01-15 02:38:31,858 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 02:38:31,859 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:38:31,995 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-15 02:38:31,996 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting
2016-01-15 02:38:31,997 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:38:31,997 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower-offset.txt"]
2016-01-15 02:38:31,997 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinInnerSingleField/joininnersingle"]
2016-01-15 02:38:31,998 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] parallel execution of steps is enabled: true
2016-01-15 02:38:31,998 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executing total steps: 1
2016-01-15 02:38:31,999 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] allocating management threads: 1
2016-01-15 02:38:32,000 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting step: (1/1) ...ngleField/joininnersingle
2016-01-15 02:38:32,969 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] submitted hadoop job: job_1452825506007_0001
2016-01-15 02:38:32,969 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0001/
2016-01-15 02:38:52,330 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0001_01_000002 is : 143
2016-01-15 02:38:52,589 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0001_01_000003 is : 143
2016-01-15 02:38:53,593 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0001_01_000004 is : 143
2016-01-15 02:38:53,735 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0001_01_000005 is : 143
2016-01-15 02:38:53,834 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0001_01_000006 is : 143
2016-01-15 02:38:55,117 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinInnerSingleField/joininnersingle/_temporary
2016-01-15 02:38:55,119 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] completed in: 00:23.117, using cpu time: 00:05.620
2016-01-15 02:38:55,205 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinInnerSingleField/joininnersingle
2016-01-15 02:38:55,254 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:38:55,255 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:38:55,381 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.116
2016-01-15 02:38:55,384 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 2
2016-01-15 02:38:55,384 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:38:55,433 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] starting
2016-01-15 02:38:55,433 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:38:55,434 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:38:55,434 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSameSourceIntoJoinSimple/joinsamesourceintojoinsimple"]
2016-01-15 02:38:55,439 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] parallel execution of steps is enabled: true
2016-01-15 02:38:55,439 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] executing total steps: 2
2016-01-15 02:38:55,439 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] allocating management threads: 2
2016-01-15 02:38:55,444 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] starting step: (1/2)
2016-01-15 02:38:55,676 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] submitted hadoop job: job_1452825506007_0002
2016-01-15 02:38:55,676 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0002/
2016-01-15 02:39:20,407 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0002_01_000002 is : 143
2016-01-15 02:39:20,585 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0002_01_000004 is : 143
2016-01-15 02:39:20,958 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0002_01_000005 is : 143
2016-01-15 02:39:21,002 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0002_01_000003 is : 143
2016-01-15 02:39:21,130 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0002_01_000006 is : 143
2016-01-15 02:39:22,313 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] starting step: (2/2) ...nsamesourceintojoinsimple
2016-01-15 02:39:22,509 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] submitted hadoop job: job_1452825506007_0003
2016-01-15 02:39:22,510 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0003/
2016-01-15 02:39:27,588 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1080)) - Event EventType: KILL_CONTAINER sent to absent container container_1452825506007_0002_01_000001
2016-01-15 02:39:45,995 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0003_01_000003 is : 143
2016-01-15 02:39:46,145 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0003_01_000002 is : 143
2016-01-15 02:39:46,899 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0003_01_000005 is : 143
2016-01-15 02:39:47,121 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0003_01_000006 is : 143
2016-01-15 02:39:47,323 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0003_01_000004 is : 143
2016-01-15 02:39:48,528 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSameSourceIntoJoinSimple/joinsamesourceintojoinsimple/_temporary
2016-01-15 02:39:48,530 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] completed in: 00:53.091, using cpu time: 00:12.000
2016-01-15 02:39:48,601 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinSameSourceIntoJoinSimple/joinsamesourceintojoinsimple
2016-01-15 02:39:48,654 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:39:48,655 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:39:48,757 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2*lower] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.094
2016-01-15 02:39:48,759 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2*lower] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 2
2016-01-15 02:39:48,759 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2*lower] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:39:48,791 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2*lower] starting
2016-01-15 02:39:48,792 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2*lower] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:39:48,792 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2*lower] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:39:48,792 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2*lower] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:39:48,792 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2*lower] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinAroundJoinLeftMost/joinaroundjoinleftmost"]
2016-01-15 02:39:48,792 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2*lower] parallel execution of steps is enabled: true
2016-01-15 02:39:48,792 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2*lower] executing total steps: 2
2016-01-15 02:39:48,792 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2*lower] allocating management threads: 2
2016-01-15 02:39:48,796 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2*lower] starting step: (1/2)
2016-01-15 02:39:48,936 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2*lower] submitted hadoop job: job_1452825506007_0004
2016-01-15 02:39:48,936 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2*lower] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0004/
2016-01-15 02:40:12,917 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0004_01_000002 is : 143
2016-01-15 02:40:13,196 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0004_01_000003 is : 143
2016-01-15 02:40:13,513 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0004_01_000005 is : 143
2016-01-15 02:40:13,630 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0004_01_000004 is : 143
2016-01-15 02:40:13,835 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0004_01_000006 is : 143
2016-01-15 02:40:14,997 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2*lower] starting step: (2/2) ...st/joinaroundjoinleftmost
2016-01-15 02:40:15,172 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2*lower] submitted hadoop job: job_1452825506007_0005
2016-01-15 02:40:15,173 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2*lower] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0005/
2016-01-15 02:40:39,356 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0005_01_000005 is : 143
2016-01-15 02:40:39,481 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0005_01_000003 is : 143
2016-01-15 02:40:39,709 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0005_01_000004 is : 143
2016-01-15 02:40:39,842 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0005_01_000002 is : 143
2016-01-15 02:40:41,040 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinAroundJoinLeftMost/joinaroundjoinleftmost/_temporary
2016-01-15 02:40:41,042 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2*lower] completed in: 00:52.245, using cpu time: 00:12.340
2016-01-15 02:40:41,098 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinAroundJoinLeftMost/joinaroundjoinleftmost
2016-01-15 02:40:41,135 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:40:41,136 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:40:41,186 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [tail] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.043
2016-01-15 02:40:41,187 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [tail] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 02:40:41,187 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [tail] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:40:41,203 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [tail] starting
2016-01-15 02:40:41,203 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [tail] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:40:41,204 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [tail] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:40:41,204 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [tail] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSamePipeName/renamedpipes"]
2016-01-15 02:40:41,204 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [tail] parallel execution of steps is enabled: true
2016-01-15 02:40:41,204 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [tail] executing total steps: 1
2016-01-15 02:40:41,204 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [tail] allocating management threads: 1
2016-01-15 02:40:41,206 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [tail] starting step: (1/1) ...SamePipeName/renamedpipes
2016-01-15 02:40:41,322 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [tail] submitted hadoop job: job_1452825506007_0006
2016-01-15 02:40:41,322 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [tail] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0006/
2016-01-15 02:41:05,668 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0006_01_000002 is : 143
2016-01-15 02:41:05,934 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0006_01_000003 is : 143
2016-01-15 02:41:06,249 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0006_01_000004 is : 143
2016-01-15 02:41:06,283 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0006_01_000005 is : 143
2016-01-15 02:41:06,488 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0006_01_000006 is : 143
2016-01-15 02:41:07,693 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSamePipeName/renamedpipes/_temporary
2016-01-15 02:41:07,695 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [tail] completed in: 00:26.487, using cpu time: 00:05.990
2016-01-15 02:41:07,757 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinSamePipeName/renamedpipes
2016-01-15 02:41:07,795 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:41:07,795 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:41:07,901 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.087
2016-01-15 02:41:07,903 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 5
2016-01-15 02:41:07,903 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:41:07,952 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting
2016-01-15 02:41:07,952 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:41:07,953 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:41:07,953 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinAfterEvery/afterevery"]
2016-01-15 02:41:07,953 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] parallel execution of steps is enabled: true
2016-01-15 02:41:07,953 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executing total steps: 3
2016-01-15 02:41:07,953 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] allocating management threads: 3
2016-01-15 02:41:07,956 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting step: (2/3)
2016-01-15 02:41:07,956 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting step: (1/3)
2016-01-15 02:41:08,170 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] submitted hadoop job: job_1452825506007_0007
2016-01-15 02:41:08,171 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0007/
2016-01-15 02:41:08,187 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] submitted hadoop job: job_1452825506007_0008
2016-01-15 02:41:08,188 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0008/
2016-01-15 02:41:12,893 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1080)) - Event EventType: KILL_CONTAINER sent to absent container container_1452825506007_0006_01_000001
2016-01-15 02:41:32,701 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0007_01_000003 is : 143
2016-01-15 02:41:33,302 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0007_01_000005 is : 143
2016-01-15 02:41:33,639 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0007_01_000002 is : 143
2016-01-15 02:41:33,815 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0007_01_000004 is : 143
2016-01-15 02:41:33,841 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0007_01_000006 is : 143
2016-01-15 02:41:39,863 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0007_01_000007 is : 143
2016-01-15 02:42:05,567 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0008_01_000005 is : 143
2016-01-15 02:42:05,713 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0008_01_000002 is : 143
2016-01-15 02:42:05,909 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0008_01_000003 is : 143
2016-01-15 02:42:06,022 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0008_01_000006 is : 143
2016-01-15 02:42:06,261 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0008_01_000004 is : 143
2016-01-15 02:42:12,349 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0008_01_000007 is : 143
2016-01-15 02:42:13,508 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting step: (3/3) ...JoinAfterEvery/afterevery
2016-01-15 02:42:13,675 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] submitted hadoop job: job_1452825506007_0009
2016-01-15 02:42:13,675 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0009/
2016-01-15 02:42:30,026 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0009_01_000002 is : 143
2016-01-15 02:42:31,226 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinAfterEvery/afterevery/_temporary
2016-01-15 02:42:31,228 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] completed in: 01:23.270, using cpu time: 00:15.780
2016-01-15 02:42:31,262 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinAfterEvery/afterevery
2016-01-15 02:42:31,312 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:42:31,312 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:42:31,395 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.078
2016-01-15 02:42:31,396 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 02:42:31,397 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:42:31,430 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] starting
2016-01-15 02:42:31,430 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:42:31,431 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:42:31,431 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/rhs.txt"]
2016-01-15 02:42:31,432 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lhs.txt"]
2016-01-15 02:42:31,432 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinsIntoCoGroupLhsSwappedJoin/joinsintocogrouplhsswappedjoin"]
2016-01-15 02:42:31,432 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] parallel execution of steps is enabled: true
2016-01-15 02:42:31,433 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] executing total steps: 1
2016-01-15 02:42:31,433 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] allocating management threads: 1
2016-01-15 02:42:31,435 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] starting step: (1/1) ...intocogrouplhsswappedjoin
2016-01-15 02:42:31,549 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] submitted hadoop job: job_1452825506007_0010
2016-01-15 02:42:31,549 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0010/
2016-01-15 02:42:55,272 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0010_01_000002 is : 143
2016-01-15 02:42:55,589 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0010_01_000003 is : 143
2016-01-15 02:42:55,978 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0010_01_000005 is : 143
2016-01-15 02:42:56,484 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0010_01_000006 is : 143
2016-01-15 02:42:56,661 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0010_01_000004 is : 143
2016-01-15 02:43:02,541 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0010_01_000007 is : 143
2016-01-15 02:43:03,720 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinsIntoCoGroupLhsSwappedJoin/joinsintocogrouplhsswappedjoin/_temporary
2016-01-15 02:43:03,721 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] completed in: 00:32.288, using cpu time: 00:07.210
2016-01-15 02:43:03,755 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinsIntoCoGroupLhsSwappedJoin/joinsintocogrouplhsswappedjoin
2016-01-15 02:43:03,792 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:43:03,792 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:43:03,895 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.098
2016-01-15 02:43:03,898 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 4
2016-01-15 02:43:03,898 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:43:03,935 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] starting
2016-01-15 02:43:03,935 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:43:03,935 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:43:03,935 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower+upper.txt"]
2016-01-15 02:43:03,935 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testGroupBySplitJoins/rhs"]
2016-01-15 02:43:03,935 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testGroupBySplitJoins/lhs"]
2016-01-15 02:43:03,935 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] parallel execution of steps is enabled: true
2016-01-15 02:43:03,935 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] executing total steps: 3
2016-01-15 02:43:03,936 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] allocating management threads: 3
2016-01-15 02:43:03,938 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] starting step: (1/3)
2016-01-15 02:43:04,256 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] submitted hadoop job: job_1452825506007_0011
2016-01-15 02:43:04,256 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0011/
2016-01-15 02:43:28,460 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0011_01_000005 is : 143
2016-01-15 02:43:28,536 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0011_01_000002 is : 143
2016-01-15 02:43:28,614 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0011_01_000006 is : 143
2016-01-15 02:43:29,026 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0011_01_000004 is : 143
2016-01-15 02:43:35,276 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0011_01_000007 is : 143
2016-01-15 02:43:36,437 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] starting step: (2/3) ...testGroupBySplitJoins/lhs
2016-01-15 02:43:36,437 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] starting step: (3/3) ...testGroupBySplitJoins/rhs
2016-01-15 02:43:36,603 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] submitted hadoop job: job_1452825506007_0012
2016-01-15 02:43:36,603 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0012/
2016-01-15 02:43:36,632 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] submitted hadoop job: job_1452825506007_0013
2016-01-15 02:43:36,633 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0013/
2016-01-15 02:43:53,848 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0012_01_000002 is : 143
2016-01-15 02:44:11,725 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0013_01_000002 is : 143
2016-01-15 02:44:12,928 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testGroupBySplitJoins/lhs/_temporary
2016-01-15 02:44:12,930 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testGroupBySplitJoins/rhs/_temporary
2016-01-15 02:44:12,932 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] completed in: 01:08.990, using cpu time: 00:09.120
2016-01-15 02:44:12,995 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testGroupBySplitJoins/lhs
2016-01-15 02:44:13,000 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testGroupBySplitJoins/rhs
2016-01-15 02:44:13,024 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:44:13,024 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:44:13,105 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.077
2016-01-15 02:44:13,107 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 3
2016-01-15 02:44:13,107 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:44:13,158 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] starting
2016-01-15 02:44:13,158 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:44:13,158 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:44:13,158 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/rhs.txt"]
2016-01-15 02:44:13,159 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lhs.txt"]
2016-01-15 02:44:13,159 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinsIntoCoGroupLhs/joinsintocogrouplhs"]
2016-01-15 02:44:13,160 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] parallel execution of steps is enabled: true
2016-01-15 02:44:13,160 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] executing total steps: 2
2016-01-15 02:44:13,160 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] allocating management threads: 2
2016-01-15 02:44:13,161 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] starting step: (1/2)
2016-01-15 02:44:13,288 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] submitted hadoop job: job_1452825506007_0014
2016-01-15 02:44:13,289 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0014/
2016-01-15 02:44:37,443 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0014_01_000002 is : 143
2016-01-15 02:44:37,547 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0014_01_000003 is : 143
2016-01-15 02:44:37,734 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0014_01_000004 is : 143
2016-01-15 02:44:38,022 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0014_01_000006 is : 143
2016-01-15 02:44:38,321 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0014_01_000005 is : 143
2016-01-15 02:44:39,477 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] starting step: (2/2) ...upLhs/joinsintocogrouplhs
2016-01-15 02:44:39,626 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] submitted hadoop job: job_1452825506007_0015
2016-01-15 02:44:39,626 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0015/
2016-01-15 02:45:04,386 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0015_01_000005 is : 143
2016-01-15 02:45:04,857 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0015_01_000002 is : 143
2016-01-15 02:45:05,076 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0015_01_000003 is : 143
2016-01-15 02:45:05,173 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0015_01_000004 is : 143
2016-01-15 02:45:10,736 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0015_01_000007 is : 143
2016-01-15 02:45:11,916 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinsIntoCoGroupLhs/joinsintocogrouplhs/_temporary
2016-01-15 02:45:11,918 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] completed in: 00:58.754, using cpu time: 00:14.320
2016-01-15 02:45:11,951 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinsIntoCoGroupLhs/joinsintocogrouplhs
2016-01-15 02:45:11,975 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:45:11,976 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:45:12,064 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.084
2016-01-15 02:45:12,065 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 3
2016-01-15 02:45:12,066 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:45:12,106 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] starting
2016-01-15 02:45:12,106 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:45:12,106 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:45:12,107 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/rhs.txt"]
2016-01-15 02:45:12,107 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lhs.txt"]
2016-01-15 02:45:12,107 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinsIntoCoGroupRhs/joinsintocogrouprhs"]
2016-01-15 02:45:12,108 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] parallel execution of steps is enabled: true
2016-01-15 02:45:12,108 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] executing total steps: 2
2016-01-15 02:45:12,108 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] allocating management threads: 2
2016-01-15 02:45:12,110 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] starting step: (1/2)
2016-01-15 02:45:12,227 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] submitted hadoop job: job_1452825506007_0016
2016-01-15 02:45:12,227 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0016/
2016-01-15 02:45:17,711 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1080)) - Event EventType: KILL_CONTAINER sent to absent container container_1452825506007_0015_01_000001
2016-01-15 02:45:36,294 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0016_01_000002 is : 143
2016-01-15 02:45:36,385 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0016_01_000003 is : 143
2016-01-15 02:45:36,708 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0016_01_000006 is : 143
2016-01-15 02:45:36,779 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0016_01_000005 is : 143
2016-01-15 02:45:37,078 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0016_01_000004 is : 143
2016-01-15 02:45:38,235 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] starting step: (2/2) ...upRhs/joinsintocogrouprhs
2016-01-15 02:45:38,305 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
2016-01-15 02:45:38,306 WARN protocol.BlockStoragePolicy (BlockStoragePolicy.java:chooseStorageTypes(160)) - Failed to place enough replicas: expected size is 1 but only 0 storage types can be selected (replication=4, selected=[], unavailable=[DISK], removed=[DISK], policy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]})
2016-01-15 02:45:38,306 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) All required storage types are unavailable: unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}
2016-01-15 02:45:38,355 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] submitted hadoop job: job_1452825506007_0017
2016-01-15 02:45:38,355 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0017/
2016-01-15 02:46:02,862 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0017_01_000004 is : 143
2016-01-15 02:46:03,173 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0017_01_000003 is : 143
2016-01-15 02:46:03,520 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0017_01_000002 is : 143
2016-01-15 02:46:03,663 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0017_01_000005 is : 143
2016-01-15 02:46:03,945 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0017_01_000006 is : 143
2016-01-15 02:46:09,511 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0017_01_000007 is : 143
2016-01-15 02:46:10,689 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinsIntoCoGroupRhs/joinsintocogrouprhs/_temporary
2016-01-15 02:46:10,691 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] completed in: 00:58.581, using cpu time: 00:14.330
2016-01-15 02:46:10,725 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinsIntoCoGroupRhs/joinsintocogrouprhs
2016-01-15 02:46:10,852 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:46:10,852 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:46:10,889 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.033
2016-01-15 02:46:10,891 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 02:46:10,891 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:46:10,907 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting
2016-01-15 02:46:10,908 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:46:10,908 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:46:10,908 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinWithHasher/joinhasher"]
2016-01-15 02:46:10,908 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] parallel execution of steps is enabled: true
2016-01-15 02:46:10,908 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executing total steps: 1
2016-01-15 02:46:10,908 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] allocating management threads: 1
2016-01-15 02:46:10,909 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting step: (1/1) ...JoinWithHasher/joinhasher
2016-01-15 02:46:11,233 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] submitted hadoop job: job_1452825506007_0018
2016-01-15 02:46:11,233 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0018/
2016-01-15 02:46:35,647 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0018_01_000003 is : 143
2016-01-15 02:46:35,714 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0018_01_000002 is : 143
2016-01-15 02:46:35,927 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0018_01_000006 is : 143
2016-01-15 02:46:36,384 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0018_01_000005 is : 143
2016-01-15 02:46:36,611 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0018_01_000004 is : 143
2016-01-15 02:46:37,811 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinWithHasher/joinhasher/_temporary
2016-01-15 02:46:37,816 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] completed in: 00:26.902, using cpu time: 00:08.660
2016-01-15 02:46:37,867 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinWithHasher/joinhasher
2016-01-15 02:46:37,896 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:46:37,896 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:46:37,966 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper*joined] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.065
2016-01-15 02:46:37,967 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper*joined] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 3
2016-01-15 02:46:37,967 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper*joined] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:46:37,993 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper*joined] starting
2016-01-15 02:46:37,993 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper*joined] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:46:37,994 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper*joined] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:46:37,994 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper*joined] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower+upper.txt"]
2016-01-15 02:46:37,995 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper*joined] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinGroupByJoin/joingroupbyjoin"]
2016-01-15 02:46:37,995 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper*joined] parallel execution of steps is enabled: true
2016-01-15 02:46:37,995 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper*joined] executing total steps: 2
2016-01-15 02:46:37,996 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper*joined] allocating management threads: 2
2016-01-15 02:46:38,002 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper*joined] starting step: (1/2)
2016-01-15 02:46:38,326 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper*joined] submitted hadoop job: job_1452825506007_0019
2016-01-15 02:46:38,326 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper*joined] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0019/
2016-01-15 02:47:02,640 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0019_01_000002 is : 143
2016-01-15 02:47:02,745 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0019_01_000003 is : 143
2016-01-15 02:47:02,846 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0019_01_000006 is : 143
2016-01-15 02:47:02,959 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0019_01_000004 is : 143
2016-01-15 02:47:03,087 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0019_01_000005 is : 143
2016-01-15 02:47:10,172 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0019_01_000007 is : 143
2016-01-15 02:47:11,343 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper*joined] starting step: (2/2) ...oupByJoin/joingroupbyjoin
2016-01-15 02:47:11,667 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper*joined] submitted hadoop job: job_1452825506007_0020
2016-01-15 02:47:11,667 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper*joined] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0020/
2016-01-15 02:47:28,147 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0020_01_000002 is : 143
2016-01-15 02:47:29,364 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinGroupByJoin/joingroupbyjoin/_temporary
2016-01-15 02:47:29,370 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper*joined] completed in: 00:51.369, using cpu time: 00:08.210
2016-01-15 02:47:29,402 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinGroupByJoin/joingroupbyjoin
2016-01-15 02:47:29,422 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:47:29,422 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:47:29,455 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-15 02:47:29,456 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 02:47:29,456 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:47:29,466 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] starting
2016-01-15 02:47:29,466 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/rhs.txt"]
2016-01-15 02:47:29,466 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lhs.txt"]
2016-01-15 02:47:29,466 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testCross/cross"]
2016-01-15 02:47:29,467 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] parallel execution of steps is enabled: true
2016-01-15 02:47:29,467 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] executing total steps: 1
2016-01-15 02:47:29,468 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] allocating management threads: 1
2016-01-15 02:47:29,468 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] starting step: (1/1) ...splatform/testCross/cross
2016-01-15 02:47:29,571 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] submitted hadoop job: job_1452825506007_0021
2016-01-15 02:47:29,571 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0021/
2016-01-15 02:47:35,137 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1080)) - Event EventType: KILL_CONTAINER sent to absent container container_1452825506007_0020_01_000001
2016-01-15 02:47:52,333 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0021_01_000004 is : 143
2016-01-15 02:47:52,459 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0021_01_000005 is : 143
2016-01-15 02:47:52,592 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0021_01_000003 is : 143
2016-01-15 02:47:52,836 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0021_01_000002 is : 143
2016-01-15 02:47:54,029 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testCross/cross/_temporary
2016-01-15 02:47:54,031 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] completed in: 00:24.555, using cpu time: 00:04.840
2016-01-15 02:47:54,077 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testCross/cross
2016-01-15 02:47:54,103 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:47:54,103 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:47:54,137 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.030
2016-01-15 02:47:54,141 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 02:47:54,142 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:47:54,152 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting
2016-01-15 02:47:54,153 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:47:54,153 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:47:54,153 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoin/join"]
2016-01-15 02:47:54,154 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] parallel execution of steps is enabled: true
2016-01-15 02:47:54,154 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executing total steps: 1
2016-01-15 02:47:54,154 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] allocating management threads: 1
2016-01-15 02:47:54,156 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting step: (1/1) ...pesplatform/testJoin/join
2016-01-15 02:47:54,274 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] submitted hadoop job: job_1452825506007_0022
2016-01-15 02:47:54,274 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0022/
2016-01-15 02:48:19,396 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0022_01_000002 is : 143
2016-01-15 02:48:19,629 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0022_01_000004 is : 143
2016-01-15 02:48:19,716 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0022_01_000003 is : 143
2016-01-15 02:48:19,851 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0022_01_000005 is : 143
2016-01-15 02:48:19,886 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0022_01_000006 is : 143
2016-01-15 02:48:21,090 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoin/join/_temporary
2016-01-15 02:48:21,092 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] completed in: 00:26.935, using cpu time: 00:05.990
2016-01-15 02:48:21,138 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoin/join
2016-01-15 02:48:21,167 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:48:21,167 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:48:21,289 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.117
2016-01-15 02:48:21,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 5
2016-01-15 02:48:21,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:48:21,333 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting
2016-01-15 02:48:21,333 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/rhs.txt"]
2016-01-15 02:48:21,333 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/rhs.txt"]
2016-01-15 02:48:21,333 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lhs.txt"]
2016-01-15 02:48:21,334 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSplitBeforeJoin/rhs"]
2016-01-15 02:48:21,334 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSplitBeforeJoin/lhs"]
2016-01-15 02:48:21,335 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] parallel execution of steps is enabled: true
2016-01-15 02:48:21,335 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executing total steps: 3
2016-01-15 02:48:21,335 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] allocating management threads: 3
2016-01-15 02:48:21,337 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (1/3)
2016-01-15 02:48:21,453 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_1452825506007_0023
2016-01-15 02:48:21,454 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0023/
2016-01-15 02:48:22,425 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=false) For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
2016-01-15 02:48:22,425 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=false) For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
2016-01-15 02:48:22,425 WARN protocol.BlockStoragePolicy (BlockStoragePolicy.java:chooseStorageTypes(160)) - Failed to place enough replicas: expected size is 1 but only 0 storage types can be selected (replication=4, selected=[], unavailable=[DISK, ARCHIVE], removed=[DISK], policy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]})
2016-01-15 02:48:22,425 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[DISK, ARCHIVE], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=false) All required storage types are unavailable: unavailableStorages=[DISK, ARCHIVE], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}
2016-01-15 02:48:47,030 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0023_01_000002 is : 143
2016-01-15 02:48:47,136 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0023_01_000005 is : 143
2016-01-15 02:48:47,277 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0023_01_000003 is : 143
2016-01-15 02:48:47,381 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0023_01_000004 is : 143
2016-01-15 02:48:48,528 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (2/3) ...stJoinSplitBeforeJoin/rhs
2016-01-15 02:48:48,528 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (3/3) ...stJoinSplitBeforeJoin/lhs
2016-01-15 02:48:48,712 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_1452825506007_0024
2016-01-15 02:48:48,713 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0024/
2016-01-15 02:48:48,925 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_1452825506007_0025
2016-01-15 02:48:48,925 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0025/
2016-01-15 02:49:12,736 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0024_01_000006 is : 143
2016-01-15 02:49:13,619 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0024_01_000003 is : 143
2016-01-15 02:49:13,664 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0024_01_000005 is : 143
2016-01-15 02:49:13,698 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0024_01_000004 is : 143
2016-01-15 02:49:14,130 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0024_01_000002 is : 143
2016-01-15 02:49:19,976 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0024_01_000007 is : 143
2016-01-15 02:49:43,189 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0025_01_000002 is : 143
2016-01-15 02:49:43,516 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0025_01_000003 is : 143
2016-01-15 02:49:43,837 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0025_01_000005 is : 143
2016-01-15 02:49:44,011 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0025_01_000004 is : 143
2016-01-15 02:49:50,027 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0025_01_000006 is : 143
2016-01-15 02:49:51,211 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSplitBeforeJoin/rhs/_temporary
2016-01-15 02:49:51,212 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSplitBeforeJoin/lhs/_temporary
2016-01-15 02:49:51,214 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] completed in: 01:29.874, using cpu time: 00:19.760
2016-01-15 02:49:51,248 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinSplitBeforeJoin/rhs
2016-01-15 02:49:51,253 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinSplitBeforeJoin/lhs
2016-01-15 02:49:51,277 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:49:51,277 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:49:51,362 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merging] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.077
2016-01-15 02:49:51,364 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merging] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 02:49:51,364 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merging] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:49:51,404 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merging] starting
2016-01-15 02:49:51,405 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merging] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:49:51,405 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merging] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:49:51,405 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merging] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/rhs.txt"]
2016-01-15 02:49:51,405 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merging] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lhs.txt"]
2016-01-15 02:49:51,405 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merging] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinsIntoGroupBy/joinsintogroupby"]
2016-01-15 02:49:51,406 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merging] parallel execution of steps is enabled: true
2016-01-15 02:49:51,406 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merging] executing total steps: 1
2016-01-15 02:49:51,406 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merging] allocating management threads: 1
2016-01-15 02:49:51,407 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merging] starting step: (1/1) ...oGroupBy/joinsintogroupby
2016-01-15 02:49:51,554 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merging] submitted hadoop job: job_1452825506007_0026
2016-01-15 02:49:51,555 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merging] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0026/
2016-01-15 02:49:52,438 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=false) For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
2016-01-15 02:49:52,438 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=false) For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
2016-01-15 02:49:52,438 WARN protocol.BlockStoragePolicy (BlockStoragePolicy.java:chooseStorageTypes(160)) - Failed to place enough replicas: expected size is 1 but only 0 storage types can be selected (replication=4, selected=[], unavailable=[DISK, ARCHIVE], removed=[DISK], policy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]})
2016-01-15 02:49:52,438 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[DISK, ARCHIVE], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=false) All required storage types are unavailable: unavailableStorages=[DISK, ARCHIVE], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}
2016-01-15 02:50:18,858 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0026_01_000004 is : 143
2016-01-15 02:50:19,077 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0026_01_000005 is : 143
2016-01-15 02:50:19,197 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0026_01_000006 is : 143
2016-01-15 02:50:19,402 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0026_01_000003 is : 143
2016-01-15 02:50:19,405 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0026_01_000007 is : 143
2016-01-15 02:50:24,905 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0026_01_000008 is : 143
2016-01-15 02:50:26,096 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinsIntoGroupBy/joinsintogroupby/_temporary
2016-01-15 02:50:26,098 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merging] completed in: 00:34.691, using cpu time: 00:08.680
2016-01-15 02:50:26,132 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinsIntoGroupBy/joinsintogroupby
2016-01-15 02:50:26,159 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:50:26,160 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:50:26,202 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-15 02:50:26,204 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 02:50:26,204 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:50:26,216 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting
2016-01-15 02:50:26,216 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:50:26,216 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:50:26,217 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinWithUnknowns/unknown"]
2016-01-15 02:50:26,217 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] parallel execution of steps is enabled: true
2016-01-15 02:50:26,217 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executing total steps: 1
2016-01-15 02:50:26,217 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] allocating management threads: 1
2016-01-15 02:50:26,218 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting step: (1/1) ...tJoinWithUnknowns/unknown
2016-01-15 02:50:26,325 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] submitted hadoop job: job_1452825506007_0027
2016-01-15 02:50:26,325 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0027/
2016-01-15 02:50:50,244 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0027_01_000004 is : 143
2016-01-15 02:50:50,617 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0027_01_000002 is : 143
2016-01-15 02:50:50,817 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0027_01_000005 is : 143
2016-01-15 02:50:51,044 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0027_01_000003 is : 143
2016-01-15 02:50:51,071 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0027_01_000006 is : 143
2016-01-15 02:50:52,257 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinWithUnknowns/unknown/_temporary
2016-01-15 02:50:52,259 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] completed in: 00:26.039, using cpu time: 00:05.940
2016-01-15 02:50:52,304 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinWithUnknowns/unknown
2016-01-15 02:50:52,340 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:50:52,341 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:50:52,382 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.038
2016-01-15 02:50:52,384 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 02:50:52,384 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:50:52,397 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] starting
2016-01-15 02:50:52,397 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:50:52,398 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:50:52,398 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:50:52,398 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinAroundJoinRightMost/joinaroundjoinrightmost"]
2016-01-15 02:50:52,398 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] parallel execution of steps is enabled: true
2016-01-15 02:50:52,398 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] executing total steps: 1
2016-01-15 02:50:52,399 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] allocating management threads: 1
2016-01-15 02:50:52,400 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] starting step: (1/1) ...t/joinaroundjoinrightmost
2016-01-15 02:50:52,518 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] submitted hadoop job: job_1452825506007_0028
2016-01-15 02:50:52,519 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0028/
2016-01-15 02:51:16,719 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0028_01_000005 is : 143
2016-01-15 02:51:17,039 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0028_01_000004 is : 143
2016-01-15 02:51:17,084 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0028_01_000003 is : 143
2016-01-15 02:51:17,325 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0028_01_000002 is : 143
2016-01-15 02:51:18,516 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinAroundJoinRightMost/joinaroundjoinrightmost/_temporary
2016-01-15 02:51:18,518 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] completed in: 00:26.117, using cpu time: 00:05.940
2016-01-15 02:51:18,572 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinAroundJoinRightMost/joinaroundjoinrightmost
2016-01-15 02:51:18,599 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:51:18,600 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:51:18,648 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.043
2016-01-15 02:51:18,650 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 02:51:18,650 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:51:18,661 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting
2016-01-15 02:51:18,661 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:51:18,661 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:51:18,662 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinNone/joinnone"]
2016-01-15 02:51:18,662 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] parallel execution of steps is enabled: true
2016-01-15 02:51:18,662 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executing total steps: 1
2016-01-15 02:51:18,662 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] allocating management threads: 1
2016-01-15 02:51:18,664 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting step: (1/1) ...orm/testJoinNone/joinnone
2016-01-15 02:51:18,989 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] submitted hadoop job: job_1452825506007_0029
2016-01-15 02:51:18,990 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0029/
2016-01-15 02:51:43,223 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0029_01_000002 is : 143
2016-01-15 02:51:43,518 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0029_01_000005 is : 143
2016-01-15 02:51:43,553 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0029_01_000004 is : 143
2016-01-15 02:51:43,585 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0029_01_000003 is : 143
2016-01-15 02:51:44,057 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0029_01_000006 is : 143
2016-01-15 02:51:45,235 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinNone/joinnone/_temporary
2016-01-15 02:51:45,237 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] completed in: 00:26.572, using cpu time: 00:05.900
2016-01-15 02:51:45,286 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinNone/joinnone
2016-01-15 02:51:45,311 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:51:45,311 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:51:45,361 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.047
2016-01-15 02:51:45,362 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 2
2016-01-15 02:51:45,363 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:51:45,380 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting
2016-01-15 02:51:45,380 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:51:45,380 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:51:45,380 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSelf/joinself"]
2016-01-15 02:51:45,380 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] parallel execution of steps is enabled: true
2016-01-15 02:51:45,380 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executing total steps: 2
2016-01-15 02:51:45,381 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] allocating management threads: 2
2016-01-15 02:51:45,382 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting step: (1/2)
2016-01-15 02:51:45,493 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] submitted hadoop job: job_1452825506007_0030
2016-01-15 02:51:45,494 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0030/
2016-01-15 02:51:50,540 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1080)) - Event EventType: KILL_CONTAINER sent to absent container container_1452825506007_0029_01_000001
2016-01-15 02:52:08,707 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0030_01_000006 is : 143
2016-01-15 02:52:09,563 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0030_01_000003 is : 143
2016-01-15 02:52:09,625 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0030_01_000002 is : 143
2016-01-15 02:52:09,712 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0030_01_000005 is : 143
2016-01-15 02:52:09,995 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0030_01_000004 is : 143
2016-01-15 02:52:11,147 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting step: (2/2) ...orm/testJoinSelf/joinself
2016-01-15 02:52:11,286 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] submitted hadoop job: job_1452825506007_0031
2016-01-15 02:52:11,287 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0031/
2016-01-15 02:52:36,441 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0031_01_000004 is : 143
2016-01-15 02:52:36,593 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0031_01_000003 is : 143
2016-01-15 02:52:36,722 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0031_01_000006 is : 143
2016-01-15 02:52:37,924 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSelf/joinself/_temporary
2016-01-15 02:52:37,927 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] completed in: 00:52.540, using cpu time: 00:12.020
2016-01-15 02:52:37,977 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinSelf/joinself
2016-01-15 02:52:38,012 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:52:38,012 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:52:38,080 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.064
2016-01-15 02:52:38,082 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 3
2016-01-15 02:52:38,082 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:52:38,117 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting
2016-01-15 02:52:38,119 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/rhs.txt"]
2016-01-15 02:52:38,119 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lhs.txt"]
2016-01-15 02:52:38,119 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lhs.txt"]
2016-01-15 02:52:38,120 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testSameSourceJoinSplitIntoJoin/rhs"]
2016-01-15 02:52:38,120 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testSameSourceJoinSplitIntoJoin/lhs"]
2016-01-15 02:52:38,120 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] parallel execution of steps is enabled: true
2016-01-15 02:52:38,121 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executing total steps: 3
2016-01-15 02:52:38,121 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] allocating management threads: 3
2016-01-15 02:52:38,122 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (1/3)
2016-01-15 02:52:38,184 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
2016-01-15 02:52:38,185 WARN protocol.BlockStoragePolicy (BlockStoragePolicy.java:chooseStorageTypes(160)) - Failed to place enough replicas: expected size is 1 but only 0 storage types can be selected (replication=4, selected=[], unavailable=[DISK], removed=[DISK], policy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]})
2016-01-15 02:52:38,185 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) All required storage types are unavailable: unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}
2016-01-15 02:52:38,442 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_1452825506007_0032
2016-01-15 02:52:38,442 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0032/
2016-01-15 02:52:59,621 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0032_01_000003 is : 143
2016-01-15 02:52:59,889 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0032_01_000002 is : 143
2016-01-15 02:53:00,183 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0032_01_000004 is : 143
2016-01-15 02:53:00,255 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0032_01_000005 is : 143
2016-01-15 02:53:01,390 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (3/3) ...urceJoinSplitIntoJoin/lhs
2016-01-15 02:53:01,390 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (2/3) ...urceJoinSplitIntoJoin/rhs
2016-01-15 02:53:01,568 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_1452825506007_0033
2016-01-15 02:53:01,568 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0033/
2016-01-15 02:53:01,574 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_1452825506007_0034
2016-01-15 02:53:01,574 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0034/
2016-01-15 02:53:23,790 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0033_01_000005 is : 143
2016-01-15 02:53:24,181 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0033_01_000004 is : 143
2016-01-15 02:53:24,580 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0033_01_000002 is : 143
2016-01-15 02:53:48,774 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0034_01_000004 is : 143
2016-01-15 02:53:49,060 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0034_01_000002 is : 143
2016-01-15 02:53:49,174 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0034_01_000005 is : 143
2016-01-15 02:53:49,937 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0034_01_000003 is : 143
2016-01-15 02:53:51,130 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testSameSourceJoinSplitIntoJoin/rhs/_temporary
2016-01-15 02:53:51,132 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testSameSourceJoinSplitIntoJoin/lhs/_temporary
2016-01-15 02:53:51,134 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] completed in: 01:13.010, using cpu time: 00:15.060
2016-01-15 02:53:51,190 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testSameSourceJoinSplitIntoJoin/lhs
2016-01-15 02:53:51,200 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testSameSourceJoinSplitIntoJoin/rhs
2016-01-15 02:53:51,224 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:53:51,225 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:53:51,277 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper2*lower*upper1] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.049
2016-01-15 02:53:51,279 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper2*lower*upper1] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 2
2016-01-15 02:53:51,279 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper2*lower*upper1] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:53:51,298 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper2*lower*upper1] starting
2016-01-15 02:53:51,298 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper2*lower*upper1] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:53:51,298 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper2*lower*upper1] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:53:51,298 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper2*lower*upper1] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:53:51,298 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper2*lower*upper1] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinAroundJoinRightMostSwapped/joinaroundjoinswapped"]
2016-01-15 02:53:51,298 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper2*lower*upper1] parallel execution of steps is enabled: true
2016-01-15 02:53:51,298 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper2*lower*upper1] executing total steps: 2
2016-01-15 02:53:51,298 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper2*lower*upper1] allocating management threads: 2
2016-01-15 02:53:51,301 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper2*lower*upper1] starting step: (1/2)
2016-01-15 02:53:51,616 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper2*lower*upper1] submitted hadoop job: job_1452825506007_0035
2016-01-15 02:53:51,616 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper2*lower*upper1] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0035/
2016-01-15 02:54:16,003 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0035_01_000005 is : 143
2016-01-15 02:54:16,267 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0035_01_000006 is : 143
2016-01-15 02:54:16,563 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0035_01_000004 is : 143
2016-01-15 02:54:16,945 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0035_01_000002 is : 143
2016-01-15 02:54:18,078 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper2*lower*upper1] starting step: (2/2) ...ped/joinaroundjoinswapped
2016-01-15 02:54:18,417 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper2*lower*upper1] submitted hadoop job: job_1452825506007_0036
2016-01-15 02:54:18,417 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper2*lower*upper1] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0036/
2016-01-15 02:54:43,445 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0036_01_000006 is : 143
2016-01-15 02:54:43,665 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0036_01_000005 is : 143
2016-01-15 02:54:43,818 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0036_01_000003 is : 143
2016-01-15 02:54:43,849 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0036_01_000004 is : 143
2016-01-15 02:54:44,490 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0036_01_000002 is : 143
2016-01-15 02:54:45,654 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinAroundJoinRightMostSwapped/joinaroundjoinswapped/_temporary
2016-01-15 02:54:45,656 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper2*lower*upper1] completed in: 00:54.353, using cpu time: 00:12.540
2016-01-15 02:54:45,699 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinAroundJoinRightMostSwapped/joinaroundjoinswapped
2016-01-15 02:54:45,730 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:54:45,731 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:54:45,781 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.047
2016-01-15 02:54:45,782 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 3
2016-01-15 02:54:45,783 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:54:45,808 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting
2016-01-15 02:54:45,808 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:54:45,808 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:54:45,809 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinFilteredBranch/joinfilteredbranch"]
2016-01-15 02:54:45,809 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] parallel execution of steps is enabled: true
2016-01-15 02:54:45,810 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executing total steps: 2
2016-01-15 02:54:45,810 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] allocating management threads: 2
2016-01-15 02:54:45,811 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting step: (1/2)
2016-01-15 02:54:45,923 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] submitted hadoop job: job_1452825506007_0037
2016-01-15 02:54:45,923 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0037/
2016-01-15 02:55:09,545 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0037_01_000003 is : 143
2016-01-15 02:55:09,914 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0037_01_000005 is : 143
2016-01-15 02:55:10,010 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0037_01_000002 is : 143
2016-01-15 02:55:10,234 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0037_01_000006 is : 143
2016-01-15 02:55:10,344 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0037_01_000004 is : 143
2016-01-15 02:55:16,504 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0037_01_000007 is : 143
2016-01-15 02:55:17,629 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting step: (2/2) ...Branch/joinfilteredbranch
2016-01-15 02:55:17,736 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] submitted hadoop job: job_1452825506007_0038
2016-01-15 02:55:17,736 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0038/
2016-01-15 02:55:22,965 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1080)) - Event EventType: KILL_CONTAINER sent to absent container container_1452825506007_0037_01_000001
2016-01-15 02:55:42,071 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0038_01_000003 is : 143
2016-01-15 02:55:42,274 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0038_01_000006 is : 143
2016-01-15 02:55:42,536 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0038_01_000005 is : 143
2016-01-15 02:55:42,859 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0038_01_000004 is : 143
2016-01-15 02:55:44,052 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinFilteredBranch/joinfilteredbranch/_temporary
2016-01-15 02:55:44,055 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] completed in: 00:58.238, using cpu time: 00:13.070
2016-01-15 02:55:44,107 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinFilteredBranch/joinfilteredbranch
2016-01-15 02:55:44,133 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:55:44,135 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:55:44,220 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.081
2016-01-15 02:55:44,223 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 3
2016-01-15 02:55:44,223 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:55:44,247 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] starting
2016-01-15 02:55:44,247 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:55:44,248 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:55:44,248 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:55:44,248 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSameSourceIntoJoin/joinsamesourceintojoin"]
2016-01-15 02:55:44,248 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] parallel execution of steps is enabled: true
2016-01-15 02:55:44,249 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] executing total steps: 3
2016-01-15 02:55:44,249 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] allocating management threads: 3
2016-01-15 02:55:44,260 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] starting step: (1/3)
2016-01-15 02:55:44,387 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] submitted hadoop job: job_1452825506007_0039
2016-01-15 02:55:44,387 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0039/
2016-01-15 02:56:07,628 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0039_01_000003 is : 143
2016-01-15 02:56:07,960 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0039_01_000005 is : 143
2016-01-15 02:56:08,188 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0039_01_000002 is : 143
2016-01-15 02:56:08,240 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0039_01_000004 is : 143
2016-01-15 02:56:08,583 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0039_01_000006 is : 143
2016-01-15 02:56:09,724 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] starting step: (2/3)
2016-01-15 02:56:09,829 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] submitted hadoop job: job_1452825506007_0040
2016-01-15 02:56:09,829 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0040/
2016-01-15 02:56:33,615 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0040_01_000006 is : 143
2016-01-15 02:56:34,326 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0040_01_000002 is : 143
2016-01-15 02:56:34,528 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0040_01_000005 is : 143
2016-01-15 02:56:34,692 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0040_01_000003 is : 143
2016-01-15 02:56:34,799 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0040_01_000004 is : 143
2016-01-15 02:56:35,956 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] starting step: (3/3) ...in/joinsamesourceintojoin
2016-01-15 02:56:36,032 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
2016-01-15 02:56:36,032 WARN protocol.BlockStoragePolicy (BlockStoragePolicy.java:chooseStorageTypes(160)) - Failed to place enough replicas: expected size is 1 but only 0 storage types can be selected (replication=4, selected=[], unavailable=[DISK], removed=[DISK], policy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]})
2016-01-15 02:56:36,032 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) All required storage types are unavailable: unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}
2016-01-15 02:56:36,082 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] submitted hadoop job: job_1452825506007_0041
2016-01-15 02:56:36,083 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0041/
2016-01-15 02:56:37,498 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=false) For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
2016-01-15 02:56:37,499 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=false) For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
2016-01-15 02:56:37,500 WARN protocol.BlockStoragePolicy (BlockStoragePolicy.java:chooseStorageTypes(160)) - Failed to place enough replicas: expected size is 1 but only 0 storage types can be selected (replication=4, selected=[], unavailable=[DISK, ARCHIVE], removed=[DISK], policy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]})
2016-01-15 02:56:37,500 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[DISK, ARCHIVE], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=false) All required storage types are unavailable: unavailableStorages=[DISK, ARCHIVE], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}
2016-01-15 02:57:00,010 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0041_01_000003 is : 143
2016-01-15 02:57:00,542 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0041_01_000006 is : 143
2016-01-15 02:57:00,575 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0041_01_000002 is : 143
2016-01-15 02:57:01,177 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0041_01_000004 is : 143
2016-01-15 02:57:01,298 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0041_01_000005 is : 143
2016-01-15 02:57:02,486 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSameSourceIntoJoin/joinsamesourceintojoin/_temporary
2016-01-15 02:57:02,492 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper1*upper2] completed in: 01:18.234, using cpu time: 00:18.290
2016-01-15 02:57:02,544 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinSameSourceIntoJoin/joinsamesourceintojoin
2016-01-15 02:57:02,572 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:57:02,573 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:57:02,638 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.061
2016-01-15 02:57:02,639 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 02:57:02,639 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:57:02,670 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] starting
2016-01-15 02:57:02,671 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:57:02,671 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:57:02,671 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/rhs.txt"]
2016-01-15 02:57:02,672 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lhs.txt"]
2016-01-15 02:57:02,672 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinsIntoCoGroup/joinsintocogroup"]
2016-01-15 02:57:02,672 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] parallel execution of steps is enabled: true
2016-01-15 02:57:02,672 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] executing total steps: 1
2016-01-15 02:57:02,673 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] allocating management threads: 1
2016-01-15 02:57:02,676 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] starting step: (1/1) ...oCoGroup/joinsintocogroup
2016-01-15 02:57:02,999 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] submitted hadoop job: job_1452825506007_0042
2016-01-15 02:57:02,999 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0042/
2016-01-15 02:57:29,056 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0042_01_000002 is : 143
2016-01-15 02:57:29,864 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0042_01_000003 is : 143
2016-01-15 02:57:29,920 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0042_01_000006 is : 143
2016-01-15 02:57:30,291 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0042_01_000004 is : 143
2016-01-15 02:57:30,362 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0042_01_000007 is : 143
2016-01-15 02:57:30,635 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0042_01_000005 is : 143
2016-01-15 02:57:35,732 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0042_01_000008 is : 143
2016-01-15 02:57:36,914 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinsIntoCoGroup/joinsintocogroup/_temporary
2016-01-15 02:57:36,915 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [cogrouping] completed in: 00:34.242, using cpu time: 00:08.620
2016-01-15 02:57:36,955 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinsIntoCoGroup/joinsintocogroup
2016-01-15 02:57:37,001 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:57:37,002 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:57:37,030 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-01-15 02:57:37,031 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 02:57:37,032 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:57:37,049 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting
2016-01-15 02:57:37,049 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/rhs-sparse.txt"]
2016-01-15 02:57:37,050 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lhs-sparse.txt"]
2016-01-15 02:57:37,050 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinInner/joininner"]
2016-01-15 02:57:37,050 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] parallel execution of steps is enabled: true
2016-01-15 02:57:37,050 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executing total steps: 1
2016-01-15 02:57:37,050 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] allocating management threads: 1
2016-01-15 02:57:37,051 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting step: (1/1) ...m/testJoinInner/joininner
2016-01-15 02:57:37,154 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] submitted hadoop job: job_1452825506007_0043
2016-01-15 02:57:37,154 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0043/
2016-01-15 02:58:01,166 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0043_01_000006 is : 143
2016-01-15 02:58:01,771 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0043_01_000004 is : 143
2016-01-15 02:58:02,279 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0043_01_000003 is : 143
2016-01-15 02:58:02,365 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0043_01_000005 is : 143
2016-01-15 02:58:03,529 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinInner/joininner/_temporary
2016-01-15 02:58:03,531 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] completed in: 00:26.478, using cpu time: 00:05.900
2016-01-15 02:58:03,573 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinInner/joininner
2016-01-15 02:58:03,598 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:58:03,598 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:58:03,651 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.050
2016-01-15 02:58:03,653 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 2
2016-01-15 02:58:03,653 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:58:03,679 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting
2016-01-15 02:58:03,679 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/rhs.txt"]
2016-01-15 02:58:03,679 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lhs.txt"]
2016-01-15 02:58:03,680 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSplit/rhs"]
2016-01-15 02:58:03,680 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSplit/lhs"]
2016-01-15 02:58:03,680 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] parallel execution of steps is enabled: true
2016-01-15 02:58:03,680 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executing total steps: 2
2016-01-15 02:58:03,680 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] allocating management threads: 2
2016-01-15 02:58:03,682 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (1/2) ...latform/testJoinSplit/lhs
2016-01-15 02:58:03,683 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (2/2) ...latform/testJoinSplit/rhs
2016-01-15 02:58:03,876 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_1452825506007_0044
2016-01-15 02:58:03,876 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0044/
2016-01-15 02:58:03,884 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_1452825506007_0045
2016-01-15 02:58:03,884 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0045/
2016-01-15 02:58:25,749 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0044_01_000003 is : 143
2016-01-15 02:58:26,274 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0044_01_000005 is : 143
2016-01-15 02:58:26,689 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0044_01_000004 is : 143
2016-01-15 02:58:26,813 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0044_01_000002 is : 143
2016-01-15 02:58:50,527 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0045_01_000002 is : 143
2016-01-15 02:58:50,588 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0045_01_000003 is : 143
2016-01-15 02:58:50,808 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0045_01_000005 is : 143
2016-01-15 02:58:50,931 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0045_01_000004 is : 143
2016-01-15 02:58:52,126 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSplit/lhs/_temporary
2016-01-15 02:58:52,128 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSplit/rhs/_temporary
2016-01-15 02:58:52,129 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] completed in: 00:48.445, using cpu time: 00:09.530
2016-01-15 02:58:52,200 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinSplit/rhs
2016-01-15 02:58:52,211 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinSplit/lhs
2016-01-15 02:58:52,234 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:58:52,235 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:58:52,283 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.044
2016-01-15 02:58:52,285 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 3
2016-01-15 02:58:52,285 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:58:52,306 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] starting
2016-01-15 02:58:52,306 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 02:58:52,307 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSamePipeAroundGroupBy/samepipearoundgroupby"]
2016-01-15 02:58:52,307 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] parallel execution of steps is enabled: true
2016-01-15 02:58:52,307 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] executing total steps: 2
2016-01-15 02:58:52,307 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] allocating management threads: 2
2016-01-15 02:58:52,308 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] starting step: (1/2)
2016-01-15 02:58:52,369 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
2016-01-15 02:58:52,369 WARN protocol.BlockStoragePolicy (BlockStoragePolicy.java:chooseStorageTypes(160)) - Failed to place enough replicas: expected size is 1 but only 0 storage types can be selected (replication=4, selected=[], unavailable=[DISK], removed=[DISK], policy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]})
2016-01-15 02:58:52,369 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) All required storage types are unavailable: unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}
2016-01-15 02:58:52,421 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] submitted hadoop job: job_1452825506007_0046
2016-01-15 02:58:52,421 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0046/
2016-01-15 02:58:52,518 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=false) For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
2016-01-15 02:58:52,518 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=false) For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
2016-01-15 02:58:52,518 WARN protocol.BlockStoragePolicy (BlockStoragePolicy.java:chooseStorageTypes(160)) - Failed to place enough replicas: expected size is 1 but only 0 storage types can be selected (replication=4, selected=[], unavailable=[DISK, ARCHIVE], removed=[DISK], policy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]})
2016-01-15 02:58:52,519 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[DISK, ARCHIVE], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=false) All required storage types are unavailable: unavailableStorages=[DISK, ARCHIVE], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}
2016-01-15 02:59:16,504 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0046_01_000006 is : 143
2016-01-15 02:59:16,936 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0046_01_000004 is : 143
2016-01-15 02:59:17,023 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0046_01_000003 is : 143
2016-01-15 02:59:17,460 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0046_01_000002 is : 143
2016-01-15 02:59:17,494 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0046_01_000005 is : 143
2016-01-15 02:59:23,396 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0046_01_000007 is : 143
2016-01-15 02:59:24,541 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] starting step: (2/2) ...pBy/samepipearoundgroupby
2016-01-15 02:59:24,656 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] submitted hadoop job: job_1452825506007_0047
2016-01-15 02:59:24,656 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0047/
2016-01-15 02:59:48,907 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0047_01_000003 is : 143
2016-01-15 02:59:49,332 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0047_01_000002 is : 143
2016-01-15 02:59:49,495 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0047_01_000006 is : 143
2016-01-15 02:59:49,588 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0047_01_000005 is : 143
2016-01-15 02:59:49,891 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0047_01_000004 is : 143
2016-01-15 02:59:51,069 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSamePipeAroundGroupBy/samepipearoundgroupby/_temporary
2016-01-15 02:59:51,071 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs*rhs] completed in: 00:58.760, using cpu time: 00:12.800
2016-01-15 02:59:51,113 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinSamePipeAroundGroupBy/samepipearoundgroupby
2016-01-15 02:59:51,144 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:59:51,145 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:59:51,202 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.054
2016-01-15 02:59:51,204 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 5
2016-01-15 02:59:51,204 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:59:51,232 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] starting
2016-01-15 02:59:51,232 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:59:51,232 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 02:59:51,232 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSameSourceOverGroupByIntoJoinSimple/joinsamesourceovergroupbyintojoinsimple"]
2016-01-15 02:59:51,233 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] parallel execution of steps is enabled: true
2016-01-15 02:59:51,233 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] executing total steps: 3
2016-01-15 02:59:51,233 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] allocating management threads: 3
2016-01-15 02:59:51,235 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] starting step: (1/3)
2016-01-15 02:59:51,236 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] starting step: (2/3)
2016-01-15 02:59:51,425 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] submitted hadoop job: job_1452825506007_0049
2016-01-15 02:59:51,425 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0049/
2016-01-15 02:59:51,617 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] submitted hadoop job: job_1452825506007_0048
2016-01-15 02:59:51,617 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0048/
2016-01-15 03:00:15,842 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0048_01_000003 is : 143
2016-01-15 03:00:16,192 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0048_01_000005 is : 143
2016-01-15 03:00:16,238 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0048_01_000006 is : 143
2016-01-15 03:00:16,443 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0048_01_000004 is : 143
2016-01-15 03:00:16,488 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0048_01_000002 is : 143
2016-01-15 03:00:22,698 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0048_01_000007 is : 143
2016-01-15 03:00:47,916 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0049_01_000006 is : 143
2016-01-15 03:00:48,605 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0049_01_000002 is : 143
2016-01-15 03:00:48,721 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0049_01_000005 is : 143
2016-01-15 03:00:48,784 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0049_01_000003 is : 143
2016-01-15 03:00:48,822 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0049_01_000004 is : 143
2016-01-15 03:00:54,702 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0049_01_000007 is : 143
2016-01-15 03:00:55,853 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] starting step: (3/3) ...overgroupbyintojoinsimple
2016-01-15 03:00:55,970 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] submitted hadoop job: job_1452825506007_0050
2016-01-15 03:00:55,970 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0050/
2016-01-15 03:01:13,438 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0050_01_000002 is : 143
2016-01-15 03:01:14,631 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSameSourceOverGroupByIntoJoinSimple/joinsamesourceovergroupbyintojoinsimple/_temporary
2016-01-15 03:01:14,633 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [upper1*upper2] completed in: 01:23.395, using cpu time: 00:14.570
2016-01-15 03:01:14,672 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinSameSourceOverGroupByIntoJoinSimple/joinsamesourceovergroupbyintojoinsimple
2016-01-15 03:01:14,711 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 03:01:14,711 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 03:01:14,762 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [join-merge] executed rule registry: MapReduceHadoopRuleRegistry, completed as: ILLEGAL, in: 00:00.048
2016-01-15 03:01:14,763 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [join-merge] rule registry: MapReduceHadoopRuleRegistry, found assembly to be malformed
2016-01-15 03:01:14,764 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/testJoinMergeGroupBy/hashjoin
2016-01-15 03:01:14,778 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 03:01:14,778 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 03:01:14,799 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-15 03:01:14,801 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 03:01:14,801 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 03:01:14,809 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] starting
2016-01-15 03:01:14,809 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 03:01:14,810 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSamePipe2/samepipe2"]
2016-01-15 03:01:14,810 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] parallel execution of steps is enabled: true
2016-01-15 03:01:14,811 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] executing total steps: 1
2016-01-15 03:01:14,811 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] allocating management threads: 1
2016-01-15 03:01:14,812 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] starting step: (1/1) ...stJoinSamePipe2/samepipe2
2016-01-15 03:01:14,910 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] submitted hadoop job: job_1452825506007_0051
2016-01-15 03:01:14,910 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0051/
2016-01-15 03:01:38,619 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0051_01_000003 is : 143
2016-01-15 03:01:38,755 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0051_01_000002 is : 143
2016-01-15 03:01:38,940 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0051_01_000005 is : 143
2016-01-15 03:01:39,107 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0051_01_000004 is : 143
2016-01-15 03:01:39,210 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0051_01_000006 is : 143
2016-01-15 03:01:40,393 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSamePipe2/samepipe2/_temporary
2016-01-15 03:01:40,395 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] completed in: 00:25.582, using cpu time: 00:05.500
2016-01-15 03:01:40,439 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinSamePipe2/samepipe2
2016-01-15 03:01:40,474 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 03:01:40,474 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 03:01:40,498 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-01-15 03:01:40,500 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 03:01:40,500 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 03:01:40,512 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs] starting
2016-01-15 03:01:40,512 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 03:01:40,512 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSamePipe3/samepipe3"]
2016-01-15 03:01:40,512 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs] parallel execution of steps is enabled: true
2016-01-15 03:01:40,513 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs] executing total steps: 1
2016-01-15 03:01:40,514 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs] allocating management threads: 1
2016-01-15 03:01:40,514 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs] starting step: (1/1) ...stJoinSamePipe3/samepipe3
2016-01-15 03:01:40,818 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs] submitted hadoop job: job_1452825506007_0052
2016-01-15 03:01:40,818 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0052/
2016-01-15 03:02:04,701 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0052_01_000006 is : 143
2016-01-15 03:02:05,033 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0052_01_000004 is : 143
2016-01-15 03:02:05,089 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0052_01_000003 is : 143
2016-01-15 03:02:05,462 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0052_01_000005 is : 143
2016-01-15 03:02:05,501 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0052_01_000002 is : 143
2016-01-15 03:02:06,683 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSamePipe3/samepipe3/_temporary
2016-01-15 03:02:06,685 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs] completed in: 00:26.169, using cpu time: 00:05.350
2016-01-15 03:02:06,735 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinSamePipe3/samepipe3
2016-01-15 03:02:06,760 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 03:02:06,760 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 03:02:06,794 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.031
2016-01-15 03:02:06,796 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 03:02:06,796 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 03:02:06,810 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting
2016-01-15 03:02:06,810 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 03:02:06,810 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 03:02:06,811 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinGroupBy/joingroupby"]
2016-01-15 03:02:06,811 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] parallel execution of steps is enabled: true
2016-01-15 03:02:06,811 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executing total steps: 1
2016-01-15 03:02:06,811 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] allocating management threads: 1
2016-01-15 03:02:06,812 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting step: (1/1) ...stJoinGroupBy/joingroupby
2016-01-15 03:02:06,914 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] submitted hadoop job: job_1452825506007_0053
2016-01-15 03:02:06,915 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0053/
2016-01-15 03:02:30,983 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0053_01_000003 is : 143
2016-01-15 03:02:31,146 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0053_01_000004 is : 143
2016-01-15 03:02:31,216 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0053_01_000002 is : 143
2016-01-15 03:02:31,514 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0053_01_000005 is : 143
2016-01-15 03:02:31,588 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0053_01_000006 is : 143
2016-01-15 03:02:37,358 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0053_01_000007 is : 143
2016-01-15 03:02:38,563 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinGroupBy/joingroupby/_temporary
2016-01-15 03:02:38,565 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] completed in: 00:31.751, using cpu time: 00:07.300
2016-01-15 03:02:38,595 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinGroupBy/joingroupby
2016-01-15 03:02:38,612 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 03:02:38,612 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 03:02:38,633 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-15 03:02:38,635 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 03:02:38,635 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 03:02:38,643 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] starting
2016-01-15 03:02:38,643 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 03:02:38,643 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSamePipe/samepipe"]
2016-01-15 03:02:38,643 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] parallel execution of steps is enabled: true
2016-01-15 03:02:38,643 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] executing total steps: 1
2016-01-15 03:02:38,643 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] allocating management threads: 1
2016-01-15 03:02:38,644 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] starting step: (1/1) ...testJoinSamePipe/samepipe
2016-01-15 03:02:38,740 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] submitted hadoop job: job_1452825506007_0054
2016-01-15 03:02:38,740 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0054/
2016-01-15 03:03:02,290 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0054_01_000004 is : 143
2016-01-15 03:03:02,395 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0054_01_000005 is : 143
2016-01-15 03:03:02,785 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0054_01_000002 is : 143
2016-01-15 03:03:03,127 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0054_01_000003 is : 143
2016-01-15 03:03:04,299 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinSamePipe/samepipe/_temporary
2016-01-15 03:03:04,301 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower] completed in: 00:25.654, using cpu time: 00:05.360
2016-01-15 03:03:04,344 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinSamePipe/samepipe
2016-01-15 03:03:04,376 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 03:03:04,377 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 03:03:04,470 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.090
2016-01-15 03:03:04,473 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 4, nodes: 7
2016-01-15 03:03:04,473 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 03:03:04,525 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] starting
2016-01-15 03:03:04,525 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 03:03:04,525 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testGroupBySplitGroupByJoin/sink"]
2016-01-15 03:03:04,525 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] parallel execution of steps is enabled: true
2016-01-15 03:03:04,526 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] executing total steps: 4
2016-01-15 03:03:04,526 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] allocating management threads: 4
2016-01-15 03:03:04,528 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] starting step: (1/4)
2016-01-15 03:03:04,662 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] submitted hadoop job: job_1452825506007_0055
2016-01-15 03:03:04,662 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0055/
2016-01-15 03:03:29,005 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0055_01_000002 is : 143
2016-01-15 03:03:29,136 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0055_01_000004 is : 143
2016-01-15 03:03:29,467 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0055_01_000003 is : 143
2016-01-15 03:03:29,484 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0055_01_000006 is : 143
2016-01-15 03:03:29,524 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0055_01_000005 is : 143
2016-01-15 03:03:35,589 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0055_01_000007 is : 143
2016-01-15 03:03:36,751 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] starting step: (2/4)
2016-01-15 03:03:36,867 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] submitted hadoop job: job_1452825506007_0056
2016-01-15 03:03:36,867 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0056/
2016-01-15 03:03:53,384 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0056_01_000002 is : 143
2016-01-15 03:04:00,417 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0056_01_000003 is : 143
2016-01-15 03:04:01,539 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] starting step: (3/4)
2016-01-15 03:04:01,673 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] submitted hadoop job: job_1452825506007_0057
2016-01-15 03:04:01,673 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0057/
2016-01-15 03:04:18,645 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0057_01_000002 is : 143
2016-01-15 03:04:25,340 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0057_01_000003 is : 143
2016-01-15 03:04:26,478 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] starting step: (4/4) ...upBySplitGroupByJoin/sink
2016-01-15 03:04:26,594 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] submitted hadoop job: job_1452825506007_0058
2016-01-15 03:04:26,595 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0058/
2016-01-15 03:04:43,259 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0058_01_000002 is : 143
2016-01-15 03:04:44,468 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testGroupBySplitGroupByJoin/sink/_temporary
2016-01-15 03:04:44,471 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first*second] completed in: 01:39.938, using cpu time: 00:12.230
2016-01-15 03:04:44,501 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testGroupBySplitGroupByJoin/sink
2016-01-15 03:04:44,522 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 03:04:44,522 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 03:04:44,546 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.021
2016-01-15 03:04:44,547 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 03:04:44,547 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 03:04:44,558 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting
2016-01-15 03:04:44,558 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/rhs-sparse.txt"]
2016-01-15 03:04:44,559 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lhs-sparse.txt"]
2016-01-15 03:04:44,559 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinInnerOuter/joininnerouter"]
2016-01-15 03:04:44,560 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] parallel execution of steps is enabled: true
2016-01-15 03:04:44,560 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executing total steps: 1
2016-01-15 03:04:44,560 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] allocating management threads: 1
2016-01-15 03:04:44,562 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting step: (1/1) ...InnerOuter/joininnerouter
2016-01-15 03:04:44,878 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] submitted hadoop job: job_1452825506007_0059
2016-01-15 03:04:44,878 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0059/
2016-01-15 03:05:08,943 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0059_01_000003 is : 143
2016-01-15 03:05:09,604 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0059_01_000005 is : 143
2016-01-15 03:05:09,933 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0059_01_000002 is : 143
2016-01-15 03:05:10,240 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0059_01_000006 is : 143
2016-01-15 03:05:10,338 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0059_01_000004 is : 143
2016-01-15 03:05:11,521 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinInnerOuter/joininnerouter/_temporary
2016-01-15 03:05:11,524 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] completed in: 00:26.954, using cpu time: 00:06.030
2016-01-15 03:05:11,569 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinInnerOuter/joininnerouter
2016-01-15 03:05:11,594 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 03:05:11,594 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 03:05:11,619 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.021
2016-01-15 03:05:11,620 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 03:05:11,621 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 03:05:11,630 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting
2016-01-15 03:05:11,631 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-01-15 03:05:11,631 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 03:05:11,631 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinDiffFields/difffields"]
2016-01-15 03:05:11,631 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] parallel execution of steps is enabled: true
2016-01-15 03:05:11,631 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executing total steps: 1
2016-01-15 03:05:11,631 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] allocating management threads: 1
2016-01-15 03:05:11,633 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting step: (1/1) ...JoinDiffFields/difffields
2016-01-15 03:05:11,747 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] submitted hadoop job: job_1452825506007_0060
2016-01-15 03:05:11,747 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] tracking url: http://ip-10-167-78-165:34347/proxy/application_1452825506007_0060/
2016-01-15 03:05:34,687 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0060_01_000006 is : 143
2016-01-15 03:05:36,015 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0060_01_000004 is : 143
2016-01-15 03:05:36,344 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0060_01_000003 is : 143
2016-01-15 03:05:36,373 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0060_01_000005 is : 143
2016-01-15 03:05:36,724 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452825506007_0060_01_000002 is : 143
2016-01-15 03:05:37,909 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinDiffFields/difffields/_temporary
2016-01-15 03:05:37,911 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] completed in: 00:26.276, using cpu time: 00:05.900
2016-01-15 03:05:37,954 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinDiffFields/difffields