2016-01-14 15:33:32,491 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 15:33:32,513 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.MergePipesPlatformTest, with platform: hadoop2-tez
2016-01-14 15:33:32,542 INFO tez.Hadoop2TezPlatform (Hadoop2TezPlatform.java:setUp(164)) - using cluster
2016-01-14 15:33:33,138 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-01-14 15:33:34,076 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-01-14 15:33:34,556 WARN server.AuthenticationFilter (AuthenticationFilter.java:init(162)) - 'signature.secret' configuration not set, using a random value as secret
2016-01-14 15:33:38,285 INFO test.MiniTezCluster (MiniTezCluster.java:serviceInit(109)) - Using Tez AppJar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.tez/tez-dag/0.6.2/7cfbec38ae59bd135b5606c0b42dce12b41c076c/tez-dag-0.6.2.jar
2016-01-14 15:33:38,484 INFO test.MiniTezCluster (MiniTezCluster.java:serviceInit(121)) - Set TEZ-LIB-URI to: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:33:38,490 INFO test.MiniTezCluster (MiniTezCluster.java:serviceInit(152)) - mkdir: hdfs://localhost:55538/apps_staging_dir
2016-01-14 15:33:38,821 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 15:33:38,903 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 15:33:38,947 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 15:33:38,995 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 15:33:38,999 INFO test.MiniTezCluster (MiniTezCluster.java:serviceStart(186)) - Starting MiniTezCluster
2016-01-14 15:33:44,657 INFO test.MiniTezCluster (MiniTezCluster.java:serviceStart(205)) - Setting yarn-site.xml via YARN-APP-CP at: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/target/cascading.platform.tez.Hadoop2TezPlatform,/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/resources/test:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/main:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/resources/main:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-core/3.0.4/f8041cf548c12cc6e997a63a67562fcf5b2e237/cascading-core-3.0.4-tests.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-platform/3.0.4/2c7c4ae0a2ac3b7e296414816e065fb601e9be39/cascading-platform-3.0.4-tests.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/4f45ecd85538b8cc8c352ccd4f33c52c1776a545/cascading-hadoop2-tez-3.0.4-tests.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-mapreduce-client-core/2.4.1/4b563f928dc108bfc9974e2c643e275bbb407625/hadoop-mapreduce-client-core-2.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-common/2.4.1/5e9d624fb9eeab4b1a940f5e9b1c9ff644ec1d65/hadoop-common-2.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-minicluster/2.4.1/8cddcdc0c553483c635909b2029cff67d19e138c/hadoop-minicluster-2.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.5/6b262da268f8ad9eff941b25503a9198f0a0ac93/slf4j-api-1.7.5.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.5/6edffc576ce104ec769d954618764f39f0f0f10d/slf4j-log4j12-1.7.5.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.tez/tez-tests/0.6.2/e6c7cbbf7f067cea6a8f8c5bea595536e141dd70/tez-tests-0.6.2-tests.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.tez/tez-api/0.6.2/7be44271b408cb2a59181fc1c3d45d0bb2e6bb93/tez-api-0.6.2.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.tez/tez-dag/0.6.2/7cfbec38ae59bd135b5606c0b42dce12b41c076c/tez-dag-0.6.2.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.tez/tez-yarn-timeline-history/0.6.2/4765a7b7c177208970def6b9640c1366a61c264c/tez-yarn-timeline-history-0.6.2.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/junit/junit/4.12/2973d150c0dc1fefe998f834810d68f278ea58ec/junit-4.12.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/riffle/riffle/1.0.0/d991264d10c1e80f8588d2480e3f6e536e30fcb2/riffle-1.0.0.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.jgrapht/jgrapht-core/0.9.1/872b4fd3a6d8a4f0bdfb0f6e26c4499e752ce39/jgrapht-core-0.9.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.codehaus.janino/janino/2.7.6/37fde5de7edd5d7ebe075f03f4c083df2ac73dd8/janino-2.7.6.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-core/3.0.4/db7694f29f171efa077bb0192f3c3039f7514807/cascading-core-3.0.4.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.4.1/5079e4fb2bf12dff172ccceefc812f29c3295168/hadoop-yarn-common-2.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/com.google.protobuf/protobuf-java/2.5.0/a10732c76bfacdbd633a7eb0f7968b1059a65dfa/protobuf-java-2.5.0.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.avro/avro/1.7.4/416e7030879814f52845b97f04bb50ecd1cef372/avro-1.7.4.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-annotations/2.4.1/80434aa40184be711d1c41568852fee625925ab0/hadoop-annotations-2.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/com.google.inject.extensions/guice-servlet/3.0/610cde0e8da5a8b7d8efb8f0b8987466ffebaaf9/guice-servlet-3.0.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/io.netty/netty/3.6.2.Final/69be11c61427f0604a30539755add84ad9e37e5e/netty-3.6.2.Final.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/com.google.guava/guava/11.0.2/35a3c69e19d72743cac83778aecbee68680f63eb/guava-11.0.2.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.2/2bf96b7aa8b611c177d329452af1dc933e14501c/commons-cli-1.2.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.commons/commons-math3/3.1.1/6719d757a98ff24a83d9d727bef9cec83f59b6e1/commons-math3-3.1.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/xmlenc/xmlenc/0.52/d82554efbe65906d83b3d97bd7509289e9db561a/xmlenc-0.52.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/commons-httpclient/commons-httpclient/3.1/964cd74171f427720480efdec40a7c7f6e58426a/commons-httpclient-3.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/commons-io/commons-io/2.4/b1b6ea3b7e4aa4f492509a4952029cd8e48019ad/commons-io-2.4.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/commons-net/commons-net/3.1/2298164a7c2484406f2aa5ac85b205d39019896f/commons-net-3.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/commons-collections/commons-collections/3.2.1/761ea405b9b37ced573d2df0d1e3a4e0f9edc668/commons-collections-3.2.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/javax.servlet/servlet-api/2.5/5959582d97d8b61f4d154ca9e495aafd16726e34/servlet-api-2.5.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.mortbay.jetty/jetty/6.1.26/2f546e289fddd5b1fab1d4199fbb6e9ef43ee4b0/jetty-6.1.26.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.mortbay.jetty/jetty-util/6.1.26/e5642fe0399814e1687d55a3862aa5a3417226a9/jetty-util-6.1.26.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/com.sun.jersey/jersey-core/1.9/8341846f18187013bb9e27e46b7ee00a6395daf4/jersey-core-1.9.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/com.sun.jersey/jersey-json/1.9/1aa73e1896bcc7013fed247157d7f676226eb432/jersey-json-1.9.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/com.sun.jersey/jersey-server/1.9/3a6ea7cc5e15c824953f9f3ece2201b634d90d18/jersey-server-1.9.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/tomcat/jasper-compiler/5.5.23/6d35bd7fb8c4fbc1f5401fb3678aa976d2e4c241/jasper-compiler-5.5.23.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/tomcat/jasper-runtime/5.5.23/96ca5528a93ab47b001476b74320c644beb89dde/jasper-runtime-5.5.23.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/javax.servlet.jsp/jsp-api/2.1/63f943103f250ef1f3a4d5e94d145a0f961f5316/jsp-api-2.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/commons-el/commons-el/1.0/1df2c042b3f2de0124750241ac6c886dbfa2cc2c/commons-el-1.0.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/commons-logging/commons-logging/1.1.3/f6f66e966c70a83ffbdb6f17a0919eaf7c8aca7f/commons-logging-1.1.3.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/log4j/log4j/1.2.17/5af35056b4d257e4b64b9e8069c0746e8b08629f/log4j-1.2.17.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/net.java.dev.jets3t/jets3t/0.9.0/792bc96ee7e57b89f472aa0cb5a31015b9f59c96/jets3t-0.9.0.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/commons-lang/commons-lang/2.6/ce1edb914c94ebc388f086c6827e8bdeec71ac2/commons-lang-2.6.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/commons-configuration/commons-configuration/1.6/32cadde23955d7681b0d94a2715846d20b425235/commons-configuration-1.6.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.codehaus.jackson/jackson-core-asl/1.8.8/dd2e90bb710ea3bc4610e24299d6a4c8dac5049b/jackson-core-asl-1.8.8.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.codehaus.jackson/jackson-mapper-asl/1.8.8/1bb32d9d2527c083a56e234acca49a48d3c65c8/jackson-mapper-asl-1.8.8.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-auth/2.4.1/96af98a34a335c5a8f2c9e40c6df57308060b1b1/hadoop-auth-2.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.42/a86104b0f2e0c0bab5b0df836065823a99b5e334/jsch-0.1.42.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.zookeeper/zookeeper/3.4.5/c0f69fb36526552a8f0bc548a6c33c49cf08e562/zookeeper-3.4.5.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.commons/commons-compress/1.4.1/b02e84a993d88568417536240e970c4b809126fd/commons-compress-1.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-common/2.4.1/4b70adc7e361d45eaa046c8e4b0f34b592ba99d5/hadoop-common-2.4.1-tests.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.4.1/622cd765cf1bf31f04557f106e319814fc54a57f/hadoop-hdfs-2.4.1-tests.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.4.1/e1a4a1d3554a1779cf69332f7aa04963237d74fb/hadoop-hdfs-2.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-server-tests/2.4.1/e64fdb80075b00d491748b659b69845aad81762f/hadoop-yarn-server-tests-2.4.1-tests.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-mapreduce-client-jobclient/2.4.1/c6d5f19d3ec9dc999fc5c795a5fbcc6d7487042c/hadoop-mapreduce-client-jobclient-2.4.1-tests.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-mapreduce-client-jobclient/2.4.1/b4332fcbbe1b82c1e3adb565a34704b9101973e8/hadoop-mapreduce-client-jobclient-2.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-mapreduce-client-app/2.4.1/96da79f9773e0a23803e0894878c74324fe066e4/hadoop-mapreduce-client-app-2.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-api/2.4.1/d9ae8871a77f0da42fadd0272aad29c19ae2d800/hadoop-yarn-api-2.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-mapreduce-client-hs/2.4.1/eb6ff67c7177e69128a43482f493676ef6df722b/hadoop-mapreduce-client-hs-2.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.tez/tez-runtime-library/0.6.2/51f93c866043ed03d16e9657c292858b752100ad/tez-runtime-library-0.6.2.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.tez/tez-mapreduce/0.6.2/dc9fc549fb8023221647d410b3e17b751a1b2c03/tez-mapreduce-0.6.2.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.tez/tez-examples/0.6.2/cd9c5d801f5ffee25bc6e2f0a271e32c5c95c65/tez-examples-0.6.2.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-client/2.4.1/6d585dc8b9e3656a7fbee2ea24f80888c399f0b3/hadoop-yarn-client-2.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-mapreduce-client-common/2.4.1/521dc4a0796a80ebd88c661afdb0820e01f365f/hadoop-mapreduce-client-common-2.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.commons/commons-collections4/4.0/da217367fd25e88df52ba79e47658d4cf928b0d1/commons-collections4-4.0.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/com.sun.jersey/jersey-client/1.9/d3c4b2b5f89db32c96ceddcb863684821910a7bb/jersey-client-1.9.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.tez/tez-common/0.6.2/2b6e194f37e7a9931e8f2f732fd167c20395adb5/tez-common-0.6.2.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.tez/tez-runtime-internals/0.6.2/c03a09ad12e31ea93c2a2131fbf96f0993875e24/tez-runtime-internals-0.6.2.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-server-web-proxy/2.4.1/5f4efb0f7e31fbf73337773396358c8f1435ca9b/hadoop-yarn-server-web-proxy-2.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.codehaus.jettison/jettison/1.3.4/3c08d8f699432e23023080cdc8b4073132473dc8/jettison-1.3.4.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.hamcrest/hamcrest-core/1.3/42a25dc3219429f0e5d060061f71acb49bf010a0/hamcrest-core-1.3.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.codehaus.janino/commons-compiler/2.7.6/b71e76d942b33dfa26e4e3047ff2a774d1f917b4/commons-compiler-2.7.6.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/javax.xml.bind/jaxb-api/2.2.2/aeb3021ca93dde265796d82015beecdcff95bf09/jaxb-api-2.2.2.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/com.google.inject/guice/3.0/9d84f15fe35e2c716a02979fb62f50a29f38aefa/guice-3.0.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/com.sun.jersey.contribs/jersey-guice/1.9/5963c28c47df7e5d6ad34cec80c071c368777f7b/jersey-guice-1.9.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/com.thoughtworks.paranamer/paranamer/2.3/4a85963a752c0a2f715c3924bfc686865e7e1bc6/paranamer-2.3.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.xerial.snappy/snappy-java/1.0.4.1/f88b89a5a21a466aeb0ecf0c063605bd584b4947/snappy-java-1.0.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.mortbay.jetty/servlet-api/2.5-20081211/22bff70037e1e6fa7e6413149489552ee2064702/servlet-api-2.5-20081211.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/com.sun.xml.bind/jaxb-impl/2.2.3-1/56baae106392040a45a06d4a41099173425da1e6/jaxb-impl-2.2.3-1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.codehaus.jackson/jackson-jaxrs/1.8.3/3604ca9f572170e2ef5813141ec1f0e0100efd19/jackson-jaxrs-1.8.3.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.codehaus.jackson/jackson-xc/1.8.3/1226667dcdb7c259b3ee07e112ed83446554516e/jackson-xc-1.8.3.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/asm/asm/3.1/c157def142714c544bdea2e6144645702adf7097/asm-3.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/com.jamesmurty.utils/java-xmlbuilder/0.4/ac5962e48cdee3a0a6e1f8e00fcb594747ac5aaf/java-xmlbuilder-0.4.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/commons-digester/commons-digester/1.8/dc6a73fdbd1fa3f0944e8497c6c872fa21dca37e/commons-digester-1.8.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/commons-beanutils/commons-beanutils-core/1.8.0/175dc721f87e4bc5cc0573f990e28c3cf9117508/commons-beanutils-core-1.8.0.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.tukaani/xz/1.0/ecff5cb8b1189514c9d1d8d68eb77ac372e000c9/xz-1.0.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/commons-daemon/commons-daemon/1.0.13/750856a1fdb3ddf721ccf73c3518e4211cffc3a3/commons-daemon-1.0.13.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-server-common/2.4.1/3843d9ab1c871d93f691fcc15d3e3e7e2e1d6178/hadoop-yarn-server-common-2.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-server-nodemanager/2.4.1/17324cfa4d679e7c1113dc37dd53a5fc3e51375c/hadoop-yarn-server-nodemanager-2.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-server-resourcemanager/2.4.1/f0e3d23e8afa3008ab8a4ccba19fd075a052ce80/hadoop-yarn-server-resourcemanager-2.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-mapreduce-client-shuffle/2.4.1/36ec630ddc0748efaeefaa146a8a210ff6693225/hadoop-mapreduce-client-shuffle-2.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/javax.xml.stream/stax-api/1.0-2/d6337b0de8b25e53e81b922352fbea9f9f57ba0b/stax-api-1.0-2.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/javax.activation/activation/1.1/e6cb541461c2834bdea3eb920f1884d1eb508b50/activation-1.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/javax.inject/javax.inject/1/6975da39a7040257bd51d21a231b76c915872d38/javax.inject-1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/aopalliance/aopalliance/1.0/235ba8b489512805ac13a8f9ea77a1ca5ebe3e8/aopalliance-1.0.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.sonatype.sisu.inject/cglib/2.2.1-v20090111/7ce5e983fd0e6c78346f4c9cbfa39d83049dda2/cglib-2.2.1-v20090111.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/commons-beanutils/commons-beanutils/1.7.0/5675fd96b29656504b86029551973d60fb41339b/commons-beanutils-1.7.0.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-server-applicationhistoryservice/2.4.1/5da5194d7dd07b1335128b9292a1d044572cbb64/hadoop-yarn-server-applicationhistoryservice-2.4.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/jline/jline/0.9.94/99a18e9a44834afdebc467294e1138364c207402/jline-0.9.94.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.fusesource.leveldbjni/leveldbjni-all/1.8/707350a2eeb1fa2ed77a32ddb3893ed308e941db/leveldbjni-all-1.8.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/com.google.code.findbugs/jsr305/2.0.3/5871fb60dc68d67da54a663c3fd636a10a532948/jsr305-2.0.3.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/stax/stax-api/1.0.1/49c100caf72d658aca8e58bd74a4ba90fa2b0d70/stax-api-1.0.1.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.httpcomponents/httpclient/4.2.5/666e26e76f2e87d84e4f16acb546481ae1b8e9a6/httpclient-4.2.5.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/org.apache.httpcomponents/httpcore/4.2.4/3b7f38df6de5dd8b500e602ae8c2dd5ee446f883/httpcore-4.2.4.jar:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/commons-codec/commons-codec/1.6/b7f0fc8f61ecadeb3695f0b9464755eee44374d4/commons-codec-1.6.jar
2016-01-14 15:33:45,040 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2016-01-14 15:33:45,180 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:33:45,181 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:33:45,247 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: 4F5B79473CEB402293483DDA8E3DC96C
2016-01-14 15:33:45,381 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.071
2016-01-14 15:33:45,406 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.097
2016-01-14 15:33:45,408 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 3
2016-01-14 15:33:45,408 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 3
2016-01-14 15:33:45,409 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 15:33:45,685 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: DF4512EDB55542118C03BBB70885983C,D27D7400CADC4BBA94C35DB907F7B5D7 and EAB92D9BBF93489692BD51A5AA6AA22D
2016-01-14 15:33:45,708 INFO util.HadoopUtil (HadoopUtil.java:syncPaths(602)) - copying from: file:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar, to: hdfs://localhost:55538/user/teamcity/.staging/B69D01B7AF2F4EBFA754F60DF2064844/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:33:45,790 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 15:33:45,792 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] starting
2016-01-14 15:33:45,793 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/upper.txt"]
2016-01-14 15:33:45,793 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower.txt"]
2016-01-14 15:33:45,794 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/mergepipesplatform/testSimpleMerge/simplemerge"]
2016-01-14 15:33:45,795 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] parallel execution of steps is enabled: true
2016-01-14 15:33:45,795 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] executing total steps: 1
2016-01-14 15:33:45,796 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] allocating management threads: 1
2016-01-14 15:33:45,797 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] starting step: (1/1) ...stSimpleMerge/simplemerge
2016-01-14 15:33:45,816 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] tez session mode enabled: false
2016-01-14 15:33:45,833 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 15:33:45,909 INFO client.TezClient (TezClient.java:start(315)) - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs
2016-01-14 15:33:45,942 INFO client.TezClient (TezClient.java:submitDAGApplication(738)) - Submitting DAG application with id: application_1452785619001_0001
2016-01-14 15:33:45,943 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(171)) - Using tez.lib.uris value from configuration: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:33:45,965 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory hdfs://localhost:55538/user/teamcity/.staging/B69D01B7AF2F4EBFA754F60DF2064844/AB51933431DD431F9261264F875367DD/.tez/application_1452785619001_0001 doesn't exist and is created
2016-01-14 15:33:46,217 INFO client.TezClient (TezClient.java:submitDAGApplication(759)) - Submitting DAG to YARN, applicationId=application_1452785619001_0001, dagName=[B69D01B7AF2F4EBFA754F60DF2064844/AB51933431DD431F9261264F875367DD] merge/(1/1) ...stSimpleMerge/simplemerge
2016-01-14 15:33:46,331 INFO client.TezClient (TezClient.java:submitDAGApplication(765)) - The url to track the Tez AM: http://ip-10-187-41-40:46879/proxy/application_1452785619001_0001/
2016-01-14 15:33:46,372 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] submitted tez dag to app master: application_1452785619001_0001, with dag id: dag_1452785619001_0001_1
2016-01-14 15:34:04,491 INFO client.TimelineReaderFactory (TimelineReaderFactory.java:tokenDelegationSupported(381)) - Could not find class required for token delegation, will fallback to pseudo auth
2016-01-14 15:34:04,526 INFO counters.Limits (Limits.java:ensureInitialized(59)) - Counter limits initialized with parameters: GROUP_NAME_MAX=128, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200
2016-01-14 15:34:04,529 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] completed in: 00:18.736, using cpu time: 00:06.710
2016-01-14 15:34:04,634 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testSimpleMerge/simplemerge
2016-01-14 15:34:04,718 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:34:04,718 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:34:04,765 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: UNSUPPORTED, in: 00:00.003
2016-01-14 15:34:04,921 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.159
2016-01-14 15:34:04,923 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] rule registry: NoHashJoinHadoop2TezRuleRegistry, does not support assembly
2016-01-14 15:34:04,925 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 6
2016-01-14 15:34:04,925 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] rule registry: HashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 15:34:05,131 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: AAF0944782A34A07A1163F1DEED04692,BD2E5E2749244E9C80515A11A5587753 and CD95E855D0BD4F1FA57582F32F5BC972
2016-01-14 15:34:05,221 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: AAF0944782A34A07A1163F1DEED04692,B4AC06CB3EB5491EA890961280FF5FD4 and D4582636A4324E60B5715D4B160538D0
2016-01-14 15:34:05,223 INFO util.HadoopUtil (HadoopUtil.java:syncPaths(602)) - copying from: file:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar, to: hdfs://localhost:55538/user/teamcity/.staging/062B74ACCB214702BC98BBBE308710A8/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:34:05,248 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] starting
2016-01-14 15:34:05,248 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/upper.txt"]
2016-01-14 15:34:05,249 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower.txt"]
2016-01-14 15:34:05,249 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower-offset.txt"]
2016-01-14 15:34:05,250 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/mergepipesplatform/testHashJoinMergeIntoHashJoinAccumulatedAccumulatedMerge/multihashjoinintomergeintohashjoinfirstAccumulatedsecondAccumulatedinterMerge"]
2016-01-14 15:34:05,250 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] parallel execution of steps is enabled: true
2016-01-14 15:34:05,250 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] executing total steps: 1
2016-01-14 15:34:05,250 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] allocating management threads: 1
2016-01-14 15:34:05,251 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] starting step: (1/1) ...condAccumulatedinterMerge
2016-01-14 15:34:05,274 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] tez session mode enabled: false
2016-01-14 15:34:05,278 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 15:34:05,297 INFO client.TezClient (TezClient.java:start(315)) - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs
2016-01-14 15:34:05,299 INFO client.TezClient (TezClient.java:submitDAGApplication(738)) - Submitting DAG application with id: application_1452785619001_0002
2016-01-14 15:34:05,299 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(171)) - Using tez.lib.uris value from configuration: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:34:05,313 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory hdfs://localhost:55538/user/teamcity/.staging/062B74ACCB214702BC98BBBE308710A8/E0F3672A149D48AEA167511B9D50218A/.tez/application_1452785619001_0002 doesn't exist and is created
2016-01-14 15:34:05,386 INFO client.TezClient (TezClient.java:submitDAGApplication(759)) - Submitting DAG to YARN, applicationId=application_1452785619001_0002, dagName=[062B74ACCB214702BC98BBBE308710A8/E0F3672A149D48AEA167511B9D50218A] offset*merge2/(1/1) ...condAccumulatedinterMerge
2016-01-14 15:34:05,391 INFO client.TezClient (TezClient.java:submitDAGApplication(765)) - The url to track the Tez AM: http://ip-10-187-41-40:46879/proxy/application_1452785619001_0002/
2016-01-14 15:34:05,406 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] submitted tez dag to app master: application_1452785619001_0002, with dag id: dag_1452785619001_0002_1
2016-01-14 15:34:09,546 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0001_01_000002 is : 143
2016-01-14 15:34:09,615 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0001_01_000003 is : 143
2016-01-14 15:34:10,543 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0001_01_000002
2016-01-14 15:34:10,543 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0001_01_000003
2016-01-14 15:34:27,458 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] completed in: 00:22.209, using cpu time: 00:14.600
2016-01-14 15:34:27,498 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testHashJoinMergeIntoHashJoinAccumulatedAccumulatedMerge/multihashjoinintomergeintohashjoinfirstAccumulatedsecondAccumulatedinterMerge
2016-01-14 15:34:27,543 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:34:27,544 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:34:27,577 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: UNSUPPORTED, in: 00:00.001
2016-01-14 15:34:27,688 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.112
2016-01-14 15:34:27,690 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] rule registry: NoHashJoinHadoop2TezRuleRegistry, does not support assembly
2016-01-14 15:34:27,691 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 6
2016-01-14 15:34:27,691 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] rule registry: HashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 15:34:27,970 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: B8C4E43770744F4EAA79364506C86D34,FB8A62E0E9C249329BD1BE7EC9FAE60A and CB868EBE63A0478587CA670B090264EB
2016-01-14 15:34:28,004 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: C025FBD3ECD84B97BFBE6FE9B267FED6,B8C4E43770744F4EAA79364506C86D34 and EB562F1328F44AA38AF3D9B131C18946
2016-01-14 15:34:28,035 INFO util.HadoopUtil (HadoopUtil.java:syncPaths(602)) - copying from: file:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar, to: hdfs://localhost:55538/user/teamcity/.staging/FDD2EADBCEE747C7979D9F86FBAB7E89/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:34:28,062 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] starting
2016-01-14 15:34:28,062 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/upper.txt"]
2016-01-14 15:34:28,062 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower.txt"]
2016-01-14 15:34:28,063 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower-offset.txt"]
2016-01-14 15:34:28,063 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/mergepipesplatform/testHashJoinMergeIntoHashJoinStreamedStreamedMerge/multihashjoinintomergeintohashjoinfirstStreamedsecondStreamedinterMerge"]
2016-01-14 15:34:28,064 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] parallel execution of steps is enabled: true
2016-01-14 15:34:28,064 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] executing total steps: 1
2016-01-14 15:34:28,065 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] allocating management threads: 1
2016-01-14 15:34:28,066 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] starting step: (1/1) ...dsecondStreamedinterMerge
2016-01-14 15:34:28,090 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] tez session mode enabled: false
2016-01-14 15:34:28,094 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 15:34:28,108 INFO client.TezClient (TezClient.java:start(315)) - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs
2016-01-14 15:34:28,110 INFO client.TezClient (TezClient.java:submitDAGApplication(738)) - Submitting DAG application with id: application_1452785619001_0003
2016-01-14 15:34:28,110 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(171)) - Using tez.lib.uris value from configuration: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:34:28,122 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory hdfs://localhost:55538/user/teamcity/.staging/FDD2EADBCEE747C7979D9F86FBAB7E89/F30E17F45AF44F9E9DE290A30D0DD762/.tez/application_1452785619001_0003 doesn't exist and is created
2016-01-14 15:34:28,207 INFO client.TezClient (TezClient.java:submitDAGApplication(759)) - Submitting DAG to YARN, applicationId=application_1452785619001_0003, dagName=[FDD2EADBCEE747C7979D9F86FBAB7E89/F30E17F45AF44F9E9DE290A30D0DD762] merge2*offset/(1/1) ...dsecondStreamedinterMerge
2016-01-14 15:34:28,212 INFO client.TezClient (TezClient.java:submitDAGApplication(765)) - The url to track the Tez AM: http://ip-10-187-41-40:46879/proxy/application_1452785619001_0003/
2016-01-14 15:34:28,231 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] submitted tez dag to app master: application_1452785619001_0003, with dag id: dag_1452785619001_0003_1
2016-01-14 15:34:29,504 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0002_01_000004 is : 143
2016-01-14 15:34:30,491 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0002_01_000004
2016-01-14 15:34:31,060 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0002_01_000003 is : 143
2016-01-14 15:34:32,044 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0002_01_000003
2016-01-14 15:34:32,522 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0002_01_000002 is : 143
2016-01-14 15:34:32,531 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0002_01_000005 is : 143
2016-01-14 15:34:46,339 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] completed in: 00:18.275, using cpu time: 00:07.530
2016-01-14 15:34:46,371 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testHashJoinMergeIntoHashJoinStreamedStreamedMerge/multihashjoinintomergeintohashjoinfirstStreamedsecondStreamedinterMerge
2016-01-14 15:34:46,406 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:34:46,407 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:34:46,470 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.035
2016-01-14 15:34:46,488 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.053
2016-01-14 15:34:46,489 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 4
2016-01-14 15:34:46,489 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 4
2016-01-14 15:34:46,489 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 15:34:46,561 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: B03E29A51ABD4141A76784FB74404230,F82C894A973F4CA186B0D4D167E0F93A,CAAB90A7CBA14950B352D74D44B50F2F and ED25467DEE0D42C68CCE2D03ADA1479E
2016-01-14 15:34:46,563 INFO util.HadoopUtil (HadoopUtil.java:syncPaths(602)) - copying from: file:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar, to: hdfs://localhost:55538/user/teamcity/.staging/38C3F8ED29B744BABD45E23E1982D8C6/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:34:46,585 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] starting
2016-01-14 15:34:46,585 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/upper.txt"]
2016-01-14 15:34:46,586 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower.txt"]
2016-01-14 15:34:46,586 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower-offset.txt"]
2016-01-14 15:34:46,587 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/mergepipesplatform/testSimpleMergeThree/simplemergethree"]
2016-01-14 15:34:46,587 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] parallel execution of steps is enabled: true
2016-01-14 15:34:46,587 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] executing total steps: 1
2016-01-14 15:34:46,588 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] allocating management threads: 1
2016-01-14 15:34:46,589 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] starting step: (1/1) ...rgeThree/simplemergethree
2016-01-14 15:34:46,608 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] tez session mode enabled: false
2016-01-14 15:34:46,612 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 15:34:46,625 INFO client.TezClient (TezClient.java:start(315)) - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs
2016-01-14 15:34:46,627 INFO client.TezClient (TezClient.java:submitDAGApplication(738)) - Submitting DAG application with id: application_1452785619001_0004
2016-01-14 15:34:46,627 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(171)) - Using tez.lib.uris value from configuration: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:34:46,639 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory hdfs://localhost:55538/user/teamcity/.staging/38C3F8ED29B744BABD45E23E1982D8C6/D705681270DF4ED7A284026AFA432042/.tez/application_1452785619001_0004 doesn't exist and is created
2016-01-14 15:34:46,709 INFO client.TezClient (TezClient.java:submitDAGApplication(759)) - Submitting DAG to YARN, applicationId=application_1452785619001_0004, dagName=[38C3F8ED29B744BABD45E23E1982D8C6/D705681270DF4ED7A284026AFA432042] merge/(1/1) ...rgeThree/simplemergethree
2016-01-14 15:34:46,714 INFO client.TezClient (TezClient.java:submitDAGApplication(765)) - The url to track the Tez AM: http://ip-10-187-41-40:46879/proxy/application_1452785619001_0004/
2016-01-14 15:34:46,743 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] submitted tez dag to app master: application_1452785619001_0004, with dag id: dag_1452785619001_0004_1
2016-01-14 15:34:51,084 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0003_01_000003 is : 143
2016-01-14 15:34:51,371 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0003_01_000002 is : 143
2016-01-14 15:34:52,356 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0003_01_000002
2016-01-14 15:34:56,931 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0004_01_000003
2016-01-14 15:34:58,361 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0004_01_000006
2016-01-14 15:34:58,361 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0004_01_000007
2016-01-14 15:35:04,797 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] completed in: 00:18.211, using cpu time: 00:09.640
2016-01-14 15:35:04,830 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testSimpleMergeThree/simplemergethree
2016-01-14 15:35:04,864 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:35:04,864 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:35:04,890 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge1*offset*offset] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: UNSUPPORTED, in: 00:00.001
2016-01-14 15:35:04,957 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge1*offset*offset] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.068
2016-01-14 15:35:04,958 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge1*offset*offset] rule registry: NoHashJoinHadoop2TezRuleRegistry, does not support assembly
2016-01-14 15:35:04,959 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge1*offset*offset] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 5
2016-01-14 15:35:04,959 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge1*offset*offset] rule registry: HashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 15:35:05,196 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: BB992C6B743541EFB585B2EB43F94AE9,B4B2781C89EB44E18F30344F286BD9DF and CE03E4AD8BCC4E608BAAB1935291DCDA
2016-01-14 15:35:05,197 INFO util.HadoopUtil (HadoopUtil.java:syncPaths(602)) - copying from: file:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar, to: hdfs://localhost:55538/user/teamcity/.staging/007D57E0DC4C481D97BCD7D92BD2A44E/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:35:05,219 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge1*offset*offset] starting
2016-01-14 15:35:05,220 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge1*offset*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/upper.txt"]
2016-01-14 15:35:05,220 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge1*offset*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower.txt"]
2016-01-14 15:35:05,220 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge1*offset*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower-offset.txt"]
2016-01-14 15:35:05,220 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge1*offset*offset] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/mergepipesplatform/testHashJoinMergeIntoHashJoinStreamedStreamed/multihashjoinintomergeintohashjoinfirstStreamedsecondStreamednoInterMerge"]
2016-01-14 15:35:05,221 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge1*offset*offset] parallel execution of steps is enabled: true
2016-01-14 15:35:05,221 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge1*offset*offset] executing total steps: 1
2016-01-14 15:35:05,221 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge1*offset*offset] allocating management threads: 1
2016-01-14 15:35:05,222 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge1*offset*offset] starting step: (1/1) ...econdStreamednoInterMerge
2016-01-14 15:35:05,236 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge1*offset*offset] tez session mode enabled: false
2016-01-14 15:35:05,243 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 15:35:05,256 INFO client.TezClient (TezClient.java:start(315)) - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs
2016-01-14 15:35:05,258 INFO client.TezClient (TezClient.java:submitDAGApplication(738)) - Submitting DAG application with id: application_1452785619001_0005
2016-01-14 15:35:05,258 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(171)) - Using tez.lib.uris value from configuration: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:35:05,267 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory hdfs://localhost:55538/user/teamcity/.staging/007D57E0DC4C481D97BCD7D92BD2A44E/DAD8B119E2404513807EE764D80A000B/.tez/application_1452785619001_0005 doesn't exist and is created
2016-01-14 15:35:05,330 INFO client.TezClient (TezClient.java:submitDAGApplication(759)) - Submitting DAG to YARN, applicationId=application_1452785619001_0005, dagName=[007D57E0DC4C481D97BCD7D92BD2A44E/DAD8B119E2404513807EE764D80A000B] merge1*offset*offset/(1/1) ...econdStreamednoInterMerge
2016-01-14 15:35:05,333 INFO client.TezClient (TezClient.java:submitDAGApplication(765)) - The url to track the Tez AM: http://ip-10-187-41-40:46879/proxy/application_1452785619001_0005/
2016-01-14 15:35:05,347 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge1*offset*offset] submitted tez dag to app master: application_1452785619001_0005, with dag id: dag_1452785619001_0005_1
2016-01-14 15:35:07,216 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0004_01_000002 is : 143
2016-01-14 15:35:08,204 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0004_01_000002
2016-01-14 15:35:09,826 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0004_01_000005 is : 143
2016-01-14 15:35:09,830 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0004_01_000004 is : 143
2016-01-14 15:35:21,964 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge1*offset*offset] completed in: 00:16.744, using cpu time: 00:07.510
2016-01-14 15:35:22,009 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testHashJoinMergeIntoHashJoinStreamedStreamed/multihashjoinintomergeintohashjoinfirstStreamedsecondStreamednoInterMerge
2016-01-14 15:35:22,043 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:35:22,044 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:35:22,107 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.037
2016-01-14 15:35:22,126 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.055
2016-01-14 15:35:22,127 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 5
2016-01-14 15:35:22,127 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 5
2016-01-14 15:35:22,127 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 15:35:22,203 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: F6D2AD4D27BB423D8444E618DB04A40A,D9D9C31ED8DA46F1A97C6089FFD1E37A and B742EE4E9EB643AD94856BE33F311F7D
2016-01-14 15:35:22,232 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: B742EE4E9EB643AD94856BE33F311F7D,A62A36BB80F64776BAF78D39A11BBFE9 and E7178B585AF0472C945B9F0B32E093CC
2016-01-14 15:35:22,233 INFO util.HadoopUtil (HadoopUtil.java:syncPaths(602)) - copying from: file:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar, to: hdfs://localhost:55538/user/teamcity/.staging/27E97FC4E54341BD9C89D607194DD9F5/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:35:22,262 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] starting
2016-01-14 15:35:22,262 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/upper.txt"]
2016-01-14 15:35:22,262 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower.txt"]
2016-01-14 15:35:22,262 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower-offset.txt"]
2016-01-14 15:35:22,263 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/mergepipesplatform/testSimpleMergeThreeChain/simplemergethreechain"]
2016-01-14 15:35:22,263 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] parallel execution of steps is enabled: true
2016-01-14 15:35:22,263 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] executing total steps: 1
2016-01-14 15:35:22,263 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] allocating management threads: 1
2016-01-14 15:35:22,264 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] starting step: (1/1) ...ain/simplemergethreechain
2016-01-14 15:35:22,280 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] tez session mode enabled: false
2016-01-14 15:35:22,283 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 15:35:22,296 INFO client.TezClient (TezClient.java:start(315)) - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs
2016-01-14 15:35:22,297 INFO client.TezClient (TezClient.java:submitDAGApplication(738)) - Submitting DAG application with id: application_1452785619001_0006
2016-01-14 15:35:22,297 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(171)) - Using tez.lib.uris value from configuration: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:35:22,307 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory hdfs://localhost:55538/user/teamcity/.staging/27E97FC4E54341BD9C89D607194DD9F5/EDBE384A5204426A8404DECA972D735D/.tez/application_1452785619001_0006 doesn't exist and is created
2016-01-14 15:35:22,369 INFO client.TezClient (TezClient.java:submitDAGApplication(759)) - Submitting DAG to YARN, applicationId=application_1452785619001_0006, dagName=[27E97FC4E54341BD9C89D607194DD9F5/EDBE384A5204426A8404DECA972D735D] merge+offset/(1/1) ...ain/simplemergethreechain
2016-01-14 15:35:22,373 INFO client.TezClient (TezClient.java:submitDAGApplication(765)) - The url to track the Tez AM: http://ip-10-187-41-40:46879/proxy/application_1452785619001_0006/
2016-01-14 15:35:22,386 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] submitted tez dag to app master: application_1452785619001_0006, with dag id: dag_1452785619001_0006_1
2016-01-14 15:35:27,009 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0005_01_000003 is : 143
2016-01-14 15:35:27,055 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0005_01_000002 is : 143
2016-01-14 15:35:27,992 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0005_01_000002
2016-01-14 15:35:27,993 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0005_01_000003
2016-01-14 15:35:41,694 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] completed in: 00:19.431, using cpu time: 00:10.790
2016-01-14 15:35:41,726 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testSimpleMergeThreeChain/simplemergethreechain
2016-01-14 15:35:41,765 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:35:41,765 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:35:41,791 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: UNSUPPORTED, in: 00:00.001
2016-01-14 15:35:41,855 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.065
2016-01-14 15:35:41,856 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] rule registry: NoHashJoinHadoop2TezRuleRegistry, does not support assembly
2016-01-14 15:35:41,857 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 5
2016-01-14 15:35:41,857 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] rule registry: HashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 15:35:42,056 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: CA239FFFE6444EA3A1B685F4EC56FEF1,ACF42DFAC39B44D4A024FCC34B0C7888 and E2767F58D785435D9FC0C4CDB2D99802
2016-01-14 15:35:42,058 INFO util.HadoopUtil (HadoopUtil.java:syncPaths(602)) - copying from: file:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar, to: hdfs://localhost:55538/user/teamcity/.staging/951841BA01D54D3ABB1271882FDD6823/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:35:42,085 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] starting
2016-01-14 15:35:42,086 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/upper.txt"]
2016-01-14 15:35:42,086 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower.txt"]
2016-01-14 15:35:42,086 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower-offset.txt"]
2016-01-14 15:35:42,086 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/mergepipesplatform/testHashJoinMergeIntoHashJoinStreamedAccumulated/multihashjoinintomergeintohashjoinfirstStreamedsecondAccumulatednoInterMerge"]
2016-01-14 15:35:42,087 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] parallel execution of steps is enabled: true
2016-01-14 15:35:42,087 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] executing total steps: 1
2016-01-14 15:35:42,087 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] allocating management threads: 1
2016-01-14 15:35:42,089 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] starting step: (1/1) ...ndAccumulatednoInterMerge
2016-01-14 15:35:42,110 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] tez session mode enabled: false
2016-01-14 15:35:42,114 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 15:35:42,134 INFO client.TezClient (TezClient.java:start(315)) - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs
2016-01-14 15:35:42,136 INFO client.TezClient (TezClient.java:submitDAGApplication(738)) - Submitting DAG application with id: application_1452785619001_0007
2016-01-14 15:35:42,136 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(171)) - Using tez.lib.uris value from configuration: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:35:42,147 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory hdfs://localhost:55538/user/teamcity/.staging/951841BA01D54D3ABB1271882FDD6823/A41A438EDED84C578552BA54C8162857/.tez/application_1452785619001_0007 doesn't exist and is created
2016-01-14 15:35:42,215 INFO client.TezClient (TezClient.java:submitDAGApplication(759)) - Submitting DAG to YARN, applicationId=application_1452785619001_0007, dagName=[951841BA01D54D3ABB1271882FDD6823/A41A438EDED84C578552BA54C8162857] offset*merge1*offset/(1/1) ...ndAccumulatednoInterMerge
2016-01-14 15:35:42,218 INFO client.TezClient (TezClient.java:submitDAGApplication(765)) - The url to track the Tez AM: http://ip-10-187-41-40:46879/proxy/application_1452785619001_0007/
2016-01-14 15:35:42,235 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] submitted tez dag to app master: application_1452785619001_0007, with dag id: dag_1452785619001_0007_1
2016-01-14 15:35:46,722 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0006_01_000003 is : 143
2016-01-14 15:35:46,748 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0006_01_000004 is : 143
2016-01-14 15:35:46,799 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0006_01_000002 is : 143
2016-01-14 15:35:47,718 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0006_01_000002
2016-01-14 15:35:47,718 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0006_01_000003
2016-01-14 15:35:47,718 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0006_01_000004
2016-01-14 15:35:52,721 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0007_01_000003
2016-01-14 15:35:53,825 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0007_01_000006
2016-01-14 15:36:00,245 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] completed in: 00:18.159, using cpu time: 00:11.040
2016-01-14 15:36:00,273 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testHashJoinMergeIntoHashJoinStreamedAccumulated/multihashjoinintomergeintohashjoinfirstStreamedsecondAccumulatednoInterMerge
2016-01-14 15:36:00,324 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:36:00,325 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:36:00,395 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.047
2016-01-14 15:36:00,406 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.058
2016-01-14 15:36:00,407 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 3
2016-01-14 15:36:00,407 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 3
2016-01-14 15:36:00,407 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 15:36:00,470 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: A701A170180E40B7A1821E172D3E4848,CDFABE3C9B7440AF887FC728FEFC3867 and F9593249335640E7B3B1238B664EFDC8
2016-01-14 15:36:00,471 INFO util.HadoopUtil (HadoopUtil.java:syncPaths(602)) - copying from: file:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar, to: hdfs://localhost:55538/user/teamcity/.staging/935CC09E314741E8B10C26F845AF0996/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:36:00,492 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged] starting
2016-01-14 15:36:00,492 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/apache.10.txt"]
2016-01-14 15:36:00,492 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/mergepipesplatform/testSplitSameSourceMerged/splitsourcemerged"]
2016-01-14 15:36:00,493 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged] parallel execution of steps is enabled: true
2016-01-14 15:36:00,494 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged] executing total steps: 1
2016-01-14 15:36:00,494 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged] allocating management threads: 1
2016-01-14 15:36:00,495 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged] starting step: (1/1) ...eMerged/splitsourcemerged
2016-01-14 15:36:00,509 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged] tez session mode enabled: false
2016-01-14 15:36:00,512 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 15:36:00,524 INFO client.TezClient (TezClient.java:start(315)) - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs
2016-01-14 15:36:00,525 INFO client.TezClient (TezClient.java:submitDAGApplication(738)) - Submitting DAG application with id: application_1452785619001_0008
2016-01-14 15:36:00,525 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(171)) - Using tez.lib.uris value from configuration: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:36:00,534 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory hdfs://localhost:55538/user/teamcity/.staging/935CC09E314741E8B10C26F845AF0996/A96361278B3D4C32B3FD71E79AD5F07A/.tez/application_1452785619001_0008 doesn't exist and is created
2016-01-14 15:36:00,599 INFO client.TezClient (TezClient.java:submitDAGApplication(759)) - Submitting DAG to YARN, applicationId=application_1452785619001_0008, dagName=[935CC09E314741E8B10C26F845AF0996/A96361278B3D4C32B3FD71E79AD5F07A] merged/(1/1) ...eMerged/splitsourcemerged
2016-01-14 15:36:00,802 INFO client.TezClient (TezClient.java:submitDAGApplication(765)) - The url to track the Tez AM: http://ip-10-187-41-40:46879/proxy/application_1452785619001_0008/
2016-01-14 15:36:00,837 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged] submitted tez dag to app master: application_1452785619001_0008, with dag id: dag_1452785619001_0008_1
2016-01-14 15:36:03,878 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0007_01_000004 is : 143
2016-01-14 15:36:04,859 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0007_01_000004
2016-01-14 15:36:05,287 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0007_01_000002 is : 143
2016-01-14 15:36:05,288 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0007_01_000005 is : 143
2016-01-14 15:36:06,274 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0007_01_000005
2016-01-14 15:36:06,829 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(847)) - Event EventType: FINISH_APPLICATION sent to absent application application_1452785619001_0007
2016-01-14 15:36:16,234 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged] completed in: 00:15.741, using cpu time: 00:06.320
2016-01-14 15:36:16,266 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testSplitSameSourceMerged/splitsourcemerged
2016-01-14 15:36:16,299 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:36:16,299 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:36:16,325 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: UNSUPPORTED, in: 00:00.001
2016-01-14 15:36:16,378 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.054
2016-01-14 15:36:16,379 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] rule registry: NoHashJoinHadoop2TezRuleRegistry, does not support assembly
2016-01-14 15:36:16,379 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 4
2016-01-14 15:36:16,380 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] rule registry: HashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 15:36:16,533 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: AB8594EBAB794AA0974EA89A75900B26,F9827A855BE8422AA2DE73FFF6281E6E and F75B817311E24D2CBA1CD73BF8282AD8
2016-01-14 15:36:16,534 INFO util.HadoopUtil (HadoopUtil.java:syncPaths(602)) - copying from: file:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar, to: hdfs://localhost:55538/user/teamcity/.staging/FEA86B2E25464586A4332556DE91C49A/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:36:16,559 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] starting
2016-01-14 15:36:16,560 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/upper.txt"]
2016-01-14 15:36:16,560 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower.txt"]
2016-01-14 15:36:16,561 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower-offset.txt"]
2016-01-14 15:36:16,561 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/mergepipesplatform/testHashJoinMergeIntoHashJoinStreamed/hashjoinintomergeintohashjoinstreamed"]
2016-01-14 15:36:16,561 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] parallel execution of steps is enabled: true
2016-01-14 15:36:16,563 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] executing total steps: 1
2016-01-14 15:36:16,563 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] allocating management threads: 1
2016-01-14 15:36:16,563 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] starting step: (1/1) ...mergeintohashjoinstreamed
2016-01-14 15:36:16,577 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] tez session mode enabled: false
2016-01-14 15:36:16,580 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 15:36:16,592 INFO client.TezClient (TezClient.java:start(315)) - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs
2016-01-14 15:36:16,593 INFO client.TezClient (TezClient.java:submitDAGApplication(738)) - Submitting DAG application with id: application_1452785619001_0009
2016-01-14 15:36:16,594 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(171)) - Using tez.lib.uris value from configuration: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:36:16,603 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory hdfs://localhost:55538/user/teamcity/.staging/FEA86B2E25464586A4332556DE91C49A/ADE834169BFB4002AE4A95235143AD03/.tez/application_1452785619001_0009 doesn't exist and is created
2016-01-14 15:36:16,660 INFO client.TezClient (TezClient.java:submitDAGApplication(759)) - Submitting DAG to YARN, applicationId=application_1452785619001_0009, dagName=[FEA86B2E25464586A4332556DE91C49A/ADE834169BFB4002AE4A95235143AD03] merge*offset/(1/1) ...mergeintohashjoinstreamed
2016-01-14 15:36:16,863 INFO client.TezClient (TezClient.java:submitDAGApplication(765)) - The url to track the Tez AM: http://ip-10-187-41-40:46879/proxy/application_1452785619001_0009/
2016-01-14 15:36:16,879 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] submitted tez dag to app master: application_1452785619001_0009, with dag id: dag_1452785619001_0009_1
2016-01-14 15:36:21,264 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0008_01_000003 is : 143
2016-01-14 15:36:21,297 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0008_01_000002 is : 143
2016-01-14 15:36:31,885 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] completed in: 00:15.325, using cpu time: 00:07.190
2016-01-14 15:36:31,913 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testHashJoinMergeIntoHashJoinStreamed/hashjoinintomergeintohashjoinstreamed
2016-01-14 15:36:31,943 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:36:31,943 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:36:31,972 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.005
2016-01-14 15:36:31,977 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.010
2016-01-14 15:36:31,978 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 15:36:31,978 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 15:36:31,978 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testSimpleMergeFail/simplemergefail
2016-01-14 15:36:32,025 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:36:32,026 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:36:32,095 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.046
2016-01-14 15:36:32,147 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.098
2016-01-14 15:36:32,149 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 6
2016-01-14 15:36:32,149 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 6
2016-01-14 15:36:32,150 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 15:36:32,229 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: BE79C39CB9DD4774A224AFCF92039859,A7D5AF18035F4E58BF431233C528A762 and F9C3CC3B6A9F4F34A27C1AB53DDA8C6E
2016-01-14 15:36:32,294 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: F9C3CC3B6A9F4F34A27C1AB53DDA8C6E,D5A9A07E5D974548B92CC319C7EBEDA6 and F9BDBC5541B44EC2B705375EF493B9D4
2016-01-14 15:36:32,296 INFO util.HadoopUtil (HadoopUtil.java:syncPaths(602)) - copying from: file:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar, to: hdfs://localhost:55538/user/teamcity/.staging/2BF5C3DF21054693B0A6034582CAA2C4/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:36:32,330 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] starting
2016-01-14 15:36:32,331 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/upper.txt"]
2016-01-14 15:36:32,331 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower.txt"]
2016-01-14 15:36:32,331 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower-offset.txt"]
2016-01-14 15:36:32,331 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/mergepipesplatform/testSimpleMergeThreeChainGroup/simplemergethreechaingroup"]
2016-01-14 15:36:32,332 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] parallel execution of steps is enabled: true
2016-01-14 15:36:32,332 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] executing total steps: 1
2016-01-14 15:36:32,332 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] allocating management threads: 1
2016-01-14 15:36:32,333 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] starting step: (1/1) ...implemergethreechaingroup
2016-01-14 15:36:32,352 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] tez session mode enabled: false
2016-01-14 15:36:32,356 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 15:36:32,375 INFO client.TezClient (TezClient.java:start(315)) - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs
2016-01-14 15:36:32,376 INFO client.TezClient (TezClient.java:submitDAGApplication(738)) - Submitting DAG application with id: application_1452785619001_0010
2016-01-14 15:36:32,376 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(171)) - Using tez.lib.uris value from configuration: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:36:32,389 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory hdfs://localhost:55538/user/teamcity/.staging/2BF5C3DF21054693B0A6034582CAA2C4/E859EC7002AB46F595068C614FF00D01/.tez/application_1452785619001_0010 doesn't exist and is created
2016-01-14 15:36:32,475 INFO client.TezClient (TezClient.java:submitDAGApplication(759)) - Submitting DAG to YARN, applicationId=application_1452785619001_0010, dagName=[2BF5C3DF21054693B0A6034582CAA2C4/E859EC7002AB46F595068C614FF00D01] merge+offset/(1/1) ...implemergethreechaingroup
2016-01-14 15:36:32,479 INFO client.TezClient (TezClient.java:submitDAGApplication(765)) - The url to track the Tez AM: http://ip-10-187-41-40:46879/proxy/application_1452785619001_0010/
2016-01-14 15:36:32,493 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] submitted tez dag to app master: application_1452785619001_0010, with dag id: dag_1452785619001_0010_1
2016-01-14 15:36:36,935 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0009_01_000003 is : 143
2016-01-14 15:36:36,997 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0009_01_000002 is : 143
2016-01-14 15:36:52,680 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] completed in: 00:20.349, using cpu time: 00:10.870
2016-01-14 15:36:52,708 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testSimpleMergeThreeChainGroup/simplemergethreechaingroup
2016-01-14 15:36:52,738 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:36:52,738 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:36:52,778 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: UNSUPPORTED, in: 00:00.001
2016-01-14 15:36:52,833 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.056
2016-01-14 15:36:52,834 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] rule registry: NoHashJoinHadoop2TezRuleRegistry, does not support assembly
2016-01-14 15:36:52,835 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 5
2016-01-14 15:36:52,835 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] rule registry: HashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 15:36:52,985 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: DB5D6990B513416C8A1B5A16FFCF9FEF,D21547D3E04E471FB37248415F9AE17B and BA5B064A7AB6426FB98C39EDEBCD0CC3
2016-01-14 15:36:53,013 INFO util.HadoopUtil (HadoopUtil.java:syncPaths(602)) - copying from: file:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar, to: hdfs://localhost:55538/user/teamcity/.staging/9A464219066B4584976F01A30A0F4226/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:36:53,038 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] starting
2016-01-14 15:36:53,038 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/upper.txt"]
2016-01-14 15:36:53,039 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower.txt"]
2016-01-14 15:36:53,039 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower-offset.txt"]
2016-01-14 15:36:53,039 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/mergepipesplatform/testHashJoinMergeIntoHashJoinAccumulatedStreamed/multihashjoinintomergeintohashjoinfirstAccumulatedsecondStreamednoInterMerge"]
2016-01-14 15:36:53,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] parallel execution of steps is enabled: true
2016-01-14 15:36:53,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] executing total steps: 1
2016-01-14 15:36:53,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] allocating management threads: 1
2016-01-14 15:36:53,041 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] starting step: (1/1) ...econdStreamednoInterMerge
2016-01-14 15:36:53,055 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] tez session mode enabled: false
2016-01-14 15:36:53,058 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 15:36:53,070 INFO client.TezClient (TezClient.java:start(315)) - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs
2016-01-14 15:36:53,072 INFO client.TezClient (TezClient.java:submitDAGApplication(738)) - Submitting DAG application with id: application_1452785619001_0011
2016-01-14 15:36:53,072 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(171)) - Using tez.lib.uris value from configuration: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:36:53,081 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory hdfs://localhost:55538/user/teamcity/.staging/9A464219066B4584976F01A30A0F4226/EB7E490DEDAE45838A9F9488CAB00AFF/.tez/application_1452785619001_0011 doesn't exist and is created
2016-01-14 15:36:53,141 INFO client.TezClient (TezClient.java:submitDAGApplication(759)) - Submitting DAG to YARN, applicationId=application_1452785619001_0011, dagName=[9A464219066B4584976F01A30A0F4226/EB7E490DEDAE45838A9F9488CAB00AFF] offset*merge1*offset/(1/1) ...econdStreamednoInterMerge
2016-01-14 15:36:53,144 INFO client.TezClient (TezClient.java:submitDAGApplication(765)) - The url to track the Tez AM: http://ip-10-187-41-40:46879/proxy/application_1452785619001_0011/
2016-01-14 15:36:53,157 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] submitted tez dag to app master: application_1452785619001_0011, with dag id: dag_1452785619001_0011_1
2016-01-14 15:36:57,719 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0010_01_000002 is : 143
2016-01-14 15:36:57,762 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0010_01_000004 is : 143
2016-01-14 15:36:57,794 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0010_01_000003 is : 143
2016-01-14 15:36:58,709 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0010_01_000002
2016-01-14 15:36:58,709 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0010_01_000003
2016-01-14 15:36:58,709 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0010_01_000004
2016-01-14 15:37:12,719 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge1*offset] completed in: 00:19.680, using cpu time: 00:11.070
2016-01-14 15:37:12,747 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testHashJoinMergeIntoHashJoinAccumulatedStreamed/multihashjoinintomergeintohashjoinfirstAccumulatedsecondStreamednoInterMerge
2016-01-14 15:37:12,775 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:37:12,775 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:37:12,799 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: UNSUPPORTED, in: 00:00.000
2016-01-14 15:37:12,831 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.032
2016-01-14 15:37:12,832 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] rule registry: NoHashJoinHadoop2TezRuleRegistry, does not support assembly
2016-01-14 15:37:12,833 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 3
2016-01-14 15:37:12,833 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] rule registry: HashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 15:37:12,924 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: C1D618CBBB404B5999121EEA6E6D94BE,DA886FE40BBF4BC1B967DFEDB4BC76EE and FCF698B4DB744D5599B3880C02CC0D58
2016-01-14 15:37:12,925 INFO util.HadoopUtil (HadoopUtil.java:syncPaths(602)) - copying from: file:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar, to: hdfs://localhost:55538/user/teamcity/.staging/6C9232BDBC614BE294CA712EE4FD9445/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:37:12,947 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] starting
2016-01-14 15:37:12,947 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/upper.txt"]
2016-01-14 15:37:12,948 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower.txt"]
2016-01-14 15:37:12,948 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower-offset.txt"]
2016-01-14 15:37:12,948 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/mergepipesplatform/testMergeIntoHashJoinStreamed/mergeintohashjoinstreamed"]
2016-01-14 15:37:12,949 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] parallel execution of steps is enabled: true
2016-01-14 15:37:12,949 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] executing total steps: 1
2016-01-14 15:37:12,949 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] allocating management threads: 1
2016-01-14 15:37:12,952 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] starting step: (1/1) ...mergeintohashjoinstreamed
2016-01-14 15:37:12,973 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] tez session mode enabled: false
2016-01-14 15:37:12,980 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 15:37:13,002 INFO client.TezClient (TezClient.java:start(315)) - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs
2016-01-14 15:37:13,004 INFO client.TezClient (TezClient.java:submitDAGApplication(738)) - Submitting DAG application with id: application_1452785619001_0012
2016-01-14 15:37:13,004 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(171)) - Using tez.lib.uris value from configuration: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:37:13,014 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory hdfs://localhost:55538/user/teamcity/.staging/6C9232BDBC614BE294CA712EE4FD9445/A3C2FCE7B027429FB2BE24F451470BA2/.tez/application_1452785619001_0012 doesn't exist and is created
2016-01-14 15:37:13,074 INFO client.TezClient (TezClient.java:submitDAGApplication(759)) - Submitting DAG to YARN, applicationId=application_1452785619001_0012, dagName=[6C9232BDBC614BE294CA712EE4FD9445/A3C2FCE7B027429FB2BE24F451470BA2] merge*offset/(1/1) ...mergeintohashjoinstreamed
2016-01-14 15:37:13,077 INFO client.TezClient (TezClient.java:submitDAGApplication(765)) - The url to track the Tez AM: http://ip-10-187-41-40:46879/proxy/application_1452785619001_0012/
2016-01-14 15:37:13,089 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] submitted tez dag to app master: application_1452785619001_0012, with dag id: dag_1452785619001_0012_1
2016-01-14 15:37:17,754 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0011_01_000002 is : 143
2016-01-14 15:37:17,785 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0011_01_000004 is : 143
2016-01-14 15:37:17,812 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0011_01_000003 is : 143
2016-01-14 15:37:18,751 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0011_01_000002
2016-01-14 15:37:18,752 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0011_01_000003
2016-01-14 15:37:18,752 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0011_01_000004
2016-01-14 15:37:27,164 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] completed in: 00:14.216, using cpu time: 00:06.510
2016-01-14 15:37:27,192 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testMergeIntoHashJoinStreamed/mergeintohashjoinstreamed
2016-01-14 15:37:27,227 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:37:27,228 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:37:27,271 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-01-14 15:37:27,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.040
2016-01-14 15:37:27,291 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 5
2016-01-14 15:37:27,291 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 5
2016-01-14 15:37:27,291 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 15:37:27,374 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: B7B9E149D4574147B2515F4D2A951B79,FC4E268945CB42F493EC1E9444665B84 and AB36AF5CDDCF4DA7BDECCF3C88B83F30
2016-01-14 15:37:27,449 INFO util.HadoopUtil (HadoopUtil.java:syncPaths(602)) - copying from: file:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar, to: hdfs://localhost:55538/user/teamcity/.staging/BE95BB140FB84310A48A59473472125E/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:37:27,473 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] starting
2016-01-14 15:37:27,473 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/upper.txt"]
2016-01-14 15:37:27,473 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower.txt"]
2016-01-14 15:37:27,474 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower-offset.txt"]
2016-01-14 15:37:27,474 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/mergepipesplatform/testSimpleMergeThreeChainCoGroup/simplemergethreechaincogroup"]
2016-01-14 15:37:27,478 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] parallel execution of steps is enabled: true
2016-01-14 15:37:27,478 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] executing total steps: 1
2016-01-14 15:37:27,478 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] allocating management threads: 1
2016-01-14 15:37:27,480 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] starting step: (1/1) ...plemergethreechaincogroup
2016-01-14 15:37:27,494 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] tez session mode enabled: false
2016-01-14 15:37:27,497 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 15:37:27,510 INFO client.TezClient (TezClient.java:start(315)) - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs
2016-01-14 15:37:27,511 INFO client.TezClient (TezClient.java:submitDAGApplication(738)) - Submitting DAG application with id: application_1452785619001_0013
2016-01-14 15:37:27,511 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(171)) - Using tez.lib.uris value from configuration: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:37:27,520 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory hdfs://localhost:55538/user/teamcity/.staging/BE95BB140FB84310A48A59473472125E/EDD8A020668A42D8971D19C22EE46AB2/.tez/application_1452785619001_0013 doesn't exist and is created
2016-01-14 15:37:27,581 INFO client.TezClient (TezClient.java:submitDAGApplication(759)) - Submitting DAG to YARN, applicationId=application_1452785619001_0013, dagName=[BE95BB140FB84310A48A59473472125E/EDD8A020668A42D8971D19C22EE46AB2] merge*offset/(1/1) ...plemergethreechaincogroup
2016-01-14 15:37:27,783 INFO client.TezClient (TezClient.java:submitDAGApplication(765)) - The url to track the Tez AM: http://ip-10-187-41-40:46879/proxy/application_1452785619001_0013/
2016-01-14 15:37:27,799 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] submitted tez dag to app master: application_1452785619001_0013, with dag id: dag_1452785619001_0013_1
2016-01-14 15:37:32,206 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0012_01_000003 is : 143
2016-01-14 15:37:32,238 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0012_01_000002 is : 143
2016-01-14 15:37:45,002 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge*offset] completed in: 00:17.528, using cpu time: 00:10.700
2016-01-14 15:37:45,031 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testSimpleMergeThreeChainCoGroup/simplemergethreechaincogroup
2016-01-14 15:37:45,069 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:37:45,070 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:37:45,148 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.053
2016-01-14 15:37:45,166 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.071
2016-01-14 15:37:45,167 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 6
2016-01-14 15:37:45,167 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 6
2016-01-14 15:37:45,168 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 15:37:45,318 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: BF59E39F26CC4D33BCB5F61EC6CD67BA,ADB77DFAD1054B589549EF18B93CB23E and D4B79EB2FDA7466E92691A36D00BB066
2016-01-14 15:37:45,346 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: B62DCB4562DD4BE8AB1A0081D0977D02,ADB77DFAD1054B589549EF18B93CB23E and DA46A834070D4A60BB4283690447D801
2016-01-14 15:37:45,396 INFO util.HadoopUtil (HadoopUtil.java:syncPaths(602)) - copying from: file:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar, to: hdfs://localhost:55538/user/teamcity/.staging/3E5397D77257459B92F1D2E9568DAE48/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:37:45,418 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] starting
2016-01-14 15:37:45,418 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower.txt"]
2016-01-14 15:37:45,418 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/mergepipesplatform/testSameSourceMergeThreeChainGroup/samemergethreechaingroup"]
2016-01-14 15:37:45,419 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] parallel execution of steps is enabled: true
2016-01-14 15:37:45,419 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] executing total steps: 1
2016-01-14 15:37:45,419 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] allocating management threads: 1
2016-01-14 15:37:45,420 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] starting step: (1/1) .../samemergethreechaingroup
2016-01-14 15:37:45,433 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] tez session mode enabled: false
2016-01-14 15:37:45,436 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 15:37:45,448 INFO client.TezClient (TezClient.java:start(315)) - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs
2016-01-14 15:37:45,450 INFO client.TezClient (TezClient.java:submitDAGApplication(738)) - Submitting DAG application with id: application_1452785619001_0014
2016-01-14 15:37:45,450 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(171)) - Using tez.lib.uris value from configuration: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:37:45,459 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory hdfs://localhost:55538/user/teamcity/.staging/3E5397D77257459B92F1D2E9568DAE48/AFC75755C3274E24A70A966DDC8B1605/.tez/application_1452785619001_0014 doesn't exist and is created
2016-01-14 15:37:45,524 INFO client.TezClient (TezClient.java:submitDAGApplication(759)) - Submitting DAG to YARN, applicationId=application_1452785619001_0014, dagName=[3E5397D77257459B92F1D2E9568DAE48/AFC75755C3274E24A70A966DDC8B1605] merge+offset/(1/1) .../samemergethreechaingroup
2016-01-14 15:37:45,527 INFO client.TezClient (TezClient.java:submitDAGApplication(765)) - The url to track the Tez AM: http://ip-10-187-41-40:46879/proxy/application_1452785619001_0014/
2016-01-14 15:37:45,541 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] submitted tez dag to app master: application_1452785619001_0014, with dag id: dag_1452785619001_0014_1
2016-01-14 15:37:49,739 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0013_01_000004 is : 143
2016-01-14 15:37:50,029 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0013_01_000003 is : 143
2016-01-14 15:37:50,059 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0013_01_000002 is : 143
2016-01-14 15:38:03,429 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge+offset] completed in: 00:18.010, using cpu time: 00:07.980
2016-01-14 15:38:03,456 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testSameSourceMergeThreeChainGroup/samemergethreechaingroup
2016-01-14 15:38:03,486 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:38:03,486 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:38:03,518 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: UNSUPPORTED, in: 00:00.001
2016-01-14 15:38:03,576 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.058
2016-01-14 15:38:03,576 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] rule registry: NoHashJoinHadoop2TezRuleRegistry, does not support assembly
2016-01-14 15:38:03,577 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 6
2016-01-14 15:38:03,577 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] rule registry: HashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 15:38:03,699 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: A86D2DAD3F7144AC8F1CB4CEA8286583,CF17EDE337384C99B0C31CAB5F7A80E4 and D06BF4EE1EF5490AA7DF4C467D86E971
2016-01-14 15:38:03,724 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: A86D2DAD3F7144AC8F1CB4CEA8286583,FCDEF0B592584326A11C1A04771470EB and D3F279CC17F44681813BCD8B036591A8
2016-01-14 15:38:03,786 INFO util.HadoopUtil (HadoopUtil.java:syncPaths(602)) - copying from: file:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar, to: hdfs://localhost:55538/user/teamcity/.staging/6A8F8F9D3A0C4096B5C6E73F7EC0F7D7/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:38:03,805 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] starting
2016-01-14 15:38:03,806 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/upper.txt"]
2016-01-14 15:38:03,806 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower.txt"]
2016-01-14 15:38:03,806 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower-offset.txt"]
2016-01-14 15:38:03,806 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/mergepipesplatform/testHashJoinMergeIntoHashJoinAccumulatedStreamedMerge/multihashjoinintomergeintohashjoinfirstAccumulatedsecondStreamedinterMerge"]
2016-01-14 15:38:03,807 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] parallel execution of steps is enabled: true
2016-01-14 15:38:03,807 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] executing total steps: 1
2016-01-14 15:38:03,807 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] allocating management threads: 1
2016-01-14 15:38:03,808 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] starting step: (1/1) ...dsecondStreamedinterMerge
2016-01-14 15:38:03,822 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] tez session mode enabled: false
2016-01-14 15:38:03,825 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 15:38:03,837 INFO client.TezClient (TezClient.java:start(315)) - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs
2016-01-14 15:38:03,839 INFO client.TezClient (TezClient.java:submitDAGApplication(738)) - Submitting DAG application with id: application_1452785619001_0015
2016-01-14 15:38:03,839 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(171)) - Using tez.lib.uris value from configuration: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:38:03,848 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory hdfs://localhost:55538/user/teamcity/.staging/6A8F8F9D3A0C4096B5C6E73F7EC0F7D7/EA7AD81C3A3448CD9C609879EEA83AF7/.tez/application_1452785619001_0015 doesn't exist and is created
2016-01-14 15:38:03,916 INFO client.TezClient (TezClient.java:submitDAGApplication(759)) - Submitting DAG to YARN, applicationId=application_1452785619001_0015, dagName=[6A8F8F9D3A0C4096B5C6E73F7EC0F7D7/EA7AD81C3A3448CD9C609879EEA83AF7] merge2*offset/(1/1) ...dsecondStreamedinterMerge
2016-01-14 15:38:04,118 INFO client.TezClient (TezClient.java:submitDAGApplication(765)) - The url to track the Tez AM: http://ip-10-187-41-40:46879/proxy/application_1452785619001_0015/
2016-01-14 15:38:04,132 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] submitted tez dag to app master: application_1452785619001_0015, with dag id: dag_1452785619001_0015_1
2016-01-14 15:38:08,464 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0014_01_000003 is : 143
2016-01-14 15:38:08,493 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0014_01_000002 is : 143
2016-01-14 15:38:09,457 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0014_01_000002
2016-01-14 15:38:09,457 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0014_01_000003
2016-01-14 15:38:23,897 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merge2*offset] completed in: 00:20.091, using cpu time: 00:11.920
2016-01-14 15:38:23,925 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testHashJoinMergeIntoHashJoinAccumulatedStreamedMerge/multihashjoinintomergeintohashjoinfirstAccumulatedsecondStreamedinterMerge
2016-01-14 15:38:23,952 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:38:23,952 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:38:23,985 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: UNSUPPORTED, in: 00:00.000
2016-01-14 15:38:24,012 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.027
2016-01-14 15:38:24,013 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] rule registry: NoHashJoinHadoop2TezRuleRegistry, does not support assembly
2016-01-14 15:38:24,013 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 3
2016-01-14 15:38:24,014 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] rule registry: HashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 15:38:24,093 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: D96C6A832C65432FA9DD94ABAE14018C,B951F90446914A00BE7AEAE5BA83C12D and FFC4E3ADC68A493E9BB2529DE3244483
2016-01-14 15:38:24,094 INFO util.HadoopUtil (HadoopUtil.java:syncPaths(602)) - copying from: file:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar, to: hdfs://localhost:55538/user/teamcity/.staging/B0C781DA83A44015A7DF18EF3F3B9C02/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:38:24,117 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] starting
2016-01-14 15:38:24,117 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/upper.txt"]
2016-01-14 15:38:24,117 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower.txt"]
2016-01-14 15:38:24,118 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower-offset.txt"]
2016-01-14 15:38:24,118 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/mergepipesplatform/testMergeIntoHashJoinAccumulated/mergeintohashjoinaccumulated"]
2016-01-14 15:38:24,119 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] parallel execution of steps is enabled: true
2016-01-14 15:38:24,119 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] executing total steps: 1
2016-01-14 15:38:24,119 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] allocating management threads: 1
2016-01-14 15:38:24,120 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] starting step: (1/1) ...geintohashjoinaccumulated
2016-01-14 15:38:24,134 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] tez session mode enabled: false
2016-01-14 15:38:24,137 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 15:38:24,149 INFO client.TezClient (TezClient.java:start(315)) - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs
2016-01-14 15:38:24,151 INFO client.TezClient (TezClient.java:submitDAGApplication(738)) - Submitting DAG application with id: application_1452785619001_0016
2016-01-14 15:38:24,152 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(171)) - Using tez.lib.uris value from configuration: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:38:24,165 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory hdfs://localhost:55538/user/teamcity/.staging/B0C781DA83A44015A7DF18EF3F3B9C02/EAECB9BA89F845BDAABE8F4E6BA92E99/.tez/application_1452785619001_0016 doesn't exist and is created
2016-01-14 15:38:24,225 INFO client.TezClient (TezClient.java:submitDAGApplication(759)) - Submitting DAG to YARN, applicationId=application_1452785619001_0016, dagName=[B0C781DA83A44015A7DF18EF3F3B9C02/EAECB9BA89F845BDAABE8F4E6BA92E99] offset*merge/(1/1) ...geintohashjoinaccumulated
2016-01-14 15:38:24,229 INFO client.TezClient (TezClient.java:submitDAGApplication(765)) - The url to track the Tez AM: http://ip-10-187-41-40:46879/proxy/application_1452785619001_0016/
2016-01-14 15:38:24,242 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] submitted tez dag to app master: application_1452785619001_0016, with dag id: dag_1452785619001_0016_1
2016-01-14 15:38:28,949 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0015_01_000004 is : 143
2016-01-14 15:38:28,980 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0015_01_000003 is : 143
2016-01-14 15:38:29,001 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0015_01_000002 is : 143
2016-01-14 15:38:42,452 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] completed in: 00:18.334, using cpu time: 00:10.180
2016-01-14 15:38:42,490 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testMergeIntoHashJoinAccumulated/mergeintohashjoinaccumulated
2016-01-14 15:38:42,524 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:38:42,525 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:38:42,597 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged-second] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.037
2016-01-14 15:38:42,614 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged-second] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.054
2016-01-14 15:38:42,615 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged-second] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 5
2016-01-14 15:38:42,615 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged-second] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 5
2016-01-14 15:38:42,615 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged-second] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 15:38:42,682 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: F0B9E705160646EE8E10B3081B0EED71,EB456A97F4784F158D69BE8948CE7CC3 and B62FF509FE0D47C493D5FC9FE43283B9
2016-01-14 15:38:42,719 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: A0A730198E0B488CA2728FC21A7F811C,FE59B55E62A84558BD8FA183D1ECC405 and F0B9E705160646EE8E10B3081B0EED71
2016-01-14 15:38:42,744 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: A0A730198E0B488CA2728FC21A7F811C,FE59B55E62A84558BD8FA183D1ECC405 and EB456A97F4784F158D69BE8948CE7CC3
2016-01-14 15:38:42,745 INFO util.HadoopUtil (HadoopUtil.java:syncPaths(602)) - copying from: file:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar, to: hdfs://localhost:55538/user/teamcity/.staging/0BCDDEBC72EB4A798DF057A939F215BF/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:38:42,767 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged-second] starting
2016-01-14 15:38:42,767 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged-second] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/apache.10.txt"]
2016-01-14 15:38:42,768 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged-second] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/mergepipesplatform/testSplitSameSourceMergedComplex/splitsourcemergedcomplex"]
2016-01-14 15:38:42,769 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged-second] parallel execution of steps is enabled: true
2016-01-14 15:38:42,769 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged-second] executing total steps: 1
2016-01-14 15:38:42,769 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged-second] allocating management threads: 1
2016-01-14 15:38:42,770 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged-second] starting step: (1/1) .../splitsourcemergedcomplex
2016-01-14 15:38:42,783 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged-second] tez session mode enabled: false
2016-01-14 15:38:42,786 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 15:38:42,799 INFO client.TezClient (TezClient.java:start(315)) - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs
2016-01-14 15:38:42,800 INFO client.TezClient (TezClient.java:submitDAGApplication(738)) - Submitting DAG application with id: application_1452785619001_0017
2016-01-14 15:38:42,801 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(171)) - Using tez.lib.uris value from configuration: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:38:42,810 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory hdfs://localhost:55538/user/teamcity/.staging/0BCDDEBC72EB4A798DF057A939F215BF/A063B9F4AA2B433A8CB69FC362D5CAA3/.tez/application_1452785619001_0017 doesn't exist and is created
2016-01-14 15:38:42,881 INFO client.TezClient (TezClient.java:submitDAGApplication(759)) - Submitting DAG to YARN, applicationId=application_1452785619001_0017, dagName=[0BCDDEBC72EB4A798DF057A939F215BF/A063B9F4AA2B433A8CB69FC362D5CAA3] merged-second/(1/1) .../splitsourcemergedcomplex
2016-01-14 15:38:42,884 INFO client.TezClient (TezClient.java:submitDAGApplication(765)) - The url to track the Tez AM: http://ip-10-187-41-40:46879/proxy/application_1452785619001_0017/
2016-01-14 15:38:42,896 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged-second] submitted tez dag to app master: application_1452785619001_0017, with dag id: dag_1452785619001_0017_1
2016-01-14 15:38:47,479 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0016_01_000002 is : 143
2016-01-14 15:38:47,510 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0016_01_000004 is : 143
2016-01-14 15:38:47,552 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0016_01_000003 is : 143
2016-01-14 15:38:48,473 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0016_01_000002
2016-01-14 15:38:48,473 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0016_01_000003
2016-01-14 15:38:48,473 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0016_01_000004
2016-01-14 15:38:59,836 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [merged-second] completed in: 00:17.068, using cpu time: 00:07.420
2016-01-14 15:38:59,865 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testSplitSameSourceMergedComplex/splitsourcemergedcomplex
2016-01-14 15:38:59,892 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:38:59,893 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:38:59,915 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: UNSUPPORTED, in: 00:00.001
2016-01-14 15:38:59,960 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.046
2016-01-14 15:38:59,960 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] rule registry: NoHashJoinHadoop2TezRuleRegistry, does not support assembly
2016-01-14 15:38:59,961 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 4
2016-01-14 15:38:59,961 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] rule registry: HashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 15:39:00,074 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: D3870453CE3449C1B6CA9566047F0E15,BB2FC3B188764A6EAD08C0B54BB143AF and A59057E17BE94F5FA26DA18EE6BB66FA
2016-01-14 15:39:00,075 INFO util.HadoopUtil (HadoopUtil.java:syncPaths(602)) - copying from: file:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar, to: hdfs://localhost:55538/user/teamcity/.staging/17867E0E7A6E4FD281D59FEC8787BED5/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:39:00,109 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] starting
2016-01-14 15:39:00,109 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/upper.txt"]
2016-01-14 15:39:00,109 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower.txt"]
2016-01-14 15:39:00,109 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower-offset.txt"]
2016-01-14 15:39:00,109 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/mergepipesplatform/testHashJoinMergeIntoHashJoinAccumulated/hashjoinintomergeintohashjoinaccumulated"]
2016-01-14 15:39:00,110 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] parallel execution of steps is enabled: true
2016-01-14 15:39:00,110 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] executing total steps: 1
2016-01-14 15:39:00,110 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] allocating management threads: 1
2016-01-14 15:39:00,111 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] starting step: (1/1) ...geintohashjoinaccumulated
2016-01-14 15:39:00,125 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] tez session mode enabled: false
2016-01-14 15:39:00,130 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 15:39:00,142 INFO client.TezClient (TezClient.java:start(315)) - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs
2016-01-14 15:39:00,143 INFO client.TezClient (TezClient.java:submitDAGApplication(738)) - Submitting DAG application with id: application_1452785619001_0018
2016-01-14 15:39:00,143 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(171)) - Using tez.lib.uris value from configuration: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:39:00,153 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory hdfs://localhost:55538/user/teamcity/.staging/17867E0E7A6E4FD281D59FEC8787BED5/FAB4C3B7CBA440A89098210775D9AD71/.tez/application_1452785619001_0018 doesn't exist and is created
2016-01-14 15:39:00,218 INFO client.TezClient (TezClient.java:submitDAGApplication(759)) - Submitting DAG to YARN, applicationId=application_1452785619001_0018, dagName=[17867E0E7A6E4FD281D59FEC8787BED5/FAB4C3B7CBA440A89098210775D9AD71] offset*merge/(1/1) ...geintohashjoinaccumulated
2016-01-14 15:39:00,222 INFO client.TezClient (TezClient.java:submitDAGApplication(765)) - The url to track the Tez AM: http://ip-10-187-41-40:46879/proxy/application_1452785619001_0018/
2016-01-14 15:39:00,235 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] submitted tez dag to app master: application_1452785619001_0018, with dag id: dag_1452785619001_0018_1
2016-01-14 15:39:04,866 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0017_01_000002 is : 143
2016-01-14 15:39:04,904 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0017_01_000003 is : 143
2016-01-14 15:39:05,864 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0017_01_000002
2016-01-14 15:39:05,864 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0017_01_000003
2016-01-14 15:39:17,677 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge] completed in: 00:17.564, using cpu time: 00:10.140
2016-01-14 15:39:17,704 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testHashJoinMergeIntoHashJoinAccumulated/hashjoinintomergeintohashjoinaccumulated
2016-01-14 15:39:17,737 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:39:17,738 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:39:17,761 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*offset*merge1] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: UNSUPPORTED, in: 00:00.001
2016-01-14 15:39:17,843 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*offset*merge1] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.083
2016-01-14 15:39:17,844 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*offset*merge1] rule registry: NoHashJoinHadoop2TezRuleRegistry, does not support assembly
2016-01-14 15:39:17,844 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*offset*merge1] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 5
2016-01-14 15:39:17,844 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*offset*merge1] rule registry: HashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 15:39:17,964 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: BB9CE712EDEE4CD6AA691AC25C10A29D,F4C030A1F6ED4EEF9C5E76D538C5DA7A and F20E7B431C6D4329B41989DE10ACF8E8
2016-01-14 15:39:18,015 INFO util.HadoopUtil (HadoopUtil.java:syncPaths(602)) - copying from: file:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar, to: hdfs://localhost:55538/user/teamcity/.staging/A9F491B1E7E940F5907A4044E79DF557/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:39:18,039 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*offset*merge1] starting
2016-01-14 15:39:18,039 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*offset*merge1] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/upper.txt"]
2016-01-14 15:39:18,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*offset*merge1] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower.txt"]
2016-01-14 15:39:18,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*offset*merge1] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower-offset.txt"]
2016-01-14 15:39:18,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*offset*merge1] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/mergepipesplatform/testHashJoinMergeIntoHashJoinAccumulatedAccumulated/multihashjoinintomergeintohashjoinfirstAccumulatedsecondAccumulatednoInterMerge"]
2016-01-14 15:39:18,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*offset*merge1] parallel execution of steps is enabled: true
2016-01-14 15:39:18,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*offset*merge1] executing total steps: 1
2016-01-14 15:39:18,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*offset*merge1] allocating management threads: 1
2016-01-14 15:39:18,041 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*offset*merge1] starting step: (1/1) ...ndAccumulatednoInterMerge
2016-01-14 15:39:18,056 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*offset*merge1] tez session mode enabled: false
2016-01-14 15:39:18,061 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 15:39:18,082 INFO client.TezClient (TezClient.java:start(315)) - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs
2016-01-14 15:39:18,083 INFO client.TezClient (TezClient.java:submitDAGApplication(738)) - Submitting DAG application with id: application_1452785619001_0019
2016-01-14 15:39:18,083 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(171)) - Using tez.lib.uris value from configuration: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:39:18,092 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory hdfs://localhost:55538/user/teamcity/.staging/A9F491B1E7E940F5907A4044E79DF557/EDEA93FF2CCB4AD8BBA92B0C2AE51BE5/.tez/application_1452785619001_0019 doesn't exist and is created
2016-01-14 15:39:18,151 INFO client.TezClient (TezClient.java:submitDAGApplication(759)) - Submitting DAG to YARN, applicationId=application_1452785619001_0019, dagName=[A9F491B1E7E940F5907A4044E79DF557/EDEA93FF2CCB4AD8BBA92B0C2AE51BE5] offset*offset*merge1/(1/1) ...ndAccumulatednoInterMerge
2016-01-14 15:39:18,153 INFO client.TezClient (TezClient.java:submitDAGApplication(765)) - The url to track the Tez AM: http://ip-10-187-41-40:46879/proxy/application_1452785619001_0019/
2016-01-14 15:39:18,165 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*offset*merge1] submitted tez dag to app master: application_1452785619001_0019, with dag id: dag_1452785619001_0019_1
2016-01-14 15:39:21,947 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0018_01_000002 is : 143
2016-01-14 15:39:22,702 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0018_01_000003 is : 143
2016-01-14 15:39:22,716 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0018_01_000002
2016-01-14 15:39:22,726 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0018_01_000004 is : 143
2016-01-14 15:39:23,688 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0018_01_000003
2016-01-14 15:39:23,689 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0018_01_000004
2016-01-14 15:39:39,895 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*offset*merge1] completed in: 00:21.855, using cpu time: 00:14.890
2016-01-14 15:39:39,922 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testHashJoinMergeIntoHashJoinAccumulatedAccumulated/multihashjoinintomergeintohashjoinfirstAccumulatedsecondAccumulatednoInterMerge
2016-01-14 15:39:39,949 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 15:39:39,950 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:39:39,985 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: UNSUPPORTED, in: 00:00.001
2016-01-14 15:39:40,060 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.075
2016-01-14 15:39:40,061 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] rule registry: NoHashJoinHadoop2TezRuleRegistry, does not support assembly
2016-01-14 15:39:40,061 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 6
2016-01-14 15:39:40,062 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] rule registry: HashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 15:39:40,306 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: E8A985E9221E4981B0F70F824200AF8D,BE24E38BC5EE4BF28A384740AC6DBEB1 and F3D37F7F7CBC46CDBE56F26A262ABC34
2016-01-14 15:39:40,331 INFO tez.Hadoop2TezFlowStep (Hadoop2TezFlowStep.java:createDAG(264)) - adding grouped edge between: C5657C765766448F8961F5F2E08D1BAD,BE24E38BC5EE4BF28A384740AC6DBEB1 and DA46F580C23C45319E46247119D39BAE
2016-01-14 15:39:40,332 INFO util.HadoopUtil (HadoopUtil.java:syncPaths(602)) - copying from: file:/opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar, to: hdfs://localhost:55538/user/teamcity/.staging/5111ED1ADA0845F7AA1ECE6663BBB471/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 15:39:40,358 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] starting
2016-01-14 15:39:40,358 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/upper.txt"]
2016-01-14 15:39:40,358 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower.txt"]
2016-01-14 15:39:40,359 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/lower-offset.txt"]
2016-01-14 15:39:40,360 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/mergepipesplatform/testHashJoinMergeIntoHashJoinStreamedAccumulatedMerge/multihashjoinintomergeintohashjoinfirstStreamedsecondAccumulatedinterMerge"]
2016-01-14 15:39:40,360 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] parallel execution of steps is enabled: true
2016-01-14 15:39:40,360 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] executing total steps: 1
2016-01-14 15:39:40,361 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] allocating management threads: 1
2016-01-14 15:39:40,363 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] starting step: (1/1) ...condAccumulatedinterMerge
2016-01-14 15:39:40,376 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] tez session mode enabled: false
2016-01-14 15:39:40,380 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 15:39:40,392 INFO client.TezClient (TezClient.java:start(315)) - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs
2016-01-14 15:39:40,394 INFO client.TezClient (TezClient.java:submitDAGApplication(738)) - Submitting DAG application with id: application_1452785619001_0020
2016-01-14 15:39:40,394 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(171)) - Using tez.lib.uris value from configuration: hdfs://localhost:55538/user/teamcity/target/cascading.platform.tez.Hadoop2TezPlatform-tmpDir/TezAppJar.jar
2016-01-14 15:39:40,403 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory hdfs://localhost:55538/user/teamcity/.staging/5111ED1ADA0845F7AA1ECE6663BBB471/DB8AEAD55EE845809EC474ADE86854C8/.tez/application_1452785619001_0020 doesn't exist and is created
2016-01-14 15:39:40,466 INFO client.TezClient (TezClient.java:submitDAGApplication(759)) - Submitting DAG to YARN, applicationId=application_1452785619001_0020, dagName=[5111ED1ADA0845F7AA1ECE6663BBB471/DB8AEAD55EE845809EC474ADE86854C8] offset*merge2/(1/1) ...condAccumulatedinterMerge
2016-01-14 15:39:40,471 INFO client.TezClient (TezClient.java:submitDAGApplication(765)) - The url to track the Tez AM: http://ip-10-187-41-40:46879/proxy/application_1452785619001_0020/
2016-01-14 15:39:40,485 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] submitted tez dag to app master: application_1452785619001_0020, with dag id: dag_1452785619001_0020_1
2016-01-14 15:39:44,926 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0019_01_000003 is : 143
2016-01-14 15:39:44,960 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0019_01_000004 is : 143
2016-01-14 15:39:44,992 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0019_01_000005 is : 143
2016-01-14 15:39:45,020 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452785619001_0019_01_000002 is : 143
2016-01-14 15:39:45,921 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0019_01_000002
2016-01-14 15:39:45,921 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0019_01_000003
2016-01-14 15:39:45,921 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0019_01_000004
2016-01-14 15:39:45,921 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452785619001_0019_01_000005
2016-01-14 15:39:59,991 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [offset*merge2] completed in: 00:19.627, using cpu time: 00:11.490
2016-01-14 15:40:00,026 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/mergepipesplatform/testHashJoinMergeIntoHashJoinStreamedAccumulatedMerge/multihashjoinintomergeintohashjoinfirstStreamedsecondAccumulatedinterMerge