2016-01-14 21:41:03,732 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 21:41:03,754 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.pipe.assembly.AssemblyHelpersPlatformTest, with platform: hadoop2-mr1
2016-01-14 21:41:03,784 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(119)) - not using cluster
2016-01-14 21:41:04,298 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-01-14 21:41:04,449 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2016-01-14 21:41:04,747 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:04,749 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:04,827 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: DE37DA6194E849C78E7C73E63BF603B8
2016-01-14 21:41:05,041 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.166
2016-01-14 21:41:05,044 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:05,045 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:05,226 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 21:41:05,227 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-14 21:41:05,228 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:05,228 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt"]
2016-01-14 21:41:05,229 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMerge/multimerge+false571"]
2016-01-14 21:41:05,230 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] parallel execution of steps is enabled: false
2016-01-14 21:41:05,230 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executing total steps: 1
2016-01-14 21:41:05,231 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] allocating management threads: 1
2016-01-14 21:41:05,231 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...Merge/multimerge+false571
2016-01-14 21:41:05,675 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1011791491/.staging/job_local1011791491_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:05,683 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1011791491/.staging/job_local1011791491_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:05,828 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1011791491_0001/job_local1011791491_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:05,833 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1011791491_0001/job_local1011791491_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:05,841 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local1011791491_0001
2016-01-14 21:41:05,841 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-14 21:41:05,923 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:06,065 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:06,065 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:06,087 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DE633445922342469D8E4C5AC7C41710, ordinal: 0
2016-01-14 21:41:06,122 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:06,123 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 21:41:06,124 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DE633445922342469D8E4C5AC7C41710, mem on start (mb), free: 134, total: 281, max: 672
2016-01-14 21:41:06,140 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:06,140 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 133, total: 281, max: 672
2016-01-14 21:41:06,140 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 41% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:06,142 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:06,142 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 133, total: 281, max: 672
2016-01-14 21:41:06,142 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 41% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:06,143 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:06,144 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 133, total: 281, max: 672
2016-01-14 21:41:06,144 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 41% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:06,145 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:06,145 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 133, total: 281, max: 672
2016-01-14 21:41:06,146 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 41% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:06,147 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DE633445922342469D8E4C5AC7C41710, mem on close (mb), free: 133, total: 281, max: 672
2016-01-14 21:41:06,171 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt
2016-01-14 21:41:06,278 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:06,278 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:06,297 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DE633445922342469D8E4C5AC7C41710, ordinal: 0
2016-01-14 21:41:06,298 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt"]
2016-01-14 21:41:06,299 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 21:41:06,299 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DE633445922342469D8E4C5AC7C41710, mem on start (mb), free: 131, total: 382, max: 672
2016-01-14 21:41:06,371 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:06,372 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 128, total: 382, max: 672
2016-01-14 21:41:06,372 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 56% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:06,374 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:06,374 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 128, total: 382, max: 672
2016-01-14 21:41:06,374 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 56% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:06,376 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:06,376 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 128, total: 382, max: 672
2016-01-14 21:41:06,376 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 56% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:06,377 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:06,378 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 128, total: 382, max: 672
2016-01-14 21:41:06,378 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 56% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:06,379 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DE633445922342469D8E4C5AC7C41710, mem on close (mb), free: 128, total: 382, max: 672
2016-01-14 21:41:06,483 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:06,484 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:06,502 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DCEBA3BA70E442B5A7FC31E3BE395E10, ordinal: 1
2016-01-14 21:41:06,506 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 21:41:06,506 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMerge/multimerge+false571"]
2016-01-14 21:41:06,506 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DCEBA3BA70E442B5A7FC31E3BE395E10, mem on start (mb), free: 117, total: 382, max: 672
2016-01-14 21:41:06,525 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DCEBA3BA70E442B5A7FC31E3BE395E10, mem on close (mb), free: 115, total: 382, max: 672
2016-01-14 21:41:06,563 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMerge/multimerge+false571/_temporary
2016-01-14 21:41:06,564 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] completed in: 00:01.335
2016-01-14 21:41:06,628 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMerge/multimerge+false571
2016-01-14 21:41:06,662 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:06,663 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:06,735 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.060
2016-01-14 21:41:06,736 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:06,737 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:06,763 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting
2016-01-14 21:41:06,763 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:06,763 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] sink: Hfs["TextDelimited[['num', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByString/minbystring"]
2016-01-14 21:41:06,763 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] parallel execution of steps is enabled: false
2016-01-14 21:41:06,763 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executing total steps: 1
2016-01-14 21:41:06,764 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] allocating management threads: 1
2016-01-14 21:41:06,765 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting step: (1/1) ...stMinByString/minbystring
2016-01-14 21:41:06,859 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity513521351/.staging/job_local513521351_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:06,861 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity513521351/.staging/job_local513521351_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:06,946 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local513521351_0002/job_local513521351_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:06,950 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local513521351_0002/job_local513521351_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:06,951 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] submitted hadoop job: job_local513521351_0002
2016-01-14 21:41:06,951 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] tracking url: http://localhost:8080/
2016-01-14 21:41:06,958 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:07,062 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:07,063 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:07,072 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C0A0CE9367D549F49B51AAE379FE80FD, ordinal: 0
2016-01-14 21:41:07,073 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:07,073 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2016-01-14 21:41:07,073 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C0A0CE9367D549F49B51AAE379FE80FD, mem on start (mb), free: 65, total: 482, max: 672
2016-01-14 21:41:07,075 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:07,075 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 65, total: 482, max: 672
2016-01-14 21:41:07,075 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 71% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:07,076 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:07,076 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 65, total: 482, max: 672
2016-01-14 21:41:07,076 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 71% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:07,077 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C0A0CE9367D549F49B51AAE379FE80FD, mem on close (mb), free: 65, total: 482, max: 672
2016-01-14 21:41:07,097 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:07,097 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:07,109 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F327F9E2E188493DB81E2D4F85204D6B, ordinal: 1
2016-01-14 21:41:07,110 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2016-01-14 21:41:07,110 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['num', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByString/minbystring"]
2016-01-14 21:41:07,110 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F327F9E2E188493DB81E2D4F85204D6B, mem on start (mb), free: 60, total: 482, max: 672
2016-01-14 21:41:07,122 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F327F9E2E188493DB81E2D4F85204D6B, mem on close (mb), free: 60, total: 482, max: 672
2016-01-14 21:41:07,154 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByString/minbystring/_temporary
2016-01-14 21:41:07,154 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] completed in: 00:00.391
2016-01-14 21:41:07,265 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMinByString/minbystring
2016-01-14 21:41:07,302 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:07,302 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:07,404 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.092
2016-01-14 21:41:07,406 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:07,406 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:07,447 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] starting
2016-01-14 21:41:07,448 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt"]
2016-01-14 21:41:07,449 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:07,449 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageMerge/mergeaverage"]
2016-01-14 21:41:07,450 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] parallel execution of steps is enabled: false
2016-01-14 21:41:07,450 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] executing total steps: 1
2016-01-14 21:41:07,451 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] allocating management threads: 1
2016-01-14 21:41:07,452 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] starting step: (1/1) ...AverageMerge/mergeaverage
2016-01-14 21:41:07,621 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity2057732312/.staging/job_local2057732312_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:07,624 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity2057732312/.staging/job_local2057732312_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:07,680 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2057732312_0003/job_local2057732312_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:07,681 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2057732312_0003/job_local2057732312_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:07,682 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] submitted hadoop job: job_local2057732312_0003
2016-01-14 21:41:07,687 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] tracking url: http://localhost:8080/
2016-01-14 21:41:07,695 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:07,801 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:07,801 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:07,816 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E59F851B4D364B00A9A1233D6EC6E702, ordinal: 0
2016-01-14 21:41:07,817 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:07,817 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2016-01-14 21:41:07,817 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E59F851B4D364B00A9A1233D6EC6E702, mem on start (mb), free: 120, total: 583, max: 672
2016-01-14 21:41:07,819 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:07,819 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 120, total: 583, max: 672
2016-01-14 21:41:07,820 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:07,820 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 120, total: 583, max: 672
2016-01-14 21:41:07,821 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:07,821 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 120, total: 583, max: 672
2016-01-14 21:41:07,821 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:07,822 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 120, total: 583, max: 672
2016-01-14 21:41:07,822 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E59F851B4D364B00A9A1233D6EC6E702, mem on close (mb), free: 120, total: 583, max: 672
2016-01-14 21:41:07,834 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt
2016-01-14 21:41:07,933 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:07,934 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:07,945 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E59F851B4D364B00A9A1233D6EC6E702, ordinal: 0
2016-01-14 21:41:07,946 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt"]
2016-01-14 21:41:07,946 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2016-01-14 21:41:07,946 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E59F851B4D364B00A9A1233D6EC6E702, mem on start (mb), free: 67, total: 630, max: 672
2016-01-14 21:41:07,950 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:07,950 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 66, total: 630, max: 672
2016-01-14 21:41:07,951 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:07,951 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 66, total: 630, max: 672
2016-01-14 21:41:07,952 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:07,952 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 66, total: 630, max: 672
2016-01-14 21:41:07,953 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:07,953 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 66, total: 630, max: 672
2016-01-14 21:41:07,954 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E59F851B4D364B00A9A1233D6EC6E702, mem on close (mb), free: 66, total: 630, max: 672
2016-01-14 21:41:07,975 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:07,975 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:07,988 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F93760943D86474EB6913B95527F47C2, ordinal: 1
2016-01-14 21:41:07,988 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2016-01-14 21:41:07,988 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageMerge/mergeaverage"]
2016-01-14 21:41:07,989 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F93760943D86474EB6913B95527F47C2, mem on start (mb), free: 62, total: 630, max: 672
2016-01-14 21:41:08,000 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F93760943D86474EB6913B95527F47C2, mem on close (mb), free: 61, total: 630, max: 672
2016-01-14 21:41:08,027 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageMerge/mergeaverage/_temporary
2016-01-14 21:41:08,027 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] completed in: 00:00.579
2016-01-14 21:41:08,090 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testAverageMerge/mergeaverage
2016-01-14 21:41:08,115 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:08,116 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:08,154 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.032
2016-01-14 21:41:08,155 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 21:41:08,155 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:08,173 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 21:41:08,174 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt"]
2016-01-14 21:41:08,174 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameAll/renameall"]
2016-01-14 21:41:08,175 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-14 21:41:08,175 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-14 21:41:08,175 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-14 21:41:08,176 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...m/testRenameAll/renameall
2016-01-14 21:41:08,246 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1891114985/.staging/job_local1891114985_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:08,247 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1891114985/.staging/job_local1891114985_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:08,300 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1891114985_0004/job_local1891114985_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:08,302 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1891114985_0004/job_local1891114985_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:08,303 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local1891114985_0004
2016-01-14 21:41:08,304 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 21:41:08,310 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt
2016-01-14 21:41:08,322 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:08,322 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:08,331 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E8322C06AEE949C891DCC9E2D9B9CA0B, ordinal: 0
2016-01-14 21:41:08,333 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt"]
2016-01-14 21:41:08,333 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameAll/renameall"]
2016-01-14 21:41:08,333 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E8322C06AEE949C891DCC9E2D9B9CA0B, mem on start (mb), free: 10, total: 630, max: 672
2016-01-14 21:41:08,337 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E8322C06AEE949C891DCC9E2D9B9CA0B, mem on close (mb), free: 10, total: 630, max: 672
2016-01-14 21:41:08,360 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameAll/renameall/_temporary
2016-01-14 21:41:08,360 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:00.186
2016-01-14 21:41:08,385 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testRenameAll/renameall
2016-01-14 21:41:08,629 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:08,629 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:08,714 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.080
2016-01-14 21:41:08,715 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 4
2016-01-14 21:41:08,715 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:08,753 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting
2016-01-14 21:41:08,753 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:08,753 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] sink: Hfs["TextDelimited[['count', 'count2']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountCount/countcount"]
2016-01-14 21:41:08,754 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] parallel execution of steps is enabled: false
2016-01-14 21:41:08,754 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executing total steps: 2
2016-01-14 21:41:08,754 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] allocating management threads: 1
2016-01-14 21:41:08,755 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (1/2)
2016-01-14 21:41:08,831 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity630590652/.staging/job_local630590652_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:08,832 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity630590652/.staging/job_local630590652_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:08,869 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local630590652_0005/job_local630590652_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:08,870 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local630590652_0005/job_local630590652_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:08,871 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local630590652_0005
2016-01-14 21:41:08,871 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-14 21:41:08,876 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:08,891 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:08,891 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:08,899 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: CEF017ACE49F4C9D8136740F65D82072, ordinal: 0
2016-01-14 21:41:08,900 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:08,900 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2016-01-14 21:41:08,900 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CEF017ACE49F4C9D8136740F65D82072, mem on start (mb), free: 97, total: 244, max: 672
2016-01-14 21:41:08,902 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:08,902 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 97, total: 244, max: 672
2016-01-14 21:41:08,902 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:08,903 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:08,903 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 97, total: 244, max: 672
2016-01-14 21:41:08,903 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:08,904 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:08,904 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 97, total: 244, max: 672
2016-01-14 21:41:08,904 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:08,904 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:08,905 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 97, total: 244, max: 672
2016-01-14 21:41:08,905 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:08,905 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CEF017ACE49F4C9D8136740F65D82072, mem on close (mb), free: 97, total: 244, max: 672
2016-01-14 21:41:08,925 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:08,925 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:08,932 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C4CC1616C2E24C16875AD39CFCA59C43, ordinal: 1
2016-01-14 21:41:08,933 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2016-01-14 21:41:08,933 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['count', 'count2']]"][9161137905/count/]
2016-01-14 21:41:08,933 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C4CC1616C2E24C16875AD39CFCA59C43, mem on start (mb), free: 92, total: 244, max: 672
2016-01-14 21:41:08,951 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:08,952 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 91, total: 244, max: 672
2016-01-14 21:41:08,952 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:08,952 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C4CC1616C2E24C16875AD39CFCA59C43, mem on close (mb), free: 91, total: 244, max: 672
2016-01-14 21:41:08,974 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (2/2) ...testCountCount/countcount
2016-01-14 21:41:09,044 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity536664122/.staging/job_local536664122_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:09,045 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity536664122/.staging/job_local536664122_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:09,081 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local536664122_0006/job_local536664122_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:09,082 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local536664122_0006/job_local536664122_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:09,083 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local536664122_0006
2016-01-14 21:41:09,083 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-14 21:41:09,088 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/9161137905_count_67E9BBD261474877A12BFB9A67DE685B/part-00000
2016-01-14 21:41:09,191 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:09,191 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:09,199 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: EAECE816C7334D29ACAB811BDDAA9CB6, ordinal: 0
2016-01-14 21:41:09,200 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['count', 'count2']]"][9161137905/count/]
2016-01-14 21:41:09,200 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{1}:'count']]
2016-01-14 21:41:09,200 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EAECE816C7334D29ACAB811BDDAA9CB6, mem on start (mb), free: 58, total: 344, max: 672
2016-01-14 21:41:09,201 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EAECE816C7334D29ACAB811BDDAA9CB6, mem on close (mb), free: 58, total: 344, max: 672
2016-01-14 21:41:09,216 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:09,217 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:09,225 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B93ADCD3759945D4A2A8DC8CACC7EFC2, ordinal: 1
2016-01-14 21:41:09,226 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{1}:'count']]
2016-01-14 21:41:09,226 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['count', 'count2']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountCount/countcount"]
2016-01-14 21:41:09,226 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B93ADCD3759945D4A2A8DC8CACC7EFC2, mem on start (mb), free: 52, total: 344, max: 672
2016-01-14 21:41:09,235 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B93ADCD3759945D4A2A8DC8CACC7EFC2, mem on close (mb), free: 52, total: 344, max: 672
2016-01-14 21:41:09,254 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountCount/countcount/_temporary
2016-01-14 21:41:09,255 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] completed in: 00:00.500
2016-01-14 21:41:09,302 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCountCount/countcount
2016-01-14 21:41:09,320 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:09,321 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:09,380 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.055
2016-01-14 21:41:09,382 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:09,382 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:09,414 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] starting
2016-01-14 21:41:09,415 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:09,415 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt"]
2016-01-14 21:41:09,415 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountMerge/mergecount"]
2016-01-14 21:41:09,416 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] parallel execution of steps is enabled: false
2016-01-14 21:41:09,416 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] executing total steps: 1
2016-01-14 21:41:09,416 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] allocating management threads: 1
2016-01-14 21:41:09,417 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] starting step: (1/1) ...testCountMerge/mergecount
2016-01-14 21:41:09,532 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity483103312/.staging/job_local483103312_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:09,535 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity483103312/.staging/job_local483103312_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:09,585 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local483103312_0007/job_local483103312_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:09,586 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local483103312_0007/job_local483103312_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:09,587 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] submitted hadoop job: job_local483103312_0007
2016-01-14 21:41:09,587 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] tracking url: http://localhost:8080/
2016-01-14 21:41:09,593 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:09,608 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:09,608 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:09,618 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E2B4E8D72F964392958A86C6A5BC65F7, ordinal: 0
2016-01-14 21:41:09,619 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:09,620 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 21:41:09,620 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E2B4E8D72F964392958A86C6A5BC65F7, mem on start (mb), free: 182, total: 312, max: 672
2016-01-14 21:41:09,622 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:09,622 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 182, total: 312, max: 672
2016-01-14 21:41:09,623 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 46% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:09,623 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:09,624 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 182, total: 312, max: 672
2016-01-14 21:41:09,624 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 46% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:09,625 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:09,625 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 182, total: 312, max: 672
2016-01-14 21:41:09,625 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 46% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:09,626 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:09,626 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 182, total: 312, max: 672
2016-01-14 21:41:09,626 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 46% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:09,627 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E2B4E8D72F964392958A86C6A5BC65F7, mem on close (mb), free: 182, total: 312, max: 672
2016-01-14 21:41:09,636 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt
2016-01-14 21:41:09,674 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:09,674 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:09,683 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E2B4E8D72F964392958A86C6A5BC65F7, ordinal: 0
2016-01-14 21:41:09,684 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt"]
2016-01-14 21:41:09,684 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 21:41:09,684 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E2B4E8D72F964392958A86C6A5BC65F7, mem on start (mb), free: 181, total: 412, max: 672
2016-01-14 21:41:09,688 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:09,688 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 180, total: 412, max: 672
2016-01-14 21:41:09,688 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:09,689 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:09,689 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 180, total: 412, max: 672
2016-01-14 21:41:09,690 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:09,690 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:09,690 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 180, total: 412, max: 672
2016-01-14 21:41:09,691 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:09,691 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:09,691 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 180, total: 412, max: 672
2016-01-14 21:41:09,692 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:09,692 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E2B4E8D72F964392958A86C6A5BC65F7, mem on close (mb), free: 180, total: 412, max: 672
2016-01-14 21:41:09,711 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:09,711 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:09,719 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: ED46FE35A0C249349B97E24076724D08, ordinal: 1
2016-01-14 21:41:09,720 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 21:41:09,720 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountMerge/mergecount"]
2016-01-14 21:41:09,720 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ED46FE35A0C249349B97E24076724D08, mem on start (mb), free: 176, total: 412, max: 672
2016-01-14 21:41:09,729 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ED46FE35A0C249349B97E24076724D08, mem on close (mb), free: 175, total: 412, max: 672
2016-01-14 21:41:09,751 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountMerge/mergecount/_temporary
2016-01-14 21:41:09,752 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] completed in: 00:00.337
2016-01-14 21:41:09,799 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCountMerge/mergecount
2016-01-14 21:41:09,817 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:09,818 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:09,853 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.032
2016-01-14 21:41:09,854 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:09,854 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:09,870 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] starting
2016-01-14 21:41:09,870 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:09,871 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] sink: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByNullSafety/minbynullsafety"]
2016-01-14 21:41:09,871 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] parallel execution of steps is enabled: false
2016-01-14 21:41:09,871 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] executing total steps: 1
2016-01-14 21:41:09,871 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] allocating management threads: 1
2016-01-14 21:41:09,872 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] starting step: (1/1) ...ullSafety/minbynullsafety
2016-01-14 21:41:09,939 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1698516851/.staging/job_local1698516851_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:09,940 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1698516851/.staging/job_local1698516851_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:09,975 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1698516851_0008/job_local1698516851_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:09,976 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1698516851_0008/job_local1698516851_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:09,977 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] submitted hadoop job: job_local1698516851_0008
2016-01-14 21:41:09,982 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] tracking url: http://localhost:8080/
2016-01-14 21:41:09,987 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:10,091 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:10,092 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:10,099 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C13A138D6D5C4597B2149A177BA75400, ordinal: 0
2016-01-14 21:41:10,100 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:10,100 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(min)[by:[{1}:'char']]
2016-01-14 21:41:10,101 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C13A138D6D5C4597B2149A177BA75400, mem on start (mb), free: 126, total: 513, max: 672
2016-01-14 21:41:10,103 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:10,103 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 125, total: 513, max: 672
2016-01-14 21:41:10,104 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 76% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:10,105 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:10,105 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 125, total: 513, max: 672
2016-01-14 21:41:10,106 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 76% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:10,107 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:10,107 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 125, total: 513, max: 672
2016-01-14 21:41:10,108 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 76% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:10,109 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:10,109 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 125, total: 513, max: 672
2016-01-14 21:41:10,109 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 76% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:10,111 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C13A138D6D5C4597B2149A177BA75400, mem on close (mb), free: 125, total: 513, max: 672
2016-01-14 21:41:10,127 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:10,127 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:10,135 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DF53CC8113CB49E8B5CA40E9DD53821D, ordinal: 1
2016-01-14 21:41:10,135 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(min)[by:[{1}:'char']]
2016-01-14 21:41:10,136 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByNullSafety/minbynullsafety"]
2016-01-14 21:41:10,137 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DF53CC8113CB49E8B5CA40E9DD53821D, mem on start (mb), free: 120, total: 513, max: 672
2016-01-14 21:41:10,145 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DF53CC8113CB49E8B5CA40E9DD53821D, mem on close (mb), free: 120, total: 513, max: 672
2016-01-14 21:41:10,161 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByNullSafety/minbynullsafety/_temporary
2016-01-14 21:41:10,162 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] completed in: 00:00.291
2016-01-14 21:41:10,211 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMinByNullSafety/minbynullsafety
2016-01-14 21:41:10,229 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:10,229 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:10,273 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.039
2016-01-14 21:41:10,274 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:10,274 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:10,293 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting
2016-01-14 21:41:10,294 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:10,294 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] sink: Hfs["TextDelimited[['num', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByString/maxbystring"]
2016-01-14 21:41:10,295 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] parallel execution of steps is enabled: false
2016-01-14 21:41:10,295 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executing total steps: 1
2016-01-14 21:41:10,296 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] allocating management threads: 1
2016-01-14 21:41:10,297 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting step: (1/1) ...stMaxByString/maxbystring
2016-01-14 21:41:10,378 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1544342150/.staging/job_local1544342150_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:10,379 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1544342150/.staging/job_local1544342150_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:10,439 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1544342150_0009/job_local1544342150_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:10,440 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1544342150_0009/job_local1544342150_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:10,441 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] submitted hadoop job: job_local1544342150_0009
2016-01-14 21:41:10,441 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] tracking url: http://localhost:8080/
2016-01-14 21:41:10,446 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:10,462 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:10,462 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:10,468 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: EDB328A5A4A54A28AC319366ECD8F942, ordinal: 0
2016-01-14 21:41:10,468 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:10,469 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2016-01-14 21:41:10,469 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EDB328A5A4A54A28AC319366ECD8F942, mem on start (mb), free: 108, total: 537, max: 672
2016-01-14 21:41:10,471 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:10,471 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 108, total: 537, max: 672
2016-01-14 21:41:10,471 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 79% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:10,472 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:10,472 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 108, total: 537, max: 672
2016-01-14 21:41:10,472 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 79% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 21:41:10,473 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EDB328A5A4A54A28AC319366ECD8F942, mem on close (mb), free: 108, total: 537, max: 672
2016-01-14 21:41:10,487 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:10,488 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:10,494 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D4AA809E23D547D0B89A1317B12C3761, ordinal: 1
2016-01-14 21:41:10,494 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2016-01-14 21:41:10,495 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['num', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByString/maxbystring"]
2016-01-14 21:41:10,495 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D4AA809E23D547D0B89A1317B12C3761, mem on start (mb), free: 102, total: 537, max: 672
2016-01-14 21:41:10,503 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D4AA809E23D547D0B89A1317B12C3761, mem on close (mb), free: 100, total: 537, max: 672
2016-01-14 21:41:10,528 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByString/maxbystring/_temporary
2016-01-14 21:41:10,529 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] completed in: 00:00.235
2016-01-14 21:41:10,588 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMaxByString/maxbystring
2016-01-14 21:41:10,612 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:10,613 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:10,648 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.031
2016-01-14 21:41:10,649 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:10,650 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:10,674 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-14 21:41:10,674 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] source: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2016-01-14 21:41:10,674 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstBy/firstnfields"]
2016-01-14 21:41:10,675 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] parallel execution of steps is enabled: false
2016-01-14 21:41:10,676 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executing total steps: 1
2016-01-14 21:41:10,677 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] allocating management threads: 1
2016-01-14 21:41:10,678 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) .../testFirstBy/firstnfields
2016-01-14 21:41:10,745 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1118312290/.staging/job_local1118312290_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:10,747 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1118312290/.staging/job_local1118312290_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:10,780 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1118312290_0010/job_local1118312290_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:10,781 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1118312290_0010/job_local1118312290_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:10,782 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted hadoop job: job_local1118312290_0010
2016-01-14 21:41:10,782 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tracking url: http://localhost:8080/
2016-01-14 21:41:10,786 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2016-01-14 21:41:10,802 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:10,802 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:10,809 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: ACF47302CF584F288ECEAD6F2B22CE50, ordinal: 0
2016-01-14 21:41:10,811 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2016-01-14 21:41:10,812 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(first)[by:[{1}:'num']]
2016-01-14 21:41:10,812 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: ACF47302CF584F288ECEAD6F2B22CE50, mem on start (mb), free: 133, total: 577, max: 672
2016-01-14 21:41:10,817 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:10,818 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 133, total: 577, max: 672
2016-01-14 21:41:10,820 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:10,820 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 133, total: 577, max: 672
2016-01-14 21:41:10,823 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: ACF47302CF584F288ECEAD6F2B22CE50, mem on close (mb), free: 133, total: 577, max: 672
2016-01-14 21:41:10,843 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:10,843 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:10,852 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A4008D1D816840969031F62E7A5A5089, ordinal: 1
2016-01-14 21:41:10,852 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(first)[by:[{1}:'num']]
2016-01-14 21:41:10,852 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstBy/firstnfields"]
2016-01-14 21:41:10,852 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A4008D1D816840969031F62E7A5A5089, mem on start (mb), free: 126, total: 577, max: 672
2016-01-14 21:41:10,860 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A4008D1D816840969031F62E7A5A5089, mem on close (mb), free: 124, total: 577, max: 672
2016-01-14 21:41:10,883 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstBy/firstnfields/_temporary
2016-01-14 21:41:10,883 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] completed in: 00:00.208
2016-01-14 21:41:10,908 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testFirstBy/firstnfields
2016-01-14 21:41:10,934 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:10,935 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:10,971 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.031
2016-01-14 21:41:10,971 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 21:41:10,972 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:10,982 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] starting
2016-01-14 21:41:10,982 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt"]
2016-01-14 21:41:10,983 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] sink: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerceFields/coercefields"]
2016-01-14 21:41:10,983 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] parallel execution of steps is enabled: false
2016-01-14 21:41:10,983 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] executing total steps: 1
2016-01-14 21:41:10,984 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] allocating management threads: 1
2016-01-14 21:41:10,984 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] starting step: (1/1) ...CoerceFields/coercefields
2016-01-14 21:41:11,050 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity953272973/.staging/job_local953272973_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:11,051 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity953272973/.staging/job_local953272973_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:11,096 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local953272973_0011/job_local953272973_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:11,097 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local953272973_0011/job_local953272973_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:11,097 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] submitted hadoop job: job_local953272973_0011
2016-01-14 21:41:11,098 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] tracking url: http://localhost:8080/
2016-01-14 21:41:11,111 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt
2016-01-14 21:41:11,117 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:11,118 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:11,123 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AEC6362D61DE4A0BB8B11661090769B0, ordinal: 0
2016-01-14 21:41:11,124 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt"]
2016-01-14 21:41:11,126 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerceFields/coercefields"]
2016-01-14 21:41:11,126 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AEC6362D61DE4A0BB8B11661090769B0, mem on start (mb), free: 295, total: 614, max: 672
2016-01-14 21:41:11,133 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AEC6362D61DE4A0BB8B11661090769B0, mem on close (mb), free: 294, total: 614, max: 672
2016-01-14 21:41:11,152 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerceFields/coercefields/_temporary
2016-01-14 21:41:11,152 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] completed in: 00:00.170
2016-01-14 21:41:11,176 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCoerceFields/coercefields
2016-01-14 21:41:11,192 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:11,192 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:11,229 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.033
2016-01-14 21:41:11,230 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:11,230 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:11,246 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting
2016-01-14 21:41:11,247 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:11,247 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCount/count"]
2016-01-14 21:41:11,247 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] parallel execution of steps is enabled: false
2016-01-14 21:41:11,247 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executing total steps: 1
2016-01-14 21:41:11,248 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] allocating management threads: 1
2016-01-14 21:41:11,249 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (1/1) ...splatform/testCount/count
2016-01-14 21:41:11,302 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1010687557/.staging/job_local1010687557_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:11,303 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1010687557/.staging/job_local1010687557_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:11,338 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1010687557_0012/job_local1010687557_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:11,340 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1010687557_0012/job_local1010687557_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:11,340 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local1010687557_0012
2016-01-14 21:41:11,341 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-14 21:41:11,345 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:11,366 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:11,366 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:11,373 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B5E3AA1DA0A047FE866E1964ABC41E84, ordinal: 0
2016-01-14 21:41:11,374 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:11,374 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2016-01-14 21:41:11,374 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B5E3AA1DA0A047FE866E1964ABC41E84, mem on start (mb), free: 140, total: 614, max: 672
2016-01-14 21:41:11,376 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:11,376 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 140, total: 614, max: 672
2016-01-14 21:41:11,377 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:11,377 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 140, total: 614, max: 672
2016-01-14 21:41:11,378 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:11,378 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 140, total: 614, max: 672
2016-01-14 21:41:11,379 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:11,379 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 140, total: 614, max: 672
2016-01-14 21:41:11,380 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B5E3AA1DA0A047FE866E1964ABC41E84, mem on close (mb), free: 140, total: 614, max: 672
2016-01-14 21:41:11,394 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:11,394 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:11,402 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B0F8DC8BD03D47329FD2FA3B04314345, ordinal: 1
2016-01-14 21:41:11,402 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2016-01-14 21:41:11,402 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCount/count"]
2016-01-14 21:41:11,403 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B0F8DC8BD03D47329FD2FA3B04314345, mem on start (mb), free: 133, total: 614, max: 672
2016-01-14 21:41:11,410 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B0F8DC8BD03D47329FD2FA3B04314345, mem on close (mb), free: 132, total: 614, max: 672
2016-01-14 21:41:11,428 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCount/count/_temporary
2016-01-14 21:41:11,428 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] completed in: 00:00.182
2016-01-14 21:41:11,476 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCount/count
2016-01-14 21:41:11,490 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:11,490 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:11,523 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.028
2016-01-14 21:41:11,523 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:11,524 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:11,536 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting
2016-01-14 21:41:11,536 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:11,537 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] sink: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxBy/maxby"]
2016-01-14 21:41:11,537 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] parallel execution of steps is enabled: false
2016-01-14 21:41:11,537 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executing total steps: 1
2016-01-14 21:41:11,538 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] allocating management threads: 1
2016-01-14 21:41:11,539 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting step: (1/1) ...splatform/testMaxBy/maxby
2016-01-14 21:41:11,606 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity4466541/.staging/job_local4466541_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:11,607 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity4466541/.staging/job_local4466541_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:11,653 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local4466541_0013/job_local4466541_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:11,654 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local4466541_0013/job_local4466541_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:11,655 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] submitted hadoop job: job_local4466541_0013
2016-01-14 21:41:11,655 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] tracking url: http://localhost:8080/
2016-01-14 21:41:11,662 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:11,676 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:11,676 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:11,681 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F7302F88889340198538451AFC440F25, ordinal: 0
2016-01-14 21:41:11,682 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:11,682 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(max)[by:[{1}:'char']]
2016-01-14 21:41:11,682 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F7302F88889340198538451AFC440F25, mem on start (mb), free: 187, total: 615, max: 672
2016-01-14 21:41:11,683 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:11,683 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 187, total: 615, max: 672
2016-01-14 21:41:11,684 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:11,684 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 187, total: 615, max: 672
2016-01-14 21:41:11,684 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:11,684 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 187, total: 615, max: 672
2016-01-14 21:41:11,685 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:11,685 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 187, total: 615, max: 672
2016-01-14 21:41:11,685 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F7302F88889340198538451AFC440F25, mem on close (mb), free: 187, total: 615, max: 672
2016-01-14 21:41:11,699 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:11,700 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:11,706 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B2B9B3A9BAAE4368BC6C942CC78BB1FF, ordinal: 1
2016-01-14 21:41:11,706 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(max)[by:[{1}:'char']]
2016-01-14 21:41:11,707 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxBy/maxby"]
2016-01-14 21:41:11,707 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B2B9B3A9BAAE4368BC6C942CC78BB1FF, mem on start (mb), free: 180, total: 615, max: 672
2016-01-14 21:41:11,715 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B2B9B3A9BAAE4368BC6C942CC78BB1FF, mem on close (mb), free: 178, total: 615, max: 672
2016-01-14 21:41:11,732 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxBy/maxby/_temporary
2016-01-14 21:41:11,733 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] completed in: 00:00.196
2016-01-14 21:41:11,777 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMaxBy/maxby
2016-01-14 21:41:11,801 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:11,801 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:11,836 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 21:41:11,837 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:11,837 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:11,853 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] starting
2016-01-14 21:41:11,854 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:11,854 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] sink: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinBy/minby"]
2016-01-14 21:41:11,855 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] parallel execution of steps is enabled: false
2016-01-14 21:41:11,855 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] executing total steps: 1
2016-01-14 21:41:11,855 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] allocating management threads: 1
2016-01-14 21:41:11,856 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] starting step: (1/1) ...splatform/testMinBy/minby
2016-01-14 21:41:11,922 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity296644568/.staging/job_local296644568_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:11,924 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity296644568/.staging/job_local296644568_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:11,977 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local296644568_0014/job_local296644568_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:11,977 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local296644568_0014/job_local296644568_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:11,978 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] submitted hadoop job: job_local296644568_0014
2016-01-14 21:41:11,979 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] tracking url: http://localhost:8080/
2016-01-14 21:41:11,984 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:12,006 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:12,007 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:12,013 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B7AB348FF505401A8E29C5993A853D85, ordinal: 0
2016-01-14 21:41:12,014 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:12,014 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(min)[by:[{1}:'char']]
2016-01-14 21:41:12,015 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B7AB348FF505401A8E29C5993A853D85, mem on start (mb), free: 205, total: 621, max: 672
2016-01-14 21:41:12,017 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:12,017 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 205, total: 621, max: 672
2016-01-14 21:41:12,018 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:12,019 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 205, total: 621, max: 672
2016-01-14 21:41:12,020 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:12,020 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 205, total: 621, max: 672
2016-01-14 21:41:12,021 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:12,021 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 205, total: 621, max: 672
2016-01-14 21:41:12,022 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B7AB348FF505401A8E29C5993A853D85, mem on close (mb), free: 205, total: 621, max: 672
2016-01-14 21:41:12,041 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:12,042 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:12,051 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E57C95C9F2BC412A838E595D37807098, ordinal: 1
2016-01-14 21:41:12,052 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(min)[by:[{1}:'char']]
2016-01-14 21:41:12,053 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinBy/minby"]
2016-01-14 21:41:12,053 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E57C95C9F2BC412A838E595D37807098, mem on start (mb), free: 199, total: 621, max: 672
2016-01-14 21:41:12,062 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E57C95C9F2BC412A838E595D37807098, mem on close (mb), free: 197, total: 621, max: 672
2016-01-14 21:41:12,079 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinBy/minby/_temporary
2016-01-14 21:41:12,080 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] completed in: 00:00.226
2016-01-14 21:41:12,119 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMinBy/minby
2016-01-14 21:41:12,131 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:12,132 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:12,158 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-01-14 21:41:12,158 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:12,158 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:12,169 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] starting
2016-01-14 21:41:12,169 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:12,169 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumBy/sum"]
2016-01-14 21:41:12,170 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] parallel execution of steps is enabled: false
2016-01-14 21:41:12,170 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] executing total steps: 1
2016-01-14 21:41:12,170 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] allocating management threads: 1
2016-01-14 21:41:12,171 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] starting step: (1/1) ...ersplatform/testSumBy/sum
2016-01-14 21:41:12,222 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity352450325/.staging/job_local352450325_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:12,223 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity352450325/.staging/job_local352450325_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:12,253 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local352450325_0015/job_local352450325_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:12,254 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local352450325_0015/job_local352450325_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:12,255 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] submitted hadoop job: job_local352450325_0015
2016-01-14 21:41:12,255 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] tracking url: http://localhost:8080/
2016-01-14 21:41:12,260 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:12,281 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:12,281 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:12,287 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AEEA3B840A934D3897177CCD7DE52854, ordinal: 0
2016-01-14 21:41:12,288 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:12,288 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2016-01-14 21:41:12,288 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AEEA3B840A934D3897177CCD7DE52854, mem on start (mb), free: 206, total: 622, max: 672
2016-01-14 21:41:12,290 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:12,290 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 206, total: 622, max: 672
2016-01-14 21:41:12,291 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:12,292 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 206, total: 622, max: 672
2016-01-14 21:41:12,292 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:12,292 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 206, total: 622, max: 672
2016-01-14 21:41:12,293 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:12,293 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 206, total: 622, max: 672
2016-01-14 21:41:12,293 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AEEA3B840A934D3897177CCD7DE52854, mem on close (mb), free: 206, total: 622, max: 672
2016-01-14 21:41:12,307 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:12,308 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:12,317 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: EE1420C7E60749F1A59CC3A9FD9EF23D, ordinal: 1
2016-01-14 21:41:12,317 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2016-01-14 21:41:12,317 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumBy/sum"]
2016-01-14 21:41:12,318 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EE1420C7E60749F1A59CC3A9FD9EF23D, mem on start (mb), free: 200, total: 622, max: 672
2016-01-14 21:41:12,324 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EE1420C7E60749F1A59CC3A9FD9EF23D, mem on close (mb), free: 199, total: 622, max: 672
2016-01-14 21:41:12,345 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumBy/sum/_temporary
2016-01-14 21:41:12,345 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] completed in: 00:00.176
2016-01-14 21:41:12,387 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testSumBy/sum
2016-01-14 21:41:12,403 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:12,403 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:12,440 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.033
2016-01-14 21:41:12,441 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:12,441 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:12,452 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] starting
2016-01-14 21:41:12,452 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt"]
2016-01-14 21:41:12,452 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:12,453 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumMerge/mergesum"]
2016-01-14 21:41:12,453 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] parallel execution of steps is enabled: false
2016-01-14 21:41:12,453 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] executing total steps: 1
2016-01-14 21:41:12,453 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] allocating management threads: 1
2016-01-14 21:41:12,454 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] starting step: (1/1) ...orm/testSumMerge/mergesum
2016-01-14 21:41:12,505 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1894720822/.staging/job_local1894720822_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:12,506 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1894720822/.staging/job_local1894720822_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:12,534 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1894720822_0016/job_local1894720822_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:12,535 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1894720822_0016/job_local1894720822_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:12,536 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] submitted hadoop job: job_local1894720822_0016
2016-01-14 21:41:12,536 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] tracking url: http://localhost:8080/
2016-01-14 21:41:12,540 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:12,559 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:12,559 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:12,566 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C61DAD9E4D75421188B82A25BFA1CE5D, ordinal: 0
2016-01-14 21:41:12,567 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:12,567 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2016-01-14 21:41:12,567 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C61DAD9E4D75421188B82A25BFA1CE5D, mem on start (mb), free: 207, total: 623, max: 672
2016-01-14 21:41:12,568 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:12,568 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 207, total: 623, max: 672
2016-01-14 21:41:12,570 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:12,570 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 207, total: 623, max: 672
2016-01-14 21:41:12,571 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:12,572 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 207, total: 623, max: 672
2016-01-14 21:41:12,572 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:12,573 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 207, total: 623, max: 672
2016-01-14 21:41:12,573 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C61DAD9E4D75421188B82A25BFA1CE5D, mem on close (mb), free: 207, total: 623, max: 672
2016-01-14 21:41:12,581 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt
2016-01-14 21:41:12,605 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:12,606 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:12,617 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C61DAD9E4D75421188B82A25BFA1CE5D, ordinal: 0
2016-01-14 21:41:12,618 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt"]
2016-01-14 21:41:12,618 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2016-01-14 21:41:12,619 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C61DAD9E4D75421188B82A25BFA1CE5D, mem on start (mb), free: 105, total: 623, max: 672
2016-01-14 21:41:12,623 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:12,623 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 105, total: 623, max: 672
2016-01-14 21:41:12,624 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:12,624 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 105, total: 623, max: 672
2016-01-14 21:41:12,625 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:12,625 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 105, total: 623, max: 672
2016-01-14 21:41:12,626 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:12,626 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 105, total: 623, max: 672
2016-01-14 21:41:12,628 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C61DAD9E4D75421188B82A25BFA1CE5D, mem on close (mb), free: 105, total: 623, max: 672
2016-01-14 21:41:12,643 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:12,643 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:12,649 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A4F9B9D555B34302A9267B346137F407, ordinal: 1
2016-01-14 21:41:12,650 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2016-01-14 21:41:12,650 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumMerge/mergesum"]
2016-01-14 21:41:12,650 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A4F9B9D555B34302A9267B346137F407, mem on start (mb), free: 99, total: 623, max: 672
2016-01-14 21:41:12,658 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A4F9B9D555B34302A9267B346137F407, mem on close (mb), free: 98, total: 623, max: 672
2016-01-14 21:41:12,675 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumMerge/mergesum/_temporary
2016-01-14 21:41:12,676 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] completed in: 00:00.223
2016-01-14 21:41:12,725 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testSumMerge/mergesum
2016-01-14 21:41:12,740 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:12,740 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:12,761 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 21:41:12,761 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 21:41:12,761 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:12,769 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 21:41:12,769 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt"]
2016-01-14 21:41:12,769 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testDiscardNarrow/discardnarrow"]
2016-01-14 21:41:12,770 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-14 21:41:12,770 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-14 21:41:12,770 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-14 21:41:12,771 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...scardNarrow/discardnarrow
2016-01-14 21:41:12,826 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity944666664/.staging/job_local944666664_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:12,827 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity944666664/.staging/job_local944666664_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:12,861 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local944666664_0017/job_local944666664_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:12,862 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local944666664_0017/job_local944666664_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:12,862 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local944666664_0017
2016-01-14 21:41:12,863 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 21:41:12,866 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt
2016-01-14 21:41:12,871 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:12,871 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:12,876 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C91B9FC2450942E984FD5DEBE5BFD3B5, ordinal: 0
2016-01-14 21:41:12,876 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt"]
2016-01-14 21:41:12,877 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testDiscardNarrow/discardnarrow"]
2016-01-14 21:41:12,877 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C91B9FC2450942E984FD5DEBE5BFD3B5, mem on start (mb), free: 267, total: 623, max: 672
2016-01-14 21:41:12,879 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C91B9FC2450942E984FD5DEBE5BFD3B5, mem on close (mb), free: 267, total: 623, max: 672
2016-01-14 21:41:12,896 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testDiscardNarrow/discardnarrow/_temporary
2016-01-14 21:41:12,896 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:00.127
2016-01-14 21:41:12,918 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testDiscardNarrow/discardnarrow
2016-01-14 21:41:12,937 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:12,937 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:12,979 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.037
2016-01-14 21:41:12,979 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:12,980 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:13,000 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-14 21:41:13,000 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:13,000 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt"]
2016-01-14 21:41:13,000 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMergeLegacyHash/multimerge+true572"]
2016-01-14 21:41:13,000 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] parallel execution of steps is enabled: false
2016-01-14 21:41:13,000 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executing total steps: 1
2016-01-14 21:41:13,000 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] allocating management threads: 1
2016-01-14 21:41:13,002 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...cyHash/multimerge+true572
2016-01-14 21:41:13,053 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1690133965/.staging/job_local1690133965_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:13,054 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1690133965/.staging/job_local1690133965_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:13,084 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1690133965_0018/job_local1690133965_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:13,085 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1690133965_0018/job_local1690133965_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:13,085 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local1690133965_0018
2016-01-14 21:41:13,087 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-14 21:41:13,090 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:13,105 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:13,105 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:13,112 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C7293E1AA2EC4110B4E5AF68AA325969, ordinal: 0
2016-01-14 21:41:13,113 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:13,113 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-14 21:41:13,113 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C7293E1AA2EC4110B4E5AF68AA325969, mem on start (mb), free: 116, total: 623, max: 672
2016-01-14 21:41:13,115 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:13,115 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 116, total: 623, max: 672
2016-01-14 21:41:13,116 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:13,116 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 116, total: 623, max: 672
2016-01-14 21:41:13,117 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:13,117 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 116, total: 623, max: 672
2016-01-14 21:41:13,117 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:13,118 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 116, total: 623, max: 672
2016-01-14 21:41:13,118 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C7293E1AA2EC4110B4E5AF68AA325969, mem on close (mb), free: 116, total: 623, max: 672
2016-01-14 21:41:13,126 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt
2016-01-14 21:41:13,146 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:13,146 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:13,154 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C7293E1AA2EC4110B4E5AF68AA325969, ordinal: 0
2016-01-14 21:41:13,154 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt"]
2016-01-14 21:41:13,155 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-14 21:41:13,155 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C7293E1AA2EC4110B4E5AF68AA325969, mem on start (mb), free: 207, total: 623, max: 672
2016-01-14 21:41:13,160 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:13,160 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 206, total: 623, max: 672
2016-01-14 21:41:13,161 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:13,162 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 206, total: 623, max: 672
2016-01-14 21:41:13,163 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:13,163 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 206, total: 623, max: 672
2016-01-14 21:41:13,164 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:13,164 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 206, total: 623, max: 672
2016-01-14 21:41:13,165 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C7293E1AA2EC4110B4E5AF68AA325969, mem on close (mb), free: 206, total: 623, max: 672
2016-01-14 21:41:13,180 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:13,181 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:13,187 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D401CD43B83345C9BAFFC215458B5CE7, ordinal: 1
2016-01-14 21:41:13,188 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2016-01-14 21:41:13,188 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMergeLegacyHash/multimerge+true572"]
2016-01-14 21:41:13,188 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D401CD43B83345C9BAFFC215458B5CE7, mem on start (mb), free: 200, total: 623, max: 672
2016-01-14 21:41:13,197 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D401CD43B83345C9BAFFC215458B5CE7, mem on close (mb), free: 199, total: 623, max: 672
2016-01-14 21:41:13,211 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMergeLegacyHash/multimerge+true572/_temporary
2016-01-14 21:41:13,211 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] completed in: 00:00.211
2016-01-14 21:41:13,251 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMergeLegacyHash/multimerge+true572
2016-01-14 21:41:13,263 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:13,264 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:13,286 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 21:41:13,287 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 21:41:13,287 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:13,298 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 21:41:13,299 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt"]
2016-01-14 21:41:13,299 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNamed/rename"]
2016-01-14 21:41:13,299 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-14 21:41:13,299 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-14 21:41:13,299 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-14 21:41:13,300 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...rm/testRenameNamed/rename
2016-01-14 21:41:13,355 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1301127762/.staging/job_local1301127762_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:13,356 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1301127762/.staging/job_local1301127762_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:13,393 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1301127762_0019/job_local1301127762_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:13,394 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1301127762_0019/job_local1301127762_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:13,396 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local1301127762_0019
2016-01-14 21:41:13,396 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 21:41:13,401 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt
2016-01-14 21:41:13,409 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:13,409 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:13,412 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D0B2349303B341E0ABA96A091432927A, ordinal: 0
2016-01-14 21:41:13,413 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt"]
2016-01-14 21:41:13,413 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNamed/rename"]
2016-01-14 21:41:13,413 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D0B2349303B341E0ABA96A091432927A, mem on start (mb), free: 146, total: 623, max: 672
2016-01-14 21:41:13,415 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D0B2349303B341E0ABA96A091432927A, mem on close (mb), free: 146, total: 623, max: 672
2016-01-14 21:41:13,432 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNamed/rename/_temporary
2016-01-14 21:41:13,434 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:00.134
2016-01-14 21:41:13,455 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testRenameNamed/rename
2016-01-14 21:41:13,470 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:13,470 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:13,526 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.051
2016-01-14 21:41:13,528 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:13,529 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:13,547 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-14 21:41:13,548 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:13,549 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt"]
2016-01-14 21:41:13,550 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMerge/multimerge+true571"]
2016-01-14 21:41:13,550 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] parallel execution of steps is enabled: false
2016-01-14 21:41:13,552 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executing total steps: 1
2016-01-14 21:41:13,552 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] allocating management threads: 1
2016-01-14 21:41:13,554 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...rMerge/multimerge+true571
2016-01-14 21:41:13,609 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1772253954/.staging/job_local1772253954_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:13,610 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1772253954/.staging/job_local1772253954_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:13,640 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1772253954_0020/job_local1772253954_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:13,641 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1772253954_0020/job_local1772253954_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:13,641 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local1772253954_0020
2016-01-14 21:41:13,642 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-14 21:41:13,646 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:13,665 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:13,666 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:13,671 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A07C04AB2735412F8B77479F328CDF3C, ordinal: 0
2016-01-14 21:41:13,672 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:13,672 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-14 21:41:13,672 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A07C04AB2735412F8B77479F328CDF3C, mem on start (mb), free: 207, total: 624, max: 672
2016-01-14 21:41:13,673 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:13,673 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 207, total: 624, max: 672
2016-01-14 21:41:13,674 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:13,674 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 207, total: 624, max: 672
2016-01-14 21:41:13,674 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:13,675 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 207, total: 624, max: 672
2016-01-14 21:41:13,675 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:13,675 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 207, total: 624, max: 672
2016-01-14 21:41:13,676 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A07C04AB2735412F8B77479F328CDF3C, mem on close (mb), free: 207, total: 624, max: 672
2016-01-14 21:41:13,682 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt
2016-01-14 21:41:13,696 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:13,697 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:13,702 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A07C04AB2735412F8B77479F328CDF3C, ordinal: 0
2016-01-14 21:41:13,703 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt"]
2016-01-14 21:41:13,703 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-14 21:41:13,703 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A07C04AB2735412F8B77479F328CDF3C, mem on start (mb), free: 105, total: 624, max: 672
2016-01-14 21:41:13,706 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:13,707 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 105, total: 624, max: 672
2016-01-14 21:41:13,708 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:13,708 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 105, total: 624, max: 672
2016-01-14 21:41:13,708 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:13,709 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 105, total: 624, max: 672
2016-01-14 21:41:13,709 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:13,709 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 105, total: 624, max: 672
2016-01-14 21:41:13,710 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A07C04AB2735412F8B77479F328CDF3C, mem on close (mb), free: 105, total: 624, max: 672
2016-01-14 21:41:13,726 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:13,726 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:13,733 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: AF6F194B6A6149F882BD9E8D783FFEA1, ordinal: 1
2016-01-14 21:41:13,734 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2016-01-14 21:41:13,734 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMerge/multimerge+true571"]
2016-01-14 21:41:13,734 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AF6F194B6A6149F882BD9E8D783FFEA1, mem on start (mb), free: 98, total: 624, max: 672
2016-01-14 21:41:13,743 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AF6F194B6A6149F882BD9E8D783FFEA1, mem on close (mb), free: 97, total: 624, max: 672
2016-01-14 21:41:13,764 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMerge/multimerge+true571/_temporary
2016-01-14 21:41:13,764 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] completed in: 00:00.216
2016-01-14 21:41:13,810 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMerge/multimerge+true571
2016-01-14 21:41:13,825 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:13,825 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:13,886 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.058
2016-01-14 21:41:13,887 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 4
2016-01-14 21:41:13,887 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:13,906 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting
2016-01-14 21:41:13,906 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:13,907 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMerge/samesourcemergecount"]
2016-01-14 21:41:13,907 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] parallel execution of steps is enabled: false
2016-01-14 21:41:13,907 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executing total steps: 2
2016-01-14 21:41:13,909 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] allocating management threads: 1
2016-01-14 21:41:13,910 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting step: (1/2)
2016-01-14 21:41:13,966 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity569273676/.staging/job_local569273676_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:13,967 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity569273676/.staging/job_local569273676_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:13,998 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local569273676_0021/job_local569273676_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:13,998 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local569273676_0021/job_local569273676_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:13,999 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] submitted hadoop job: job_local569273676_0021
2016-01-14 21:41:13,999 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tracking url: http://localhost:8080/
2016-01-14 21:41:14,003 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:14,017 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:14,018 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:14,023 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DFF394A39D2D43D8BDD2EA5DC653123A, ordinal: 0
2016-01-14 21:41:14,024 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:14,024 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(first)[by:[{1}:'char']]
2016-01-14 21:41:14,024 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DFF394A39D2D43D8BDD2EA5DC653123A, mem on start (mb), free: 166, total: 624, max: 672
2016-01-14 21:41:14,028 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:14,028 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 166, total: 624, max: 672
2016-01-14 21:41:14,029 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:14,029 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 166, total: 624, max: 672
2016-01-14 21:41:14,029 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:14,029 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 166, total: 624, max: 672
2016-01-14 21:41:14,030 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:14,030 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 166, total: 624, max: 672
2016-01-14 21:41:14,030 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DFF394A39D2D43D8BDD2EA5DC653123A, mem on close (mb), free: 166, total: 624, max: 672
2016-01-14 21:41:14,047 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:14,047 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:14,055 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C269E683798C40EEAF7C6D9F35745892, ordinal: 1
2016-01-14 21:41:14,055 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(first)[by:[{1}:'char']]
2016-01-14 21:41:14,055 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][9716378172/first/]
2016-01-14 21:41:14,056 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C269E683798C40EEAF7C6D9F35745892, mem on start (mb), free: 159, total: 624, max: 672
2016-01-14 21:41:14,063 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C269E683798C40EEAF7C6D9F35745892, mem on close (mb), free: 158, total: 624, max: 672
2016-01-14 21:41:14,083 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting step: (2/2) ...erge/samesourcemergecount
2016-01-14 21:41:14,154 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity975171596/.staging/job_local975171596_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:14,156 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity975171596/.staging/job_local975171596_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:14,188 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local975171596_0022/job_local975171596_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:14,189 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local975171596_0022/job_local975171596_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:14,189 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] submitted hadoop job: job_local975171596_0022
2016-01-14 21:41:14,189 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tracking url: http://localhost:8080/
2016-01-14 21:41:14,194 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/9716378172_first_B68646B8FC4D41969D705B45F6074927/part-00000
2016-01-14 21:41:14,213 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:14,213 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:14,218 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DBFAE3F3584C4E00A2071E002CBD424F, ordinal: 0
2016-01-14 21:41:14,219 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][9716378172/first/]
2016-01-14 21:41:14,219 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(second)[by:[{1}:'char']]
2016-01-14 21:41:14,219 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DBFAE3F3584C4E00A2071E002CBD424F, mem on start (mb), free: 208, total: 625, max: 672
2016-01-14 21:41:14,220 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:14,221 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 208, total: 625, max: 672
2016-01-14 21:41:14,221 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:14,221 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 208, total: 625, max: 672
2016-01-14 21:41:14,222 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DBFAE3F3584C4E00A2071E002CBD424F, mem on close (mb), free: 208, total: 625, max: 672
2016-01-14 21:41:14,234 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:14,234 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:14,240 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B87545BEB7B44961B10330F018BB2BEC, ordinal: 1
2016-01-14 21:41:14,241 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(second)[by:[{1}:'char']]
2016-01-14 21:41:14,241 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMerge/samesourcemergecount"]
2016-01-14 21:41:14,241 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B87545BEB7B44961B10330F018BB2BEC, mem on start (mb), free: 202, total: 625, max: 672
2016-01-14 21:41:14,249 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B87545BEB7B44961B10330F018BB2BEC, mem on close (mb), free: 200, total: 625, max: 672
2016-01-14 21:41:14,267 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMerge/samesourcemergecount/_temporary
2016-01-14 21:41:14,268 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] completed in: 00:00.360
2016-01-14 21:41:14,311 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testSameSourceMerge/samesourcemergecount
2016-01-14 21:41:14,329 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:14,330 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:14,351 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 21:41:14,352 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:14,352 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:14,359 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] starting
2016-01-14 21:41:14,359 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:14,359 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageBy/average"]
2016-01-14 21:41:14,360 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] parallel execution of steps is enabled: false
2016-01-14 21:41:14,360 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] executing total steps: 1
2016-01-14 21:41:14,360 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] allocating management threads: 1
2016-01-14 21:41:14,361 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] starting step: (1/1) ...orm/testAverageBy/average
2016-01-14 21:41:14,410 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity2071033206/.staging/job_local2071033206_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:14,411 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity2071033206/.staging/job_local2071033206_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:14,440 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2071033206_0023/job_local2071033206_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:14,441 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2071033206_0023/job_local2071033206_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:14,442 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] submitted hadoop job: job_local2071033206_0023
2016-01-14 21:41:14,443 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] tracking url: http://localhost:8080/
2016-01-14 21:41:14,447 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:14,466 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:14,467 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:14,471 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FE04608B4A0F408A84D02FEC5E8D7318, ordinal: 0
2016-01-14 21:41:14,472 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:14,472 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2016-01-14 21:41:14,472 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FE04608B4A0F408A84D02FEC5E8D7318, mem on start (mb), free: 210, total: 625, max: 672
2016-01-14 21:41:14,474 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:14,474 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 210, total: 625, max: 672
2016-01-14 21:41:14,475 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:14,475 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 210, total: 625, max: 672
2016-01-14 21:41:14,476 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:14,476 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 210, total: 625, max: 672
2016-01-14 21:41:14,476 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:14,477 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 210, total: 625, max: 672
2016-01-14 21:41:14,477 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FE04608B4A0F408A84D02FEC5E8D7318, mem on close (mb), free: 210, total: 625, max: 672
2016-01-14 21:41:14,493 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:14,494 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:14,498 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: EC0C624631894E84A6AC037331BBCBA6, ordinal: 1
2016-01-14 21:41:14,499 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2016-01-14 21:41:14,499 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageBy/average"]
2016-01-14 21:41:14,500 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EC0C624631894E84A6AC037331BBCBA6, mem on start (mb), free: 204, total: 625, max: 672
2016-01-14 21:41:14,507 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EC0C624631894E84A6AC037331BBCBA6, mem on close (mb), free: 203, total: 625, max: 672
2016-01-14 21:41:14,519 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageBy/average/_temporary
2016-01-14 21:41:14,520 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] completed in: 00:00.160
2016-01-14 21:41:14,571 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testAverageBy/average
2016-01-14 21:41:14,583 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:14,584 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:14,604 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 21:41:14,605 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:14,605 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:14,615 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting
2016-01-14 21:41:14,615 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:14,615 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] sink: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByNullSafety/maxbynullsafety"]
2016-01-14 21:41:14,615 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] parallel execution of steps is enabled: false
2016-01-14 21:41:14,615 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executing total steps: 1
2016-01-14 21:41:14,616 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] allocating management threads: 1
2016-01-14 21:41:14,616 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting step: (1/1) ...ullSafety/maxbynullsafety
2016-01-14 21:41:14,665 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity368904188/.staging/job_local368904188_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:14,666 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity368904188/.staging/job_local368904188_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:14,694 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local368904188_0024/job_local368904188_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:14,695 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local368904188_0024/job_local368904188_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:14,696 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] submitted hadoop job: job_local368904188_0024
2016-01-14 21:41:14,696 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] tracking url: http://localhost:8080/
2016-01-14 21:41:14,700 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:14,719 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:14,719 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:14,724 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: EB6606E6258243268FCB87FC2D780DCE, ordinal: 0
2016-01-14 21:41:14,724 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:14,724 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(max)[by:[{1}:'char']]
2016-01-14 21:41:14,724 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EB6606E6258243268FCB87FC2D780DCE, mem on start (mb), free: 210, total: 626, max: 672
2016-01-14 21:41:14,726 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:14,726 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 210, total: 626, max: 672
2016-01-14 21:41:14,727 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:14,727 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 210, total: 626, max: 672
2016-01-14 21:41:14,728 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:14,728 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 210, total: 626, max: 672
2016-01-14 21:41:14,728 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:14,728 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 210, total: 626, max: 672
2016-01-14 21:41:14,730 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EB6606E6258243268FCB87FC2D780DCE, mem on close (mb), free: 210, total: 626, max: 672
2016-01-14 21:41:14,746 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:14,746 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:14,750 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A0C1CBB850354F1AB5F694D7E7F42FBB, ordinal: 1
2016-01-14 21:41:14,751 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(max)[by:[{1}:'char']]
2016-01-14 21:41:14,751 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByNullSafety/maxbynullsafety"]
2016-01-14 21:41:14,751 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A0C1CBB850354F1AB5F694D7E7F42FBB, mem on start (mb), free: 205, total: 626, max: 672
2016-01-14 21:41:14,759 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A0C1CBB850354F1AB5F694D7E7F42FBB, mem on close (mb), free: 204, total: 626, max: 672
2016-01-14 21:41:14,772 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByNullSafety/maxbynullsafety/_temporary
2016-01-14 21:41:14,772 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] completed in: 00:00.158
2016-01-14 21:41:14,815 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMaxByNullSafety/maxbynullsafety
2016-01-14 21:41:14,827 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:14,828 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:14,848 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 21:41:14,851 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:14,851 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:14,860 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] starting
2016-01-14 21:41:14,860 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:14,860 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumByNulls/sumnulls"]
2016-01-14 21:41:14,860 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] parallel execution of steps is enabled: false
2016-01-14 21:41:14,860 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] executing total steps: 1
2016-01-14 21:41:14,861 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] allocating management threads: 1
2016-01-14 21:41:14,861 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] starting step: (1/1) ...m/testSumByNulls/sumnulls
2016-01-14 21:41:14,910 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity260754934/.staging/job_local260754934_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:14,911 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity260754934/.staging/job_local260754934_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:14,944 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local260754934_0025/job_local260754934_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:14,944 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local260754934_0025/job_local260754934_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:14,945 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] submitted hadoop job: job_local260754934_0025
2016-01-14 21:41:14,946 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] tracking url: http://localhost:8080/
2016-01-14 21:41:14,950 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:14,971 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:14,972 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:14,976 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: EA717F12336E4EEDBB43B0AD990E5A71, ordinal: 0
2016-01-14 21:41:14,977 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:14,977 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2016-01-14 21:41:14,978 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EA717F12336E4EEDBB43B0AD990E5A71, mem on start (mb), free: 211, total: 626, max: 672
2016-01-14 21:41:14,985 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:14,985 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 210, total: 626, max: 672
2016-01-14 21:41:14,987 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:14,987 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 210, total: 626, max: 672
2016-01-14 21:41:14,988 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:14,988 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 210, total: 626, max: 672
2016-01-14 21:41:14,989 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:14,989 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 210, total: 626, max: 672
2016-01-14 21:41:14,990 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EA717F12336E4EEDBB43B0AD990E5A71, mem on close (mb), free: 210, total: 626, max: 672
2016-01-14 21:41:15,006 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:15,006 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:15,010 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CA65C095145F4170903DDBC1E86237CF, ordinal: 1
2016-01-14 21:41:15,010 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2016-01-14 21:41:15,011 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumByNulls/sumnulls"]
2016-01-14 21:41:15,011 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CA65C095145F4170903DDBC1E86237CF, mem on start (mb), free: 205, total: 626, max: 672
2016-01-14 21:41:15,019 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CA65C095145F4170903DDBC1E86237CF, mem on close (mb), free: 204, total: 626, max: 672
2016-01-14 21:41:15,034 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumByNulls/sumnulls/_temporary
2016-01-14 21:41:15,036 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] completed in: 00:00.174
2016-01-14 21:41:15,086 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testSumByNulls/sumnulls
2016-01-14 21:41:15,099 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:15,099 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:15,119 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 21:41:15,120 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:15,120 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:15,128 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting
2016-01-14 21:41:15,128 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:15,128 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] sink: Hfs["TextDelimited[['count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountAll/countall"]
2016-01-14 21:41:15,128 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] parallel execution of steps is enabled: false
2016-01-14 21:41:15,129 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executing total steps: 1
2016-01-14 21:41:15,129 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] allocating management threads: 1
2016-01-14 21:41:15,130 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (1/1) ...orm/testCountAll/countall
2016-01-14 21:41:15,179 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1908954303/.staging/job_local1908954303_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:15,180 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1908954303/.staging/job_local1908954303_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:15,211 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1908954303_0026/job_local1908954303_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:15,212 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1908954303_0026/job_local1908954303_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:15,213 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local1908954303_0026
2016-01-14 21:41:15,214 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-14 21:41:15,217 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:15,237 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:15,238 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:15,242 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AB43A7540D7F4109A10D361494A11630, ordinal: 0
2016-01-14 21:41:15,243 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:15,243 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2016-01-14 21:41:15,243 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AB43A7540D7F4109A10D361494A11630, mem on start (mb), free: 211, total: 627, max: 672
2016-01-14 21:41:15,246 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AB43A7540D7F4109A10D361494A11630, mem on close (mb), free: 211, total: 627, max: 672
2016-01-14 21:41:15,257 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:15,257 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:15,262 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E79D9C6B1DC94870B11388E10DDA3180, ordinal: 1
2016-01-14 21:41:15,262 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2016-01-14 21:41:15,262 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountAll/countall"]
2016-01-14 21:41:15,262 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E79D9C6B1DC94870B11388E10DDA3180, mem on start (mb), free: 206, total: 627, max: 672
2016-01-14 21:41:15,269 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E79D9C6B1DC94870B11388E10DDA3180, mem on close (mb), free: 205, total: 627, max: 672
2016-01-14 21:41:15,288 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountAll/countall/_temporary
2016-01-14 21:41:15,289 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] completed in: 00:00.160
2016-01-14 21:41:15,329 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCountAll/countall
2016-01-14 21:41:15,342 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:15,342 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:15,365 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-01-14 21:41:15,366 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:15,366 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:15,375 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-14 21:41:15,375 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:15,376 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregates/multi"]
2016-01-14 21:41:15,376 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] parallel execution of steps is enabled: false
2016-01-14 21:41:15,376 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executing total steps: 1
2016-01-14 21:41:15,376 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] allocating management threads: 1
2016-01-14 21:41:15,377 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...tParallelAggregates/multi
2016-01-14 21:41:15,432 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1202756579/.staging/job_local1202756579_0027/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:15,434 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1202756579/.staging/job_local1202756579_0027/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:15,480 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1202756579_0027/job_local1202756579_0027.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:15,482 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1202756579_0027/job_local1202756579_0027.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:15,483 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local1202756579_0027
2016-01-14 21:41:15,483 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-14 21:41:15,487 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:15,509 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:15,509 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:15,515 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D3104B3846FB42229D2F38210099DD54, ordinal: 0
2016-01-14 21:41:15,515 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:15,516 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-14 21:41:15,516 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D3104B3846FB42229D2F38210099DD54, mem on start (mb), free: 211, total: 627, max: 672
2016-01-14 21:41:15,518 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:15,518 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 211, total: 627, max: 672
2016-01-14 21:41:15,519 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:15,520 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 211, total: 627, max: 672
2016-01-14 21:41:15,521 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:15,521 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 211, total: 627, max: 672
2016-01-14 21:41:15,522 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:15,522 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 211, total: 627, max: 672
2016-01-14 21:41:15,523 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D3104B3846FB42229D2F38210099DD54, mem on close (mb), free: 211, total: 627, max: 672
2016-01-14 21:41:15,536 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:15,536 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:15,542 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C4BC5A320C9147578C26F5C83548D1D1, ordinal: 1
2016-01-14 21:41:15,543 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2016-01-14 21:41:15,543 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregates/multi"]
2016-01-14 21:41:15,543 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C4BC5A320C9147578C26F5C83548D1D1, mem on start (mb), free: 205, total: 627, max: 672
2016-01-14 21:41:15,552 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C4BC5A320C9147578C26F5C83548D1D1, mem on close (mb), free: 205, total: 627, max: 672
2016-01-14 21:41:15,572 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregates/multi/_temporary
2016-01-14 21:41:15,572 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] completed in: 00:00.197
2016-01-14 21:41:15,619 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testParallelAggregates/multi
2016-01-14 21:41:15,632 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:15,633 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:15,650 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.013
2016-01-14 21:41:15,650 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 21:41:15,651 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:15,657 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 21:41:15,657 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt"]
2016-01-14 21:41:15,658 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRetainNarrow/retainnarrow"]
2016-01-14 21:41:15,658 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-14 21:41:15,658 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-14 21:41:15,658 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-14 21:41:15,659 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...RetainNarrow/retainnarrow
2016-01-14 21:41:15,709 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1624204811/.staging/job_local1624204811_0028/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:15,709 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1624204811/.staging/job_local1624204811_0028/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:15,737 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1624204811_0028/job_local1624204811_0028.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:15,738 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1624204811_0028/job_local1624204811_0028.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:15,738 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local1624204811_0028
2016-01-14 21:41:15,738 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 21:41:15,742 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt
2016-01-14 21:41:15,747 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:15,747 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:15,750 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A93C7572323F4CF2AF959A6C861A1A36, ordinal: 0
2016-01-14 21:41:15,750 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt"]
2016-01-14 21:41:15,751 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRetainNarrow/retainnarrow"]
2016-01-14 21:41:15,751 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A93C7572323F4CF2AF959A6C861A1A36, mem on start (mb), free: 154, total: 627, max: 672
2016-01-14 21:41:15,752 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A93C7572323F4CF2AF959A6C861A1A36, mem on close (mb), free: 154, total: 627, max: 672
2016-01-14 21:41:15,771 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRetainNarrow/retainnarrow/_temporary
2016-01-14 21:41:15,771 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:00.114
2016-01-14 21:41:15,790 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testRetainNarrow/retainnarrow
2016-01-14 21:41:15,801 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:15,802 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:15,817 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.012
2016-01-14 21:41:15,817 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 21:41:15,817 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:15,823 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 21:41:15,823 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt"]
2016-01-14 21:41:15,823 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['item']->['char', 'item']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNarrow/renamenarrow"]
2016-01-14 21:41:15,823 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-14 21:41:15,824 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-14 21:41:15,824 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-14 21:41:15,824 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...RenameNarrow/renamenarrow
2016-01-14 21:41:15,891 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity475551435/.staging/job_local475551435_0029/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:15,892 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity475551435/.staging/job_local475551435_0029/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:15,923 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local475551435_0029/job_local475551435_0029.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:15,924 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local475551435_0029/job_local475551435_0029.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:15,925 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local475551435_0029
2016-01-14 21:41:15,925 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 21:41:15,928 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt
2016-01-14 21:41:15,933 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:15,933 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:15,938 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B3AC9476A26349A9BD66940A554A66D7, ordinal: 0
2016-01-14 21:41:15,939 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt"]
2016-01-14 21:41:15,939 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['item']->['char', 'item']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNarrow/renamenarrow"]
2016-01-14 21:41:15,939 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B3AC9476A26349A9BD66940A554A66D7, mem on start (mb), free: 109, total: 627, max: 672
2016-01-14 21:41:15,941 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B3AC9476A26349A9BD66940A554A66D7, mem on close (mb), free: 109, total: 627, max: 672
2016-01-14 21:41:15,958 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNarrow/renamenarrow/_temporary
2016-01-14 21:41:15,958 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:00.134
2016-01-14 21:41:15,980 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testRenameNarrow/renamenarrow
2016-01-14 21:41:15,994 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:15,994 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:16,015 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 21:41:16,016 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:16,016 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:16,023 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] starting
2016-01-14 21:41:16,024 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:16,024 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageByNull/averagenull"]
2016-01-14 21:41:16,025 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] parallel execution of steps is enabled: false
2016-01-14 21:41:16,026 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] executing total steps: 1
2016-01-14 21:41:16,026 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] allocating management threads: 1
2016-01-14 21:41:16,027 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] starting step: (1/1) ...AverageByNull/averagenull
2016-01-14 21:41:16,087 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity108283467/.staging/job_local108283467_0030/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:16,088 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity108283467/.staging/job_local108283467_0030/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:16,116 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local108283467_0030/job_local108283467_0030.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:16,117 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local108283467_0030/job_local108283467_0030.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:16,117 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] submitted hadoop job: job_local108283467_0030
2016-01-14 21:41:16,117 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] tracking url: http://localhost:8080/
2016-01-14 21:41:16,123 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:16,138 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:16,138 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:16,142 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D931BE91CCB04C4EA4CE82B02EA16CD4, ordinal: 0
2016-01-14 21:41:16,143 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:16,143 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2016-01-14 21:41:16,143 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D931BE91CCB04C4EA4CE82B02EA16CD4, mem on start (mb), free: 194, total: 628, max: 672
2016-01-14 21:41:16,147 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:16,147 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 194, total: 628, max: 672
2016-01-14 21:41:16,148 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:16,148 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 194, total: 628, max: 672
2016-01-14 21:41:16,149 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:16,149 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 194, total: 628, max: 672
2016-01-14 21:41:16,150 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:16,150 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 194, total: 628, max: 672
2016-01-14 21:41:16,151 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D931BE91CCB04C4EA4CE82B02EA16CD4, mem on close (mb), free: 193, total: 628, max: 672
2016-01-14 21:41:16,163 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:16,163 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:16,167 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B10C27159D6846F3B450367E815C67F2, ordinal: 1
2016-01-14 21:41:16,168 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2016-01-14 21:41:16,168 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageByNull/averagenull"]
2016-01-14 21:41:16,168 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B10C27159D6846F3B450367E815C67F2, mem on start (mb), free: 188, total: 628, max: 672
2016-01-14 21:41:16,176 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B10C27159D6846F3B450367E815C67F2, mem on close (mb), free: 186, total: 628, max: 672
2016-01-14 21:41:16,192 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageByNull/averagenull/_temporary
2016-01-14 21:41:16,193 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] completed in: 00:00.169
2016-01-14 21:41:16,232 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testAverageByNull/averagenull
2016-01-14 21:41:16,244 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:16,245 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:16,261 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.013
2016-01-14 21:41:16,262 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 21:41:16,263 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:16,268 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] starting
2016-01-14 21:41:16,268 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt"]
2016-01-14 21:41:16,268 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] sink: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerce/coerce"]
2016-01-14 21:41:16,268 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] parallel execution of steps is enabled: false
2016-01-14 21:41:16,268 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] executing total steps: 1
2016-01-14 21:41:16,268 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] allocating management threads: 1
2016-01-14 21:41:16,270 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] starting step: (1/1) ...latform/testCoerce/coerce
2016-01-14 21:41:16,318 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1867671424/.staging/job_local1867671424_0031/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:16,319 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1867671424/.staging/job_local1867671424_0031/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:16,350 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1867671424_0031/job_local1867671424_0031.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:16,351 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1867671424_0031/job_local1867671424_0031.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:16,351 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] submitted hadoop job: job_local1867671424_0031
2016-01-14 21:41:16,351 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] tracking url: http://localhost:8080/
2016-01-14 21:41:16,354 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt
2016-01-14 21:41:16,360 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:16,360 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:16,364 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A6E54699F439499B8AD736158CD81E7D, ordinal: 0
2016-01-14 21:41:16,364 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt"]
2016-01-14 21:41:16,364 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerce/coerce"]
2016-01-14 21:41:16,364 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A6E54699F439499B8AD736158CD81E7D, mem on start (mb), free: 133, total: 628, max: 672
2016-01-14 21:41:16,366 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A6E54699F439499B8AD736158CD81E7D, mem on close (mb), free: 133, total: 628, max: 672
2016-01-14 21:41:16,384 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerce/coerce/_temporary
2016-01-14 21:41:16,385 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] completed in: 00:00.116
2016-01-14 21:41:16,404 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCoerce/coerce
2016-01-14 21:41:16,416 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:16,417 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:16,438 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 21:41:16,439 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:16,439 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:16,451 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-14 21:41:16,451 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] source: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs+rhs-cross-rev.txt"]
2016-01-14 21:41:16,451 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstByWithoutComparator/firstnfieldswithoutcomparator"]
2016-01-14 21:41:16,451 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] parallel execution of steps is enabled: false
2016-01-14 21:41:16,451 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executing total steps: 1
2016-01-14 21:41:16,451 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] allocating management threads: 1
2016-01-14 21:41:16,452 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) ...tnfieldswithoutcomparator
2016-01-14 21:41:16,503 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1264436777/.staging/job_local1264436777_0032/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:16,504 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1264436777/.staging/job_local1264436777_0032/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:16,532 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1264436777_0032/job_local1264436777_0032.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:16,533 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1264436777_0032/job_local1264436777_0032.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:16,534 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted hadoop job: job_local1264436777_0032
2016-01-14 21:41:16,534 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tracking url: http://localhost:8080/
2016-01-14 21:41:16,538 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs+rhs-cross-rev.txt
2016-01-14 21:41:16,559 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:16,560 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:16,564 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D7D941D886294B5BAB9155C96E914A11, ordinal: 0
2016-01-14 21:41:16,564 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs+rhs-cross-rev.txt"]
2016-01-14 21:41:16,565 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(first)[by:[{1}:'num']]
2016-01-14 21:41:16,565 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D7D941D886294B5BAB9155C96E914A11, mem on start (mb), free: 211, total: 628, max: 672
2016-01-14 21:41:16,567 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:16,568 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 211, total: 628, max: 672
2016-01-14 21:41:16,569 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:16,569 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 211, total: 628, max: 672
2016-01-14 21:41:16,570 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D7D941D886294B5BAB9155C96E914A11, mem on close (mb), free: 211, total: 628, max: 672
2016-01-14 21:41:16,583 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:16,583 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:16,587 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: FC769762AF7A4CC88AA31B920799A1F6, ordinal: 1
2016-01-14 21:41:16,588 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(first)[by:[{1}:'num']]
2016-01-14 21:41:16,588 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstByWithoutComparator/firstnfieldswithoutcomparator"]
2016-01-14 21:41:16,588 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FC769762AF7A4CC88AA31B920799A1F6, mem on start (mb), free: 205, total: 628, max: 672
2016-01-14 21:41:16,595 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FC769762AF7A4CC88AA31B920799A1F6, mem on close (mb), free: 204, total: 628, max: 672
2016-01-14 21:41:16,614 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstByWithoutComparator/firstnfieldswithoutcomparator/_temporary
2016-01-14 21:41:16,615 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] completed in: 00:00.163
2016-01-14 21:41:16,641 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testFirstByWithoutComparator/firstnfieldswithoutcomparator
2016-01-14 21:41:16,662 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:16,662 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:16,701 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.034
2016-01-14 21:41:16,702 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:16,703 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:16,713 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-14 21:41:16,714 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:16,714 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt"]
2016-01-14 21:41:16,714 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMergeLegacyHash/multimerge+false572"]
2016-01-14 21:41:16,714 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] parallel execution of steps is enabled: false
2016-01-14 21:41:16,714 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executing total steps: 1
2016-01-14 21:41:16,714 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] allocating management threads: 1
2016-01-14 21:41:16,715 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...yHash/multimerge+false572
2016-01-14 21:41:16,763 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity390884845/.staging/job_local390884845_0033/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:16,764 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity390884845/.staging/job_local390884845_0033/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:16,791 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local390884845_0033/job_local390884845_0033.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:16,792 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local390884845_0033/job_local390884845_0033.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:16,792 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local390884845_0033
2016-01-14 21:41:16,793 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-14 21:41:16,796 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:16,816 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:16,817 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:16,822 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AB15A9F847EE467AB15FCAD3FFAACBF4, ordinal: 0
2016-01-14 21:41:16,823 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:16,823 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 21:41:16,823 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AB15A9F847EE467AB15FCAD3FFAACBF4, mem on start (mb), free: 212, total: 628, max: 672
2016-01-14 21:41:16,825 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:16,826 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 212, total: 628, max: 672
2016-01-14 21:41:16,827 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:16,827 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 212, total: 628, max: 672
2016-01-14 21:41:16,828 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:16,829 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 212, total: 628, max: 672
2016-01-14 21:41:16,830 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:16,830 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 212, total: 628, max: 672
2016-01-14 21:41:16,831 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AB15A9F847EE467AB15FCAD3FFAACBF4, mem on close (mb), free: 212, total: 628, max: 672
2016-01-14 21:41:16,840 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt
2016-01-14 21:41:16,856 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:16,856 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:16,865 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AB15A9F847EE467AB15FCAD3FFAACBF4, ordinal: 0
2016-01-14 21:41:16,866 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt"]
2016-01-14 21:41:16,866 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 21:41:16,867 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AB15A9F847EE467AB15FCAD3FFAACBF4, mem on start (mb), free: 111, total: 628, max: 672
2016-01-14 21:41:16,871 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:16,871 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 111, total: 628, max: 672
2016-01-14 21:41:16,873 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:16,873 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 111, total: 628, max: 672
2016-01-14 21:41:16,874 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:16,874 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 111, total: 628, max: 672
2016-01-14 21:41:16,875 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:16,875 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 111, total: 628, max: 672
2016-01-14 21:41:16,876 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AB15A9F847EE467AB15FCAD3FFAACBF4, mem on close (mb), free: 111, total: 628, max: 672
2016-01-14 21:41:16,895 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:16,895 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:16,904 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DBBA3264F9964F1A95BB72ECEBFD91A9, ordinal: 1
2016-01-14 21:41:16,905 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 21:41:16,905 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMergeLegacyHash/multimerge+false572"]
2016-01-14 21:41:16,905 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DBBA3264F9964F1A95BB72ECEBFD91A9, mem on start (mb), free: 105, total: 628, max: 672
2016-01-14 21:41:16,914 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DBBA3264F9964F1A95BB72ECEBFD91A9, mem on close (mb), free: 104, total: 628, max: 672
2016-01-14 21:41:16,935 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMergeLegacyHash/multimerge+false572/_temporary
2016-01-14 21:41:16,935 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] completed in: 00:00.221
2016-01-14 21:41:16,979 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMergeLegacyHash/multimerge+false572
2016-01-14 21:41:16,995 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:16,996 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:17,111 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.112
2016-01-14 21:41:17,112 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 5, nodes: 10
2016-01-14 21:41:17,112 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:17,160 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting
2016-01-14 21:41:17,161 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:17,161 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMergeThreeWay/samesourcemergethreeway"]
2016-01-14 21:41:17,161 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] parallel execution of steps is enabled: false
2016-01-14 21:41:17,161 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] executing total steps: 5
2016-01-14 21:41:17,162 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] allocating management threads: 1
2016-01-14 21:41:17,162 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (1/5)
2016-01-14 21:41:17,219 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity203375288/.staging/job_local203375288_0034/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:17,220 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity203375288/.staging/job_local203375288_0034/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:17,249 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local203375288_0034/job_local203375288_0034.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:17,250 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local203375288_0034/job_local203375288_0034.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:17,251 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local203375288_0034
2016-01-14 21:41:17,252 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-14 21:41:17,255 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:17,269 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:17,269 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:17,273 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FEC1902A2EBF4225BF1BB1A160A1B7C1, ordinal: 0
2016-01-14 21:41:17,274 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:17,274 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(source)[by:[{1}:'char']]
2016-01-14 21:41:17,274 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FEC1902A2EBF4225BF1BB1A160A1B7C1, mem on start (mb), free: 178, total: 630, max: 672
2016-01-14 21:41:17,275 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:17,275 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 178, total: 630, max: 672
2016-01-14 21:41:17,276 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:17,276 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 178, total: 630, max: 672
2016-01-14 21:41:17,276 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 21:41:17,277 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 178, total: 630, max: 672
2016-01-14 21:41:17,277 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 21:41:17,277 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 178, total: 630, max: 672
2016-01-14 21:41:17,278 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FEC1902A2EBF4225BF1BB1A160A1B7C1, mem on close (mb), free: 178, total: 630, max: 672
2016-01-14 21:41:17,289 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:17,290 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:17,293 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C97115B51C564E1DB51A1A53659D0D4E, ordinal: 1
2016-01-14 21:41:17,294 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(source)[by:[{1}:'char']]
2016-01-14 21:41:17,294 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][2730528369/source/]
2016-01-14 21:41:17,294 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C97115B51C564E1DB51A1A53659D0D4E, mem on start (mb), free: 172, total: 630, max: 672
2016-01-14 21:41:17,302 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C97115B51C564E1DB51A1A53659D0D4E, mem on close (mb), free: 170, total: 630, max: 672
2016-01-14 21:41:17,317 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (2/5)
2016-01-14 21:41:17,377 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1095463424/.staging/job_local1095463424_0035/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:17,378 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1095463424/.staging/job_local1095463424_0035/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:17,405 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1095463424_0035/job_local1095463424_0035.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:17,406 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1095463424_0035/job_local1095463424_0035.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:17,407 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local1095463424_0035
2016-01-14 21:41:17,407 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-14 21:41:17,410 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/2730528369_source_7DEBD2DD91F6400593FED66B38FAB38C/part-00000
2016-01-14 21:41:17,431 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:17,431 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:17,435 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FC0F6B721462421598D24BCA0F971FFE, ordinal: 0
2016-01-14 21:41:17,436 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][2730528369/source/]
2016-01-14 21:41:17,436 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count-rhs)[by:[{1}:'char']]
2016-01-14 21:41:17,437 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FC0F6B721462421598D24BCA0F971FFE, mem on start (mb), free: 213, total: 630, max: 672
2016-01-14 21:41:17,438 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:17,438 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 213, total: 630, max: 672
2016-01-14 21:41:17,438 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:17,439 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 213, total: 630, max: 672
2016-01-14 21:41:17,439 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FC0F6B721462421598D24BCA0F971FFE, mem on close (mb), free: 213, total: 630, max: 672
2016-01-14 21:41:17,451 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:17,451 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:17,455 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C3CE82210BDA4E86A9E8ECF6ECEE3D0F, ordinal: 1
2016-01-14 21:41:17,456 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count-rhs)[by:[{1}:'char']]
2016-01-14 21:41:17,456 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][1039098194/count-rhs/]
2016-01-14 21:41:17,456 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C3CE82210BDA4E86A9E8ECF6ECEE3D0F, mem on start (mb), free: 207, total: 630, max: 672
2016-01-14 21:41:17,462 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C3CE82210BDA4E86A9E8ECF6ECEE3D0F, mem on close (mb), free: 205, total: 630, max: 672
2016-01-14 21:41:17,482 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (3/5)
2016-01-14 21:41:17,539 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity2042250048/.staging/job_local2042250048_0036/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:17,540 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity2042250048/.staging/job_local2042250048_0036/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:17,574 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2042250048_0036/job_local2042250048_0036.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:17,575 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2042250048_0036/job_local2042250048_0036.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:17,575 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local2042250048_0036
2016-01-14 21:41:17,576 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-14 21:41:17,579 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/2730528369_source_7DEBD2DD91F6400593FED66B38FAB38C/part-00000
2016-01-14 21:41:17,599 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:17,599 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:17,604 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D5F77E9C2D034B46B07980BE15EC8F92, ordinal: 0
2016-01-14 21:41:17,604 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][2730528369/source/]
2016-01-14 21:41:17,604 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count-lhs)[by:[{1}:'char']]
2016-01-14 21:41:17,605 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D5F77E9C2D034B46B07980BE15EC8F92, mem on start (mb), free: 213, total: 630, max: 672
2016-01-14 21:41:17,606 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 21:41:17,606 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 213, total: 630, max: 672
2016-01-14 21:41:17,607 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 21:41:17,607 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 213, total: 630, max: 672
2016-01-14 21:41:17,607 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D5F77E9C2D034B46B07980BE15EC8F92, mem on close (mb), free: 213, total: 630, max: 672
2016-01-14 21:41:17,619 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:17,619 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:17,623 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: ED1281B0A32946559725C94768037565, ordinal: 1
2016-01-14 21:41:17,624 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count-lhs)[by:[{1}:'char']]
2016-01-14 21:41:17,624 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][891347545/count-lhs/]
2016-01-14 21:41:17,624 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ED1281B0A32946559725C94768037565, mem on start (mb), free: 207, total: 630, max: 672
2016-01-14 21:41:17,630 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ED1281B0A32946559725C94768037565, mem on close (mb), free: 205, total: 630, max: 672
2016-01-14 21:41:17,639 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (4/5)
2016-01-14 21:41:17,708 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1040041993/.staging/job_local1040041993_0037/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:17,708 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1040041993/.staging/job_local1040041993_0037/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:17,736 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1040041993_0037/job_local1040041993_0037.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:17,736 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1040041993_0037/job_local1040041993_0037.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:17,737 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local1040041993_0037
2016-01-14 21:41:17,738 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-14 21:41:17,741 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/1039098194_count_rhs_17E05B5FE9C742888F058BAA33AB50FF/part-00000
2016-01-14 21:41:17,760 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:17,761 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:17,765 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F695945D2F4342C2B86BDC140DC30A4B, ordinal: 0
2016-01-14 21:41:17,766 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][1039098194/count-rhs/]
2016-01-14 21:41:17,766 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 21:41:17,766 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F695945D2F4342C2B86BDC140DC30A4B, mem on start (mb), free: 213, total: 630, max: 672
2016-01-14 21:41:17,767 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F695945D2F4342C2B86BDC140DC30A4B, mem on close (mb), free: 213, total: 630, max: 672
2016-01-14 21:41:17,773 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/2730528369_source_7DEBD2DD91F6400593FED66B38FAB38C/part-00000
2016-01-14 21:41:17,787 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:17,787 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:17,791 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F695945D2F4342C2B86BDC140DC30A4B, ordinal: 0
2016-01-14 21:41:17,792 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][2730528369/source/]
2016-01-14 21:41:17,792 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 21:41:17,792 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F695945D2F4342C2B86BDC140DC30A4B, mem on start (mb), free: 111, total: 630, max: 672
2016-01-14 21:41:17,794 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F695945D2F4342C2B86BDC140DC30A4B, mem on close (mb), free: 111, total: 630, max: 672
2016-01-14 21:41:17,807 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:17,807 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:17,811 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C16FE31E693745479CCD9B047757D2F7, ordinal: 1
2016-01-14 21:41:17,812 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 21:41:17,812 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][8812956714/source_count-rhs/]
2016-01-14 21:41:17,812 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C16FE31E693745479CCD9B047757D2F7, mem on start (mb), free: 104, total: 630, max: 672
2016-01-14 21:41:17,825 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 21:41:17,825 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 21:41:17,833 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C16FE31E693745479CCD9B047757D2F7, mem on close (mb), free: 102, total: 630, max: 672
2016-01-14 21:41:17,853 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (5/5) ...y/samesourcemergethreeway
2016-01-14 21:41:17,926 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity105335704/.staging/job_local105335704_0038/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:17,927 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity105335704/.staging/job_local105335704_0038/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:17,956 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local105335704_0038/job_local105335704_0038.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:17,956 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local105335704_0038/job_local105335704_0038.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:17,957 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local105335704_0038
2016-01-14 21:41:17,957 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-14 21:41:17,961 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/8812956714_source_count_rhs_D3F4A1B920954BC496B5EE42DC7725D0/part-00000
2016-01-14 21:41:17,975 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:17,975 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:17,980 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F4925C2E711A4062A8C8AACE89335961, ordinal: 0
2016-01-14 21:41:17,980 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][8812956714/source_count-rhs/]
2016-01-14 21:41:17,980 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2016-01-14 21:41:17,981 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F4925C2E711A4062A8C8AACE89335961, mem on start (mb), free: 199, total: 630, max: 672
2016-01-14 21:41:17,982 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F4925C2E711A4062A8C8AACE89335961, mem on close (mb), free: 199, total: 630, max: 672
2016-01-14 21:41:17,988 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/891347545_count_lhs_4539672CD1904AE4898C28F0ED4546F1/part-00000
2016-01-14 21:41:18,003 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:18,003 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:18,008 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F4925C2E711A4062A8C8AACE89335961, ordinal: 0
2016-01-14 21:41:18,009 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][891347545/count-lhs/]
2016-01-14 21:41:18,009 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2016-01-14 21:41:18,009 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F4925C2E711A4062A8C8AACE89335961, mem on start (mb), free: 97, total: 630, max: 672
2016-01-14 21:41:18,011 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F4925C2E711A4062A8C8AACE89335961, mem on close (mb), free: 97, total: 630, max: 672
2016-01-14 21:41:18,023 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:18,023 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:18,028 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E00D4E53768C429984CD4D82FA989422, ordinal: 1
2016-01-14 21:41:18,028 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2016-01-14 21:41:18,029 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMergeThreeWay/samesourcemergethreeway"]
2016-01-14 21:41:18,029 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E00D4E53768C429984CD4D82FA989422, mem on start (mb), free: 89, total: 630, max: 672
2016-01-14 21:41:18,034 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 21:41:18,035 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 21:41:18,037 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E00D4E53768C429984CD4D82FA989422, mem on close (mb), free: 87, total: 630, max: 672
2016-01-14 21:41:18,054 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMergeThreeWay/samesourcemergethreeway/_temporary
2016-01-14 21:41:18,056 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] completed in: 00:00.892
2016-01-14 21:41:18,101 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testSameSourceMergeThreeWay/samesourcemergethreeway
2016-01-14 21:41:18,115 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:18,115 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:18,140 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.021
2016-01-14 21:41:18,140 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:18,140 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:18,150 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] starting
2016-01-14 21:41:18,150 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt"]
2016-01-14 21:41:18,150 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:18,151 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] sink: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUniqueMerge/uniquemerge-nondeterministic"]
2016-01-14 21:41:18,151 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] parallel execution of steps is enabled: false
2016-01-14 21:41:18,151 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] executing total steps: 1
2016-01-14 21:41:18,151 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] allocating management threads: 1
2016-01-14 21:41:18,152 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] starting step: (1/1) ...quemerge-nondeterministic
2016-01-14 21:41:18,202 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity282651407/.staging/job_local282651407_0039/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:18,203 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity282651407/.staging/job_local282651407_0039/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:18,231 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local282651407_0039/job_local282651407_0039.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:18,232 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local282651407_0039/job_local282651407_0039.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:18,233 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] submitted hadoop job: job_local282651407_0039
2016-01-14 21:41:18,233 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] tracking url: http://localhost:8080/
2016-01-14 21:41:18,236 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:18,251 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:18,251 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:18,255 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BF3FE83EF8A0444C94A5A917F2A936EC, ordinal: 0
2016-01-14 21:41:18,255 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:18,256 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2016-01-14 21:41:18,256 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BF3FE83EF8A0444C94A5A917F2A936EC, mem on start (mb), free: 163, total: 631, max: 672
2016-01-14 21:41:18,261 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BF3FE83EF8A0444C94A5A917F2A936EC, mem on close (mb), free: 163, total: 631, max: 672
2016-01-14 21:41:18,267 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt
2016-01-14 21:41:18,287 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:18,288 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:18,291 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BF3FE83EF8A0444C94A5A917F2A936EC, ordinal: 0
2016-01-14 21:41:18,292 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/rhs.txt"]
2016-01-14 21:41:18,292 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2016-01-14 21:41:18,292 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BF3FE83EF8A0444C94A5A917F2A936EC, mem on start (mb), free: 216, total: 632, max: 672
2016-01-14 21:41:18,294 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BF3FE83EF8A0444C94A5A917F2A936EC, mem on close (mb), free: 216, total: 632, max: 672
2016-01-14 21:41:18,312 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:18,312 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:18,317 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A84670393922416D93863C52DE0C4580, ordinal: 1
2016-01-14 21:41:18,319 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2016-01-14 21:41:18,319 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUniqueMerge/uniquemerge-nondeterministic"]
2016-01-14 21:41:18,319 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A84670393922416D93863C52DE0C4580, mem on start (mb), free: 208, total: 632, max: 672
2016-01-14 21:41:18,329 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A84670393922416D93863C52DE0C4580, mem on close (mb), free: 207, total: 632, max: 672
2016-01-14 21:41:18,357 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUniqueMerge/uniquemerge-nondeterministic/_temporary
2016-01-14 21:41:18,357 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] completed in: 00:00.206
2016-01-14 21:41:18,378 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testUniqueMerge/uniquemerge-nondeterministic
2016-01-14 21:41:18,395 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:18,395 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:18,413 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.015
2016-01-14 21:41:18,414 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:18,414 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:18,424 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 21:41:18,424 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:18,425 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUnique/unique"]
2016-01-14 21:41:18,425 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-14 21:41:18,426 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-14 21:41:18,426 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-14 21:41:18,427 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...latform/testUnique/unique
2016-01-14 21:41:18,482 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1946525251/.staging/job_local1946525251_0040/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:18,483 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1946525251/.staging/job_local1946525251_0040/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:18,511 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1946525251_0040/job_local1946525251_0040.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:18,512 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1946525251_0040/job_local1946525251_0040.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:18,513 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local1946525251_0040
2016-01-14 21:41:18,513 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 21:41:18,516 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:18,539 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:18,540 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:18,543 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DCF9F6C15F024CBC9D1FAA978F4433F0, ordinal: 0
2016-01-14 21:41:18,544 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:18,544 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(shape)[by:[{1}:'num']]
2016-01-14 21:41:18,544 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DCF9F6C15F024CBC9D1FAA978F4433F0, mem on start (mb), free: 216, total: 632, max: 672
2016-01-14 21:41:18,546 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DCF9F6C15F024CBC9D1FAA978F4433F0, mem on close (mb), free: 216, total: 632, max: 672
2016-01-14 21:41:18,559 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:18,559 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:18,562 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D92A22D1CFB84A08884F4EF816B77C27, ordinal: 1
2016-01-14 21:41:18,562 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(shape)[by:[{1}:'num']]
2016-01-14 21:41:18,563 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUnique/unique"]
2016-01-14 21:41:18,563 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D92A22D1CFB84A08884F4EF816B77C27, mem on start (mb), free: 209, total: 632, max: 672
2016-01-14 21:41:18,569 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D92A22D1CFB84A08884F4EF816B77C27, mem on close (mb), free: 208, total: 632, max: 672
2016-01-14 21:41:18,589 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUnique/unique/_temporary
2016-01-14 21:41:18,590 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:00.165
2016-01-14 21:41:18,609 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testUnique/unique
2016-01-14 21:41:18,622 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:41:18,623 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:41:18,641 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.015
2016-01-14 21:41:18,642 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 21:41:18,642 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:41:18,649 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting
2016-01-14 21:41:18,650 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:18,650 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] sink: Hfs["TextDelimited[['notnull', 'null']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountNullNotNull/countnullnotnull"]
2016-01-14 21:41:18,651 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] parallel execution of steps is enabled: false
2016-01-14 21:41:18,651 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executing total steps: 1
2016-01-14 21:41:18,652 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] allocating management threads: 1
2016-01-14 21:41:18,653 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (1/1) ...lNotNull/countnullnotnull
2016-01-14 21:41:18,707 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity340138239/.staging/job_local340138239_0041/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:18,707 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity340138239/.staging/job_local340138239_0041/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:18,736 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local340138239_0041/job_local340138239_0041.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 21:41:18,737 WARN conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local340138239_0041/job_local340138239_0041.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 21:41:18,738 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local340138239_0041
2016-01-14 21:41:18,738 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-14 21:41:18,741 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt
2016-01-14 21:41:18,761 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 21:41:18,761 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 21:41:18,766 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F9B0F035610942A6B2C35108BB4F1175, ordinal: 0
2016-01-14 21:41:18,767 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lhs.txt"]
2016-01-14 21:41:18,767 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2016-01-14 21:41:18,767 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F9B0F035610942A6B2C35108BB4F1175, mem on start (mb), free: 217, total: 632, max: 672
2016-01-14 21:41:18,772 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F9B0F035610942A6B2C35108BB4F1175, mem on close (mb), free: 216, total: 632, max: 672
2016-01-14 21:41:18,784 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 21:41:18,785 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 21:41:18,790 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C43D557895FF4D09A2A710F4937EA2E9, ordinal: 1
2016-01-14 21:41:18,790 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2016-01-14 21:41:18,790 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['notnull', 'null']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountNullNotNull/countnullnotnull"]
2016-01-14 21:41:18,791 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C43D557895FF4D09A2A710F4937EA2E9, mem on start (mb), free: 210, total: 632, max: 672
2016-01-14 21:41:18,797 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C43D557895FF4D09A2A710F4937EA2E9, mem on close (mb), free: 208, total: 632, max: 672
2016-01-14 21:41:18,812 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountNullNotNull/countnullnotnull/_temporary
2016-01-14 21:41:18,812 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] completed in: 00:00.163
2016-01-14 21:41:18,850 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCountNullNotNull/countnullnotnull