Class cascading.pipe.assembly.AssemblyHelpersPlatformTest

35

tests

0

failures

0

ignored

14.671s

duration

100%

successful

Tests

Test Duration Result
testAverageBy 0.256s passed
testAverageByNull 0.240s passed
testAverageMerge 0.803s passed
testCoerce 0.183s passed
testCoerceFields 0.218s passed
testCount 0.294s passed
testCountAll 0.223s passed
testCountCount 0.947s passed
testCountMerge 0.436s passed
testCountNullNotNull 0.224s passed
testDiscardNarrow 0.223s passed
testFirstBy 0.311s passed
testFirstByWithoutComparator 0.222s passed
testMaxBy 0.276s passed
testMaxByNullSafety 0.249s passed
testMaxByString 0.321s passed
testMinBy 0.306s passed
testMinByNullSafety 0.382s passed
testMinByString 0.567s passed
testParallelAggregates 0.242s passed
testParallelAggregatesMerge 3.023s passed
testParallelAggregatesMergeLegacyHash 0.346s passed
testParallelAggregatesPriorMerge 0.337s passed
testParallelAggregatesPriorMergeLegacyHash 0.336s passed
testRenameAll 0.264s passed
testRenameNamed 0.180s passed
testRenameNarrow 0.164s passed
testRetainNarrow 0.172s passed
testSameSourceMerge 0.504s passed
testSameSourceMergeThreeWay 1.075s passed
testSumBy 0.277s passed
testSumByNulls 0.244s passed
testSumMerge 0.344s passed
testUnique 0.201s passed
testUniqueMerge 0.281s passed

Standard output

2016-01-14 17:06:35,380 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 17:06:35,409 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.pipe.assembly.AssemblyHelpersPlatformTest, with platform: hadoop2-mr1
2016-01-14 17:06:35,449 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(119)) - not using cluster
2016-01-14 17:06:36,070 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-01-14 17:06:36,245 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides: 
2016-01-14 17:06:36,582 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:36,585 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:36,696 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 5834F58CA1A14304A22CDEB73CB2A6C0
2016-01-14 17:06:36,915 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.165
2016-01-14 17:06:36,919 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:36,920 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:37,133 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 17:06:37,135 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-14 17:06:37,136 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:37,137 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:37,138 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMerge/multimerge+false479"]
2016-01-14 17:06:37,140 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  parallel execution of steps is enabled: false
2016-01-14 17:06:37,140 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  executing total steps: 1
2016-01-14 17:06:37,141 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  allocating management threads: 1
2016-01-14 17:06:37,142 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...Merge/multimerge+false479
2016-01-14 17:06:37,671 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity954986480/.staging/job_local954986480_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:37,683 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity954986480/.staging/job_local954986480_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:37,770 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local954986480_0001/job_local954986480_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:37,771 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local954986480_0001/job_local954986480_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:37,780 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local954986480_0001
2016-01-14 17:06:37,781 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-14 17:06:37,846 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:37,983 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:37,983 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:38,006 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F0CE57ED21C1486BBE24B691186CCC15, ordinal: 0
2016-01-14 17:06:38,040 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:38,041 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 17:06:38,041 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F0CE57ED21C1486BBE24B691186CCC15, mem on start (mb), free: 85, total: 223, max: 672
2016-01-14 17:06:38,058 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:38,058 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 83, total: 223, max: 672
2016-01-14 17:06:38,058 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 33% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:38,060 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:38,060 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 83, total: 223, max: 672
2016-01-14 17:06:38,060 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 33% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:38,061 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:38,062 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 83, total: 223, max: 672
2016-01-14 17:06:38,062 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 33% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:38,063 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:38,064 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 83, total: 223, max: 672
2016-01-14 17:06:38,064 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 33% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:38,065 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F0CE57ED21C1486BBE24B691186CCC15, mem on close (mb), free: 83, total: 223, max: 672
2016-01-14 17:06:38,088 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt
2016-01-14 17:06:38,193 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:38,194 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:38,212 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F0CE57ED21C1486BBE24B691186CCC15, ordinal: 0
2016-01-14 17:06:38,214 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:38,214 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 17:06:38,214 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F0CE57ED21C1486BBE24B691186CCC15, mem on start (mb), free: 82, total: 323, max: 672
2016-01-14 17:06:38,287 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:38,287 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 79, total: 323, max: 672
2016-01-14 17:06:38,288 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 48% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:38,289 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:38,290 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 79, total: 323, max: 672
2016-01-14 17:06:38,290 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 48% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:38,291 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:38,291 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 79, total: 323, max: 672
2016-01-14 17:06:38,292 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 48% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:38,293 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:38,293 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 79, total: 323, max: 672
2016-01-14 17:06:38,294 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 48% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:38,295 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F0CE57ED21C1486BBE24B691186CCC15, mem on close (mb), free: 78, total: 323, max: 672
2016-01-14 17:06:38,328 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:38,328 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:38,346 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D18F3FB3C0384F649F0F5A774050C63D, ordinal: 1
2016-01-14 17:06:38,350 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 17:06:38,350 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMerge/multimerge+false479"]
2016-01-14 17:06:38,351 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D18F3FB3C0384F649F0F5A774050C63D, mem on start (mb), free: 76, total: 323, max: 672
2016-01-14 17:06:38,372 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D18F3FB3C0384F649F0F5A774050C63D, mem on close (mb), free: 75, total: 323, max: 672
2016-01-14 17:06:38,402 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMerge/multimerge+false479/_temporary
2016-01-14 17:06:38,402 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  completed in: 00:01.266
2016-01-14 17:06:38,469 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMerge/multimerge+false479
2016-01-14 17:06:38,493 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:38,494 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:38,559 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.058
2016-01-14 17:06:38,561 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:38,561 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:38,586 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting
2016-01-14 17:06:38,587 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:38,587 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  sink: Hfs["TextDelimited[['num', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByString/minbystring"]
2016-01-14 17:06:38,588 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  parallel execution of steps is enabled: false
2016-01-14 17:06:38,589 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  executing total steps: 1
2016-01-14 17:06:38,589 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  allocating management threads: 1
2016-01-14 17:06:38,591 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting step: (1/1) ...stMinByString/minbystring
2016-01-14 17:06:38,706 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1496798347/.staging/job_local1496798347_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:38,710 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1496798347/.staging/job_local1496798347_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:38,772 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1496798347_0002/job_local1496798347_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:38,773 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1496798347_0002/job_local1496798347_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:38,775 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] submitted hadoop job: job_local1496798347_0002
2016-01-14 17:06:38,776 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] tracking url: http://localhost:8080/
2016-01-14 17:06:38,785 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:38,894 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:38,895 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:38,904 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FF01500C3EBC48B5BB1D42B7F8ACA7D6, ordinal: 0
2016-01-14 17:06:38,906 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:38,906 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2016-01-14 17:06:38,907 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FF01500C3EBC48B5BB1D42B7F8ACA7D6, mem on start (mb), free: 91, total: 424, max: 672
2016-01-14 17:06:38,909 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:38,909 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 91, total: 424, max: 672
2016-01-14 17:06:38,910 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 63% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:38,911 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:38,911 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 91, total: 424, max: 672
2016-01-14 17:06:38,912 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 63% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:38,913 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FF01500C3EBC48B5BB1D42B7F8ACA7D6, mem on close (mb), free: 91, total: 424, max: 672
2016-01-14 17:06:38,927 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:38,928 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:38,938 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: ACAC05DF157648A29533DF9B646C5BE0, ordinal: 1
2016-01-14 17:06:38,938 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2016-01-14 17:06:38,939 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['num', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByString/minbystring"]
2016-01-14 17:06:38,939 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ACAC05DF157648A29533DF9B646C5BE0, mem on start (mb), free: 90, total: 424, max: 672
2016-01-14 17:06:38,949 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ACAC05DF157648A29533DF9B646C5BE0, mem on close (mb), free: 89, total: 424, max: 672
2016-01-14 17:06:38,973 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByString/minbystring/_temporary
2016-01-14 17:06:38,974 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  completed in: 00:00.387
2016-01-14 17:06:39,038 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMinByString/minbystring
2016-01-14 17:06:39,063 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:39,063 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:39,138 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.068
2016-01-14 17:06:39,140 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:39,141 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:39,170 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] starting
2016-01-14 17:06:39,170 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:39,171 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:39,172 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs]  sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageMerge/mergeaverage"]
2016-01-14 17:06:39,172 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs]  parallel execution of steps is enabled: false
2016-01-14 17:06:39,173 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs]  executing total steps: 1
2016-01-14 17:06:39,173 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs]  allocating management threads: 1
2016-01-14 17:06:39,175 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] starting step: (1/1) ...AverageMerge/mergeaverage
2016-01-14 17:06:39,326 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1513505659/.staging/job_local1513505659_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:39,328 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1513505659/.staging/job_local1513505659_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:39,476 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1513505659_0003/job_local1513505659_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:39,477 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1513505659_0003/job_local1513505659_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:39,479 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] submitted hadoop job: job_local1513505659_0003
2016-01-14 17:06:39,479 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] tracking url: http://localhost:8080/
2016-01-14 17:06:39,489 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:39,542 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:39,543 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:39,558 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A2AA4FE560E34991BED8F33E431FB17E, ordinal: 0
2016-01-14 17:06:39,559 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:39,559 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2016-01-14 17:06:39,559 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A2AA4FE560E34991BED8F33E431FB17E, mem on start (mb), free: 61, total: 482, max: 672
2016-01-14 17:06:39,560 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:39,561 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 61, total: 482, max: 672
2016-01-14 17:06:39,561 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 71% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:39,562 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:39,562 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 61, total: 482, max: 672
2016-01-14 17:06:39,563 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 71% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:39,563 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:39,563 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 61, total: 482, max: 672
2016-01-14 17:06:39,564 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 71% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:39,564 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:39,564 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 61, total: 482, max: 672
2016-01-14 17:06:39,565 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 71% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:39,565 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A2AA4FE560E34991BED8F33E431FB17E, mem on close (mb), free: 61, total: 482, max: 672
2016-01-14 17:06:39,577 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt
2016-01-14 17:06:39,677 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:39,677 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:39,688 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A2AA4FE560E34991BED8F33E431FB17E, ordinal: 0
2016-01-14 17:06:39,689 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:39,689 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2016-01-14 17:06:39,690 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A2AA4FE560E34991BED8F33E431FB17E, mem on start (mb), free: 60, total: 583, max: 672
2016-01-14 17:06:39,693 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:39,693 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 60, total: 583, max: 672
2016-01-14 17:06:39,694 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:39,695 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 60, total: 583, max: 672
2016-01-14 17:06:39,695 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:39,695 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 60, total: 583, max: 672
2016-01-14 17:06:39,696 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:39,696 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 60, total: 583, max: 672
2016-01-14 17:06:39,697 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A2AA4FE560E34991BED8F33E431FB17E, mem on close (mb), free: 60, total: 583, max: 672
2016-01-14 17:06:39,718 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:39,718 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:39,729 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DCA577C3AE664E9F9AC9DB954FB5DB97, ordinal: 1
2016-01-14 17:06:39,730 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2016-01-14 17:06:39,730 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageMerge/mergeaverage"]
2016-01-14 17:06:39,730 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DCA577C3AE664E9F9AC9DB954FB5DB97, mem on start (mb), free: 58, total: 583, max: 672
2016-01-14 17:06:39,741 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DCA577C3AE664E9F9AC9DB954FB5DB97, mem on close (mb), free: 57, total: 583, max: 672
2016-01-14 17:06:39,792 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageMerge/mergeaverage/_temporary
2016-01-14 17:06:39,792 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs]  completed in: 00:00.622
2016-01-14 17:06:39,842 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testAverageMerge/mergeaverage
2016-01-14 17:06:39,863 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:39,863 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:39,897 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 17:06:39,898 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:06:39,898 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:39,914 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 17:06:39,915 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:39,915 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  sink: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameAll/renameall"]
2016-01-14 17:06:39,915 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  parallel execution of steps is enabled: false
2016-01-14 17:06:39,915 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  executing total steps: 1
2016-01-14 17:06:39,916 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  allocating management threads: 1
2016-01-14 17:06:39,916 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...m/testRenameAll/renameall
2016-01-14 17:06:39,980 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity2071657941/.staging/job_local2071657941_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:39,983 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity2071657941/.staging/job_local2071657941_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:40,020 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2071657941_0004/job_local2071657941_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:40,020 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2071657941_0004/job_local2071657941_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:40,022 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local2071657941_0004
2016-01-14 17:06:40,022 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 17:06:40,029 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt
2016-01-14 17:06:40,038 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:40,038 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:40,046 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B46E42FAB01D4FE68E6D9C18F4D9A51E, ordinal: 0
2016-01-14 17:06:40,047 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:40,048 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameAll/renameall"]
2016-01-14 17:06:40,048 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B46E42FAB01D4FE68E6D9C18F4D9A51E, mem on start (mb), free: 126, total: 583, max: 672
2016-01-14 17:06:40,051 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B46E42FAB01D4FE68E6D9C18F4D9A51E, mem on close (mb), free: 126, total: 583, max: 672
2016-01-14 17:06:40,080 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameAll/renameall/_temporary
2016-01-14 17:06:40,081 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  completed in: 00:00.166
2016-01-14 17:06:40,105 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testRenameAll/renameall
2016-01-14 17:06:40,123 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:40,123 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:40,195 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.067
2016-01-14 17:06:40,197 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 4
2016-01-14 17:06:40,197 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:40,234 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting
2016-01-14 17:06:40,234 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:40,235 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  sink: Hfs["TextDelimited[['count', 'count2']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountCount/countcount"]
2016-01-14 17:06:40,236 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  parallel execution of steps is enabled: false
2016-01-14 17:06:40,236 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  executing total steps: 2
2016-01-14 17:06:40,236 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  allocating management threads: 1
2016-01-14 17:06:40,237 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (1/2)
2016-01-14 17:06:40,323 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1227132762/.staging/job_local1227132762_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:40,324 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1227132762/.staging/job_local1227132762_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:40,359 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1227132762_0005/job_local1227132762_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:40,359 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1227132762_0005/job_local1227132762_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:40,361 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local1227132762_0005
2016-01-14 17:06:40,361 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-14 17:06:40,366 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:40,469 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:40,469 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:40,477 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FB322A9784D24561AA34ED6AF7654967, ordinal: 0
2016-01-14 17:06:40,478 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:40,479 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2016-01-14 17:06:40,479 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FB322A9784D24561AA34ED6AF7654967, mem on start (mb), free: 27, total: 630, max: 672
2016-01-14 17:06:40,481 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:40,482 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 27, total: 630, max: 672
2016-01-14 17:06:40,482 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:40,483 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 27, total: 630, max: 672
2016-01-14 17:06:40,484 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:40,484 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 27, total: 630, max: 672
2016-01-14 17:06:40,486 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:40,486 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 27, total: 630, max: 672
2016-01-14 17:06:40,487 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FB322A9784D24561AA34ED6AF7654967, mem on close (mb), free: 27, total: 630, max: 672
2016-01-14 17:06:40,499 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:40,499 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:40,507 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E9ECDCE4931F4D97ABA48CC2487FBDEF, ordinal: 1
2016-01-14 17:06:40,508 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2016-01-14 17:06:40,508 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['count', 'count2']]"][6595551614/count/]
2016-01-14 17:06:40,508 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E9ECDCE4931F4D97ABA48CC2487FBDEF, mem on start (mb), free: 26, total: 630, max: 672
2016-01-14 17:06:40,525 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:40,525 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 24, total: 630, max: 672
2016-01-14 17:06:40,525 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E9ECDCE4931F4D97ABA48CC2487FBDEF, mem on close (mb), free: 24, total: 630, max: 672
2016-01-14 17:06:40,574 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (2/2) ...testCountCount/countcount
2016-01-14 17:06:40,870 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity935541479/.staging/job_local935541479_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:40,871 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity935541479/.staging/job_local935541479_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:40,911 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local935541479_0006/job_local935541479_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:40,911 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local935541479_0006/job_local935541479_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:40,913 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local935541479_0006
2016-01-14 17:06:40,916 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-14 17:06:40,921 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/6595551614_count_142C3BA7EEFD4C5C863B092C10F5CAB9/part-00000
2016-01-14 17:06:40,944 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:40,945 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:40,953 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E7B3B8354E374A3A9A3F8404260D11A6, ordinal: 0
2016-01-14 17:06:40,954 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['count', 'count2']]"][6595551614/count/]
2016-01-14 17:06:40,954 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{1}:'count']]
2016-01-14 17:06:40,955 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E7B3B8354E374A3A9A3F8404260D11A6, mem on start (mb), free: 115, total: 240, max: 672
2016-01-14 17:06:40,957 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E7B3B8354E374A3A9A3F8404260D11A6, mem on close (mb), free: 115, total: 240, max: 672
2016-01-14 17:06:40,968 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:40,968 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:40,976 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F76DE5EBE62E41D58E872C72C5E3F231, ordinal: 1
2016-01-14 17:06:40,977 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{1}:'count']]
2016-01-14 17:06:40,977 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['count', 'count2']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountCount/countcount"]
2016-01-14 17:06:40,977 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F76DE5EBE62E41D58E872C72C5E3F231, mem on start (mb), free: 113, total: 240, max: 672
2016-01-14 17:06:40,985 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F76DE5EBE62E41D58E872C72C5E3F231, mem on close (mb), free: 113, total: 240, max: 672
2016-01-14 17:06:41,004 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountCount/countcount/_temporary
2016-01-14 17:06:41,005 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  completed in: 00:00.769
2016-01-14 17:06:41,053 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCountCount/countcount
2016-01-14 17:06:41,071 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:41,071 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:41,132 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.055
2016-01-14 17:06:41,133 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:41,133 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:41,157 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] starting
2016-01-14 17:06:41,158 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:41,158 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:41,159 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs]  sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountMerge/mergecount"]
2016-01-14 17:06:41,159 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs]  parallel execution of steps is enabled: false
2016-01-14 17:06:41,159 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs]  executing total steps: 1
2016-01-14 17:06:41,160 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs]  allocating management threads: 1
2016-01-14 17:06:41,160 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] starting step: (1/1) ...testCountMerge/mergecount
2016-01-14 17:06:41,221 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1385270218/.staging/job_local1385270218_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:41,223 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1385270218/.staging/job_local1385270218_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:41,262 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1385270218_0007/job_local1385270218_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:41,263 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1385270218_0007/job_local1385270218_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:41,265 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] submitted hadoop job: job_local1385270218_0007
2016-01-14 17:06:41,266 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] tracking url: http://localhost:8080/
2016-01-14 17:06:41,272 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:41,313 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:41,313 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:41,324 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A408C86BAF21465EA50DD75FEF4EA631, ordinal: 0
2016-01-14 17:06:41,325 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:41,325 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 17:06:41,326 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A408C86BAF21465EA50DD75FEF4EA631, mem on start (mb), free: 124, total: 292, max: 672
2016-01-14 17:06:41,328 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:41,328 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 124, total: 292, max: 672
2016-01-14 17:06:41,329 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 43% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,330 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:41,330 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 124, total: 292, max: 672
2016-01-14 17:06:41,331 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 43% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,332 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:41,332 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 124, total: 292, max: 672
2016-01-14 17:06:41,332 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 43% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,333 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:41,333 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 124, total: 292, max: 672
2016-01-14 17:06:41,334 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 43% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,335 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A408C86BAF21465EA50DD75FEF4EA631, mem on close (mb), free: 124, total: 292, max: 672
2016-01-14 17:06:41,345 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt
2016-01-14 17:06:41,360 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:41,360 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:41,370 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A408C86BAF21465EA50DD75FEF4EA631, ordinal: 0
2016-01-14 17:06:41,371 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:41,371 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 17:06:41,371 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A408C86BAF21465EA50DD75FEF4EA631, mem on start (mb), free: 22, total: 292, max: 672
2016-01-14 17:06:41,375 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:41,375 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 21, total: 292, max: 672
2016-01-14 17:06:41,376 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 43% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,377 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:41,377 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 21, total: 292, max: 672
2016-01-14 17:06:41,378 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 43% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,379 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:41,379 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 21, total: 292, max: 672
2016-01-14 17:06:41,379 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 43% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,380 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:41,381 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 21, total: 292, max: 672
2016-01-14 17:06:41,381 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 43% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,382 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A408C86BAF21465EA50DD75FEF4EA631, mem on close (mb), free: 21, total: 292, max: 672
2016-01-14 17:06:41,398 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:41,399 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:41,407 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: EA799B9B9D0140CEA5A4F00F22299873, ordinal: 1
2016-01-14 17:06:41,408 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 17:06:41,409 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountMerge/mergecount"]
2016-01-14 17:06:41,409 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EA799B9B9D0140CEA5A4F00F22299873, mem on start (mb), free: 20, total: 292, max: 672
2016-01-14 17:06:41,419 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EA799B9B9D0140CEA5A4F00F22299873, mem on close (mb), free: 19, total: 292, max: 672
2016-01-14 17:06:41,439 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountMerge/mergecount/_temporary
2016-01-14 17:06:41,439 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs]  completed in: 00:00.281
2016-01-14 17:06:41,489 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCountMerge/mergecount
2016-01-14 17:06:41,572 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:41,572 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:41,620 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.043
2016-01-14 17:06:41,621 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:41,621 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:41,637 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min] starting
2016-01-14 17:06:41,637 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:41,637 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min]  sink: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByNullSafety/minbynullsafety"]
2016-01-14 17:06:41,637 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min]  parallel execution of steps is enabled: false
2016-01-14 17:06:41,637 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min]  executing total steps: 1
2016-01-14 17:06:41,638 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min]  allocating management threads: 1
2016-01-14 17:06:41,638 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min] starting step: (1/1) ...ullSafety/minbynullsafety
2016-01-14 17:06:41,698 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity675117992/.staging/job_local675117992_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:41,701 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity675117992/.staging/job_local675117992_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:41,734 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local675117992_0008/job_local675117992_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:41,735 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local675117992_0008/job_local675117992_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:41,736 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min] submitted hadoop job: job_local675117992_0008
2016-01-14 17:06:41,736 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min] tracking url: http://localhost:8080/
2016-01-14 17:06:41,741 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:41,756 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:41,756 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:41,763 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: CE44F83268664436B759CA554EE7FEAB, ordinal: 0
2016-01-14 17:06:41,764 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:41,764 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(min)[by:[{1}:'char']]
2016-01-14 17:06:41,764 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CE44F83268664436B759CA554EE7FEAB, mem on start (mb), free: 198, total: 349, max: 672
2016-01-14 17:06:41,766 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:41,766 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 349, max: 672
2016-01-14 17:06:41,767 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 51% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,768 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:41,768 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 349, max: 672
2016-01-14 17:06:41,768 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 51% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,769 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:41,769 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 349, max: 672
2016-01-14 17:06:41,770 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 51% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,770 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:41,771 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 349, max: 672
2016-01-14 17:06:41,771 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 51% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,772 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CE44F83268664436B759CA554EE7FEAB, mem on close (mb), free: 198, total: 349, max: 672
2016-01-14 17:06:41,785 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:41,786 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:41,793 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DB9E450268B244CBA5735933BD2E9941, ordinal: 1
2016-01-14 17:06:41,793 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(min)[by:[{1}:'char']]
2016-01-14 17:06:41,793 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByNullSafety/minbynullsafety"]
2016-01-14 17:06:41,794 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DB9E450268B244CBA5735933BD2E9941, mem on start (mb), free: 197, total: 349, max: 672
2016-01-14 17:06:41,803 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DB9E450268B244CBA5735933BD2E9941, mem on close (mb), free: 196, total: 349, max: 672
2016-01-14 17:06:41,825 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByNullSafety/minbynullsafety/_temporary
2016-01-14 17:06:41,825 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min]  completed in: 00:00.187
2016-01-14 17:06:41,872 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMinByNullSafety/minbynullsafety
2016-01-14 17:06:41,896 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:41,896 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:41,929 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 17:06:41,930 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:41,931 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:41,947 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting
2016-01-14 17:06:41,948 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:41,948 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  sink: Hfs["TextDelimited[['num', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByString/maxbystring"]
2016-01-14 17:06:41,948 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  parallel execution of steps is enabled: false
2016-01-14 17:06:41,948 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  executing total steps: 1
2016-01-14 17:06:41,950 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  allocating management threads: 1
2016-01-14 17:06:41,951 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting step: (1/1) ...stMaxByString/maxbystring
2016-01-14 17:06:42,018 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1827902765/.staging/job_local1827902765_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:42,021 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1827902765/.staging/job_local1827902765_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:42,054 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1827902765_0009/job_local1827902765_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:42,054 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1827902765_0009/job_local1827902765_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:42,055 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] submitted hadoop job: job_local1827902765_0009
2016-01-14 17:06:42,056 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] tracking url: http://localhost:8080/
2016-01-14 17:06:42,061 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:42,077 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:42,077 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:42,086 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C558A0BE4EDA476B86080FE556CAA598, ordinal: 0
2016-01-14 17:06:42,087 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:42,088 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2016-01-14 17:06:42,088 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C558A0BE4EDA476B86080FE556CAA598, mem on start (mb), free: 262, total: 398, max: 672
2016-01-14 17:06:42,090 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:42,091 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 262, total: 398, max: 672
2016-01-14 17:06:42,091 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 59% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:42,092 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:42,092 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 262, total: 398, max: 672
2016-01-14 17:06:42,092 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 59% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:42,093 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C558A0BE4EDA476B86080FE556CAA598, mem on close (mb), free: 262, total: 398, max: 672
2016-01-14 17:06:42,107 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:42,107 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:42,114 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DBE268F548024B308FCE8A93DE731668, ordinal: 1
2016-01-14 17:06:42,114 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2016-01-14 17:06:42,114 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['num', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByString/maxbystring"]
2016-01-14 17:06:42,114 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DBE268F548024B308FCE8A93DE731668, mem on start (mb), free: 261, total: 398, max: 672
2016-01-14 17:06:42,122 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DBE268F548024B308FCE8A93DE731668, mem on close (mb), free: 258, total: 398, max: 672
2016-01-14 17:06:42,145 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByString/maxbystring/_temporary
2016-01-14 17:06:42,146 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  completed in: 00:00.198
2016-01-14 17:06:42,194 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMaxByString/maxbystring
2016-01-14 17:06:42,218 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:42,219 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:42,257 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.033
2016-01-14 17:06:42,258 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:42,258 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:42,285 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-14 17:06:42,286 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  source: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs+rhs-cross.txt"]
2016-01-14 17:06:42,286 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  sink: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstBy/firstnfields"]
2016-01-14 17:06:42,286 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  parallel execution of steps is enabled: false
2016-01-14 17:06:42,286 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  executing total steps: 1
2016-01-14 17:06:42,286 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  allocating management threads: 1
2016-01-14 17:06:42,287 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) .../testFirstBy/firstnfields
2016-01-14 17:06:42,347 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1221355029/.staging/job_local1221355029_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:42,348 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1221355029/.staging/job_local1221355029_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:42,390 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1221355029_0010/job_local1221355029_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:42,390 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1221355029_0010/job_local1221355029_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:42,391 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted hadoop job: job_local1221355029_0010
2016-01-14 17:06:42,392 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tracking url: http://localhost:8080/
2016-01-14 17:06:42,396 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs+rhs-cross.txt
2016-01-14 17:06:42,417 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:42,418 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:42,424 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FBA6006ADA774B129B3C4E6CCEA1DC46, ordinal: 0
2016-01-14 17:06:42,425 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs+rhs-cross.txt"]
2016-01-14 17:06:42,425 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(first)[by:[{1}:'num']]
2016-01-14 17:06:42,425 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FBA6006ADA774B129B3C4E6CCEA1DC46, mem on start (mb), free: 294, total: 407, max: 672
2016-01-14 17:06:42,428 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:42,428 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 294, total: 407, max: 672
2016-01-14 17:06:42,428 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:42,429 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:42,430 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 294, total: 407, max: 672
2016-01-14 17:06:42,430 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:42,431 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FBA6006ADA774B129B3C4E6CCEA1DC46, mem on close (mb), free: 294, total: 407, max: 672
2016-01-14 17:06:42,443 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:42,443 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:42,450 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C802370A785F41C9B4EE5C2A050BD6A3, ordinal: 1
2016-01-14 17:06:42,451 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(first)[by:[{1}:'num']]
2016-01-14 17:06:42,451 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstBy/firstnfields"]
2016-01-14 17:06:42,451 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C802370A785F41C9B4EE5C2A050BD6A3, mem on start (mb), free: 292, total: 407, max: 672
2016-01-14 17:06:42,459 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C802370A785F41C9B4EE5C2A050BD6A3, mem on close (mb), free: 291, total: 407, max: 672
2016-01-14 17:06:42,481 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstBy/firstnfields/_temporary
2016-01-14 17:06:42,482 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  completed in: 00:00.196
2016-01-14 17:06:42,505 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testFirstBy/firstnfields
2016-01-14 17:06:42,522 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:42,523 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:42,552 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-01-14 17:06:42,552 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:06:42,552 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:42,563 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] starting
2016-01-14 17:06:42,564 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:42,564 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce]  sink: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerceFields/coercefields"]
2016-01-14 17:06:42,564 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce]  parallel execution of steps is enabled: false
2016-01-14 17:06:42,565 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce]  executing total steps: 1
2016-01-14 17:06:42,565 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce]  allocating management threads: 1
2016-01-14 17:06:42,566 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] starting step: (1/1) ...CoerceFields/coercefields
2016-01-14 17:06:42,619 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1025078718/.staging/job_local1025078718_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:42,621 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1025078718/.staging/job_local1025078718_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:42,653 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1025078718_0011/job_local1025078718_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:42,654 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1025078718_0011/job_local1025078718_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:42,654 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] submitted hadoop job: job_local1025078718_0011
2016-01-14 17:06:42,655 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] tracking url: http://localhost:8080/
2016-01-14 17:06:42,662 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt
2016-01-14 17:06:42,669 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:42,669 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:42,675 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FC53E486DA7D449CB184E585260045F0, ordinal: 0
2016-01-14 17:06:42,677 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:42,677 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerceFields/coercefields"]
2016-01-14 17:06:42,677 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FC53E486DA7D449CB184E585260045F0, mem on start (mb), free: 241, total: 407, max: 672
2016-01-14 17:06:42,684 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FC53E486DA7D449CB184E585260045F0, mem on close (mb), free: 240, total: 407, max: 672
2016-01-14 17:06:42,700 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerceFields/coercefields/_temporary
2016-01-14 17:06:42,701 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce]  completed in: 00:00.137
2016-01-14 17:06:42,723 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCoerceFields/coercefields
2016-01-14 17:06:42,737 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:42,738 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:42,766 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-01-14 17:06:42,767 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:42,767 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:42,779 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting
2016-01-14 17:06:42,779 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:42,779 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCount/count"]
2016-01-14 17:06:42,779 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  parallel execution of steps is enabled: false
2016-01-14 17:06:42,779 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  executing total steps: 1
2016-01-14 17:06:42,779 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  allocating management threads: 1
2016-01-14 17:06:42,780 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (1/1) ...splatform/testCount/count
2016-01-14 17:06:42,845 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity382772799/.staging/job_local382772799_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:42,846 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity382772799/.staging/job_local382772799_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:42,890 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local382772799_0012/job_local382772799_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:42,891 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local382772799_0012/job_local382772799_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:42,892 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local382772799_0012
2016-01-14 17:06:42,892 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-14 17:06:42,897 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:42,917 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:42,918 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:42,924 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F4B69859B2AA45B7ACADEE2B2F00E04A, ordinal: 0
2016-01-14 17:06:42,925 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:42,925 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2016-01-14 17:06:42,926 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F4B69859B2AA45B7ACADEE2B2F00E04A, mem on start (mb), free: 293, total: 407, max: 672
2016-01-14 17:06:42,927 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:42,928 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 293, total: 407, max: 672
2016-01-14 17:06:42,928 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:42,929 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:42,929 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 293, total: 407, max: 672
2016-01-14 17:06:42,929 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:42,930 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:42,930 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 293, total: 407, max: 672
2016-01-14 17:06:42,931 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:42,931 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:42,932 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 293, total: 407, max: 672
2016-01-14 17:06:42,932 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:42,933 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F4B69859B2AA45B7ACADEE2B2F00E04A, mem on close (mb), free: 293, total: 407, max: 672
2016-01-14 17:06:42,944 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:42,945 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:42,951 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: FFC45D6B882B440BBCC4F46AC0175F4D, ordinal: 1
2016-01-14 17:06:42,952 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2016-01-14 17:06:42,952 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCount/count"]
2016-01-14 17:06:42,952 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FFC45D6B882B440BBCC4F46AC0175F4D, mem on start (mb), free: 291, total: 407, max: 672
2016-01-14 17:06:42,959 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FFC45D6B882B440BBCC4F46AC0175F4D, mem on close (mb), free: 289, total: 407, max: 672
2016-01-14 17:06:42,973 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCount/count/_temporary
2016-01-14 17:06:42,973 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  completed in: 00:00.194
2016-01-14 17:06:43,017 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCount/count
2016-01-14 17:06:43,033 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:43,034 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:43,064 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-01-14 17:06:43,065 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:43,065 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:43,077 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting
2016-01-14 17:06:43,078 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:43,079 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  sink: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxBy/maxby"]
2016-01-14 17:06:43,079 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  parallel execution of steps is enabled: false
2016-01-14 17:06:43,079 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  executing total steps: 1
2016-01-14 17:06:43,080 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  allocating management threads: 1
2016-01-14 17:06:43,081 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting step: (1/1) ...splatform/testMaxBy/maxby
2016-01-14 17:06:43,138 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity378085510/.staging/job_local378085510_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:43,141 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity378085510/.staging/job_local378085510_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:43,172 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local378085510_0013/job_local378085510_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:43,172 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local378085510_0013/job_local378085510_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:43,174 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] submitted hadoop job: job_local378085510_0013
2016-01-14 17:06:43,174 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] tracking url: http://localhost:8080/
2016-01-14 17:06:43,179 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:43,197 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:43,198 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:43,203 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D9B0436A378E4EDDABA3FC0FA20D8A90, ordinal: 0
2016-01-14 17:06:43,204 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:43,204 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(max)[by:[{1}:'char']]
2016-01-14 17:06:43,204 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D9B0436A378E4EDDABA3FC0FA20D8A90, mem on start (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,205 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:43,205 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,205 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,206 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:43,206 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,206 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,206 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:43,207 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,207 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,207 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:43,207 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,208 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,208 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D9B0436A378E4EDDABA3FC0FA20D8A90, mem on close (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,218 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:43,218 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:43,225 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: BB418C026A3145089BADD00B9A468A96, ordinal: 1
2016-01-14 17:06:43,225 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(max)[by:[{1}:'char']]
2016-01-14 17:06:43,226 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxBy/maxby"]
2016-01-14 17:06:43,226 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: BB418C026A3145089BADD00B9A468A96, mem on start (mb), free: 293, total: 408, max: 672
2016-01-14 17:06:43,233 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: BB418C026A3145089BADD00B9A468A96, mem on close (mb), free: 292, total: 408, max: 672
2016-01-14 17:06:43,253 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxBy/maxby/_temporary
2016-01-14 17:06:43,254 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  completed in: 00:00.176
2016-01-14 17:06:43,294 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMaxBy/maxby
2016-01-14 17:06:43,315 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:43,316 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:43,350 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 17:06:43,351 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:43,352 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:43,363 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min] starting
2016-01-14 17:06:43,363 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:43,364 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min]  sink: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinBy/minby"]
2016-01-14 17:06:43,364 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min]  parallel execution of steps is enabled: false
2016-01-14 17:06:43,364 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min]  executing total steps: 1
2016-01-14 17:06:43,365 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min]  allocating management threads: 1
2016-01-14 17:06:43,365 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min] starting step: (1/1) ...splatform/testMinBy/minby
2016-01-14 17:06:43,419 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity961125003/.staging/job_local961125003_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:43,420 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity961125003/.staging/job_local961125003_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:43,455 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local961125003_0014/job_local961125003_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:43,455 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local961125003_0014/job_local961125003_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:43,456 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min] submitted hadoop job: job_local961125003_0014
2016-01-14 17:06:43,457 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min] tracking url: http://localhost:8080/
2016-01-14 17:06:43,462 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:43,480 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:43,481 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:43,487 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F978FE0DC45A4F6DB59AF273B848A21B, ordinal: 0
2016-01-14 17:06:43,488 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:43,488 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(min)[by:[{1}:'char']]
2016-01-14 17:06:43,488 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F978FE0DC45A4F6DB59AF273B848A21B, mem on start (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,491 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:43,491 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,491 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,492 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:43,492 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,493 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,493 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:43,494 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,494 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,494 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:43,494 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,494 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,496 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F978FE0DC45A4F6DB59AF273B848A21B, mem on close (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,510 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:43,511 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:43,520 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D3A8EF7156774F88BD87473E12C6B229, ordinal: 1
2016-01-14 17:06:43,521 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(min)[by:[{1}:'char']]
2016-01-14 17:06:43,521 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinBy/minby"]
2016-01-14 17:06:43,522 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D3A8EF7156774F88BD87473E12C6B229, mem on start (mb), free: 294, total: 408, max: 672
2016-01-14 17:06:43,531 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D3A8EF7156774F88BD87473E12C6B229, mem on close (mb), free: 293, total: 408, max: 672
2016-01-14 17:06:43,555 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinBy/minby/_temporary
2016-01-14 17:06:43,555 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [min]  completed in: 00:00.191
2016-01-14 17:06:43,601 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMinBy/minby
2016-01-14 17:06:43,613 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:43,613 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:43,640 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.023
2016-01-14 17:06:43,641 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:43,641 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:43,653 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] starting
2016-01-14 17:06:43,654 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:43,654 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum]  sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumBy/sum"]
2016-01-14 17:06:43,654 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum]  parallel execution of steps is enabled: false
2016-01-14 17:06:43,654 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum]  executing total steps: 1
2016-01-14 17:06:43,655 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum]  allocating management threads: 1
2016-01-14 17:06:43,656 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] starting step: (1/1) ...ersplatform/testSumBy/sum
2016-01-14 17:06:43,710 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1235750162/.staging/job_local1235750162_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:43,712 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1235750162/.staging/job_local1235750162_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:43,744 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1235750162_0015/job_local1235750162_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:43,745 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1235750162_0015/job_local1235750162_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:43,745 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] submitted hadoop job: job_local1235750162_0015
2016-01-14 17:06:43,746 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] tracking url: http://localhost:8080/
2016-01-14 17:06:43,751 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:43,770 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:43,770 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:43,777 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D09FEB543721462C90793858228D7E2D, ordinal: 0
2016-01-14 17:06:43,778 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:43,778 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2016-01-14 17:06:43,779 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D09FEB543721462C90793858228D7E2D, mem on start (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,780 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:43,780 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,781 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,781 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:43,782 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,782 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,783 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:43,783 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,783 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,785 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:43,785 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,786 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,787 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D09FEB543721462C90793858228D7E2D, mem on close (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,798 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:43,798 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:43,807 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E9EB86B2A0A54B89B34BE9369B601E71, ordinal: 1
2016-01-14 17:06:43,808 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2016-01-14 17:06:43,808 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumBy/sum"]
2016-01-14 17:06:43,809 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E9EB86B2A0A54B89B34BE9369B601E71, mem on start (mb), free: 294, total: 408, max: 672
2016-01-14 17:06:43,817 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E9EB86B2A0A54B89B34BE9369B601E71, mem on close (mb), free: 293, total: 408, max: 672
2016-01-14 17:06:43,833 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumBy/sum/_temporary
2016-01-14 17:06:43,834 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum]  completed in: 00:00.180
2016-01-14 17:06:43,878 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testSumBy/sum
2016-01-14 17:06:43,891 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:43,891 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:43,942 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.046
2016-01-14 17:06:43,942 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:43,943 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:43,954 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] starting
2016-01-14 17:06:43,954 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:43,954 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:43,954 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs]  sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumMerge/mergesum"]
2016-01-14 17:06:43,955 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs]  parallel execution of steps is enabled: false
2016-01-14 17:06:43,955 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs]  executing total steps: 1
2016-01-14 17:06:43,955 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs]  allocating management threads: 1
2016-01-14 17:06:43,956 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] starting step: (1/1) ...orm/testSumMerge/mergesum
2016-01-14 17:06:44,009 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity626690370/.staging/job_local626690370_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:44,011 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity626690370/.staging/job_local626690370_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:44,041 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local626690370_0016/job_local626690370_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:44,041 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local626690370_0016/job_local626690370_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:44,042 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] submitted hadoop job: job_local626690370_0016
2016-01-14 17:06:44,042 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] tracking url: http://localhost:8080/
2016-01-14 17:06:44,046 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:44,064 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:44,065 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:44,071 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AA36F9C9AACB4BA2861039236B91905B, ordinal: 0
2016-01-14 17:06:44,071 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:44,071 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2016-01-14 17:06:44,071 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AA36F9C9AACB4BA2861039236B91905B, mem on start (mb), free: 297, total: 409, max: 672
2016-01-14 17:06:44,073 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:44,073 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 409, max: 672
2016-01-14 17:06:44,073 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,074 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:44,074 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 409, max: 672
2016-01-14 17:06:44,074 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,075 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:44,075 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 409, max: 672
2016-01-14 17:06:44,075 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,076 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:44,076 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 409, max: 672
2016-01-14 17:06:44,076 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,077 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AA36F9C9AACB4BA2861039236B91905B, mem on close (mb), free: 297, total: 409, max: 672
2016-01-14 17:06:44,086 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt
2016-01-14 17:06:44,103 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:44,104 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:44,111 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AA36F9C9AACB4BA2861039236B91905B, ordinal: 0
2016-01-14 17:06:44,112 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:44,112 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2016-01-14 17:06:44,112 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AA36F9C9AACB4BA2861039236B91905B, mem on start (mb), free: 195, total: 409, max: 672
2016-01-14 17:06:44,116 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:44,116 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 409, max: 672
2016-01-14 17:06:44,117 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,118 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:44,118 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 409, max: 672
2016-01-14 17:06:44,118 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,119 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:44,119 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 409, max: 672
2016-01-14 17:06:44,120 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,120 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:44,121 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 409, max: 672
2016-01-14 17:06:44,121 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,122 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AA36F9C9AACB4BA2861039236B91905B, mem on close (mb), free: 195, total: 409, max: 672
2016-01-14 17:06:44,135 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:44,136 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:44,142 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D608051353C04949B8ED750AC1D886EB, ordinal: 1
2016-01-14 17:06:44,143 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2016-01-14 17:06:44,143 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumMerge/mergesum"]
2016-01-14 17:06:44,143 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D608051353C04949B8ED750AC1D886EB, mem on start (mb), free: 193, total: 409, max: 672
2016-01-14 17:06:44,152 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D608051353C04949B8ED750AC1D886EB, mem on close (mb), free: 192, total: 409, max: 672
2016-01-14 17:06:44,172 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumMerge/mergesum/_temporary
2016-01-14 17:06:44,176 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs]  completed in: 00:00.217
2016-01-14 17:06:44,222 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testSumMerge/mergesum
2016-01-14 17:06:44,242 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:44,242 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:44,275 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 17:06:44,277 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:06:44,277 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:44,292 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 17:06:44,293 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:44,293 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  sink: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testDiscardNarrow/discardnarrow"]
2016-01-14 17:06:44,293 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  parallel execution of steps is enabled: false
2016-01-14 17:06:44,294 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  executing total steps: 1
2016-01-14 17:06:44,294 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  allocating management threads: 1
2016-01-14 17:06:44,295 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...scardNarrow/discardnarrow
2016-01-14 17:06:44,350 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1731432795/.staging/job_local1731432795_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:44,352 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1731432795/.staging/job_local1731432795_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:44,383 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1731432795_0017/job_local1731432795_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:44,383 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1731432795_0017/job_local1731432795_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:44,385 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local1731432795_0017
2016-01-14 17:06:44,385 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 17:06:44,390 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt
2016-01-14 17:06:44,396 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:44,396 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:44,400 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C70F7A5BDD2D425199B25F50A1F1E586, ordinal: 0
2016-01-14 17:06:44,401 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:44,401 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testDiscardNarrow/discardnarrow"]
2016-01-14 17:06:44,401 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C70F7A5BDD2D425199B25F50A1F1E586, mem on start (mb), free: 366, total: 410, max: 672
2016-01-14 17:06:44,403 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C70F7A5BDD2D425199B25F50A1F1E586, mem on close (mb), free: 366, total: 410, max: 672
2016-01-14 17:06:44,420 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testDiscardNarrow/discardnarrow/_temporary
2016-01-14 17:06:44,424 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  completed in: 00:00.127
2016-01-14 17:06:44,446 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testDiscardNarrow/discardnarrow
2016-01-14 17:06:44,462 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:44,463 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:44,505 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.038
2016-01-14 17:06:44,507 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:44,507 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:44,523 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-14 17:06:44,523 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:44,523 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:44,523 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMergeLegacyHash/multimerge+true480"]
2016-01-14 17:06:44,524 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  parallel execution of steps is enabled: false
2016-01-14 17:06:44,524 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  executing total steps: 1
2016-01-14 17:06:44,524 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  allocating management threads: 1
2016-01-14 17:06:44,527 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...cyHash/multimerge+true480
2016-01-14 17:06:44,580 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity244709199/.staging/job_local244709199_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:44,582 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity244709199/.staging/job_local244709199_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:44,612 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local244709199_0018/job_local244709199_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:44,612 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local244709199_0018/job_local244709199_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:44,613 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local244709199_0018
2016-01-14 17:06:44,613 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-14 17:06:44,617 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:44,633 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:44,633 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:44,640 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B20A1C7100DE45F5B396F34917158610, ordinal: 0
2016-01-14 17:06:44,641 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:44,641 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:06:44,642 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B20A1C7100DE45F5B396F34917158610, mem on start (mb), free: 216, total: 410, max: 672
2016-01-14 17:06:44,644 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:44,644 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 216, total: 410, max: 672
2016-01-14 17:06:44,644 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,645 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:44,646 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 216, total: 410, max: 672
2016-01-14 17:06:44,646 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,647 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:44,647 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 216, total: 410, max: 672
2016-01-14 17:06:44,648 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,648 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:44,649 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 216, total: 410, max: 672
2016-01-14 17:06:44,649 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,650 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B20A1C7100DE45F5B396F34917158610, mem on close (mb), free: 216, total: 410, max: 672
2016-01-14 17:06:44,657 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt
2016-01-14 17:06:44,677 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:44,677 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:44,684 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B20A1C7100DE45F5B396F34917158610, ordinal: 0
2016-01-14 17:06:44,685 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:44,685 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:06:44,686 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B20A1C7100DE45F5B396F34917158610, mem on start (mb), free: 298, total: 410, max: 672
2016-01-14 17:06:44,689 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:44,690 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:44,690 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,691 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:44,691 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:44,691 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,692 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:44,692 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:44,693 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,694 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:44,694 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:44,694 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,695 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B20A1C7100DE45F5B396F34917158610, mem on close (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:44,708 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:44,709 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:44,715 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A22FA627D7E24276A7A3D1CB5504CB68, ordinal: 1
2016-01-14 17:06:44,716 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:06:44,716 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMergeLegacyHash/multimerge+true480"]
2016-01-14 17:06:44,716 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A22FA627D7E24276A7A3D1CB5504CB68, mem on start (mb), free: 295, total: 410, max: 672
2016-01-14 17:06:44,725 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A22FA627D7E24276A7A3D1CB5504CB68, mem on close (mb), free: 294, total: 410, max: 672
2016-01-14 17:06:44,745 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMergeLegacyHash/multimerge+true480/_temporary
2016-01-14 17:06:44,745 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  completed in: 00:00.223
2016-01-14 17:06:44,784 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMergeLegacyHash/multimerge+true480
2016-01-14 17:06:44,796 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:44,796 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:44,815 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.016
2016-01-14 17:06:44,816 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:06:44,816 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:44,822 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 17:06:44,822 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:44,822 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  sink: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNamed/rename"]
2016-01-14 17:06:44,823 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  parallel execution of steps is enabled: false
2016-01-14 17:06:44,823 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  executing total steps: 1
2016-01-14 17:06:44,823 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  allocating management threads: 1
2016-01-14 17:06:44,824 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...rm/testRenameNamed/rename
2016-01-14 17:06:44,875 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity513558147/.staging/job_local513558147_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:44,878 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity513558147/.staging/job_local513558147_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:44,906 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local513558147_0019/job_local513558147_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:44,906 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local513558147_0019/job_local513558147_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:44,907 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local513558147_0019
2016-01-14 17:06:44,908 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 17:06:44,912 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt
2016-01-14 17:06:44,918 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:44,918 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:44,922 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AD5037D44DB743AEA7D8A4A3C4844577, ordinal: 0
2016-01-14 17:06:44,922 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:44,923 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNamed/rename"]
2016-01-14 17:06:44,923 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AD5037D44DB743AEA7D8A4A3C4844577, mem on start (mb), free: 243, total: 410, max: 672
2016-01-14 17:06:44,924 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AD5037D44DB743AEA7D8A4A3C4844577, mem on close (mb), free: 243, total: 410, max: 672
2016-01-14 17:06:44,942 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNamed/rename/_temporary
2016-01-14 17:06:44,943 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  completed in: 00:00.120
2016-01-14 17:06:44,964 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testRenameNamed/rename
2016-01-14 17:06:44,978 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:44,979 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:45,017 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.035
2016-01-14 17:06:45,018 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:45,018 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:45,029 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-14 17:06:45,029 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:45,030 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:45,030 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMerge/multimerge+true479"]
2016-01-14 17:06:45,030 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  parallel execution of steps is enabled: false
2016-01-14 17:06:45,030 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  executing total steps: 1
2016-01-14 17:06:45,031 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  allocating management threads: 1
2016-01-14 17:06:45,032 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...rMerge/multimerge+true479
2016-01-14 17:06:45,086 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity2079524764/.staging/job_local2079524764_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:45,087 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity2079524764/.staging/job_local2079524764_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:45,117 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2079524764_0020/job_local2079524764_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:45,118 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2079524764_0020/job_local2079524764_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:45,119 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local2079524764_0020
2016-01-14 17:06:45,119 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-14 17:06:45,124 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:45,146 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:45,147 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:45,153 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B7B40DEDE6C14EABA5577BF1D28936F6, ordinal: 0
2016-01-14 17:06:45,154 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:45,154 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:06:45,154 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B7B40DEDE6C14EABA5577BF1D28936F6, mem on start (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:45,155 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:45,156 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:45,156 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,157 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:45,157 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:45,157 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,158 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:45,158 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:45,158 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,159 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:45,159 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:45,159 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,160 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B7B40DEDE6C14EABA5577BF1D28936F6, mem on close (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:45,170 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt
2016-01-14 17:06:45,185 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:45,186 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:45,192 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B7B40DEDE6C14EABA5577BF1D28936F6, ordinal: 0
2016-01-14 17:06:45,193 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:45,193 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:06:45,194 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B7B40DEDE6C14EABA5577BF1D28936F6, mem on start (mb), free: 195, total: 410, max: 672
2016-01-14 17:06:45,197 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:45,197 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 410, max: 672
2016-01-14 17:06:45,197 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,199 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:45,199 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 410, max: 672
2016-01-14 17:06:45,199 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,200 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:45,200 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 410, max: 672
2016-01-14 17:06:45,201 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,201 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:45,202 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 410, max: 672
2016-01-14 17:06:45,202 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,204 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B7B40DEDE6C14EABA5577BF1D28936F6, mem on close (mb), free: 195, total: 410, max: 672
2016-01-14 17:06:45,218 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:45,218 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:45,225 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C99FEF76CA71497B8978FFDA6D4B7B55, ordinal: 1
2016-01-14 17:06:45,227 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:06:45,227 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMerge/multimerge+true479"]
2016-01-14 17:06:45,227 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C99FEF76CA71497B8978FFDA6D4B7B55, mem on start (mb), free: 192, total: 410, max: 672
2016-01-14 17:06:45,238 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C99FEF76CA71497B8978FFDA6D4B7B55, mem on close (mb), free: 191, total: 410, max: 672
2016-01-14 17:06:45,261 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMerge/multimerge+true479/_temporary
2016-01-14 17:06:45,261 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  completed in: 00:00.232
2016-01-14 17:06:45,302 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMerge/multimerge+true479
2016-01-14 17:06:45,315 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:45,316 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:45,384 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.065
2016-01-14 17:06:45,386 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 4
2016-01-14 17:06:45,386 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:45,413 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting
2016-01-14 17:06:45,414 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:45,414 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second]  sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMerge/samesourcemergecount"]
2016-01-14 17:06:45,414 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second]  parallel execution of steps is enabled: false
2016-01-14 17:06:45,415 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second]  executing total steps: 2
2016-01-14 17:06:45,415 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second]  allocating management threads: 1
2016-01-14 17:06:45,416 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting step: (1/2)
2016-01-14 17:06:45,485 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1163808395/.staging/job_local1163808395_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:45,487 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1163808395/.staging/job_local1163808395_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:45,515 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1163808395_0021/job_local1163808395_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:45,516 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1163808395_0021/job_local1163808395_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:45,517 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] submitted hadoop job: job_local1163808395_0021
2016-01-14 17:06:45,517 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tracking url: http://localhost:8080/
2016-01-14 17:06:45,521 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:45,535 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:45,536 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:45,541 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C98AB715E16E456CA3605980438E3FDC, ordinal: 0
2016-01-14 17:06:45,542 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:45,542 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(first)[by:[{1}:'char']]
2016-01-14 17:06:45,542 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C98AB715E16E456CA3605980438E3FDC, mem on start (mb), free: 267, total: 410, max: 672
2016-01-14 17:06:45,546 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:45,546 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 267, total: 410, max: 672
2016-01-14 17:06:45,546 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,547 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:45,548 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 266, total: 410, max: 672
2016-01-14 17:06:45,548 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,548 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:45,549 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 266, total: 410, max: 672
2016-01-14 17:06:45,549 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,549 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:45,550 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 266, total: 410, max: 672
2016-01-14 17:06:45,550 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,551 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C98AB715E16E456CA3605980438E3FDC, mem on close (mb), free: 266, total: 410, max: 672
2016-01-14 17:06:45,560 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:45,560 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:45,564 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B4CF7E0A218F4CA9A63588AD46B4A054, ordinal: 1
2016-01-14 17:06:45,565 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(first)[by:[{1}:'char']]
2016-01-14 17:06:45,565 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][7763453343/first/]
2016-01-14 17:06:45,565 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B4CF7E0A218F4CA9A63588AD46B4A054, mem on start (mb), free: 265, total: 410, max: 672
2016-01-14 17:06:45,572 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B4CF7E0A218F4CA9A63588AD46B4A054, mem on close (mb), free: 264, total: 410, max: 672
2016-01-14 17:06:45,585 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting step: (2/2) ...erge/samesourcemergecount
2016-01-14 17:06:45,654 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity224100269/.staging/job_local224100269_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:45,655 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity224100269/.staging/job_local224100269_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:45,683 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local224100269_0022/job_local224100269_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:45,683 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local224100269_0022/job_local224100269_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:45,684 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] submitted hadoop job: job_local224100269_0022
2016-01-14 17:06:45,684 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tracking url: http://localhost:8080/
2016-01-14 17:06:45,688 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/7763453343_first_B923E7FE8200406F816F278306BB3D42/part-00000
2016-01-14 17:06:45,706 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:45,707 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:45,712 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BCE21F8F33D44BC0967F4FE1FC56E524, ordinal: 0
2016-01-14 17:06:45,713 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][7763453343/first/]
2016-01-14 17:06:45,714 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(second)[by:[{1}:'char']]
2016-01-14 17:06:45,714 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BCE21F8F33D44BC0967F4FE1FC56E524, mem on start (mb), free: 299, total: 411, max: 672
2016-01-14 17:06:45,715 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:45,716 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 411, max: 672
2016-01-14 17:06:45,716 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,717 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:45,717 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 411, max: 672
2016-01-14 17:06:45,718 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,718 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BCE21F8F33D44BC0967F4FE1FC56E524, mem on close (mb), free: 298, total: 411, max: 672
2016-01-14 17:06:45,726 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:45,727 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:45,733 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E6E771903BDC4576B1F41DCB7EAF8C9B, ordinal: 1
2016-01-14 17:06:45,734 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(second)[by:[{1}:'char']]
2016-01-14 17:06:45,734 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMerge/samesourcemergecount"]
2016-01-14 17:06:45,734 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E6E771903BDC4576B1F41DCB7EAF8C9B, mem on start (mb), free: 297, total: 411, max: 672
2016-01-14 17:06:45,741 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E6E771903BDC4576B1F41DCB7EAF8C9B, mem on close (mb), free: 295, total: 411, max: 672
2016-01-14 17:06:45,761 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMerge/samesourcemergecount/_temporary
2016-01-14 17:06:45,762 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second]  completed in: 00:00.347
2016-01-14 17:06:45,806 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testSameSourceMerge/samesourcemergecount
2016-01-14 17:06:45,817 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:45,817 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:45,839 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 17:06:45,839 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:45,839 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:45,846 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average] starting
2016-01-14 17:06:45,846 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:45,847 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average]  sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageBy/average"]
2016-01-14 17:06:45,847 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average]  parallel execution of steps is enabled: false
2016-01-14 17:06:45,848 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average]  executing total steps: 1
2016-01-14 17:06:45,848 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average]  allocating management threads: 1
2016-01-14 17:06:45,849 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average] starting step: (1/1) ...orm/testAverageBy/average
2016-01-14 17:06:45,898 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1177623559/.staging/job_local1177623559_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:45,900 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1177623559/.staging/job_local1177623559_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:45,926 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1177623559_0023/job_local1177623559_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:45,926 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1177623559_0023/job_local1177623559_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:45,927 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average] submitted hadoop job: job_local1177623559_0023
2016-01-14 17:06:45,927 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average] tracking url: http://localhost:8080/
2016-01-14 17:06:45,932 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:45,951 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:45,951 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:45,955 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C919908AD90C42869FAFF67A46106DF7, ordinal: 0
2016-01-14 17:06:45,956 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:45,956 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2016-01-14 17:06:45,956 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C919908AD90C42869FAFF67A46106DF7, mem on start (mb), free: 299, total: 411, max: 672
2016-01-14 17:06:45,957 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:45,957 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 411, max: 672
2016-01-14 17:06:45,958 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,958 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:45,959 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 411, max: 672
2016-01-14 17:06:45,959 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,959 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:45,959 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 411, max: 672
2016-01-14 17:06:45,959 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,960 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:45,960 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 411, max: 672
2016-01-14 17:06:45,960 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,961 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C919908AD90C42869FAFF67A46106DF7, mem on close (mb), free: 299, total: 411, max: 672
2016-01-14 17:06:45,971 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:45,971 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:45,981 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CE198A0F76714A4391E08085A0E86A5D, ordinal: 1
2016-01-14 17:06:45,982 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2016-01-14 17:06:45,982 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageBy/average"]
2016-01-14 17:06:45,983 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CE198A0F76714A4391E08085A0E86A5D, mem on start (mb), free: 297, total: 411, max: 672
2016-01-14 17:06:45,992 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CE198A0F76714A4391E08085A0E86A5D, mem on close (mb), free: 296, total: 411, max: 672
2016-01-14 17:06:46,015 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageBy/average/_temporary
2016-01-14 17:06:46,016 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average]  completed in: 00:00.169
2016-01-14 17:06:46,061 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testAverageBy/average
2016-01-14 17:06:46,076 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:46,076 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:46,105 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-01-14 17:06:46,106 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:46,106 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:46,113 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting
2016-01-14 17:06:46,114 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:46,114 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  sink: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByNullSafety/maxbynullsafety"]
2016-01-14 17:06:46,114 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  parallel execution of steps is enabled: false
2016-01-14 17:06:46,114 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  executing total steps: 1
2016-01-14 17:06:46,114 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  allocating management threads: 1
2016-01-14 17:06:46,115 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting step: (1/1) ...ullSafety/maxbynullsafety
2016-01-14 17:06:46,165 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity966503881/.staging/job_local966503881_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:46,167 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity966503881/.staging/job_local966503881_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:46,194 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local966503881_0024/job_local966503881_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:46,194 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local966503881_0024/job_local966503881_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:46,195 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] submitted hadoop job: job_local966503881_0024
2016-01-14 17:06:46,195 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max] tracking url: http://localhost:8080/
2016-01-14 17:06:46,199 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:46,217 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:46,218 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:46,222 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A8FF2AAC06934C93BAA7A7A9FF1FF64B, ordinal: 0
2016-01-14 17:06:46,223 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:46,223 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(max)[by:[{1}:'char']]
2016-01-14 17:06:46,223 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A8FF2AAC06934C93BAA7A7A9FF1FF64B, mem on start (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,225 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:46,225 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,226 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,227 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:46,227 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,227 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,228 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:46,228 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,229 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,229 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:46,230 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,230 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,231 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A8FF2AAC06934C93BAA7A7A9FF1FF64B, mem on close (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,243 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:46,243 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:46,246 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E225BC4EE7D24968A63F4C7D6318E65F, ordinal: 1
2016-01-14 17:06:46,247 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(max)[by:[{1}:'char']]
2016-01-14 17:06:46,247 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByNullSafety/maxbynullsafety"]
2016-01-14 17:06:46,247 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E225BC4EE7D24968A63F4C7D6318E65F, mem on start (mb), free: 298, total: 412, max: 672
2016-01-14 17:06:46,253 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E225BC4EE7D24968A63F4C7D6318E65F, mem on close (mb), free: 297, total: 412, max: 672
2016-01-14 17:06:46,271 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByNullSafety/maxbynullsafety/_temporary
2016-01-14 17:06:46,272 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [max]  completed in: 00:00.158
2016-01-14 17:06:46,310 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMaxByNullSafety/maxbynullsafety
2016-01-14 17:06:46,322 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:46,322 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:46,346 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-01-14 17:06:46,347 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:46,347 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:46,356 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] starting
2016-01-14 17:06:46,356 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:46,356 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum]  sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumByNulls/sumnulls"]
2016-01-14 17:06:46,357 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum]  parallel execution of steps is enabled: false
2016-01-14 17:06:46,357 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum]  executing total steps: 1
2016-01-14 17:06:46,357 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum]  allocating management threads: 1
2016-01-14 17:06:46,359 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] starting step: (1/1) ...m/testSumByNulls/sumnulls
2016-01-14 17:06:46,408 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity989659888/.staging/job_local989659888_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:46,408 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity989659888/.staging/job_local989659888_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:46,437 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local989659888_0025/job_local989659888_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:46,437 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local989659888_0025/job_local989659888_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:46,439 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] submitted hadoop job: job_local989659888_0025
2016-01-14 17:06:46,439 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] tracking url: http://localhost:8080/
2016-01-14 17:06:46,442 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:46,461 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:46,461 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:46,466 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: ACA8D86821B34CB993E17F0C705C9C4B, ordinal: 0
2016-01-14 17:06:46,466 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:46,466 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2016-01-14 17:06:46,467 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: ACA8D86821B34CB993E17F0C705C9C4B, mem on start (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,474 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:46,474 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,474 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,475 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:46,475 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,476 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,476 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:46,477 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,477 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,478 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:46,478 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,478 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,479 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: ACA8D86821B34CB993E17F0C705C9C4B, mem on close (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,488 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:46,488 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:46,492 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B93B3D149D8C485082010E68F827A7B5, ordinal: 1
2016-01-14 17:06:46,492 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2016-01-14 17:06:46,492 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumByNulls/sumnulls"]
2016-01-14 17:06:46,492 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B93B3D149D8C485082010E68F827A7B5, mem on start (mb), free: 298, total: 412, max: 672
2016-01-14 17:06:46,499 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B93B3D149D8C485082010E68F827A7B5, mem on close (mb), free: 297, total: 412, max: 672
2016-01-14 17:06:46,515 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumByNulls/sumnulls/_temporary
2016-01-14 17:06:46,516 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [sum]  completed in: 00:00.159
2016-01-14 17:06:46,554 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testSumByNulls/sumnulls
2016-01-14 17:06:46,568 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:46,568 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:46,588 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 17:06:46,588 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:46,588 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:46,595 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting
2016-01-14 17:06:46,595 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:46,596 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  sink: Hfs["TextDelimited[['count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountAll/countall"]
2016-01-14 17:06:46,596 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  parallel execution of steps is enabled: false
2016-01-14 17:06:46,596 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  executing total steps: 1
2016-01-14 17:06:46,596 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  allocating management threads: 1
2016-01-14 17:06:46,596 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (1/1) ...orm/testCountAll/countall
2016-01-14 17:06:46,646 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity2022169848/.staging/job_local2022169848_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:46,647 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity2022169848/.staging/job_local2022169848_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:46,675 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2022169848_0026/job_local2022169848_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:46,675 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2022169848_0026/job_local2022169848_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:46,676 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local2022169848_0026
2016-01-14 17:06:46,677 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-14 17:06:46,680 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:46,698 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:46,698 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:46,702 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E6A9707F5E2E48A09449D053D37BE928, ordinal: 0
2016-01-14 17:06:46,703 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:46,703 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2016-01-14 17:06:46,703 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E6A9707F5E2E48A09449D053D37BE928, mem on start (mb), free: 301, total: 412, max: 672
2016-01-14 17:06:46,705 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E6A9707F5E2E48A09449D053D37BE928, mem on close (mb), free: 301, total: 412, max: 672
2016-01-14 17:06:46,713 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:46,714 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:46,718 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E417F95D3AF548BFB5B5D150598DF119, ordinal: 1
2016-01-14 17:06:46,718 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2016-01-14 17:06:46,718 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountAll/countall"]
2016-01-14 17:06:46,718 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E417F95D3AF548BFB5B5D150598DF119, mem on start (mb), free: 299, total: 412, max: 672
2016-01-14 17:06:46,725 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E417F95D3AF548BFB5B5D150598DF119, mem on close (mb), free: 298, total: 412, max: 672
2016-01-14 17:06:46,741 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountAll/countall/_temporary
2016-01-14 17:06:46,742 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  completed in: 00:00.146
2016-01-14 17:06:46,778 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCountAll/countall
2016-01-14 17:06:46,792 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:46,793 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:46,815 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-01-14 17:06:46,816 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:46,816 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:46,826 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-14 17:06:46,826 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:46,826 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregates/multi"]
2016-01-14 17:06:46,826 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  parallel execution of steps is enabled: false
2016-01-14 17:06:46,827 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  executing total steps: 1
2016-01-14 17:06:46,827 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  allocating management threads: 1
2016-01-14 17:06:46,827 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...tParallelAggregates/multi
2016-01-14 17:06:46,879 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1424594727/.staging/job_local1424594727_0027/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:46,880 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1424594727/.staging/job_local1424594727_0027/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:46,907 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1424594727_0027/job_local1424594727_0027.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:46,908 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1424594727_0027/job_local1424594727_0027.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:46,908 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local1424594727_0027
2016-01-14 17:06:46,909 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-14 17:06:46,913 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:46,931 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:46,931 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:46,936 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AD5099B7C8624174A796A0DA0F598529, ordinal: 0
2016-01-14 17:06:46,937 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:46,937 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:06:46,937 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AD5099B7C8624174A796A0DA0F598529, mem on start (mb), free: 301, total: 412, max: 672
2016-01-14 17:06:46,939 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:46,939 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,940 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,941 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:46,941 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,941 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,942 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:46,942 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,943 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,943 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:46,943 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,943 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,944 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AD5099B7C8624174A796A0DA0F598529, mem on close (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,953 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:46,953 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:46,959 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: AA96D7E0E1BD43FB9ADA19E27A9CE660, ordinal: 1
2016-01-14 17:06:46,960 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:06:46,960 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregates/multi"]
2016-01-14 17:06:46,961 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AA96D7E0E1BD43FB9ADA19E27A9CE660, mem on start (mb), free: 298, total: 412, max: 672
2016-01-14 17:06:46,968 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AA96D7E0E1BD43FB9ADA19E27A9CE660, mem on close (mb), free: 297, total: 412, max: 672
2016-01-14 17:06:46,984 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregates/multi/_temporary
2016-01-14 17:06:46,985 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  completed in: 00:00.158
2016-01-14 17:06:47,022 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testParallelAggregates/multi
2016-01-14 17:06:47,035 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:47,035 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:47,051 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.011
2016-01-14 17:06:47,051 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:06:47,051 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:47,058 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 17:06:47,058 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:47,058 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  sink: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRetainNarrow/retainnarrow"]
2016-01-14 17:06:47,059 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  parallel execution of steps is enabled: false
2016-01-14 17:06:47,059 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  executing total steps: 1
2016-01-14 17:06:47,059 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  allocating management threads: 1
2016-01-14 17:06:47,060 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...RetainNarrow/retainnarrow
2016-01-14 17:06:47,109 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1870816127/.staging/job_local1870816127_0028/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:47,110 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1870816127/.staging/job_local1870816127_0028/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:47,137 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1870816127_0028/job_local1870816127_0028.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:47,138 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1870816127_0028/job_local1870816127_0028.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:47,139 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local1870816127_0028
2016-01-14 17:06:47,140 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 17:06:47,143 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt
2016-01-14 17:06:47,148 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:47,148 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:47,152 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FC4074727A224402ABBEA8B0A9768812, ordinal: 0
2016-01-14 17:06:47,153 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:47,153 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRetainNarrow/retainnarrow"]
2016-01-14 17:06:47,153 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FC4074727A224402ABBEA8B0A9768812, mem on start (mb), free: 248, total: 412, max: 672
2016-01-14 17:06:47,155 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FC4074727A224402ABBEA8B0A9768812, mem on close (mb), free: 248, total: 412, max: 672
2016-01-14 17:06:47,173 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRetainNarrow/retainnarrow/_temporary
2016-01-14 17:06:47,173 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  completed in: 00:00.115
2016-01-14 17:06:47,193 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testRetainNarrow/retainnarrow
2016-01-14 17:06:47,204 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:47,205 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:47,219 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.012
2016-01-14 17:06:47,220 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:06:47,220 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:47,225 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 17:06:47,225 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:47,225 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  sink: Hfs["TextLine[['item']->['char', 'item']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNarrow/renamenarrow"]
2016-01-14 17:06:47,225 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  parallel execution of steps is enabled: false
2016-01-14 17:06:47,225 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  executing total steps: 1
2016-01-14 17:06:47,225 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  allocating management threads: 1
2016-01-14 17:06:47,227 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...RenameNarrow/renamenarrow
2016-01-14 17:06:47,275 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity686728229/.staging/job_local686728229_0029/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:47,276 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity686728229/.staging/job_local686728229_0029/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:47,303 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local686728229_0029/job_local686728229_0029.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:47,304 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local686728229_0029/job_local686728229_0029.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:47,304 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local686728229_0029
2016-01-14 17:06:47,305 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 17:06:47,308 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt
2016-01-14 17:06:47,313 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:47,313 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:47,316 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BB87C6D537244CF48A44CD66B56A9B07, ordinal: 0
2016-01-14 17:06:47,317 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:47,317 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['item']->['char', 'item']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNarrow/renamenarrow"]
2016-01-14 17:06:47,317 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BB87C6D537244CF48A44CD66B56A9B07, mem on start (mb), free: 204, total: 412, max: 672
2016-01-14 17:06:47,319 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BB87C6D537244CF48A44CD66B56A9B07, mem on close (mb), free: 204, total: 412, max: 672
2016-01-14 17:06:47,338 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNarrow/renamenarrow/_temporary
2016-01-14 17:06:47,338 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  completed in: 00:00.113
2016-01-14 17:06:47,358 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testRenameNarrow/renamenarrow
2016-01-14 17:06:47,370 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:47,371 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:47,392 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 17:06:47,392 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:47,393 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:47,399 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average] starting
2016-01-14 17:06:47,400 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:47,400 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average]  sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageByNull/averagenull"]
2016-01-14 17:06:47,401 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average]  parallel execution of steps is enabled: false
2016-01-14 17:06:47,401 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average]  executing total steps: 1
2016-01-14 17:06:47,402 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average]  allocating management threads: 1
2016-01-14 17:06:47,404 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average] starting step: (1/1) ...AverageByNull/averagenull
2016-01-14 17:06:47,460 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1210090817/.staging/job_local1210090817_0030/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:47,461 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1210090817/.staging/job_local1210090817_0030/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:47,494 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1210090817_0030/job_local1210090817_0030.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:47,494 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1210090817_0030/job_local1210090817_0030.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:47,495 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average] submitted hadoop job: job_local1210090817_0030
2016-01-14 17:06:47,495 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average] tracking url: http://localhost:8080/
2016-01-14 17:06:47,500 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:47,514 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:47,514 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:47,518 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D6925BD7650E4A3CBE1CDBE61C0581CF, ordinal: 0
2016-01-14 17:06:47,519 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:47,519 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2016-01-14 17:06:47,519 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D6925BD7650E4A3CBE1CDBE61C0581CF, mem on start (mb), free: 292, total: 413, max: 672
2016-01-14 17:06:47,523 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:47,524 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 292, total: 413, max: 672
2016-01-14 17:06:47,524 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:47,525 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:47,525 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 292, total: 413, max: 672
2016-01-14 17:06:47,525 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:47,526 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:47,526 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 292, total: 413, max: 672
2016-01-14 17:06:47,526 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:47,527 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:47,527 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 292, total: 413, max: 672
2016-01-14 17:06:47,527 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:47,528 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D6925BD7650E4A3CBE1CDBE61C0581CF, mem on close (mb), free: 292, total: 413, max: 672
2016-01-14 17:06:47,536 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:47,536 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:47,541 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C2C38EB295724D3E91A56CAA17CF5FAD, ordinal: 1
2016-01-14 17:06:47,541 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2016-01-14 17:06:47,541 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageByNull/averagenull"]
2016-01-14 17:06:47,542 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C2C38EB295724D3E91A56CAA17CF5FAD, mem on start (mb), free: 290, total: 413, max: 672
2016-01-14 17:06:47,549 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C2C38EB295724D3E91A56CAA17CF5FAD, mem on close (mb), free: 289, total: 413, max: 672
2016-01-14 17:06:47,559 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageByNull/averagenull/_temporary
2016-01-14 17:06:47,560 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [average]  completed in: 00:00.160
2016-01-14 17:06:47,599 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testAverageByNull/averagenull
2016-01-14 17:06:47,610 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:47,611 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:47,628 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 17:06:47,629 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:06:47,629 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:47,634 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] starting
2016-01-14 17:06:47,634 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:47,634 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce]  sink: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerce/coerce"]
2016-01-14 17:06:47,635 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce]  parallel execution of steps is enabled: false
2016-01-14 17:06:47,635 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce]  executing total steps: 1
2016-01-14 17:06:47,635 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce]  allocating management threads: 1
2016-01-14 17:06:47,636 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] starting step: (1/1) ...latform/testCoerce/coerce
2016-01-14 17:06:47,685 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity2004417555/.staging/job_local2004417555_0031/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:47,686 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity2004417555/.staging/job_local2004417555_0031/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:47,722 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2004417555_0031/job_local2004417555_0031.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:47,722 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2004417555_0031/job_local2004417555_0031.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:47,724 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] submitted hadoop job: job_local2004417555_0031
2016-01-14 17:06:47,724 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] tracking url: http://localhost:8080/
2016-01-14 17:06:47,730 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt
2016-01-14 17:06:47,737 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:47,737 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:47,742 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DAC63A79D5504557BFB52B7034A4D698, ordinal: 0
2016-01-14 17:06:47,742 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:47,742 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerce/coerce"]
2016-01-14 17:06:47,743 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DAC63A79D5504557BFB52B7034A4D698, mem on start (mb), free: 237, total: 413, max: 672
2016-01-14 17:06:47,744 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DAC63A79D5504557BFB52B7034A4D698, mem on close (mb), free: 237, total: 413, max: 672
2016-01-14 17:06:47,757 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerce/coerce/_temporary
2016-01-14 17:06:47,758 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce]  completed in: 00:00.123
2016-01-14 17:06:47,782 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCoerce/coerce
2016-01-14 17:06:47,793 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:47,793 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:47,811 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.015
2016-01-14 17:06:47,812 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:47,812 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:47,818 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-14 17:06:47,818 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  source: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs+rhs-cross-rev.txt"]
2016-01-14 17:06:47,819 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  sink: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstByWithoutComparator/firstnfieldswithoutcomparator"]
2016-01-14 17:06:47,819 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  parallel execution of steps is enabled: false
2016-01-14 17:06:47,819 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  executing total steps: 1
2016-01-14 17:06:47,820 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  allocating management threads: 1
2016-01-14 17:06:47,821 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) ...tnfieldswithoutcomparator
2016-01-14 17:06:47,871 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity603577890/.staging/job_local603577890_0032/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:47,872 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity603577890/.staging/job_local603577890_0032/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:47,899 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local603577890_0032/job_local603577890_0032.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:47,900 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local603577890_0032/job_local603577890_0032.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:47,900 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted hadoop job: job_local603577890_0032
2016-01-14 17:06:47,903 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tracking url: http://localhost:8080/
2016-01-14 17:06:47,905 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs+rhs-cross-rev.txt
2016-01-14 17:06:47,924 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:47,925 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:47,929 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C2D768E857504369BD8EAFD09EA68AC8, ordinal: 0
2016-01-14 17:06:47,930 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs+rhs-cross-rev.txt"]
2016-01-14 17:06:47,930 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(first)[by:[{1}:'num']]
2016-01-14 17:06:47,930 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C2D768E857504369BD8EAFD09EA68AC8, mem on start (mb), free: 300, total: 413, max: 672
2016-01-14 17:06:47,935 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:47,935 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 413, max: 672
2016-01-14 17:06:47,936 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:47,938 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:47,938 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 413, max: 672
2016-01-14 17:06:47,938 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:47,940 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C2D768E857504369BD8EAFD09EA68AC8, mem on close (mb), free: 300, total: 413, max: 672
2016-01-14 17:06:47,948 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:47,948 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:47,952 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: EA7FEF12229342AE97F8C9ABD13E0BAB, ordinal: 1
2016-01-14 17:06:47,952 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(first)[by:[{1}:'num']]
2016-01-14 17:06:47,953 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstByWithoutComparator/firstnfieldswithoutcomparator"]
2016-01-14 17:06:47,953 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EA7FEF12229342AE97F8C9ABD13E0BAB, mem on start (mb), free: 298, total: 413, max: 672
2016-01-14 17:06:47,959 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EA7FEF12229342AE97F8C9ABD13E0BAB, mem on close (mb), free: 297, total: 413, max: 672
2016-01-14 17:06:47,979 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstByWithoutComparator/firstnfieldswithoutcomparator/_temporary
2016-01-14 17:06:47,980 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first]  completed in: 00:00.161
2016-01-14 17:06:48,004 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testFirstByWithoutComparator/firstnfieldswithoutcomparator
2016-01-14 17:06:48,024 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:48,024 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:48,059 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.030
2016-01-14 17:06:48,060 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:48,060 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:48,073 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-14 17:06:48,073 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:48,074 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:48,075 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMergeLegacyHash/multimerge+false480"]
2016-01-14 17:06:48,075 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  parallel execution of steps is enabled: false
2016-01-14 17:06:48,075 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  executing total steps: 1
2016-01-14 17:06:48,076 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  allocating management threads: 1
2016-01-14 17:06:48,077 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...yHash/multimerge+false480
2016-01-14 17:06:48,128 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1142707615/.staging/job_local1142707615_0033/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:48,129 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1142707615/.staging/job_local1142707615_0033/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:48,156 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1142707615_0033/job_local1142707615_0033.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:48,156 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1142707615_0033/job_local1142707615_0033.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:48,157 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local1142707615_0033
2016-01-14 17:06:48,157 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-14 17:06:48,161 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:48,178 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:48,179 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:48,183 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AEC7C57F63174476B390B9618CAD7833, ordinal: 0
2016-01-14 17:06:48,184 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:48,184 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 17:06:48,184 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AEC7C57F63174476B390B9618CAD7833, mem on start (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,185 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:48,185 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,186 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,186 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:48,186 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,187 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,187 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:48,187 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,187 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,187 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:48,188 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,188 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,189 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AEC7C57F63174476B390B9618CAD7833, mem on close (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,200 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt
2016-01-14 17:06:48,217 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:48,218 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:48,227 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AEC7C57F63174476B390B9618CAD7833, ordinal: 0
2016-01-14 17:06:48,227 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:48,228 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 17:06:48,228 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AEC7C57F63174476B390B9618CAD7833, mem on start (mb), free: 200, total: 414, max: 672
2016-01-14 17:06:48,237 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:48,238 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 200, total: 414, max: 672
2016-01-14 17:06:48,238 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,241 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:48,241 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 200, total: 414, max: 672
2016-01-14 17:06:48,242 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,244 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:48,244 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 200, total: 414, max: 672
2016-01-14 17:06:48,245 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,246 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:48,247 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 200, total: 414, max: 672
2016-01-14 17:06:48,248 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,248 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AEC7C57F63174476B390B9618CAD7833, mem on close (mb), free: 200, total: 414, max: 672
2016-01-14 17:06:48,266 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:48,267 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:48,275 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B3E0143B65CF43CE95F52E9605C4F043, ordinal: 1
2016-01-14 17:06:48,276 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 17:06:48,277 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMergeLegacyHash/multimerge+false480"]
2016-01-14 17:06:48,277 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B3E0143B65CF43CE95F52E9605C4F043, mem on start (mb), free: 198, total: 414, max: 672
2016-01-14 17:06:48,286 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B3E0143B65CF43CE95F52E9605C4F043, mem on close (mb), free: 197, total: 414, max: 672
2016-01-14 17:06:48,310 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMergeLegacyHash/multimerge+false480/_temporary
2016-01-14 17:06:48,311 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [name]  completed in: 00:00.237
2016-01-14 17:06:48,351 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMergeLegacyHash/multimerge+false480
2016-01-14 17:06:48,365 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:48,365 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:48,467 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.098
2016-01-14 17:06:48,468 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 5, nodes: 10
2016-01-14 17:06:48,468 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:48,504 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting
2016-01-14 17:06:48,505 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:48,507 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...]  sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMergeThreeWay/samesourcemergethreeway"]
2016-01-14 17:06:48,507 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...]  parallel execution of steps is enabled: false
2016-01-14 17:06:48,508 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...]  executing total steps: 5
2016-01-14 17:06:48,509 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...]  allocating management threads: 1
2016-01-14 17:06:48,511 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (1/5)
2016-01-14 17:06:48,563 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity385828956/.staging/job_local385828956_0034/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:48,564 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity385828956/.staging/job_local385828956_0034/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:48,590 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local385828956_0034/job_local385828956_0034.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:48,590 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local385828956_0034/job_local385828956_0034.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:48,591 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local385828956_0034
2016-01-14 17:06:48,592 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-14 17:06:48,595 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:48,609 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:48,609 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:48,613 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BFF61539E3BA4EDFBC8AE958D435692B, ordinal: 0
2016-01-14 17:06:48,614 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:48,614 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(source)[by:[{1}:'char']]
2016-01-14 17:06:48,614 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BFF61539E3BA4EDFBC8AE958D435692B, mem on start (mb), free: 272, total: 414, max: 672
2016-01-14 17:06:48,615 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:48,615 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 272, total: 414, max: 672
2016-01-14 17:06:48,616 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,616 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:48,617 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 272, total: 414, max: 672
2016-01-14 17:06:48,617 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,618 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:48,618 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 272, total: 414, max: 672
2016-01-14 17:06:48,618 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,619 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:48,619 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 272, total: 414, max: 672
2016-01-14 17:06:48,619 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,620 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BFF61539E3BA4EDFBC8AE958D435692B, mem on close (mb), free: 272, total: 414, max: 672
2016-01-14 17:06:48,628 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:48,628 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:48,632 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A21E66356115429A93190A5EEF249261, ordinal: 1
2016-01-14 17:06:48,632 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(source)[by:[{1}:'char']]
2016-01-14 17:06:48,633 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][2480690792/source/]
2016-01-14 17:06:48,633 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A21E66356115429A93190A5EEF249261, mem on start (mb), free: 270, total: 414, max: 672
2016-01-14 17:06:48,639 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A21E66356115429A93190A5EEF249261, mem on close (mb), free: 268, total: 414, max: 672
2016-01-14 17:06:48,656 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (2/5)
2016-01-14 17:06:48,718 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity49110433/.staging/job_local49110433_0035/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:48,719 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity49110433/.staging/job_local49110433_0035/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:48,744 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local49110433_0035/job_local49110433_0035.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:48,744 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local49110433_0035/job_local49110433_0035.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:48,745 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local49110433_0035
2016-01-14 17:06:48,745 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-14 17:06:48,749 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/2480690792_source_4465F0229711417C898B42A8A3071AF2/part-00000
2016-01-14 17:06:48,766 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:48,767 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:48,770 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A06F781E241449E4BFA8020A34685904, ordinal: 0
2016-01-14 17:06:48,771 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][2480690792/source/]
2016-01-14 17:06:48,771 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count-lhs)[by:[{1}:'char']]
2016-01-14 17:06:48,771 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A06F781E241449E4BFA8020A34685904, mem on start (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,772 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:48,772 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,773 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,773 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:48,773 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,773 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,774 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A06F781E241449E4BFA8020A34685904, mem on close (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,784 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:48,785 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:48,791 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D9BC2978124E41A2AF7E97E4B8B742F5, ordinal: 1
2016-01-14 17:06:48,792 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count-lhs)[by:[{1}:'char']]
2016-01-14 17:06:48,792 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][1367985507/count-lhs/]
2016-01-14 17:06:48,792 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D9BC2978124E41A2AF7E97E4B8B742F5, mem on start (mb), free: 300, total: 414, max: 672
2016-01-14 17:06:48,800 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D9BC2978124E41A2AF7E97E4B8B742F5, mem on close (mb), free: 298, total: 414, max: 672
2016-01-14 17:06:48,809 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (3/5)
2016-01-14 17:06:48,875 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1341539245/.staging/job_local1341539245_0036/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:48,876 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1341539245/.staging/job_local1341539245_0036/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:48,903 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1341539245_0036/job_local1341539245_0036.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:48,903 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1341539245_0036/job_local1341539245_0036.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:48,905 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local1341539245_0036
2016-01-14 17:06:48,906 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-14 17:06:48,908 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/2480690792_source_4465F0229711417C898B42A8A3071AF2/part-00000
2016-01-14 17:06:48,926 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:48,927 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:48,931 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DD7EBE3ECB55433CB58A092F745ADDE0, ordinal: 0
2016-01-14 17:06:48,932 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][2480690792/source/]
2016-01-14 17:06:48,932 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count-rhs)[by:[{1}:'char']]
2016-01-14 17:06:48,933 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DD7EBE3ECB55433CB58A092F745ADDE0, mem on start (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,934 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:48,935 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,935 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,937 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:48,937 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,937 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,939 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DD7EBE3ECB55433CB58A092F745ADDE0, mem on close (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,946 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:48,946 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:48,950 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CC04423E74554F559008107C963DE41C, ordinal: 1
2016-01-14 17:06:48,950 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count-rhs)[by:[{1}:'char']]
2016-01-14 17:06:48,950 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][283882565/count-rhs/]
2016-01-14 17:06:48,950 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CC04423E74554F559008107C963DE41C, mem on start (mb), free: 300, total: 414, max: 672
2016-01-14 17:06:48,956 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CC04423E74554F559008107C963DE41C, mem on close (mb), free: 299, total: 414, max: 672
2016-01-14 17:06:48,971 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (4/5)
2016-01-14 17:06:49,043 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity819556759/.staging/job_local819556759_0037/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:49,044 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity819556759/.staging/job_local819556759_0037/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:49,072 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local819556759_0037/job_local819556759_0037.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:49,072 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local819556759_0037/job_local819556759_0037.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:49,073 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local819556759_0037
2016-01-14 17:06:49,074 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-14 17:06:49,077 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/2480690792_source_4465F0229711417C898B42A8A3071AF2/part-00000
2016-01-14 17:06:49,097 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:49,097 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,104 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F55B6B81B1A34D7B90083A4C554CFF6C, ordinal: 0
2016-01-14 17:06:49,106 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][2480690792/source/]
2016-01-14 17:06:49,106 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 17:06:49,107 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F55B6B81B1A34D7B90083A4C554CFF6C, mem on start (mb), free: 302, total: 415, max: 672
2016-01-14 17:06:49,109 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F55B6B81B1A34D7B90083A4C554CFF6C, mem on close (mb), free: 302, total: 415, max: 672
2016-01-14 17:06:49,114 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/283882565_count_rhs_685F7F24DE3A44D1BE333B4BB9D601A4/part-00000
2016-01-14 17:06:49,129 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:49,130 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,135 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F55B6B81B1A34D7B90083A4C554CFF6C, ordinal: 0
2016-01-14 17:06:49,135 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][283882565/count-rhs/]
2016-01-14 17:06:49,135 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 17:06:49,136 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F55B6B81B1A34D7B90083A4C554CFF6C, mem on start (mb), free: 200, total: 415, max: 672
2016-01-14 17:06:49,138 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F55B6B81B1A34D7B90083A4C554CFF6C, mem on close (mb), free: 200, total: 415, max: 672
2016-01-14 17:06:49,148 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:49,148 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,151 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: AF0866A280604BCB89EA22D0E05E514A, ordinal: 1
2016-01-14 17:06:49,152 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 17:06:49,152 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][3804924744/source_count-rhs/]
2016-01-14 17:06:49,152 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AF0866A280604BCB89EA22D0E05E514A, mem on start (mb), free: 198, total: 415, max: 672
2016-01-14 17:06:49,162 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 17:06:49,162 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 17:06:49,175 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AF0866A280604BCB89EA22D0E05E514A, mem on close (mb), free: 196, total: 415, max: 672
2016-01-14 17:06:49,189 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (5/5) ...y/samesourcemergethreeway
2016-01-14 17:06:49,256 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1394691871/.staging/job_local1394691871_0038/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:49,257 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1394691871/.staging/job_local1394691871_0038/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:49,289 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1394691871_0038/job_local1394691871_0038.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:49,289 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1394691871_0038/job_local1394691871_0038.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:49,290 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local1394691871_0038
2016-01-14 17:06:49,290 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-14 17:06:49,294 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/3804924744_source_count_rhs_9F84B3EE6E5947F981E37B536A895A59/part-00000
2016-01-14 17:06:49,308 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:49,308 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,313 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DFF3D8EDF266449AA4B80194F49E2F6E, ordinal: 0
2016-01-14 17:06:49,313 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][3804924744/source_count-rhs/]
2016-01-14 17:06:49,314 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2016-01-14 17:06:49,314 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DFF3D8EDF266449AA4B80194F49E2F6E, mem on start (mb), free: 295, total: 415, max: 672
2016-01-14 17:06:49,315 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DFF3D8EDF266449AA4B80194F49E2F6E, mem on close (mb), free: 295, total: 415, max: 672
2016-01-14 17:06:49,321 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/1367985507_count_lhs_A658D8030B0C495ABE0122136D52F64F/part-00000
2016-01-14 17:06:49,335 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:49,336 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,340 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DFF3D8EDF266449AA4B80194F49E2F6E, ordinal: 0
2016-01-14 17:06:49,341 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][1367985507/count-lhs/]
2016-01-14 17:06:49,341 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2016-01-14 17:06:49,341 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DFF3D8EDF266449AA4B80194F49E2F6E, mem on start (mb), free: 193, total: 415, max: 672
2016-01-14 17:06:49,343 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DFF3D8EDF266449AA4B80194F49E2F6E, mem on close (mb), free: 193, total: 415, max: 672
2016-01-14 17:06:49,353 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:49,353 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,358 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D8D803333CCE46BDB4233B1E77C5BA0D, ordinal: 1
2016-01-14 17:06:49,359 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2016-01-14 17:06:49,359 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMergeThreeWay/samesourcemergethreeway"]
2016-01-14 17:06:49,359 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D8D803333CCE46BDB4233B1E77C5BA0D, mem on start (mb), free: 191, total: 415, max: 672
2016-01-14 17:06:49,365 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 17:06:49,365 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 17:06:49,368 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D8D803333CCE46BDB4233B1E77C5BA0D, mem on close (mb), free: 190, total: 415, max: 672
2016-01-14 17:06:49,389 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMergeThreeWay/samesourcemergethreeway/_temporary
2016-01-14 17:06:49,390 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...]  completed in: 00:00.883
2016-01-14 17:06:49,427 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testSameSourceMergeThreeWay/samesourcemergethreeway
2016-01-14 17:06:49,440 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:49,440 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:49,472 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 17:06:49,473 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:49,474 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:49,485 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] starting
2016-01-14 17:06:49,485 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:49,485 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:49,486 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs]  sink: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUniqueMerge/uniquemerge-nondeterministic"]
2016-01-14 17:06:49,486 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs]  parallel execution of steps is enabled: false
2016-01-14 17:06:49,486 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs]  executing total steps: 1
2016-01-14 17:06:49,487 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs]  allocating management threads: 1
2016-01-14 17:06:49,487 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] starting step: (1/1) ...quemerge-nondeterministic
2016-01-14 17:06:49,540 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity713014921/.staging/job_local713014921_0039/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:49,541 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity713014921/.staging/job_local713014921_0039/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:49,569 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local713014921_0039/job_local713014921_0039.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:49,569 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local713014921_0039/job_local713014921_0039.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:49,572 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] submitted hadoop job: job_local713014921_0039
2016-01-14 17:06:49,572 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] tracking url: http://localhost:8080/
2016-01-14 17:06:49,576 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:49,589 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:49,590 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,593 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: CB2430EE66154ECFB612BCE79337F4AB, ordinal: 0
2016-01-14 17:06:49,594 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:49,594 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2016-01-14 17:06:49,594 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CB2430EE66154ECFB612BCE79337F4AB, mem on start (mb), free: 275, total: 416, max: 672
2016-01-14 17:06:49,601 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CB2430EE66154ECFB612BCE79337F4AB, mem on close (mb), free: 274, total: 416, max: 672
2016-01-14 17:06:49,607 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt
2016-01-14 17:06:49,623 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:49,624 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,630 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: CB2430EE66154ECFB612BCE79337F4AB, ordinal: 0
2016-01-14 17:06:49,631 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:49,631 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2016-01-14 17:06:49,631 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CB2430EE66154ECFB612BCE79337F4AB, mem on start (mb), free: 173, total: 416, max: 672
2016-01-14 17:06:49,634 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CB2430EE66154ECFB612BCE79337F4AB, mem on close (mb), free: 173, total: 416, max: 672
2016-01-14 17:06:49,648 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:49,648 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,652 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F212EC4FA125497FA78A1B563772646D, ordinal: 1
2016-01-14 17:06:49,653 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2016-01-14 17:06:49,653 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUniqueMerge/uniquemerge-nondeterministic"]
2016-01-14 17:06:49,654 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F212EC4FA125497FA78A1B563772646D, mem on start (mb), free: 170, total: 416, max: 672
2016-01-14 17:06:49,663 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F212EC4FA125497FA78A1B563772646D, mem on close (mb), free: 169, total: 416, max: 672
2016-01-14 17:06:49,684 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUniqueMerge/uniquemerge-nondeterministic/_temporary
2016-01-14 17:06:49,686 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs]  completed in: 00:00.199
2016-01-14 17:06:49,708 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testUniqueMerge/uniquemerge-nondeterministic
2016-01-14 17:06:49,719 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:49,720 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:49,741 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-01-14 17:06:49,742 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:49,742 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:49,749 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 17:06:49,749 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:49,749 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  sink: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUnique/unique"]
2016-01-14 17:06:49,750 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  parallel execution of steps is enabled: false
2016-01-14 17:06:49,750 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  executing total steps: 1
2016-01-14 17:06:49,751 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  allocating management threads: 1
2016-01-14 17:06:49,752 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...latform/testUnique/unique
2016-01-14 17:06:49,804 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity588684722/.staging/job_local588684722_0040/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:49,805 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity588684722/.staging/job_local588684722_0040/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:49,831 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local588684722_0040/job_local588684722_0040.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:49,831 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local588684722_0040/job_local588684722_0040.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:49,832 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local588684722_0040
2016-01-14 17:06:49,834 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 17:06:49,837 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:49,852 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:49,852 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,856 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: ABFDA8D8D5DA47CE9DAB9DE835A515E8, ordinal: 0
2016-01-14 17:06:49,856 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:49,857 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(shape)[by:[{1}:'num']]
2016-01-14 17:06:49,857 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: ABFDA8D8D5DA47CE9DAB9DE835A515E8, mem on start (mb), free: 253, total: 412, max: 672
2016-01-14 17:06:49,859 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: ABFDA8D8D5DA47CE9DAB9DE835A515E8, mem on close (mb), free: 253, total: 412, max: 672
2016-01-14 17:06:49,867 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:49,868 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,870 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CAAFB7FE827F425797A9AC1E5621715F, ordinal: 1
2016-01-14 17:06:49,871 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(shape)[by:[{1}:'num']]
2016-01-14 17:06:49,871 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUnique/unique"]
2016-01-14 17:06:49,871 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CAAFB7FE827F425797A9AC1E5621715F, mem on start (mb), free: 252, total: 412, max: 672
2016-01-14 17:06:49,877 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CAAFB7FE827F425797A9AC1E5621715F, mem on close (mb), free: 251, total: 412, max: 672
2016-01-14 17:06:49,889 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUnique/unique/_temporary
2016-01-14 17:06:49,889 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [shape]  completed in: 00:00.139
2016-01-14 17:06:49,910 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testUnique/unique
2016-01-14 17:06:49,922 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:49,922 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:49,942 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 17:06:49,943 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:49,943 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:49,951 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting
2016-01-14 17:06:49,951 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:49,951 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  sink: Hfs["TextDelimited[['notnull', 'null']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountNullNotNull/countnullnotnull"]
2016-01-14 17:06:49,951 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  parallel execution of steps is enabled: false
2016-01-14 17:06:49,951 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  executing total steps: 1
2016-01-14 17:06:49,951 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  allocating management threads: 1
2016-01-14 17:06:49,952 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (1/1) ...lNotNull/countnullnotnull
2016-01-14 17:06:50,002 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity158947665/.staging/job_local158947665_0041/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:50,003 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity158947665/.staging/job_local158947665_0041/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:50,030 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local158947665_0041/job_local158947665_0041.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 17:06:50,030 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local158947665_0041/job_local158947665_0041.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 17:06:50,031 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local158947665_0041
2016-01-14 17:06:50,031 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-14 17:06:50,034 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:50,052 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:50,052 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:50,057 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F90ED919395C4C818DF13F046EB84AEC, ordinal: 0
2016-01-14 17:06:50,058 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:50,058 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2016-01-14 17:06:50,059 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F90ED919395C4C818DF13F046EB84AEC, mem on start (mb), free: 303, total: 416, max: 672
2016-01-14 17:06:50,064 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F90ED919395C4C818DF13F046EB84AEC, mem on close (mb), free: 303, total: 416, max: 672
2016-01-14 17:06:50,071 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:50,071 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:50,076 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B20C4D87A8364D4381253EF03C2038B4, ordinal: 1
2016-01-14 17:06:50,077 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2016-01-14 17:06:50,077 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['notnull', 'null']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountNullNotNull/countnullnotnull"]
2016-01-14 17:06:50,077 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B20C4D87A8364D4381253EF03C2038B4, mem on start (mb), free: 301, total: 416, max: 672
2016-01-14 17:06:50,083 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B20C4D87A8364D4381253EF03C2038B4, mem on close (mb), free: 299, total: 416, max: 672
2016-01-14 17:06:50,096 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountNullNotNull/countnullnotnull/_temporary
2016-01-14 17:06:50,096 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [count]  completed in: 00:00.145
2016-01-14 17:06:50,134 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCountNullNotNull/countnullnotnull