2016-01-14 17:06:35,380 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 17:06:35,409 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.pipe.assembly.AssemblyHelpersPlatformTest, with platform: hadoop2-mr1
2016-01-14 17:06:35,449 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(119)) - not using cluster
2016-01-14 17:06:36,070 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-01-14 17:06:36,245 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2016-01-14 17:06:36,582 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:36,585 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:36,696 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: 5834F58CA1A14304A22CDEB73CB2A6C0
2016-01-14 17:06:36,915 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.165
2016-01-14 17:06:36,919 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:36,920 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:37,133 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 17:06:37,135 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-14 17:06:37,136 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:37,137 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:37,138 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMerge/multimerge+false479"]
2016-01-14 17:06:37,140 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] parallel execution of steps is enabled: false
2016-01-14 17:06:37,140 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executing total steps: 1
2016-01-14 17:06:37,141 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] allocating management threads: 1
2016-01-14 17:06:37,142 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...Merge/multimerge+false479
2016-01-14 17:06:37,671 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity954986480/.staging/job_local954986480_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:37,683 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity954986480/.staging/job_local954986480_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:37,770 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local954986480_0001/job_local954986480_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:37,771 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local954986480_0001/job_local954986480_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:37,780 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local954986480_0001
2016-01-14 17:06:37,781 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-14 17:06:37,846 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:37,983 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:37,983 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:38,006 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F0CE57ED21C1486BBE24B691186CCC15, ordinal: 0
2016-01-14 17:06:38,040 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:38,041 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 17:06:38,041 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F0CE57ED21C1486BBE24B691186CCC15, mem on start (mb), free: 85, total: 223, max: 672
2016-01-14 17:06:38,058 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:38,058 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 83, total: 223, max: 672
2016-01-14 17:06:38,058 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 33% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:38,060 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:38,060 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 83, total: 223, max: 672
2016-01-14 17:06:38,060 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 33% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:38,061 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:38,062 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 83, total: 223, max: 672
2016-01-14 17:06:38,062 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 33% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:38,063 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:38,064 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 83, total: 223, max: 672
2016-01-14 17:06:38,064 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 33% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:38,065 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F0CE57ED21C1486BBE24B691186CCC15, mem on close (mb), free: 83, total: 223, max: 672
2016-01-14 17:06:38,088 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt
2016-01-14 17:06:38,193 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:38,194 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:38,212 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F0CE57ED21C1486BBE24B691186CCC15, ordinal: 0
2016-01-14 17:06:38,214 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:38,214 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 17:06:38,214 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F0CE57ED21C1486BBE24B691186CCC15, mem on start (mb), free: 82, total: 323, max: 672
2016-01-14 17:06:38,287 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:38,287 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 79, total: 323, max: 672
2016-01-14 17:06:38,288 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 48% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:38,289 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:38,290 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 79, total: 323, max: 672
2016-01-14 17:06:38,290 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 48% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:38,291 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:38,291 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 79, total: 323, max: 672
2016-01-14 17:06:38,292 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 48% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:38,293 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:38,293 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 79, total: 323, max: 672
2016-01-14 17:06:38,294 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 48% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:38,295 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F0CE57ED21C1486BBE24B691186CCC15, mem on close (mb), free: 78, total: 323, max: 672
2016-01-14 17:06:38,328 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:38,328 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:38,346 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D18F3FB3C0384F649F0F5A774050C63D, ordinal: 1
2016-01-14 17:06:38,350 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 17:06:38,350 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMerge/multimerge+false479"]
2016-01-14 17:06:38,351 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D18F3FB3C0384F649F0F5A774050C63D, mem on start (mb), free: 76, total: 323, max: 672
2016-01-14 17:06:38,372 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D18F3FB3C0384F649F0F5A774050C63D, mem on close (mb), free: 75, total: 323, max: 672
2016-01-14 17:06:38,402 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMerge/multimerge+false479/_temporary
2016-01-14 17:06:38,402 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] completed in: 00:01.266
2016-01-14 17:06:38,469 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMerge/multimerge+false479
2016-01-14 17:06:38,493 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:38,494 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:38,559 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.058
2016-01-14 17:06:38,561 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:38,561 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:38,586 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting
2016-01-14 17:06:38,587 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:38,587 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] sink: Hfs["TextDelimited[['num', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByString/minbystring"]
2016-01-14 17:06:38,588 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] parallel execution of steps is enabled: false
2016-01-14 17:06:38,589 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executing total steps: 1
2016-01-14 17:06:38,589 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] allocating management threads: 1
2016-01-14 17:06:38,591 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting step: (1/1) ...stMinByString/minbystring
2016-01-14 17:06:38,706 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1496798347/.staging/job_local1496798347_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:38,710 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1496798347/.staging/job_local1496798347_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:38,772 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1496798347_0002/job_local1496798347_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:38,773 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1496798347_0002/job_local1496798347_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:38,775 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] submitted hadoop job: job_local1496798347_0002
2016-01-14 17:06:38,776 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] tracking url: http://localhost:8080/
2016-01-14 17:06:38,785 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:38,894 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:38,895 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:38,904 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FF01500C3EBC48B5BB1D42B7F8ACA7D6, ordinal: 0
2016-01-14 17:06:38,906 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:38,906 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2016-01-14 17:06:38,907 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FF01500C3EBC48B5BB1D42B7F8ACA7D6, mem on start (mb), free: 91, total: 424, max: 672
2016-01-14 17:06:38,909 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:38,909 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 91, total: 424, max: 672
2016-01-14 17:06:38,910 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 63% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:38,911 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:38,911 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 91, total: 424, max: 672
2016-01-14 17:06:38,912 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 63% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:38,913 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FF01500C3EBC48B5BB1D42B7F8ACA7D6, mem on close (mb), free: 91, total: 424, max: 672
2016-01-14 17:06:38,927 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:38,928 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:38,938 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: ACAC05DF157648A29533DF9B646C5BE0, ordinal: 1
2016-01-14 17:06:38,938 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2016-01-14 17:06:38,939 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['num', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByString/minbystring"]
2016-01-14 17:06:38,939 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ACAC05DF157648A29533DF9B646C5BE0, mem on start (mb), free: 90, total: 424, max: 672
2016-01-14 17:06:38,949 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ACAC05DF157648A29533DF9B646C5BE0, mem on close (mb), free: 89, total: 424, max: 672
2016-01-14 17:06:38,973 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByString/minbystring/_temporary
2016-01-14 17:06:38,974 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] completed in: 00:00.387
2016-01-14 17:06:39,038 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMinByString/minbystring
2016-01-14 17:06:39,063 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:39,063 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:39,138 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.068
2016-01-14 17:06:39,140 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:39,141 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:39,170 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] starting
2016-01-14 17:06:39,170 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:39,171 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:39,172 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageMerge/mergeaverage"]
2016-01-14 17:06:39,172 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] parallel execution of steps is enabled: false
2016-01-14 17:06:39,173 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] executing total steps: 1
2016-01-14 17:06:39,173 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] allocating management threads: 1
2016-01-14 17:06:39,175 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] starting step: (1/1) ...AverageMerge/mergeaverage
2016-01-14 17:06:39,326 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1513505659/.staging/job_local1513505659_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:39,328 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1513505659/.staging/job_local1513505659_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:39,476 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1513505659_0003/job_local1513505659_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:39,477 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1513505659_0003/job_local1513505659_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:39,479 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] submitted hadoop job: job_local1513505659_0003
2016-01-14 17:06:39,479 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] tracking url: http://localhost:8080/
2016-01-14 17:06:39,489 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:39,542 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:39,543 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:39,558 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A2AA4FE560E34991BED8F33E431FB17E, ordinal: 0
2016-01-14 17:06:39,559 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:39,559 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2016-01-14 17:06:39,559 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A2AA4FE560E34991BED8F33E431FB17E, mem on start (mb), free: 61, total: 482, max: 672
2016-01-14 17:06:39,560 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:39,561 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 61, total: 482, max: 672
2016-01-14 17:06:39,561 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 71% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:39,562 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:39,562 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 61, total: 482, max: 672
2016-01-14 17:06:39,563 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 71% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:39,563 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:39,563 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 61, total: 482, max: 672
2016-01-14 17:06:39,564 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 71% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:39,564 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:39,564 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 61, total: 482, max: 672
2016-01-14 17:06:39,565 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 71% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:39,565 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A2AA4FE560E34991BED8F33E431FB17E, mem on close (mb), free: 61, total: 482, max: 672
2016-01-14 17:06:39,577 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt
2016-01-14 17:06:39,677 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:39,677 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:39,688 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A2AA4FE560E34991BED8F33E431FB17E, ordinal: 0
2016-01-14 17:06:39,689 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:39,689 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2016-01-14 17:06:39,690 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A2AA4FE560E34991BED8F33E431FB17E, mem on start (mb), free: 60, total: 583, max: 672
2016-01-14 17:06:39,693 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:39,693 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 60, total: 583, max: 672
2016-01-14 17:06:39,694 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:39,695 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 60, total: 583, max: 672
2016-01-14 17:06:39,695 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:39,695 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 60, total: 583, max: 672
2016-01-14 17:06:39,696 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:39,696 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 60, total: 583, max: 672
2016-01-14 17:06:39,697 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A2AA4FE560E34991BED8F33E431FB17E, mem on close (mb), free: 60, total: 583, max: 672
2016-01-14 17:06:39,718 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:39,718 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:39,729 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DCA577C3AE664E9F9AC9DB954FB5DB97, ordinal: 1
2016-01-14 17:06:39,730 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2016-01-14 17:06:39,730 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageMerge/mergeaverage"]
2016-01-14 17:06:39,730 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DCA577C3AE664E9F9AC9DB954FB5DB97, mem on start (mb), free: 58, total: 583, max: 672
2016-01-14 17:06:39,741 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DCA577C3AE664E9F9AC9DB954FB5DB97, mem on close (mb), free: 57, total: 583, max: 672
2016-01-14 17:06:39,792 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageMerge/mergeaverage/_temporary
2016-01-14 17:06:39,792 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] completed in: 00:00.622
2016-01-14 17:06:39,842 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testAverageMerge/mergeaverage
2016-01-14 17:06:39,863 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:39,863 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:39,897 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 17:06:39,898 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:06:39,898 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:39,914 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 17:06:39,915 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:39,915 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameAll/renameall"]
2016-01-14 17:06:39,915 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-14 17:06:39,915 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-14 17:06:39,916 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-14 17:06:39,916 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...m/testRenameAll/renameall
2016-01-14 17:06:39,980 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity2071657941/.staging/job_local2071657941_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:39,983 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity2071657941/.staging/job_local2071657941_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:40,020 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2071657941_0004/job_local2071657941_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:40,020 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2071657941_0004/job_local2071657941_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:40,022 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local2071657941_0004
2016-01-14 17:06:40,022 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 17:06:40,029 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt
2016-01-14 17:06:40,038 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:40,038 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:40,046 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B46E42FAB01D4FE68E6D9C18F4D9A51E, ordinal: 0
2016-01-14 17:06:40,047 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:40,048 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameAll/renameall"]
2016-01-14 17:06:40,048 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B46E42FAB01D4FE68E6D9C18F4D9A51E, mem on start (mb), free: 126, total: 583, max: 672
2016-01-14 17:06:40,051 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B46E42FAB01D4FE68E6D9C18F4D9A51E, mem on close (mb), free: 126, total: 583, max: 672
2016-01-14 17:06:40,080 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameAll/renameall/_temporary
2016-01-14 17:06:40,081 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:00.166
2016-01-14 17:06:40,105 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testRenameAll/renameall
2016-01-14 17:06:40,123 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:40,123 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:40,195 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.067
2016-01-14 17:06:40,197 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 4
2016-01-14 17:06:40,197 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:40,234 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting
2016-01-14 17:06:40,234 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:40,235 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] sink: Hfs["TextDelimited[['count', 'count2']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountCount/countcount"]
2016-01-14 17:06:40,236 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] parallel execution of steps is enabled: false
2016-01-14 17:06:40,236 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executing total steps: 2
2016-01-14 17:06:40,236 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] allocating management threads: 1
2016-01-14 17:06:40,237 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (1/2)
2016-01-14 17:06:40,323 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1227132762/.staging/job_local1227132762_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:40,324 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1227132762/.staging/job_local1227132762_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:40,359 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1227132762_0005/job_local1227132762_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:40,359 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1227132762_0005/job_local1227132762_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:40,361 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local1227132762_0005
2016-01-14 17:06:40,361 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-14 17:06:40,366 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:40,469 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:40,469 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:40,477 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FB322A9784D24561AA34ED6AF7654967, ordinal: 0
2016-01-14 17:06:40,478 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:40,479 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2016-01-14 17:06:40,479 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FB322A9784D24561AA34ED6AF7654967, mem on start (mb), free: 27, total: 630, max: 672
2016-01-14 17:06:40,481 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:40,482 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 27, total: 630, max: 672
2016-01-14 17:06:40,482 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:40,483 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 27, total: 630, max: 672
2016-01-14 17:06:40,484 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:40,484 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 27, total: 630, max: 672
2016-01-14 17:06:40,486 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:40,486 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 27, total: 630, max: 672
2016-01-14 17:06:40,487 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FB322A9784D24561AA34ED6AF7654967, mem on close (mb), free: 27, total: 630, max: 672
2016-01-14 17:06:40,499 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:40,499 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:40,507 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E9ECDCE4931F4D97ABA48CC2487FBDEF, ordinal: 1
2016-01-14 17:06:40,508 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2016-01-14 17:06:40,508 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['count', 'count2']]"][6595551614/count/]
2016-01-14 17:06:40,508 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E9ECDCE4931F4D97ABA48CC2487FBDEF, mem on start (mb), free: 26, total: 630, max: 672
2016-01-14 17:06:40,525 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:40,525 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 24, total: 630, max: 672
2016-01-14 17:06:40,525 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E9ECDCE4931F4D97ABA48CC2487FBDEF, mem on close (mb), free: 24, total: 630, max: 672
2016-01-14 17:06:40,574 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (2/2) ...testCountCount/countcount
2016-01-14 17:06:40,870 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity935541479/.staging/job_local935541479_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:40,871 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity935541479/.staging/job_local935541479_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:40,911 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local935541479_0006/job_local935541479_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:40,911 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local935541479_0006/job_local935541479_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:40,913 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local935541479_0006
2016-01-14 17:06:40,916 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-14 17:06:40,921 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/6595551614_count_142C3BA7EEFD4C5C863B092C10F5CAB9/part-00000
2016-01-14 17:06:40,944 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:40,945 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:40,953 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E7B3B8354E374A3A9A3F8404260D11A6, ordinal: 0
2016-01-14 17:06:40,954 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['count', 'count2']]"][6595551614/count/]
2016-01-14 17:06:40,954 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{1}:'count']]
2016-01-14 17:06:40,955 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E7B3B8354E374A3A9A3F8404260D11A6, mem on start (mb), free: 115, total: 240, max: 672
2016-01-14 17:06:40,957 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E7B3B8354E374A3A9A3F8404260D11A6, mem on close (mb), free: 115, total: 240, max: 672
2016-01-14 17:06:40,968 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:40,968 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:40,976 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F76DE5EBE62E41D58E872C72C5E3F231, ordinal: 1
2016-01-14 17:06:40,977 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{1}:'count']]
2016-01-14 17:06:40,977 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['count', 'count2']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountCount/countcount"]
2016-01-14 17:06:40,977 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F76DE5EBE62E41D58E872C72C5E3F231, mem on start (mb), free: 113, total: 240, max: 672
2016-01-14 17:06:40,985 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F76DE5EBE62E41D58E872C72C5E3F231, mem on close (mb), free: 113, total: 240, max: 672
2016-01-14 17:06:41,004 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountCount/countcount/_temporary
2016-01-14 17:06:41,005 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] completed in: 00:00.769
2016-01-14 17:06:41,053 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCountCount/countcount
2016-01-14 17:06:41,071 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:41,071 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:41,132 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.055
2016-01-14 17:06:41,133 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:41,133 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:41,157 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] starting
2016-01-14 17:06:41,158 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:41,158 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:41,159 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountMerge/mergecount"]
2016-01-14 17:06:41,159 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] parallel execution of steps is enabled: false
2016-01-14 17:06:41,159 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] executing total steps: 1
2016-01-14 17:06:41,160 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] allocating management threads: 1
2016-01-14 17:06:41,160 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] starting step: (1/1) ...testCountMerge/mergecount
2016-01-14 17:06:41,221 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1385270218/.staging/job_local1385270218_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:41,223 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1385270218/.staging/job_local1385270218_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:41,262 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1385270218_0007/job_local1385270218_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:41,263 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1385270218_0007/job_local1385270218_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:41,265 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] submitted hadoop job: job_local1385270218_0007
2016-01-14 17:06:41,266 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] tracking url: http://localhost:8080/
2016-01-14 17:06:41,272 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:41,313 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:41,313 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:41,324 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A408C86BAF21465EA50DD75FEF4EA631, ordinal: 0
2016-01-14 17:06:41,325 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:41,325 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 17:06:41,326 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A408C86BAF21465EA50DD75FEF4EA631, mem on start (mb), free: 124, total: 292, max: 672
2016-01-14 17:06:41,328 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:41,328 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 124, total: 292, max: 672
2016-01-14 17:06:41,329 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 43% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,330 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:41,330 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 124, total: 292, max: 672
2016-01-14 17:06:41,331 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 43% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,332 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:41,332 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 124, total: 292, max: 672
2016-01-14 17:06:41,332 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 43% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,333 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:41,333 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 124, total: 292, max: 672
2016-01-14 17:06:41,334 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 43% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,335 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A408C86BAF21465EA50DD75FEF4EA631, mem on close (mb), free: 124, total: 292, max: 672
2016-01-14 17:06:41,345 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt
2016-01-14 17:06:41,360 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:41,360 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:41,370 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A408C86BAF21465EA50DD75FEF4EA631, ordinal: 0
2016-01-14 17:06:41,371 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:41,371 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 17:06:41,371 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A408C86BAF21465EA50DD75FEF4EA631, mem on start (mb), free: 22, total: 292, max: 672
2016-01-14 17:06:41,375 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:41,375 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 21, total: 292, max: 672
2016-01-14 17:06:41,376 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 43% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,377 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:41,377 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 21, total: 292, max: 672
2016-01-14 17:06:41,378 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 43% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,379 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:41,379 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 21, total: 292, max: 672
2016-01-14 17:06:41,379 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 43% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,380 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:41,381 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 21, total: 292, max: 672
2016-01-14 17:06:41,381 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 43% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,382 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A408C86BAF21465EA50DD75FEF4EA631, mem on close (mb), free: 21, total: 292, max: 672
2016-01-14 17:06:41,398 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:41,399 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:41,407 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: EA799B9B9D0140CEA5A4F00F22299873, ordinal: 1
2016-01-14 17:06:41,408 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 17:06:41,409 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountMerge/mergecount"]
2016-01-14 17:06:41,409 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EA799B9B9D0140CEA5A4F00F22299873, mem on start (mb), free: 20, total: 292, max: 672
2016-01-14 17:06:41,419 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EA799B9B9D0140CEA5A4F00F22299873, mem on close (mb), free: 19, total: 292, max: 672
2016-01-14 17:06:41,439 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountMerge/mergecount/_temporary
2016-01-14 17:06:41,439 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] completed in: 00:00.281
2016-01-14 17:06:41,489 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCountMerge/mergecount
2016-01-14 17:06:41,572 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:41,572 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:41,620 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.043
2016-01-14 17:06:41,621 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:41,621 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:41,637 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] starting
2016-01-14 17:06:41,637 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:41,637 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] sink: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByNullSafety/minbynullsafety"]
2016-01-14 17:06:41,637 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] parallel execution of steps is enabled: false
2016-01-14 17:06:41,637 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] executing total steps: 1
2016-01-14 17:06:41,638 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] allocating management threads: 1
2016-01-14 17:06:41,638 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] starting step: (1/1) ...ullSafety/minbynullsafety
2016-01-14 17:06:41,698 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity675117992/.staging/job_local675117992_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:41,701 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity675117992/.staging/job_local675117992_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:41,734 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local675117992_0008/job_local675117992_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:41,735 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local675117992_0008/job_local675117992_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:41,736 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] submitted hadoop job: job_local675117992_0008
2016-01-14 17:06:41,736 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] tracking url: http://localhost:8080/
2016-01-14 17:06:41,741 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:41,756 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:41,756 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:41,763 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: CE44F83268664436B759CA554EE7FEAB, ordinal: 0
2016-01-14 17:06:41,764 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:41,764 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(min)[by:[{1}:'char']]
2016-01-14 17:06:41,764 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CE44F83268664436B759CA554EE7FEAB, mem on start (mb), free: 198, total: 349, max: 672
2016-01-14 17:06:41,766 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:41,766 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 349, max: 672
2016-01-14 17:06:41,767 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 51% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,768 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:41,768 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 349, max: 672
2016-01-14 17:06:41,768 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 51% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,769 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:41,769 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 349, max: 672
2016-01-14 17:06:41,770 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 51% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,770 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:41,771 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 349, max: 672
2016-01-14 17:06:41,771 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 51% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:41,772 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CE44F83268664436B759CA554EE7FEAB, mem on close (mb), free: 198, total: 349, max: 672
2016-01-14 17:06:41,785 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:41,786 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:41,793 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DB9E450268B244CBA5735933BD2E9941, ordinal: 1
2016-01-14 17:06:41,793 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(min)[by:[{1}:'char']]
2016-01-14 17:06:41,793 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByNullSafety/minbynullsafety"]
2016-01-14 17:06:41,794 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DB9E450268B244CBA5735933BD2E9941, mem on start (mb), free: 197, total: 349, max: 672
2016-01-14 17:06:41,803 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DB9E450268B244CBA5735933BD2E9941, mem on close (mb), free: 196, total: 349, max: 672
2016-01-14 17:06:41,825 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByNullSafety/minbynullsafety/_temporary
2016-01-14 17:06:41,825 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] completed in: 00:00.187
2016-01-14 17:06:41,872 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMinByNullSafety/minbynullsafety
2016-01-14 17:06:41,896 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:41,896 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:41,929 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 17:06:41,930 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:41,931 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:41,947 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting
2016-01-14 17:06:41,948 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:41,948 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] sink: Hfs["TextDelimited[['num', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByString/maxbystring"]
2016-01-14 17:06:41,948 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] parallel execution of steps is enabled: false
2016-01-14 17:06:41,948 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executing total steps: 1
2016-01-14 17:06:41,950 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] allocating management threads: 1
2016-01-14 17:06:41,951 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting step: (1/1) ...stMaxByString/maxbystring
2016-01-14 17:06:42,018 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1827902765/.staging/job_local1827902765_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:42,021 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1827902765/.staging/job_local1827902765_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:42,054 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1827902765_0009/job_local1827902765_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:42,054 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1827902765_0009/job_local1827902765_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:42,055 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] submitted hadoop job: job_local1827902765_0009
2016-01-14 17:06:42,056 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] tracking url: http://localhost:8080/
2016-01-14 17:06:42,061 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:42,077 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:42,077 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:42,086 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C558A0BE4EDA476B86080FE556CAA598, ordinal: 0
2016-01-14 17:06:42,087 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:42,088 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2016-01-14 17:06:42,088 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C558A0BE4EDA476B86080FE556CAA598, mem on start (mb), free: 262, total: 398, max: 672
2016-01-14 17:06:42,090 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:42,091 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 262, total: 398, max: 672
2016-01-14 17:06:42,091 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 59% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:42,092 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:42,092 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 262, total: 398, max: 672
2016-01-14 17:06:42,092 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 59% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:42,093 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C558A0BE4EDA476B86080FE556CAA598, mem on close (mb), free: 262, total: 398, max: 672
2016-01-14 17:06:42,107 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:42,107 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:42,114 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DBE268F548024B308FCE8A93DE731668, ordinal: 1
2016-01-14 17:06:42,114 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2016-01-14 17:06:42,114 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['num', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByString/maxbystring"]
2016-01-14 17:06:42,114 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DBE268F548024B308FCE8A93DE731668, mem on start (mb), free: 261, total: 398, max: 672
2016-01-14 17:06:42,122 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DBE268F548024B308FCE8A93DE731668, mem on close (mb), free: 258, total: 398, max: 672
2016-01-14 17:06:42,145 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByString/maxbystring/_temporary
2016-01-14 17:06:42,146 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] completed in: 00:00.198
2016-01-14 17:06:42,194 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMaxByString/maxbystring
2016-01-14 17:06:42,218 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:42,219 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:42,257 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.033
2016-01-14 17:06:42,258 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:42,258 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:42,285 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-14 17:06:42,286 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] source: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs+rhs-cross.txt"]
2016-01-14 17:06:42,286 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstBy/firstnfields"]
2016-01-14 17:06:42,286 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] parallel execution of steps is enabled: false
2016-01-14 17:06:42,286 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executing total steps: 1
2016-01-14 17:06:42,286 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] allocating management threads: 1
2016-01-14 17:06:42,287 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) .../testFirstBy/firstnfields
2016-01-14 17:06:42,347 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1221355029/.staging/job_local1221355029_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:42,348 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1221355029/.staging/job_local1221355029_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:42,390 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1221355029_0010/job_local1221355029_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:42,390 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1221355029_0010/job_local1221355029_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:42,391 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted hadoop job: job_local1221355029_0010
2016-01-14 17:06:42,392 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tracking url: http://localhost:8080/
2016-01-14 17:06:42,396 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs+rhs-cross.txt
2016-01-14 17:06:42,417 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:42,418 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:42,424 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FBA6006ADA774B129B3C4E6CCEA1DC46, ordinal: 0
2016-01-14 17:06:42,425 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs+rhs-cross.txt"]
2016-01-14 17:06:42,425 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(first)[by:[{1}:'num']]
2016-01-14 17:06:42,425 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FBA6006ADA774B129B3C4E6CCEA1DC46, mem on start (mb), free: 294, total: 407, max: 672
2016-01-14 17:06:42,428 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:42,428 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 294, total: 407, max: 672
2016-01-14 17:06:42,428 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:42,429 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:42,430 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 294, total: 407, max: 672
2016-01-14 17:06:42,430 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:42,431 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FBA6006ADA774B129B3C4E6CCEA1DC46, mem on close (mb), free: 294, total: 407, max: 672
2016-01-14 17:06:42,443 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:42,443 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:42,450 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C802370A785F41C9B4EE5C2A050BD6A3, ordinal: 1
2016-01-14 17:06:42,451 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(first)[by:[{1}:'num']]
2016-01-14 17:06:42,451 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstBy/firstnfields"]
2016-01-14 17:06:42,451 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C802370A785F41C9B4EE5C2A050BD6A3, mem on start (mb), free: 292, total: 407, max: 672
2016-01-14 17:06:42,459 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C802370A785F41C9B4EE5C2A050BD6A3, mem on close (mb), free: 291, total: 407, max: 672
2016-01-14 17:06:42,481 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstBy/firstnfields/_temporary
2016-01-14 17:06:42,482 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] completed in: 00:00.196
2016-01-14 17:06:42,505 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testFirstBy/firstnfields
2016-01-14 17:06:42,522 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:42,523 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:42,552 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-01-14 17:06:42,552 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:06:42,552 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:42,563 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] starting
2016-01-14 17:06:42,564 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:42,564 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] sink: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerceFields/coercefields"]
2016-01-14 17:06:42,564 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] parallel execution of steps is enabled: false
2016-01-14 17:06:42,565 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] executing total steps: 1
2016-01-14 17:06:42,565 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] allocating management threads: 1
2016-01-14 17:06:42,566 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] starting step: (1/1) ...CoerceFields/coercefields
2016-01-14 17:06:42,619 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1025078718/.staging/job_local1025078718_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:42,621 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1025078718/.staging/job_local1025078718_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:42,653 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1025078718_0011/job_local1025078718_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:42,654 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1025078718_0011/job_local1025078718_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:42,654 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] submitted hadoop job: job_local1025078718_0011
2016-01-14 17:06:42,655 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] tracking url: http://localhost:8080/
2016-01-14 17:06:42,662 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt
2016-01-14 17:06:42,669 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:42,669 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:42,675 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FC53E486DA7D449CB184E585260045F0, ordinal: 0
2016-01-14 17:06:42,677 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:42,677 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerceFields/coercefields"]
2016-01-14 17:06:42,677 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FC53E486DA7D449CB184E585260045F0, mem on start (mb), free: 241, total: 407, max: 672
2016-01-14 17:06:42,684 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FC53E486DA7D449CB184E585260045F0, mem on close (mb), free: 240, total: 407, max: 672
2016-01-14 17:06:42,700 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerceFields/coercefields/_temporary
2016-01-14 17:06:42,701 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] completed in: 00:00.137
2016-01-14 17:06:42,723 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCoerceFields/coercefields
2016-01-14 17:06:42,737 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:42,738 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:42,766 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-01-14 17:06:42,767 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:42,767 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:42,779 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting
2016-01-14 17:06:42,779 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:42,779 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCount/count"]
2016-01-14 17:06:42,779 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] parallel execution of steps is enabled: false
2016-01-14 17:06:42,779 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executing total steps: 1
2016-01-14 17:06:42,779 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] allocating management threads: 1
2016-01-14 17:06:42,780 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (1/1) ...splatform/testCount/count
2016-01-14 17:06:42,845 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity382772799/.staging/job_local382772799_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:42,846 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity382772799/.staging/job_local382772799_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:42,890 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local382772799_0012/job_local382772799_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:42,891 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local382772799_0012/job_local382772799_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:42,892 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local382772799_0012
2016-01-14 17:06:42,892 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-14 17:06:42,897 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:42,917 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:42,918 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:42,924 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F4B69859B2AA45B7ACADEE2B2F00E04A, ordinal: 0
2016-01-14 17:06:42,925 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:42,925 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2016-01-14 17:06:42,926 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F4B69859B2AA45B7ACADEE2B2F00E04A, mem on start (mb), free: 293, total: 407, max: 672
2016-01-14 17:06:42,927 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:42,928 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 293, total: 407, max: 672
2016-01-14 17:06:42,928 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:42,929 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:42,929 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 293, total: 407, max: 672
2016-01-14 17:06:42,929 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:42,930 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:42,930 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 293, total: 407, max: 672
2016-01-14 17:06:42,931 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:42,931 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:42,932 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 293, total: 407, max: 672
2016-01-14 17:06:42,932 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:42,933 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F4B69859B2AA45B7ACADEE2B2F00E04A, mem on close (mb), free: 293, total: 407, max: 672
2016-01-14 17:06:42,944 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:42,945 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:42,951 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: FFC45D6B882B440BBCC4F46AC0175F4D, ordinal: 1
2016-01-14 17:06:42,952 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2016-01-14 17:06:42,952 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCount/count"]
2016-01-14 17:06:42,952 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FFC45D6B882B440BBCC4F46AC0175F4D, mem on start (mb), free: 291, total: 407, max: 672
2016-01-14 17:06:42,959 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FFC45D6B882B440BBCC4F46AC0175F4D, mem on close (mb), free: 289, total: 407, max: 672
2016-01-14 17:06:42,973 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCount/count/_temporary
2016-01-14 17:06:42,973 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] completed in: 00:00.194
2016-01-14 17:06:43,017 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCount/count
2016-01-14 17:06:43,033 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:43,034 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:43,064 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-01-14 17:06:43,065 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:43,065 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:43,077 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting
2016-01-14 17:06:43,078 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:43,079 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] sink: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxBy/maxby"]
2016-01-14 17:06:43,079 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] parallel execution of steps is enabled: false
2016-01-14 17:06:43,079 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executing total steps: 1
2016-01-14 17:06:43,080 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] allocating management threads: 1
2016-01-14 17:06:43,081 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting step: (1/1) ...splatform/testMaxBy/maxby
2016-01-14 17:06:43,138 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity378085510/.staging/job_local378085510_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:43,141 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity378085510/.staging/job_local378085510_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:43,172 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local378085510_0013/job_local378085510_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:43,172 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local378085510_0013/job_local378085510_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:43,174 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] submitted hadoop job: job_local378085510_0013
2016-01-14 17:06:43,174 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] tracking url: http://localhost:8080/
2016-01-14 17:06:43,179 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:43,197 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:43,198 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:43,203 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D9B0436A378E4EDDABA3FC0FA20D8A90, ordinal: 0
2016-01-14 17:06:43,204 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:43,204 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(max)[by:[{1}:'char']]
2016-01-14 17:06:43,204 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D9B0436A378E4EDDABA3FC0FA20D8A90, mem on start (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,205 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:43,205 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,205 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,206 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:43,206 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,206 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,206 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:43,207 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,207 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,207 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:43,207 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,208 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,208 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D9B0436A378E4EDDABA3FC0FA20D8A90, mem on close (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,218 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:43,218 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:43,225 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: BB418C026A3145089BADD00B9A468A96, ordinal: 1
2016-01-14 17:06:43,225 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(max)[by:[{1}:'char']]
2016-01-14 17:06:43,226 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxBy/maxby"]
2016-01-14 17:06:43,226 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: BB418C026A3145089BADD00B9A468A96, mem on start (mb), free: 293, total: 408, max: 672
2016-01-14 17:06:43,233 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: BB418C026A3145089BADD00B9A468A96, mem on close (mb), free: 292, total: 408, max: 672
2016-01-14 17:06:43,253 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxBy/maxby/_temporary
2016-01-14 17:06:43,254 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] completed in: 00:00.176
2016-01-14 17:06:43,294 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMaxBy/maxby
2016-01-14 17:06:43,315 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:43,316 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:43,350 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 17:06:43,351 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:43,352 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:43,363 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] starting
2016-01-14 17:06:43,363 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:43,364 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] sink: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinBy/minby"]
2016-01-14 17:06:43,364 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] parallel execution of steps is enabled: false
2016-01-14 17:06:43,364 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] executing total steps: 1
2016-01-14 17:06:43,365 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] allocating management threads: 1
2016-01-14 17:06:43,365 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] starting step: (1/1) ...splatform/testMinBy/minby
2016-01-14 17:06:43,419 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity961125003/.staging/job_local961125003_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:43,420 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity961125003/.staging/job_local961125003_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:43,455 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local961125003_0014/job_local961125003_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:43,455 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local961125003_0014/job_local961125003_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:43,456 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] submitted hadoop job: job_local961125003_0014
2016-01-14 17:06:43,457 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] tracking url: http://localhost:8080/
2016-01-14 17:06:43,462 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:43,480 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:43,481 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:43,487 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F978FE0DC45A4F6DB59AF273B848A21B, ordinal: 0
2016-01-14 17:06:43,488 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:43,488 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(min)[by:[{1}:'char']]
2016-01-14 17:06:43,488 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F978FE0DC45A4F6DB59AF273B848A21B, mem on start (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,491 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:43,491 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,491 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,492 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:43,492 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,493 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,493 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:43,494 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,494 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,494 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:43,494 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,494 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,496 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F978FE0DC45A4F6DB59AF273B848A21B, mem on close (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,510 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:43,511 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:43,520 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D3A8EF7156774F88BD87473E12C6B229, ordinal: 1
2016-01-14 17:06:43,521 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(min)[by:[{1}:'char']]
2016-01-14 17:06:43,521 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinBy/minby"]
2016-01-14 17:06:43,522 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D3A8EF7156774F88BD87473E12C6B229, mem on start (mb), free: 294, total: 408, max: 672
2016-01-14 17:06:43,531 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D3A8EF7156774F88BD87473E12C6B229, mem on close (mb), free: 293, total: 408, max: 672
2016-01-14 17:06:43,555 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinBy/minby/_temporary
2016-01-14 17:06:43,555 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] completed in: 00:00.191
2016-01-14 17:06:43,601 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMinBy/minby
2016-01-14 17:06:43,613 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:43,613 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:43,640 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.023
2016-01-14 17:06:43,641 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:43,641 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:43,653 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] starting
2016-01-14 17:06:43,654 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:43,654 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumBy/sum"]
2016-01-14 17:06:43,654 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] parallel execution of steps is enabled: false
2016-01-14 17:06:43,654 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] executing total steps: 1
2016-01-14 17:06:43,655 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] allocating management threads: 1
2016-01-14 17:06:43,656 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] starting step: (1/1) ...ersplatform/testSumBy/sum
2016-01-14 17:06:43,710 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1235750162/.staging/job_local1235750162_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:43,712 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1235750162/.staging/job_local1235750162_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:43,744 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1235750162_0015/job_local1235750162_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:43,745 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1235750162_0015/job_local1235750162_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:43,745 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] submitted hadoop job: job_local1235750162_0015
2016-01-14 17:06:43,746 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] tracking url: http://localhost:8080/
2016-01-14 17:06:43,751 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:43,770 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:43,770 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:43,777 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D09FEB543721462C90793858228D7E2D, ordinal: 0
2016-01-14 17:06:43,778 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:43,778 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2016-01-14 17:06:43,779 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D09FEB543721462C90793858228D7E2D, mem on start (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,780 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:43,780 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,781 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,781 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:43,782 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,782 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,783 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:43,783 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,783 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,785 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:43,785 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,786 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:43,787 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D09FEB543721462C90793858228D7E2D, mem on close (mb), free: 296, total: 408, max: 672
2016-01-14 17:06:43,798 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:43,798 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:43,807 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E9EB86B2A0A54B89B34BE9369B601E71, ordinal: 1
2016-01-14 17:06:43,808 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2016-01-14 17:06:43,808 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumBy/sum"]
2016-01-14 17:06:43,809 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E9EB86B2A0A54B89B34BE9369B601E71, mem on start (mb), free: 294, total: 408, max: 672
2016-01-14 17:06:43,817 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E9EB86B2A0A54B89B34BE9369B601E71, mem on close (mb), free: 293, total: 408, max: 672
2016-01-14 17:06:43,833 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumBy/sum/_temporary
2016-01-14 17:06:43,834 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] completed in: 00:00.180
2016-01-14 17:06:43,878 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testSumBy/sum
2016-01-14 17:06:43,891 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:43,891 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:43,942 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.046
2016-01-14 17:06:43,942 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:43,943 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:43,954 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] starting
2016-01-14 17:06:43,954 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:43,954 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:43,954 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumMerge/mergesum"]
2016-01-14 17:06:43,955 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] parallel execution of steps is enabled: false
2016-01-14 17:06:43,955 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] executing total steps: 1
2016-01-14 17:06:43,955 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] allocating management threads: 1
2016-01-14 17:06:43,956 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] starting step: (1/1) ...orm/testSumMerge/mergesum
2016-01-14 17:06:44,009 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity626690370/.staging/job_local626690370_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:44,011 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity626690370/.staging/job_local626690370_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:44,041 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local626690370_0016/job_local626690370_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:44,041 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local626690370_0016/job_local626690370_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:44,042 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] submitted hadoop job: job_local626690370_0016
2016-01-14 17:06:44,042 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] tracking url: http://localhost:8080/
2016-01-14 17:06:44,046 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:44,064 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:44,065 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:44,071 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AA36F9C9AACB4BA2861039236B91905B, ordinal: 0
2016-01-14 17:06:44,071 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:44,071 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2016-01-14 17:06:44,071 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AA36F9C9AACB4BA2861039236B91905B, mem on start (mb), free: 297, total: 409, max: 672
2016-01-14 17:06:44,073 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:44,073 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 409, max: 672
2016-01-14 17:06:44,073 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,074 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:44,074 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 409, max: 672
2016-01-14 17:06:44,074 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,075 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:44,075 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 409, max: 672
2016-01-14 17:06:44,075 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,076 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:44,076 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 409, max: 672
2016-01-14 17:06:44,076 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,077 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AA36F9C9AACB4BA2861039236B91905B, mem on close (mb), free: 297, total: 409, max: 672
2016-01-14 17:06:44,086 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt
2016-01-14 17:06:44,103 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:44,104 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:44,111 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AA36F9C9AACB4BA2861039236B91905B, ordinal: 0
2016-01-14 17:06:44,112 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:44,112 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2016-01-14 17:06:44,112 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AA36F9C9AACB4BA2861039236B91905B, mem on start (mb), free: 195, total: 409, max: 672
2016-01-14 17:06:44,116 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:44,116 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 409, max: 672
2016-01-14 17:06:44,117 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,118 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:44,118 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 409, max: 672
2016-01-14 17:06:44,118 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,119 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:44,119 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 409, max: 672
2016-01-14 17:06:44,120 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,120 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:44,121 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 409, max: 672
2016-01-14 17:06:44,121 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,122 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AA36F9C9AACB4BA2861039236B91905B, mem on close (mb), free: 195, total: 409, max: 672
2016-01-14 17:06:44,135 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:44,136 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:44,142 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D608051353C04949B8ED750AC1D886EB, ordinal: 1
2016-01-14 17:06:44,143 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2016-01-14 17:06:44,143 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumMerge/mergesum"]
2016-01-14 17:06:44,143 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D608051353C04949B8ED750AC1D886EB, mem on start (mb), free: 193, total: 409, max: 672
2016-01-14 17:06:44,152 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D608051353C04949B8ED750AC1D886EB, mem on close (mb), free: 192, total: 409, max: 672
2016-01-14 17:06:44,172 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumMerge/mergesum/_temporary
2016-01-14 17:06:44,176 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] completed in: 00:00.217
2016-01-14 17:06:44,222 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testSumMerge/mergesum
2016-01-14 17:06:44,242 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:44,242 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:44,275 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 17:06:44,277 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:06:44,277 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:44,292 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 17:06:44,293 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:44,293 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testDiscardNarrow/discardnarrow"]
2016-01-14 17:06:44,293 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-14 17:06:44,294 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-14 17:06:44,294 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-14 17:06:44,295 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...scardNarrow/discardnarrow
2016-01-14 17:06:44,350 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1731432795/.staging/job_local1731432795_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:44,352 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1731432795/.staging/job_local1731432795_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:44,383 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1731432795_0017/job_local1731432795_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:44,383 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1731432795_0017/job_local1731432795_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:44,385 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local1731432795_0017
2016-01-14 17:06:44,385 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 17:06:44,390 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt
2016-01-14 17:06:44,396 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:44,396 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:44,400 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C70F7A5BDD2D425199B25F50A1F1E586, ordinal: 0
2016-01-14 17:06:44,401 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:44,401 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testDiscardNarrow/discardnarrow"]
2016-01-14 17:06:44,401 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C70F7A5BDD2D425199B25F50A1F1E586, mem on start (mb), free: 366, total: 410, max: 672
2016-01-14 17:06:44,403 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C70F7A5BDD2D425199B25F50A1F1E586, mem on close (mb), free: 366, total: 410, max: 672
2016-01-14 17:06:44,420 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testDiscardNarrow/discardnarrow/_temporary
2016-01-14 17:06:44,424 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:00.127
2016-01-14 17:06:44,446 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testDiscardNarrow/discardnarrow
2016-01-14 17:06:44,462 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:44,463 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:44,505 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.038
2016-01-14 17:06:44,507 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:44,507 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:44,523 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-14 17:06:44,523 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:44,523 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:44,523 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMergeLegacyHash/multimerge+true480"]
2016-01-14 17:06:44,524 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] parallel execution of steps is enabled: false
2016-01-14 17:06:44,524 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executing total steps: 1
2016-01-14 17:06:44,524 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] allocating management threads: 1
2016-01-14 17:06:44,527 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...cyHash/multimerge+true480
2016-01-14 17:06:44,580 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity244709199/.staging/job_local244709199_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:44,582 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity244709199/.staging/job_local244709199_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:44,612 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local244709199_0018/job_local244709199_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:44,612 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local244709199_0018/job_local244709199_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:44,613 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local244709199_0018
2016-01-14 17:06:44,613 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-14 17:06:44,617 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:44,633 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:44,633 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:44,640 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B20A1C7100DE45F5B396F34917158610, ordinal: 0
2016-01-14 17:06:44,641 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:44,641 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:06:44,642 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B20A1C7100DE45F5B396F34917158610, mem on start (mb), free: 216, total: 410, max: 672
2016-01-14 17:06:44,644 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:44,644 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 216, total: 410, max: 672
2016-01-14 17:06:44,644 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,645 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:44,646 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 216, total: 410, max: 672
2016-01-14 17:06:44,646 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,647 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:44,647 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 216, total: 410, max: 672
2016-01-14 17:06:44,648 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,648 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:44,649 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 216, total: 410, max: 672
2016-01-14 17:06:44,649 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,650 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B20A1C7100DE45F5B396F34917158610, mem on close (mb), free: 216, total: 410, max: 672
2016-01-14 17:06:44,657 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt
2016-01-14 17:06:44,677 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:44,677 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:44,684 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B20A1C7100DE45F5B396F34917158610, ordinal: 0
2016-01-14 17:06:44,685 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:44,685 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:06:44,686 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B20A1C7100DE45F5B396F34917158610, mem on start (mb), free: 298, total: 410, max: 672
2016-01-14 17:06:44,689 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:44,690 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:44,690 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,691 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:44,691 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:44,691 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,692 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:44,692 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:44,693 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,694 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:44,694 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:44,694 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:44,695 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B20A1C7100DE45F5B396F34917158610, mem on close (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:44,708 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:44,709 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:44,715 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A22FA627D7E24276A7A3D1CB5504CB68, ordinal: 1
2016-01-14 17:06:44,716 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:06:44,716 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMergeLegacyHash/multimerge+true480"]
2016-01-14 17:06:44,716 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A22FA627D7E24276A7A3D1CB5504CB68, mem on start (mb), free: 295, total: 410, max: 672
2016-01-14 17:06:44,725 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A22FA627D7E24276A7A3D1CB5504CB68, mem on close (mb), free: 294, total: 410, max: 672
2016-01-14 17:06:44,745 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMergeLegacyHash/multimerge+true480/_temporary
2016-01-14 17:06:44,745 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] completed in: 00:00.223
2016-01-14 17:06:44,784 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMergeLegacyHash/multimerge+true480
2016-01-14 17:06:44,796 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:44,796 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:44,815 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.016
2016-01-14 17:06:44,816 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:06:44,816 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:44,822 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 17:06:44,822 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:44,822 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNamed/rename"]
2016-01-14 17:06:44,823 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-14 17:06:44,823 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-14 17:06:44,823 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-14 17:06:44,824 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...rm/testRenameNamed/rename
2016-01-14 17:06:44,875 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity513558147/.staging/job_local513558147_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:44,878 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity513558147/.staging/job_local513558147_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:44,906 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local513558147_0019/job_local513558147_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:44,906 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local513558147_0019/job_local513558147_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:44,907 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local513558147_0019
2016-01-14 17:06:44,908 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 17:06:44,912 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt
2016-01-14 17:06:44,918 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:44,918 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:44,922 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AD5037D44DB743AEA7D8A4A3C4844577, ordinal: 0
2016-01-14 17:06:44,922 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:44,923 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNamed/rename"]
2016-01-14 17:06:44,923 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AD5037D44DB743AEA7D8A4A3C4844577, mem on start (mb), free: 243, total: 410, max: 672
2016-01-14 17:06:44,924 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AD5037D44DB743AEA7D8A4A3C4844577, mem on close (mb), free: 243, total: 410, max: 672
2016-01-14 17:06:44,942 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNamed/rename/_temporary
2016-01-14 17:06:44,943 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:00.120
2016-01-14 17:06:44,964 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testRenameNamed/rename
2016-01-14 17:06:44,978 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:44,979 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:45,017 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.035
2016-01-14 17:06:45,018 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:45,018 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:45,029 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-14 17:06:45,029 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:45,030 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:45,030 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMerge/multimerge+true479"]
2016-01-14 17:06:45,030 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] parallel execution of steps is enabled: false
2016-01-14 17:06:45,030 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executing total steps: 1
2016-01-14 17:06:45,031 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] allocating management threads: 1
2016-01-14 17:06:45,032 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...rMerge/multimerge+true479
2016-01-14 17:06:45,086 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity2079524764/.staging/job_local2079524764_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:45,087 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity2079524764/.staging/job_local2079524764_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:45,117 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2079524764_0020/job_local2079524764_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:45,118 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2079524764_0020/job_local2079524764_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:45,119 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local2079524764_0020
2016-01-14 17:06:45,119 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-14 17:06:45,124 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:45,146 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:45,147 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:45,153 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B7B40DEDE6C14EABA5577BF1D28936F6, ordinal: 0
2016-01-14 17:06:45,154 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:45,154 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:06:45,154 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B7B40DEDE6C14EABA5577BF1D28936F6, mem on start (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:45,155 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:45,156 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:45,156 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,157 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:45,157 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:45,157 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,158 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:45,158 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:45,158 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,159 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:45,159 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:45,159 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,160 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B7B40DEDE6C14EABA5577BF1D28936F6, mem on close (mb), free: 297, total: 410, max: 672
2016-01-14 17:06:45,170 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt
2016-01-14 17:06:45,185 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:45,186 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:45,192 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B7B40DEDE6C14EABA5577BF1D28936F6, ordinal: 0
2016-01-14 17:06:45,193 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:45,193 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:06:45,194 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B7B40DEDE6C14EABA5577BF1D28936F6, mem on start (mb), free: 195, total: 410, max: 672
2016-01-14 17:06:45,197 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:45,197 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 410, max: 672
2016-01-14 17:06:45,197 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,199 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:45,199 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 410, max: 672
2016-01-14 17:06:45,199 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,200 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:45,200 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 410, max: 672
2016-01-14 17:06:45,201 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,201 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:45,202 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 410, max: 672
2016-01-14 17:06:45,202 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,204 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B7B40DEDE6C14EABA5577BF1D28936F6, mem on close (mb), free: 195, total: 410, max: 672
2016-01-14 17:06:45,218 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:45,218 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:45,225 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C99FEF76CA71497B8978FFDA6D4B7B55, ordinal: 1
2016-01-14 17:06:45,227 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:06:45,227 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMerge/multimerge+true479"]
2016-01-14 17:06:45,227 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C99FEF76CA71497B8978FFDA6D4B7B55, mem on start (mb), free: 192, total: 410, max: 672
2016-01-14 17:06:45,238 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C99FEF76CA71497B8978FFDA6D4B7B55, mem on close (mb), free: 191, total: 410, max: 672
2016-01-14 17:06:45,261 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMerge/multimerge+true479/_temporary
2016-01-14 17:06:45,261 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] completed in: 00:00.232
2016-01-14 17:06:45,302 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMerge/multimerge+true479
2016-01-14 17:06:45,315 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:45,316 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:45,384 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.065
2016-01-14 17:06:45,386 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 4
2016-01-14 17:06:45,386 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:45,413 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting
2016-01-14 17:06:45,414 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:45,414 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMerge/samesourcemergecount"]
2016-01-14 17:06:45,414 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] parallel execution of steps is enabled: false
2016-01-14 17:06:45,415 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executing total steps: 2
2016-01-14 17:06:45,415 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] allocating management threads: 1
2016-01-14 17:06:45,416 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting step: (1/2)
2016-01-14 17:06:45,485 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1163808395/.staging/job_local1163808395_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:45,487 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1163808395/.staging/job_local1163808395_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:45,515 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1163808395_0021/job_local1163808395_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:45,516 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1163808395_0021/job_local1163808395_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:45,517 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] submitted hadoop job: job_local1163808395_0021
2016-01-14 17:06:45,517 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tracking url: http://localhost:8080/
2016-01-14 17:06:45,521 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:45,535 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:45,536 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:45,541 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C98AB715E16E456CA3605980438E3FDC, ordinal: 0
2016-01-14 17:06:45,542 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:45,542 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(first)[by:[{1}:'char']]
2016-01-14 17:06:45,542 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C98AB715E16E456CA3605980438E3FDC, mem on start (mb), free: 267, total: 410, max: 672
2016-01-14 17:06:45,546 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:45,546 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 267, total: 410, max: 672
2016-01-14 17:06:45,546 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,547 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:45,548 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 266, total: 410, max: 672
2016-01-14 17:06:45,548 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,548 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:45,549 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 266, total: 410, max: 672
2016-01-14 17:06:45,549 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,549 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:45,550 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 266, total: 410, max: 672
2016-01-14 17:06:45,550 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,551 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C98AB715E16E456CA3605980438E3FDC, mem on close (mb), free: 266, total: 410, max: 672
2016-01-14 17:06:45,560 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:45,560 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:45,564 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B4CF7E0A218F4CA9A63588AD46B4A054, ordinal: 1
2016-01-14 17:06:45,565 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(first)[by:[{1}:'char']]
2016-01-14 17:06:45,565 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][7763453343/first/]
2016-01-14 17:06:45,565 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B4CF7E0A218F4CA9A63588AD46B4A054, mem on start (mb), free: 265, total: 410, max: 672
2016-01-14 17:06:45,572 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B4CF7E0A218F4CA9A63588AD46B4A054, mem on close (mb), free: 264, total: 410, max: 672
2016-01-14 17:06:45,585 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting step: (2/2) ...erge/samesourcemergecount
2016-01-14 17:06:45,654 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity224100269/.staging/job_local224100269_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:45,655 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity224100269/.staging/job_local224100269_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:45,683 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local224100269_0022/job_local224100269_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:45,683 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local224100269_0022/job_local224100269_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:45,684 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] submitted hadoop job: job_local224100269_0022
2016-01-14 17:06:45,684 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tracking url: http://localhost:8080/
2016-01-14 17:06:45,688 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/7763453343_first_B923E7FE8200406F816F278306BB3D42/part-00000
2016-01-14 17:06:45,706 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:45,707 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:45,712 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BCE21F8F33D44BC0967F4FE1FC56E524, ordinal: 0
2016-01-14 17:06:45,713 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][7763453343/first/]
2016-01-14 17:06:45,714 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(second)[by:[{1}:'char']]
2016-01-14 17:06:45,714 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BCE21F8F33D44BC0967F4FE1FC56E524, mem on start (mb), free: 299, total: 411, max: 672
2016-01-14 17:06:45,715 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:45,716 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 411, max: 672
2016-01-14 17:06:45,716 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,717 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:45,717 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 411, max: 672
2016-01-14 17:06:45,718 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,718 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BCE21F8F33D44BC0967F4FE1FC56E524, mem on close (mb), free: 298, total: 411, max: 672
2016-01-14 17:06:45,726 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:45,727 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:45,733 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E6E771903BDC4576B1F41DCB7EAF8C9B, ordinal: 1
2016-01-14 17:06:45,734 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(second)[by:[{1}:'char']]
2016-01-14 17:06:45,734 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMerge/samesourcemergecount"]
2016-01-14 17:06:45,734 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E6E771903BDC4576B1F41DCB7EAF8C9B, mem on start (mb), free: 297, total: 411, max: 672
2016-01-14 17:06:45,741 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E6E771903BDC4576B1F41DCB7EAF8C9B, mem on close (mb), free: 295, total: 411, max: 672
2016-01-14 17:06:45,761 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMerge/samesourcemergecount/_temporary
2016-01-14 17:06:45,762 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] completed in: 00:00.347
2016-01-14 17:06:45,806 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testSameSourceMerge/samesourcemergecount
2016-01-14 17:06:45,817 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:45,817 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:45,839 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 17:06:45,839 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:45,839 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:45,846 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] starting
2016-01-14 17:06:45,846 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:45,847 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageBy/average"]
2016-01-14 17:06:45,847 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] parallel execution of steps is enabled: false
2016-01-14 17:06:45,848 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] executing total steps: 1
2016-01-14 17:06:45,848 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] allocating management threads: 1
2016-01-14 17:06:45,849 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] starting step: (1/1) ...orm/testAverageBy/average
2016-01-14 17:06:45,898 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1177623559/.staging/job_local1177623559_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:45,900 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1177623559/.staging/job_local1177623559_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:45,926 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1177623559_0023/job_local1177623559_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:45,926 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1177623559_0023/job_local1177623559_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:45,927 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] submitted hadoop job: job_local1177623559_0023
2016-01-14 17:06:45,927 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] tracking url: http://localhost:8080/
2016-01-14 17:06:45,932 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:45,951 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:45,951 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:45,955 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C919908AD90C42869FAFF67A46106DF7, ordinal: 0
2016-01-14 17:06:45,956 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:45,956 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2016-01-14 17:06:45,956 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C919908AD90C42869FAFF67A46106DF7, mem on start (mb), free: 299, total: 411, max: 672
2016-01-14 17:06:45,957 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:45,957 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 411, max: 672
2016-01-14 17:06:45,958 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,958 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:45,959 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 411, max: 672
2016-01-14 17:06:45,959 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,959 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:45,959 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 411, max: 672
2016-01-14 17:06:45,959 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,960 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:45,960 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 411, max: 672
2016-01-14 17:06:45,960 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:45,961 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C919908AD90C42869FAFF67A46106DF7, mem on close (mb), free: 299, total: 411, max: 672
2016-01-14 17:06:45,971 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:45,971 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:45,981 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CE198A0F76714A4391E08085A0E86A5D, ordinal: 1
2016-01-14 17:06:45,982 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2016-01-14 17:06:45,982 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageBy/average"]
2016-01-14 17:06:45,983 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CE198A0F76714A4391E08085A0E86A5D, mem on start (mb), free: 297, total: 411, max: 672
2016-01-14 17:06:45,992 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CE198A0F76714A4391E08085A0E86A5D, mem on close (mb), free: 296, total: 411, max: 672
2016-01-14 17:06:46,015 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageBy/average/_temporary
2016-01-14 17:06:46,016 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] completed in: 00:00.169
2016-01-14 17:06:46,061 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testAverageBy/average
2016-01-14 17:06:46,076 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:46,076 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:46,105 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-01-14 17:06:46,106 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:46,106 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:46,113 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting
2016-01-14 17:06:46,114 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:46,114 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] sink: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByNullSafety/maxbynullsafety"]
2016-01-14 17:06:46,114 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] parallel execution of steps is enabled: false
2016-01-14 17:06:46,114 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executing total steps: 1
2016-01-14 17:06:46,114 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] allocating management threads: 1
2016-01-14 17:06:46,115 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting step: (1/1) ...ullSafety/maxbynullsafety
2016-01-14 17:06:46,165 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity966503881/.staging/job_local966503881_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:46,167 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity966503881/.staging/job_local966503881_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:46,194 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local966503881_0024/job_local966503881_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:46,194 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local966503881_0024/job_local966503881_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:46,195 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] submitted hadoop job: job_local966503881_0024
2016-01-14 17:06:46,195 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] tracking url: http://localhost:8080/
2016-01-14 17:06:46,199 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:46,217 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:46,218 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:46,222 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A8FF2AAC06934C93BAA7A7A9FF1FF64B, ordinal: 0
2016-01-14 17:06:46,223 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:46,223 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(max)[by:[{1}:'char']]
2016-01-14 17:06:46,223 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A8FF2AAC06934C93BAA7A7A9FF1FF64B, mem on start (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,225 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:46,225 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,226 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,227 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:46,227 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,227 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,228 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:46,228 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,229 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,229 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:46,230 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,230 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,231 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A8FF2AAC06934C93BAA7A7A9FF1FF64B, mem on close (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,243 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:46,243 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:46,246 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E225BC4EE7D24968A63F4C7D6318E65F, ordinal: 1
2016-01-14 17:06:46,247 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(max)[by:[{1}:'char']]
2016-01-14 17:06:46,247 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByNullSafety/maxbynullsafety"]
2016-01-14 17:06:46,247 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E225BC4EE7D24968A63F4C7D6318E65F, mem on start (mb), free: 298, total: 412, max: 672
2016-01-14 17:06:46,253 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E225BC4EE7D24968A63F4C7D6318E65F, mem on close (mb), free: 297, total: 412, max: 672
2016-01-14 17:06:46,271 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByNullSafety/maxbynullsafety/_temporary
2016-01-14 17:06:46,272 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] completed in: 00:00.158
2016-01-14 17:06:46,310 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMaxByNullSafety/maxbynullsafety
2016-01-14 17:06:46,322 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:46,322 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:46,346 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-01-14 17:06:46,347 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:46,347 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:46,356 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] starting
2016-01-14 17:06:46,356 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:46,356 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumByNulls/sumnulls"]
2016-01-14 17:06:46,357 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] parallel execution of steps is enabled: false
2016-01-14 17:06:46,357 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] executing total steps: 1
2016-01-14 17:06:46,357 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] allocating management threads: 1
2016-01-14 17:06:46,359 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] starting step: (1/1) ...m/testSumByNulls/sumnulls
2016-01-14 17:06:46,408 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity989659888/.staging/job_local989659888_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:46,408 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity989659888/.staging/job_local989659888_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:46,437 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local989659888_0025/job_local989659888_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:46,437 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local989659888_0025/job_local989659888_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:46,439 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] submitted hadoop job: job_local989659888_0025
2016-01-14 17:06:46,439 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] tracking url: http://localhost:8080/
2016-01-14 17:06:46,442 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:46,461 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:46,461 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:46,466 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: ACA8D86821B34CB993E17F0C705C9C4B, ordinal: 0
2016-01-14 17:06:46,466 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:46,466 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2016-01-14 17:06:46,467 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: ACA8D86821B34CB993E17F0C705C9C4B, mem on start (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,474 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:46,474 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,474 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,475 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:46,475 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,476 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,476 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:46,477 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,477 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,478 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:46,478 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,478 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,479 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: ACA8D86821B34CB993E17F0C705C9C4B, mem on close (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,488 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:46,488 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:46,492 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B93B3D149D8C485082010E68F827A7B5, ordinal: 1
2016-01-14 17:06:46,492 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2016-01-14 17:06:46,492 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumByNulls/sumnulls"]
2016-01-14 17:06:46,492 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B93B3D149D8C485082010E68F827A7B5, mem on start (mb), free: 298, total: 412, max: 672
2016-01-14 17:06:46,499 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B93B3D149D8C485082010E68F827A7B5, mem on close (mb), free: 297, total: 412, max: 672
2016-01-14 17:06:46,515 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumByNulls/sumnulls/_temporary
2016-01-14 17:06:46,516 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] completed in: 00:00.159
2016-01-14 17:06:46,554 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testSumByNulls/sumnulls
2016-01-14 17:06:46,568 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:46,568 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:46,588 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 17:06:46,588 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:46,588 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:46,595 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting
2016-01-14 17:06:46,595 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:46,596 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] sink: Hfs["TextDelimited[['count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountAll/countall"]
2016-01-14 17:06:46,596 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] parallel execution of steps is enabled: false
2016-01-14 17:06:46,596 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executing total steps: 1
2016-01-14 17:06:46,596 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] allocating management threads: 1
2016-01-14 17:06:46,596 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (1/1) ...orm/testCountAll/countall
2016-01-14 17:06:46,646 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity2022169848/.staging/job_local2022169848_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:46,647 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity2022169848/.staging/job_local2022169848_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:46,675 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2022169848_0026/job_local2022169848_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:46,675 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2022169848_0026/job_local2022169848_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:46,676 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local2022169848_0026
2016-01-14 17:06:46,677 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-14 17:06:46,680 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:46,698 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:46,698 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:46,702 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E6A9707F5E2E48A09449D053D37BE928, ordinal: 0
2016-01-14 17:06:46,703 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:46,703 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2016-01-14 17:06:46,703 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E6A9707F5E2E48A09449D053D37BE928, mem on start (mb), free: 301, total: 412, max: 672
2016-01-14 17:06:46,705 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E6A9707F5E2E48A09449D053D37BE928, mem on close (mb), free: 301, total: 412, max: 672
2016-01-14 17:06:46,713 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:46,714 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:46,718 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E417F95D3AF548BFB5B5D150598DF119, ordinal: 1
2016-01-14 17:06:46,718 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2016-01-14 17:06:46,718 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountAll/countall"]
2016-01-14 17:06:46,718 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E417F95D3AF548BFB5B5D150598DF119, mem on start (mb), free: 299, total: 412, max: 672
2016-01-14 17:06:46,725 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E417F95D3AF548BFB5B5D150598DF119, mem on close (mb), free: 298, total: 412, max: 672
2016-01-14 17:06:46,741 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountAll/countall/_temporary
2016-01-14 17:06:46,742 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] completed in: 00:00.146
2016-01-14 17:06:46,778 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCountAll/countall
2016-01-14 17:06:46,792 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:46,793 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:46,815 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-01-14 17:06:46,816 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:46,816 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:46,826 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-14 17:06:46,826 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:46,826 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregates/multi"]
2016-01-14 17:06:46,826 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] parallel execution of steps is enabled: false
2016-01-14 17:06:46,827 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executing total steps: 1
2016-01-14 17:06:46,827 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] allocating management threads: 1
2016-01-14 17:06:46,827 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...tParallelAggregates/multi
2016-01-14 17:06:46,879 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1424594727/.staging/job_local1424594727_0027/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:46,880 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1424594727/.staging/job_local1424594727_0027/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:46,907 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1424594727_0027/job_local1424594727_0027.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:46,908 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1424594727_0027/job_local1424594727_0027.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:46,908 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local1424594727_0027
2016-01-14 17:06:46,909 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-14 17:06:46,913 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:46,931 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:46,931 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:46,936 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AD5099B7C8624174A796A0DA0F598529, ordinal: 0
2016-01-14 17:06:46,937 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:46,937 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:06:46,937 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AD5099B7C8624174A796A0DA0F598529, mem on start (mb), free: 301, total: 412, max: 672
2016-01-14 17:06:46,939 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:46,939 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,940 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,941 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:46,941 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,941 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,942 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:46,942 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,943 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,943 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:46,943 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,943 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:46,944 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AD5099B7C8624174A796A0DA0F598529, mem on close (mb), free: 300, total: 412, max: 672
2016-01-14 17:06:46,953 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:46,953 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:46,959 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: AA96D7E0E1BD43FB9ADA19E27A9CE660, ordinal: 1
2016-01-14 17:06:46,960 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:06:46,960 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregates/multi"]
2016-01-14 17:06:46,961 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AA96D7E0E1BD43FB9ADA19E27A9CE660, mem on start (mb), free: 298, total: 412, max: 672
2016-01-14 17:06:46,968 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AA96D7E0E1BD43FB9ADA19E27A9CE660, mem on close (mb), free: 297, total: 412, max: 672
2016-01-14 17:06:46,984 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregates/multi/_temporary
2016-01-14 17:06:46,985 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] completed in: 00:00.158
2016-01-14 17:06:47,022 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testParallelAggregates/multi
2016-01-14 17:06:47,035 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:47,035 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:47,051 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.011
2016-01-14 17:06:47,051 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:06:47,051 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:47,058 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 17:06:47,058 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:47,058 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRetainNarrow/retainnarrow"]
2016-01-14 17:06:47,059 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-14 17:06:47,059 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-14 17:06:47,059 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-14 17:06:47,060 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...RetainNarrow/retainnarrow
2016-01-14 17:06:47,109 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1870816127/.staging/job_local1870816127_0028/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:47,110 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1870816127/.staging/job_local1870816127_0028/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:47,137 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1870816127_0028/job_local1870816127_0028.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:47,138 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1870816127_0028/job_local1870816127_0028.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:47,139 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local1870816127_0028
2016-01-14 17:06:47,140 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 17:06:47,143 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt
2016-01-14 17:06:47,148 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:47,148 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:47,152 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FC4074727A224402ABBEA8B0A9768812, ordinal: 0
2016-01-14 17:06:47,153 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:47,153 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRetainNarrow/retainnarrow"]
2016-01-14 17:06:47,153 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FC4074727A224402ABBEA8B0A9768812, mem on start (mb), free: 248, total: 412, max: 672
2016-01-14 17:06:47,155 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FC4074727A224402ABBEA8B0A9768812, mem on close (mb), free: 248, total: 412, max: 672
2016-01-14 17:06:47,173 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRetainNarrow/retainnarrow/_temporary
2016-01-14 17:06:47,173 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:00.115
2016-01-14 17:06:47,193 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testRetainNarrow/retainnarrow
2016-01-14 17:06:47,204 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:47,205 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:47,219 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.012
2016-01-14 17:06:47,220 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:06:47,220 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:47,225 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 17:06:47,225 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:47,225 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['item']->['char', 'item']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNarrow/renamenarrow"]
2016-01-14 17:06:47,225 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-14 17:06:47,225 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-14 17:06:47,225 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-14 17:06:47,227 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...RenameNarrow/renamenarrow
2016-01-14 17:06:47,275 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity686728229/.staging/job_local686728229_0029/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:47,276 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity686728229/.staging/job_local686728229_0029/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:47,303 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local686728229_0029/job_local686728229_0029.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:47,304 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local686728229_0029/job_local686728229_0029.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:47,304 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local686728229_0029
2016-01-14 17:06:47,305 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 17:06:47,308 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt
2016-01-14 17:06:47,313 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:47,313 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:47,316 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BB87C6D537244CF48A44CD66B56A9B07, ordinal: 0
2016-01-14 17:06:47,317 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:47,317 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['item']->['char', 'item']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNarrow/renamenarrow"]
2016-01-14 17:06:47,317 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BB87C6D537244CF48A44CD66B56A9B07, mem on start (mb), free: 204, total: 412, max: 672
2016-01-14 17:06:47,319 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BB87C6D537244CF48A44CD66B56A9B07, mem on close (mb), free: 204, total: 412, max: 672
2016-01-14 17:06:47,338 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNarrow/renamenarrow/_temporary
2016-01-14 17:06:47,338 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:00.113
2016-01-14 17:06:47,358 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testRenameNarrow/renamenarrow
2016-01-14 17:06:47,370 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:47,371 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:47,392 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 17:06:47,392 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:47,393 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:47,399 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] starting
2016-01-14 17:06:47,400 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:47,400 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageByNull/averagenull"]
2016-01-14 17:06:47,401 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] parallel execution of steps is enabled: false
2016-01-14 17:06:47,401 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] executing total steps: 1
2016-01-14 17:06:47,402 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] allocating management threads: 1
2016-01-14 17:06:47,404 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] starting step: (1/1) ...AverageByNull/averagenull
2016-01-14 17:06:47,460 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1210090817/.staging/job_local1210090817_0030/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:47,461 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1210090817/.staging/job_local1210090817_0030/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:47,494 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1210090817_0030/job_local1210090817_0030.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:47,494 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1210090817_0030/job_local1210090817_0030.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:47,495 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] submitted hadoop job: job_local1210090817_0030
2016-01-14 17:06:47,495 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] tracking url: http://localhost:8080/
2016-01-14 17:06:47,500 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:47,514 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:47,514 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:47,518 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D6925BD7650E4A3CBE1CDBE61C0581CF, ordinal: 0
2016-01-14 17:06:47,519 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:47,519 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2016-01-14 17:06:47,519 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D6925BD7650E4A3CBE1CDBE61C0581CF, mem on start (mb), free: 292, total: 413, max: 672
2016-01-14 17:06:47,523 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:47,524 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 292, total: 413, max: 672
2016-01-14 17:06:47,524 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:47,525 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:47,525 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 292, total: 413, max: 672
2016-01-14 17:06:47,525 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:47,526 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:47,526 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 292, total: 413, max: 672
2016-01-14 17:06:47,526 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:47,527 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:47,527 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 292, total: 413, max: 672
2016-01-14 17:06:47,527 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:47,528 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D6925BD7650E4A3CBE1CDBE61C0581CF, mem on close (mb), free: 292, total: 413, max: 672
2016-01-14 17:06:47,536 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:47,536 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:47,541 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C2C38EB295724D3E91A56CAA17CF5FAD, ordinal: 1
2016-01-14 17:06:47,541 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2016-01-14 17:06:47,541 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageByNull/averagenull"]
2016-01-14 17:06:47,542 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C2C38EB295724D3E91A56CAA17CF5FAD, mem on start (mb), free: 290, total: 413, max: 672
2016-01-14 17:06:47,549 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C2C38EB295724D3E91A56CAA17CF5FAD, mem on close (mb), free: 289, total: 413, max: 672
2016-01-14 17:06:47,559 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageByNull/averagenull/_temporary
2016-01-14 17:06:47,560 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] completed in: 00:00.160
2016-01-14 17:06:47,599 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testAverageByNull/averagenull
2016-01-14 17:06:47,610 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:47,611 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:47,628 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 17:06:47,629 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:06:47,629 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:47,634 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] starting
2016-01-14 17:06:47,634 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:47,634 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] sink: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerce/coerce"]
2016-01-14 17:06:47,635 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] parallel execution of steps is enabled: false
2016-01-14 17:06:47,635 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] executing total steps: 1
2016-01-14 17:06:47,635 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] allocating management threads: 1
2016-01-14 17:06:47,636 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] starting step: (1/1) ...latform/testCoerce/coerce
2016-01-14 17:06:47,685 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity2004417555/.staging/job_local2004417555_0031/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:47,686 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity2004417555/.staging/job_local2004417555_0031/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:47,722 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2004417555_0031/job_local2004417555_0031.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:47,722 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2004417555_0031/job_local2004417555_0031.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:47,724 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] submitted hadoop job: job_local2004417555_0031
2016-01-14 17:06:47,724 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] tracking url: http://localhost:8080/
2016-01-14 17:06:47,730 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt
2016-01-14 17:06:47,737 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:47,737 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:47,742 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DAC63A79D5504557BFB52B7034A4D698, ordinal: 0
2016-01-14 17:06:47,742 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lower.txt"]
2016-01-14 17:06:47,742 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerce/coerce"]
2016-01-14 17:06:47,743 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DAC63A79D5504557BFB52B7034A4D698, mem on start (mb), free: 237, total: 413, max: 672
2016-01-14 17:06:47,744 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DAC63A79D5504557BFB52B7034A4D698, mem on close (mb), free: 237, total: 413, max: 672
2016-01-14 17:06:47,757 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerce/coerce/_temporary
2016-01-14 17:06:47,758 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] completed in: 00:00.123
2016-01-14 17:06:47,782 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCoerce/coerce
2016-01-14 17:06:47,793 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:47,793 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:47,811 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.015
2016-01-14 17:06:47,812 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:47,812 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:47,818 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-14 17:06:47,818 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] source: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs+rhs-cross-rev.txt"]
2016-01-14 17:06:47,819 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstByWithoutComparator/firstnfieldswithoutcomparator"]
2016-01-14 17:06:47,819 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] parallel execution of steps is enabled: false
2016-01-14 17:06:47,819 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executing total steps: 1
2016-01-14 17:06:47,820 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] allocating management threads: 1
2016-01-14 17:06:47,821 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) ...tnfieldswithoutcomparator
2016-01-14 17:06:47,871 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity603577890/.staging/job_local603577890_0032/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:47,872 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity603577890/.staging/job_local603577890_0032/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:47,899 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local603577890_0032/job_local603577890_0032.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:47,900 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local603577890_0032/job_local603577890_0032.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:47,900 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted hadoop job: job_local603577890_0032
2016-01-14 17:06:47,903 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tracking url: http://localhost:8080/
2016-01-14 17:06:47,905 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs+rhs-cross-rev.txt
2016-01-14 17:06:47,924 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:47,925 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:47,929 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C2D768E857504369BD8EAFD09EA68AC8, ordinal: 0
2016-01-14 17:06:47,930 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs+rhs-cross-rev.txt"]
2016-01-14 17:06:47,930 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(first)[by:[{1}:'num']]
2016-01-14 17:06:47,930 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C2D768E857504369BD8EAFD09EA68AC8, mem on start (mb), free: 300, total: 413, max: 672
2016-01-14 17:06:47,935 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:47,935 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 413, max: 672
2016-01-14 17:06:47,936 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:47,938 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:47,938 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 413, max: 672
2016-01-14 17:06:47,938 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:47,940 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C2D768E857504369BD8EAFD09EA68AC8, mem on close (mb), free: 300, total: 413, max: 672
2016-01-14 17:06:47,948 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:47,948 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:47,952 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: EA7FEF12229342AE97F8C9ABD13E0BAB, ordinal: 1
2016-01-14 17:06:47,952 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(first)[by:[{1}:'num']]
2016-01-14 17:06:47,953 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstByWithoutComparator/firstnfieldswithoutcomparator"]
2016-01-14 17:06:47,953 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EA7FEF12229342AE97F8C9ABD13E0BAB, mem on start (mb), free: 298, total: 413, max: 672
2016-01-14 17:06:47,959 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EA7FEF12229342AE97F8C9ABD13E0BAB, mem on close (mb), free: 297, total: 413, max: 672
2016-01-14 17:06:47,979 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstByWithoutComparator/firstnfieldswithoutcomparator/_temporary
2016-01-14 17:06:47,980 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] completed in: 00:00.161
2016-01-14 17:06:48,004 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testFirstByWithoutComparator/firstnfieldswithoutcomparator
2016-01-14 17:06:48,024 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:48,024 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:48,059 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.030
2016-01-14 17:06:48,060 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:48,060 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:48,073 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-14 17:06:48,073 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:48,074 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:48,075 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMergeLegacyHash/multimerge+false480"]
2016-01-14 17:06:48,075 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] parallel execution of steps is enabled: false
2016-01-14 17:06:48,075 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executing total steps: 1
2016-01-14 17:06:48,076 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] allocating management threads: 1
2016-01-14 17:06:48,077 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...yHash/multimerge+false480
2016-01-14 17:06:48,128 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1142707615/.staging/job_local1142707615_0033/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:48,129 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1142707615/.staging/job_local1142707615_0033/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:48,156 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1142707615_0033/job_local1142707615_0033.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:48,156 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1142707615_0033/job_local1142707615_0033.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:48,157 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local1142707615_0033
2016-01-14 17:06:48,157 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-14 17:06:48,161 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:48,178 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:48,179 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:48,183 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AEC7C57F63174476B390B9618CAD7833, ordinal: 0
2016-01-14 17:06:48,184 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:48,184 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 17:06:48,184 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AEC7C57F63174476B390B9618CAD7833, mem on start (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,185 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:48,185 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,186 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,186 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:48,186 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,187 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,187 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:48,187 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,187 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,187 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:48,188 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,188 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,189 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AEC7C57F63174476B390B9618CAD7833, mem on close (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,200 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt
2016-01-14 17:06:48,217 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:48,218 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:48,227 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AEC7C57F63174476B390B9618CAD7833, ordinal: 0
2016-01-14 17:06:48,227 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:48,228 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 17:06:48,228 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AEC7C57F63174476B390B9618CAD7833, mem on start (mb), free: 200, total: 414, max: 672
2016-01-14 17:06:48,237 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:48,238 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 200, total: 414, max: 672
2016-01-14 17:06:48,238 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,241 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:48,241 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 200, total: 414, max: 672
2016-01-14 17:06:48,242 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,244 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:48,244 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 200, total: 414, max: 672
2016-01-14 17:06:48,245 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,246 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:48,247 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 200, total: 414, max: 672
2016-01-14 17:06:48,248 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,248 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AEC7C57F63174476B390B9618CAD7833, mem on close (mb), free: 200, total: 414, max: 672
2016-01-14 17:06:48,266 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:48,267 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:48,275 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B3E0143B65CF43CE95F52E9605C4F043, ordinal: 1
2016-01-14 17:06:48,276 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 17:06:48,277 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMergeLegacyHash/multimerge+false480"]
2016-01-14 17:06:48,277 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B3E0143B65CF43CE95F52E9605C4F043, mem on start (mb), free: 198, total: 414, max: 672
2016-01-14 17:06:48,286 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B3E0143B65CF43CE95F52E9605C4F043, mem on close (mb), free: 197, total: 414, max: 672
2016-01-14 17:06:48,310 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMergeLegacyHash/multimerge+false480/_temporary
2016-01-14 17:06:48,311 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] completed in: 00:00.237
2016-01-14 17:06:48,351 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMergeLegacyHash/multimerge+false480
2016-01-14 17:06:48,365 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:48,365 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:48,467 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.098
2016-01-14 17:06:48,468 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 5, nodes: 10
2016-01-14 17:06:48,468 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:48,504 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting
2016-01-14 17:06:48,505 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:48,507 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMergeThreeWay/samesourcemergethreeway"]
2016-01-14 17:06:48,507 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] parallel execution of steps is enabled: false
2016-01-14 17:06:48,508 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] executing total steps: 5
2016-01-14 17:06:48,509 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] allocating management threads: 1
2016-01-14 17:06:48,511 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (1/5)
2016-01-14 17:06:48,563 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity385828956/.staging/job_local385828956_0034/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:48,564 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity385828956/.staging/job_local385828956_0034/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:48,590 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local385828956_0034/job_local385828956_0034.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:48,590 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local385828956_0034/job_local385828956_0034.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:48,591 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local385828956_0034
2016-01-14 17:06:48,592 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-14 17:06:48,595 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:48,609 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:48,609 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:48,613 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BFF61539E3BA4EDFBC8AE958D435692B, ordinal: 0
2016-01-14 17:06:48,614 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:48,614 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(source)[by:[{1}:'char']]
2016-01-14 17:06:48,614 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BFF61539E3BA4EDFBC8AE958D435692B, mem on start (mb), free: 272, total: 414, max: 672
2016-01-14 17:06:48,615 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:48,615 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 272, total: 414, max: 672
2016-01-14 17:06:48,616 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,616 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:48,617 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 272, total: 414, max: 672
2016-01-14 17:06:48,617 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,618 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:06:48,618 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 272, total: 414, max: 672
2016-01-14 17:06:48,618 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,619 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:06:48,619 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 272, total: 414, max: 672
2016-01-14 17:06:48,619 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,620 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BFF61539E3BA4EDFBC8AE958D435692B, mem on close (mb), free: 272, total: 414, max: 672
2016-01-14 17:06:48,628 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:48,628 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:48,632 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A21E66356115429A93190A5EEF249261, ordinal: 1
2016-01-14 17:06:48,632 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(source)[by:[{1}:'char']]
2016-01-14 17:06:48,633 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][2480690792/source/]
2016-01-14 17:06:48,633 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A21E66356115429A93190A5EEF249261, mem on start (mb), free: 270, total: 414, max: 672
2016-01-14 17:06:48,639 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A21E66356115429A93190A5EEF249261, mem on close (mb), free: 268, total: 414, max: 672
2016-01-14 17:06:48,656 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (2/5)
2016-01-14 17:06:48,718 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity49110433/.staging/job_local49110433_0035/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:48,719 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity49110433/.staging/job_local49110433_0035/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:48,744 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local49110433_0035/job_local49110433_0035.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:48,744 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local49110433_0035/job_local49110433_0035.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:48,745 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local49110433_0035
2016-01-14 17:06:48,745 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-14 17:06:48,749 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/2480690792_source_4465F0229711417C898B42A8A3071AF2/part-00000
2016-01-14 17:06:48,766 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:48,767 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:48,770 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A06F781E241449E4BFA8020A34685904, ordinal: 0
2016-01-14 17:06:48,771 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][2480690792/source/]
2016-01-14 17:06:48,771 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count-lhs)[by:[{1}:'char']]
2016-01-14 17:06:48,771 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A06F781E241449E4BFA8020A34685904, mem on start (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,772 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:48,772 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,773 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,773 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:48,773 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,773 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,774 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A06F781E241449E4BFA8020A34685904, mem on close (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,784 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:48,785 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:48,791 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D9BC2978124E41A2AF7E97E4B8B742F5, ordinal: 1
2016-01-14 17:06:48,792 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count-lhs)[by:[{1}:'char']]
2016-01-14 17:06:48,792 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][1367985507/count-lhs/]
2016-01-14 17:06:48,792 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D9BC2978124E41A2AF7E97E4B8B742F5, mem on start (mb), free: 300, total: 414, max: 672
2016-01-14 17:06:48,800 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D9BC2978124E41A2AF7E97E4B8B742F5, mem on close (mb), free: 298, total: 414, max: 672
2016-01-14 17:06:48,809 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (3/5)
2016-01-14 17:06:48,875 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1341539245/.staging/job_local1341539245_0036/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:48,876 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1341539245/.staging/job_local1341539245_0036/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:48,903 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1341539245_0036/job_local1341539245_0036.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:48,903 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1341539245_0036/job_local1341539245_0036.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:48,905 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local1341539245_0036
2016-01-14 17:06:48,906 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-14 17:06:48,908 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/2480690792_source_4465F0229711417C898B42A8A3071AF2/part-00000
2016-01-14 17:06:48,926 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:48,927 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:48,931 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DD7EBE3ECB55433CB58A092F745ADDE0, ordinal: 0
2016-01-14 17:06:48,932 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][2480690792/source/]
2016-01-14 17:06:48,932 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count-rhs)[by:[{1}:'char']]
2016-01-14 17:06:48,933 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DD7EBE3ECB55433CB58A092F745ADDE0, mem on start (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,934 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:06:48,935 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,935 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,937 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:06:48,937 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,937 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:06:48,939 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DD7EBE3ECB55433CB58A092F745ADDE0, mem on close (mb), free: 302, total: 414, max: 672
2016-01-14 17:06:48,946 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:48,946 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:48,950 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CC04423E74554F559008107C963DE41C, ordinal: 1
2016-01-14 17:06:48,950 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count-rhs)[by:[{1}:'char']]
2016-01-14 17:06:48,950 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][283882565/count-rhs/]
2016-01-14 17:06:48,950 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CC04423E74554F559008107C963DE41C, mem on start (mb), free: 300, total: 414, max: 672
2016-01-14 17:06:48,956 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CC04423E74554F559008107C963DE41C, mem on close (mb), free: 299, total: 414, max: 672
2016-01-14 17:06:48,971 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (4/5)
2016-01-14 17:06:49,043 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity819556759/.staging/job_local819556759_0037/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:49,044 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity819556759/.staging/job_local819556759_0037/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:49,072 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local819556759_0037/job_local819556759_0037.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:49,072 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local819556759_0037/job_local819556759_0037.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:49,073 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local819556759_0037
2016-01-14 17:06:49,074 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-14 17:06:49,077 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/2480690792_source_4465F0229711417C898B42A8A3071AF2/part-00000
2016-01-14 17:06:49,097 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:49,097 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,104 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F55B6B81B1A34D7B90083A4C554CFF6C, ordinal: 0
2016-01-14 17:06:49,106 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][2480690792/source/]
2016-01-14 17:06:49,106 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 17:06:49,107 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F55B6B81B1A34D7B90083A4C554CFF6C, mem on start (mb), free: 302, total: 415, max: 672
2016-01-14 17:06:49,109 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F55B6B81B1A34D7B90083A4C554CFF6C, mem on close (mb), free: 302, total: 415, max: 672
2016-01-14 17:06:49,114 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/283882565_count_rhs_685F7F24DE3A44D1BE333B4BB9D601A4/part-00000
2016-01-14 17:06:49,129 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:49,130 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,135 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F55B6B81B1A34D7B90083A4C554CFF6C, ordinal: 0
2016-01-14 17:06:49,135 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][283882565/count-rhs/]
2016-01-14 17:06:49,135 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 17:06:49,136 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F55B6B81B1A34D7B90083A4C554CFF6C, mem on start (mb), free: 200, total: 415, max: 672
2016-01-14 17:06:49,138 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F55B6B81B1A34D7B90083A4C554CFF6C, mem on close (mb), free: 200, total: 415, max: 672
2016-01-14 17:06:49,148 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:49,148 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,151 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: AF0866A280604BCB89EA22D0E05E514A, ordinal: 1
2016-01-14 17:06:49,152 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 17:06:49,152 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][3804924744/source_count-rhs/]
2016-01-14 17:06:49,152 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AF0866A280604BCB89EA22D0E05E514A, mem on start (mb), free: 198, total: 415, max: 672
2016-01-14 17:06:49,162 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 17:06:49,162 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 17:06:49,175 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AF0866A280604BCB89EA22D0E05E514A, mem on close (mb), free: 196, total: 415, max: 672
2016-01-14 17:06:49,189 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (5/5) ...y/samesourcemergethreeway
2016-01-14 17:06:49,256 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1394691871/.staging/job_local1394691871_0038/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:49,257 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity1394691871/.staging/job_local1394691871_0038/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:49,289 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1394691871_0038/job_local1394691871_0038.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:49,289 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1394691871_0038/job_local1394691871_0038.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:49,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local1394691871_0038
2016-01-14 17:06:49,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-14 17:06:49,294 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/3804924744_source_count_rhs_9F84B3EE6E5947F981E37B536A895A59/part-00000
2016-01-14 17:06:49,308 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:49,308 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,313 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DFF3D8EDF266449AA4B80194F49E2F6E, ordinal: 0
2016-01-14 17:06:49,313 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][3804924744/source_count-rhs/]
2016-01-14 17:06:49,314 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2016-01-14 17:06:49,314 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DFF3D8EDF266449AA4B80194F49E2F6E, mem on start (mb), free: 295, total: 415, max: 672
2016-01-14 17:06:49,315 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DFF3D8EDF266449AA4B80194F49E2F6E, mem on close (mb), free: 295, total: 415, max: 672
2016-01-14 17:06:49,321 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/1367985507_count_lhs_A658D8030B0C495ABE0122136D52F64F/part-00000
2016-01-14 17:06:49,335 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:49,336 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,340 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DFF3D8EDF266449AA4B80194F49E2F6E, ordinal: 0
2016-01-14 17:06:49,341 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][1367985507/count-lhs/]
2016-01-14 17:06:49,341 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2016-01-14 17:06:49,341 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DFF3D8EDF266449AA4B80194F49E2F6E, mem on start (mb), free: 193, total: 415, max: 672
2016-01-14 17:06:49,343 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DFF3D8EDF266449AA4B80194F49E2F6E, mem on close (mb), free: 193, total: 415, max: 672
2016-01-14 17:06:49,353 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:49,353 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,358 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D8D803333CCE46BDB4233B1E77C5BA0D, ordinal: 1
2016-01-14 17:06:49,359 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2016-01-14 17:06:49,359 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMergeThreeWay/samesourcemergethreeway"]
2016-01-14 17:06:49,359 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D8D803333CCE46BDB4233B1E77C5BA0D, mem on start (mb), free: 191, total: 415, max: 672
2016-01-14 17:06:49,365 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 17:06:49,365 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 17:06:49,368 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D8D803333CCE46BDB4233B1E77C5BA0D, mem on close (mb), free: 190, total: 415, max: 672
2016-01-14 17:06:49,389 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMergeThreeWay/samesourcemergethreeway/_temporary
2016-01-14 17:06:49,390 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] completed in: 00:00.883
2016-01-14 17:06:49,427 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testSameSourceMergeThreeWay/samesourcemergethreeway
2016-01-14 17:06:49,440 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:49,440 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:49,472 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 17:06:49,473 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:49,474 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:49,485 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] starting
2016-01-14 17:06:49,485 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:49,485 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:49,486 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] sink: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUniqueMerge/uniquemerge-nondeterministic"]
2016-01-14 17:06:49,486 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] parallel execution of steps is enabled: false
2016-01-14 17:06:49,486 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] executing total steps: 1
2016-01-14 17:06:49,487 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] allocating management threads: 1
2016-01-14 17:06:49,487 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] starting step: (1/1) ...quemerge-nondeterministic
2016-01-14 17:06:49,540 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity713014921/.staging/job_local713014921_0039/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:49,541 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity713014921/.staging/job_local713014921_0039/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:49,569 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local713014921_0039/job_local713014921_0039.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:49,569 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local713014921_0039/job_local713014921_0039.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:49,572 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] submitted hadoop job: job_local713014921_0039
2016-01-14 17:06:49,572 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] tracking url: http://localhost:8080/
2016-01-14 17:06:49,576 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:49,589 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:49,590 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,593 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: CB2430EE66154ECFB612BCE79337F4AB, ordinal: 0
2016-01-14 17:06:49,594 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:49,594 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2016-01-14 17:06:49,594 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CB2430EE66154ECFB612BCE79337F4AB, mem on start (mb), free: 275, total: 416, max: 672
2016-01-14 17:06:49,601 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CB2430EE66154ECFB612BCE79337F4AB, mem on close (mb), free: 274, total: 416, max: 672
2016-01-14 17:06:49,607 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt
2016-01-14 17:06:49,623 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:49,624 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,630 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: CB2430EE66154ECFB612BCE79337F4AB, ordinal: 0
2016-01-14 17:06:49,631 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/rhs.txt"]
2016-01-14 17:06:49,631 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2016-01-14 17:06:49,631 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CB2430EE66154ECFB612BCE79337F4AB, mem on start (mb), free: 173, total: 416, max: 672
2016-01-14 17:06:49,634 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CB2430EE66154ECFB612BCE79337F4AB, mem on close (mb), free: 173, total: 416, max: 672
2016-01-14 17:06:49,648 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:49,648 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,652 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F212EC4FA125497FA78A1B563772646D, ordinal: 1
2016-01-14 17:06:49,653 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2016-01-14 17:06:49,653 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUniqueMerge/uniquemerge-nondeterministic"]
2016-01-14 17:06:49,654 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F212EC4FA125497FA78A1B563772646D, mem on start (mb), free: 170, total: 416, max: 672
2016-01-14 17:06:49,663 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F212EC4FA125497FA78A1B563772646D, mem on close (mb), free: 169, total: 416, max: 672
2016-01-14 17:06:49,684 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUniqueMerge/uniquemerge-nondeterministic/_temporary
2016-01-14 17:06:49,686 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] completed in: 00:00.199
2016-01-14 17:06:49,708 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testUniqueMerge/uniquemerge-nondeterministic
2016-01-14 17:06:49,719 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:49,720 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:49,741 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-01-14 17:06:49,742 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:49,742 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:49,749 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 17:06:49,749 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:49,749 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUnique/unique"]
2016-01-14 17:06:49,750 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-14 17:06:49,750 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-14 17:06:49,751 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-14 17:06:49,752 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...latform/testUnique/unique
2016-01-14 17:06:49,804 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity588684722/.staging/job_local588684722_0040/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:49,805 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity588684722/.staging/job_local588684722_0040/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:49,831 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local588684722_0040/job_local588684722_0040.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:49,831 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local588684722_0040/job_local588684722_0040.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:49,832 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local588684722_0040
2016-01-14 17:06:49,834 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 17:06:49,837 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:49,852 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:49,852 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,856 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: ABFDA8D8D5DA47CE9DAB9DE835A515E8, ordinal: 0
2016-01-14 17:06:49,856 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:49,857 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(shape)[by:[{1}:'num']]
2016-01-14 17:06:49,857 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: ABFDA8D8D5DA47CE9DAB9DE835A515E8, mem on start (mb), free: 253, total: 412, max: 672
2016-01-14 17:06:49,859 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: ABFDA8D8D5DA47CE9DAB9DE835A515E8, mem on close (mb), free: 253, total: 412, max: 672
2016-01-14 17:06:49,867 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:49,868 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:49,870 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CAAFB7FE827F425797A9AC1E5621715F, ordinal: 1
2016-01-14 17:06:49,871 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(shape)[by:[{1}:'num']]
2016-01-14 17:06:49,871 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUnique/unique"]
2016-01-14 17:06:49,871 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CAAFB7FE827F425797A9AC1E5621715F, mem on start (mb), free: 252, total: 412, max: 672
2016-01-14 17:06:49,877 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CAAFB7FE827F425797A9AC1E5621715F, mem on close (mb), free: 251, total: 412, max: 672
2016-01-14 17:06:49,889 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUnique/unique/_temporary
2016-01-14 17:06:49,889 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:00.139
2016-01-14 17:06:49,910 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testUnique/unique
2016-01-14 17:06:49,922 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:06:49,922 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 17:06:49,942 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 17:06:49,943 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:06:49,943 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:06:49,951 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting
2016-01-14 17:06:49,951 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:49,951 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] sink: Hfs["TextDelimited[['notnull', 'null']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountNullNotNull/countnullnotnull"]
2016-01-14 17:06:49,951 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] parallel execution of steps is enabled: false
2016-01-14 17:06:49,951 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executing total steps: 1
2016-01-14 17:06:49,951 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] allocating management threads: 1
2016-01-14 17:06:49,952 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (1/1) ...lNotNull/countnullnotnull
2016-01-14 17:06:50,002 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity158947665/.staging/job_local158947665_0041/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:50,003 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/tmp/cascading/staging/teamcity158947665/.staging/job_local158947665_0041/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:50,030 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local158947665_0041/job_local158947665_0041.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-14 17:06:50,030 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local158947665_0041/job_local158947665_0041.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-14 17:06:50,031 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local158947665_0041
2016-01-14 17:06:50,031 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-14 17:06:50,034 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt
2016-01-14 17:06:50,052 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:06:50,052 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:06:50,057 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F90ED919395C4C818DF13F046EB84AEC, ordinal: 0
2016-01-14 17:06:50,058 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/lhs.txt"]
2016-01-14 17:06:50,058 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2016-01-14 17:06:50,059 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F90ED919395C4C818DF13F046EB84AEC, mem on start (mb), free: 303, total: 416, max: 672
2016-01-14 17:06:50,064 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F90ED919395C4C818DF13F046EB84AEC, mem on close (mb), free: 303, total: 416, max: 672
2016-01-14 17:06:50,071 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:06:50,071 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:06:50,076 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B20C4D87A8364D4381253EF03C2038B4, ordinal: 1
2016-01-14 17:06:50,077 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2016-01-14 17:06:50,077 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['notnull', 'null']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountNullNotNull/countnullnotnull"]
2016-01-14 17:06:50,077 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B20C4D87A8364D4381253EF03C2038B4, mem on start (mb), free: 301, total: 416, max: 672
2016-01-14 17:06:50,083 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B20C4D87A8364D4381253EF03C2038B4, mem on close (mb), free: 299, total: 416, max: 672
2016-01-14 17:06:50,096 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountNullNotNull/countnullnotnull/_temporary
2016-01-14 17:06:50,096 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] completed in: 00:00.145
2016-01-14 17:06:50,134 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCountNullNotNull/countnullnotnull