2016-01-15 00:00:16,158 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-15 00:00:16,188 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.pipe.assembly.AssemblyHelpersPlatformTest, with platform: hadoop2-mr1
2016-01-15 00:00:16,230 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(119)) - not using cluster
2016-01-15 00:00:16,912 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-01-15 00:00:17,074 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2016-01-15 00:00:17,405 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:17,408 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:17,508 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: 843FB8723A9A4C29B1B4A7B35CF876F0
2016-01-15 00:00:17,728 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.167
2016-01-15 00:00:17,731 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:17,732 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:17,945 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-15 00:00:17,948 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-15 00:00:17,949 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:17,950 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt"]
2016-01-15 00:00:17,951 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMerge/multimerge+false598"]
2016-01-15 00:00:17,952 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] parallel execution of steps is enabled: false
2016-01-15 00:00:17,953 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executing total steps: 1
2016-01-15 00:00:17,953 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] allocating management threads: 1
2016-01-15 00:00:17,955 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...Merge/multimerge+false598
2016-01-15 00:00:18,413 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1367136478/.staging/job_local1367136478_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:18,422 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1367136478/.staging/job_local1367136478_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:18,518 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1367136478_0001/job_local1367136478_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:18,523 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1367136478_0001/job_local1367136478_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:18,529 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local1367136478_0001
2016-01-15 00:00:18,530 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-15 00:00:18,607 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:18,746 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:18,746 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:18,768 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E68654C002B34A38AB03A1EF1FAF22BF, ordinal: 0
2016-01-15 00:00:18,802 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:18,802 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-15 00:00:18,803 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E68654C002B34A38AB03A1EF1FAF22BF, mem on start (mb), free: 78, total: 223, max: 672
2016-01-15 00:00:18,819 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:18,819 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 76, total: 223, max: 672
2016-01-15 00:00:18,820 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 33% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:18,821 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:18,821 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 76, total: 223, max: 672
2016-01-15 00:00:18,821 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 33% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:18,822 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:18,822 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 76, total: 223, max: 672
2016-01-15 00:00:18,822 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 33% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:18,823 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:18,823 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 76, total: 223, max: 672
2016-01-15 00:00:18,823 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 33% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:18,824 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E68654C002B34A38AB03A1EF1FAF22BF, mem on close (mb), free: 76, total: 223, max: 672
2016-01-15 00:00:18,849 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt
2016-01-15 00:00:18,954 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:18,954 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:18,978 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E68654C002B34A38AB03A1EF1FAF22BF, ordinal: 0
2016-01-15 00:00:18,979 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt"]
2016-01-15 00:00:18,980 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-15 00:00:18,980 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E68654C002B34A38AB03A1EF1FAF22BF, mem on start (mb), free: 75, total: 323, max: 672
2016-01-15 00:00:19,057 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:19,058 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 71, total: 323, max: 672
2016-01-15 00:00:19,058 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 48% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:19,060 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:19,061 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 71, total: 323, max: 672
2016-01-15 00:00:19,061 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 48% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:19,062 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:19,063 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 71, total: 323, max: 672
2016-01-15 00:00:19,064 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 48% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:19,065 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:19,065 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 71, total: 323, max: 672
2016-01-15 00:00:19,066 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 48% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:19,067 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E68654C002B34A38AB03A1EF1FAF22BF, mem on close (mb), free: 71, total: 323, max: 672
2016-01-15 00:00:19,178 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:19,178 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:19,199 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DC17B3D7B9FF4BFBBD933F721D6E3C0F, ordinal: 1
2016-01-15 00:00:19,203 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-15 00:00:19,203 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMerge/multimerge+false598"]
2016-01-15 00:00:19,203 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DC17B3D7B9FF4BFBBD933F721D6E3C0F, mem on start (mb), free: 61, total: 323, max: 672
2016-01-15 00:00:19,234 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DC17B3D7B9FF4BFBBD933F721D6E3C0F, mem on close (mb), free: 61, total: 323, max: 672
2016-01-15 00:00:19,274 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMerge/multimerge+false598/_temporary
2016-01-15 00:00:19,275 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] completed in: 00:01.325
2016-01-15 00:00:19,367 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMerge/multimerge+false598
2016-01-15 00:00:19,395 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:19,396 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:19,478 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.073
2016-01-15 00:00:19,479 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:19,479 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:19,506 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting
2016-01-15 00:00:19,507 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:19,507 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] sink: Hfs["TextDelimited[['num', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByString/minbystring"]
2016-01-15 00:00:19,508 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] parallel execution of steps is enabled: false
2016-01-15 00:00:19,508 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executing total steps: 1
2016-01-15 00:00:19,508 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] allocating management threads: 1
2016-01-15 00:00:19,508 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting step: (1/1) ...stMinByString/minbystring
2016-01-15 00:00:19,601 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity820324203/.staging/job_local820324203_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:19,603 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity820324203/.staging/job_local820324203_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:19,673 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local820324203_0002/job_local820324203_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:19,676 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local820324203_0002/job_local820324203_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:19,677 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] submitted hadoop job: job_local820324203_0002
2016-01-15 00:00:19,678 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] tracking url: http://localhost:8080/
2016-01-15 00:00:19,688 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:19,805 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:19,806 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:19,816 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BFB6710F262A4B6DB06DC336FEF5C2D1, ordinal: 0
2016-01-15 00:00:19,816 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:19,817 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2016-01-15 00:00:19,817 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BFB6710F262A4B6DB06DC336FEF5C2D1, mem on start (mb), free: 70, total: 424, max: 672
2016-01-15 00:00:19,820 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:19,820 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 70, total: 424, max: 672
2016-01-15 00:00:19,820 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 63% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:19,822 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:19,822 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 70, total: 424, max: 672
2016-01-15 00:00:19,822 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 63% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:19,824 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BFB6710F262A4B6DB06DC336FEF5C2D1, mem on close (mb), free: 70, total: 424, max: 672
2016-01-15 00:00:19,844 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:19,844 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:19,853 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F14EE99042024710AB210109F6CA9E4F, ordinal: 1
2016-01-15 00:00:19,854 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2016-01-15 00:00:19,854 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['num', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByString/minbystring"]
2016-01-15 00:00:19,854 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F14EE99042024710AB210109F6CA9E4F, mem on start (mb), free: 67, total: 424, max: 672
2016-01-15 00:00:19,868 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F14EE99042024710AB210109F6CA9E4F, mem on close (mb), free: 66, total: 424, max: 672
2016-01-15 00:00:19,899 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByString/minbystring/_temporary
2016-01-15 00:00:19,899 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] completed in: 00:00.392
2016-01-15 00:00:20,003 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMinByString/minbystring
2016-01-15 00:00:20,030 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:20,030 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:20,100 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.064
2016-01-15 00:00:20,101 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:20,102 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:20,130 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] starting
2016-01-15 00:00:20,130 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt"]
2016-01-15 00:00:20,131 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:20,131 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageMerge/mergeaverage"]
2016-01-15 00:00:20,131 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] parallel execution of steps is enabled: false
2016-01-15 00:00:20,131 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] executing total steps: 1
2016-01-15 00:00:20,131 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] allocating management threads: 1
2016-01-15 00:00:20,132 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] starting step: (1/1) ...AverageMerge/mergeaverage
2016-01-15 00:00:20,316 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1522711640/.staging/job_local1522711640_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:20,318 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1522711640/.staging/job_local1522711640_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:20,370 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1522711640_0003/job_local1522711640_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:20,371 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1522711640_0003/job_local1522711640_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:20,372 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] submitted hadoop job: job_local1522711640_0003
2016-01-15 00:00:20,372 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] tracking url: http://localhost:8080/
2016-01-15 00:00:20,379 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:20,483 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:20,483 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:20,495 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B1F9E3804CC34061A7582FF4EAEB61F2, ordinal: 0
2016-01-15 00:00:20,496 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:20,496 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2016-01-15 00:00:20,496 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B1F9E3804CC34061A7582FF4EAEB61F2, mem on start (mb), free: 130, total: 583, max: 672
2016-01-15 00:00:20,498 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:20,498 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 130, total: 583, max: 672
2016-01-15 00:00:20,499 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:20,500 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 130, total: 583, max: 672
2016-01-15 00:00:20,501 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:20,501 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 130, total: 583, max: 672
2016-01-15 00:00:20,502 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:20,502 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 130, total: 583, max: 672
2016-01-15 00:00:20,503 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B1F9E3804CC34061A7582FF4EAEB61F2, mem on close (mb), free: 130, total: 583, max: 672
2016-01-15 00:00:20,515 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt
2016-01-15 00:00:20,632 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:20,632 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:20,643 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B1F9E3804CC34061A7582FF4EAEB61F2, ordinal: 0
2016-01-15 00:00:20,645 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt"]
2016-01-15 00:00:20,645 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2016-01-15 00:00:20,645 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B1F9E3804CC34061A7582FF4EAEB61F2, mem on start (mb), free: 77, total: 630, max: 672
2016-01-15 00:00:20,649 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:20,649 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 76, total: 630, max: 672
2016-01-15 00:00:20,650 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:20,651 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 76, total: 630, max: 672
2016-01-15 00:00:20,651 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:20,652 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 76, total: 630, max: 672
2016-01-15 00:00:20,652 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:20,653 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 76, total: 630, max: 672
2016-01-15 00:00:20,653 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B1F9E3804CC34061A7582FF4EAEB61F2, mem on close (mb), free: 76, total: 630, max: 672
2016-01-15 00:00:20,677 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:20,678 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:20,689 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C44446ED1351435BB600863D8174F1C0, ordinal: 1
2016-01-15 00:00:20,690 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2016-01-15 00:00:20,690 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageMerge/mergeaverage"]
2016-01-15 00:00:20,691 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C44446ED1351435BB600863D8174F1C0, mem on start (mb), free: 71, total: 630, max: 672
2016-01-15 00:00:20,702 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C44446ED1351435BB600863D8174F1C0, mem on close (mb), free: 71, total: 630, max: 672
2016-01-15 00:00:20,737 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageMerge/mergeaverage/_temporary
2016-01-15 00:00:20,737 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] completed in: 00:00.606
2016-01-15 00:00:20,788 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testAverageMerge/mergeaverage
2016-01-15 00:00:20,809 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:20,809 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:20,844 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.031
2016-01-15 00:00:20,845 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 00:00:20,846 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:20,861 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-15 00:00:20,862 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt"]
2016-01-15 00:00:20,862 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameAll/renameall"]
2016-01-15 00:00:20,863 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-15 00:00:20,863 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-15 00:00:20,863 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-15 00:00:20,864 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...m/testRenameAll/renameall
2016-01-15 00:00:20,939 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1273011922/.staging/job_local1273011922_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:20,940 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1273011922/.staging/job_local1273011922_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:21,012 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1273011922_0004/job_local1273011922_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:21,013 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1273011922_0004/job_local1273011922_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:21,015 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local1273011922_0004
2016-01-15 00:00:21,016 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-15 00:00:21,023 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt
2016-01-15 00:00:21,032 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:21,032 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:21,038 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DBB17B938D1E4409BAEE429A7D5CE477, ordinal: 0
2016-01-15 00:00:21,039 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt"]
2016-01-15 00:00:21,039 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameAll/renameall"]
2016-01-15 00:00:21,039 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DBB17B938D1E4409BAEE429A7D5CE477, mem on start (mb), free: 20, total: 630, max: 672
2016-01-15 00:00:21,041 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DBB17B938D1E4409BAEE429A7D5CE477, mem on close (mb), free: 20, total: 630, max: 672
2016-01-15 00:00:21,064 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameAll/renameall/_temporary
2016-01-15 00:00:21,065 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:00.203
2016-01-15 00:00:21,100 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testRenameAll/renameall
2016-01-15 00:00:21,124 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:21,124 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:21,207 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.077
2016-01-15 00:00:21,209 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 4
2016-01-15 00:00:21,209 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:21,464 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting
2016-01-15 00:00:21,465 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:21,465 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] sink: Hfs["TextDelimited[['count', 'count2']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountCount/countcount"]
2016-01-15 00:00:21,466 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] parallel execution of steps is enabled: false
2016-01-15 00:00:21,466 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executing total steps: 2
2016-01-15 00:00:21,466 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] allocating management threads: 1
2016-01-15 00:00:21,467 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (1/2)
2016-01-15 00:00:21,531 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1421834402/.staging/job_local1421834402_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:21,533 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1421834402/.staging/job_local1421834402_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:21,571 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1421834402_0005/job_local1421834402_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:21,572 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1421834402_0005/job_local1421834402_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:21,572 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local1421834402_0005
2016-01-15 00:00:21,573 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-15 00:00:21,578 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:21,593 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:21,593 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:21,601 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D529C723BC6E47B68C64150CCA624665, ordinal: 0
2016-01-15 00:00:21,602 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:21,602 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2016-01-15 00:00:21,602 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D529C723BC6E47B68C64150CCA624665, mem on start (mb), free: 100, total: 243, max: 672
2016-01-15 00:00:21,604 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:21,604 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 100, total: 243, max: 672
2016-01-15 00:00:21,604 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:21,605 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:21,605 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 100, total: 243, max: 672
2016-01-15 00:00:21,605 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:21,606 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:21,606 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 100, total: 243, max: 672
2016-01-15 00:00:21,606 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:21,607 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:21,607 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 100, total: 243, max: 672
2016-01-15 00:00:21,608 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:21,610 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D529C723BC6E47B68C64150CCA624665, mem on close (mb), free: 100, total: 243, max: 672
2016-01-15 00:00:21,628 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:21,628 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:21,640 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D8CD56D17DD94BC88B2DD376C1AC650E, ordinal: 1
2016-01-15 00:00:21,641 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2016-01-15 00:00:21,641 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['count', 'count2']]"][6596665100/count/]
2016-01-15 00:00:21,641 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D8CD56D17DD94BC88B2DD376C1AC650E, mem on start (mb), free: 93, total: 243, max: 672
2016-01-15 00:00:21,659 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:21,659 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 92, total: 243, max: 672
2016-01-15 00:00:21,659 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:21,660 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D8CD56D17DD94BC88B2DD376C1AC650E, mem on close (mb), free: 92, total: 243, max: 672
2016-01-15 00:00:21,683 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (2/2) ...testCountCount/countcount
2016-01-15 00:00:21,752 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity343362569/.staging/job_local343362569_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:21,753 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity343362569/.staging/job_local343362569_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:21,793 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local343362569_0006/job_local343362569_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:21,795 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local343362569_0006/job_local343362569_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:21,796 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local343362569_0006
2016-01-15 00:00:21,796 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-15 00:00:21,803 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/6596665100_count_E21CD90D35D446A4BB7D2BE7DD537D9A/part-00000
2016-01-15 00:00:21,908 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:21,908 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:21,916 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FBA8D00F01F94839B93019CA77C30E96, ordinal: 0
2016-01-15 00:00:21,916 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['count', 'count2']]"][6596665100/count/]
2016-01-15 00:00:21,917 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{1}:'count']]
2016-01-15 00:00:21,917 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FBA8D00F01F94839B93019CA77C30E96, mem on start (mb), free: 53, total: 344, max: 672
2016-01-15 00:00:21,918 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FBA8D00F01F94839B93019CA77C30E96, mem on close (mb), free: 53, total: 344, max: 672
2016-01-15 00:00:21,934 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:21,934 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:21,943 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C2F1D2175B2545E9A1A5B9F348A5EA44, ordinal: 1
2016-01-15 00:00:21,943 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{1}:'count']]
2016-01-15 00:00:21,944 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['count', 'count2']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountCount/countcount"]
2016-01-15 00:00:21,944 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C2F1D2175B2545E9A1A5B9F348A5EA44, mem on start (mb), free: 48, total: 344, max: 672
2016-01-15 00:00:21,952 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C2F1D2175B2545E9A1A5B9F348A5EA44, mem on close (mb), free: 46, total: 344, max: 672
2016-01-15 00:00:21,979 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountCount/countcount/_temporary
2016-01-15 00:00:21,980 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] completed in: 00:00.515
2016-01-15 00:00:22,027 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCountCount/countcount
2016-01-15 00:00:22,046 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:22,047 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:22,102 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.050
2016-01-15 00:00:22,103 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:22,104 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:22,124 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] starting
2016-01-15 00:00:22,124 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:22,124 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt"]
2016-01-15 00:00:22,125 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountMerge/mergecount"]
2016-01-15 00:00:22,125 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] parallel execution of steps is enabled: false
2016-01-15 00:00:22,125 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] executing total steps: 1
2016-01-15 00:00:22,125 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] allocating management threads: 1
2016-01-15 00:00:22,126 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] starting step: (1/1) ...testCountMerge/mergecount
2016-01-15 00:00:22,240 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1914100395/.staging/job_local1914100395_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:22,241 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1914100395/.staging/job_local1914100395_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:22,278 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1914100395_0007/job_local1914100395_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:22,280 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1914100395_0007/job_local1914100395_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:22,280 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] submitted hadoop job: job_local1914100395_0007
2016-01-15 00:00:22,281 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] tracking url: http://localhost:8080/
2016-01-15 00:00:22,286 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:22,302 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:22,302 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:22,313 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A70B3C98A3CF487E937CC69763D0B96C, ordinal: 0
2016-01-15 00:00:22,314 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:22,314 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-15 00:00:22,315 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A70B3C98A3CF487E937CC69763D0B96C, mem on start (mb), free: 169, total: 306, max: 672
2016-01-15 00:00:22,317 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:22,317 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 169, total: 306, max: 672
2016-01-15 00:00:22,317 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:22,318 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:22,319 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 169, total: 306, max: 672
2016-01-15 00:00:22,319 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:22,319 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:22,320 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 169, total: 306, max: 672
2016-01-15 00:00:22,320 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:22,321 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:22,321 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 169, total: 306, max: 672
2016-01-15 00:00:22,322 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:22,322 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A70B3C98A3CF487E937CC69763D0B96C, mem on close (mb), free: 169, total: 306, max: 672
2016-01-15 00:00:22,334 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt
2016-01-15 00:00:22,380 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:22,380 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:22,390 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A70B3C98A3CF487E937CC69763D0B96C, ordinal: 0
2016-01-15 00:00:22,390 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt"]
2016-01-15 00:00:22,391 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-15 00:00:22,391 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A70B3C98A3CF487E937CC69763D0B96C, mem on start (mb), free: 168, total: 407, max: 672
2016-01-15 00:00:22,395 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:22,395 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 168, total: 407, max: 672
2016-01-15 00:00:22,396 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:22,397 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:22,397 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 168, total: 407, max: 672
2016-01-15 00:00:22,397 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:22,399 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:22,399 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 168, total: 407, max: 672
2016-01-15 00:00:22,399 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:22,400 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:22,400 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 168, total: 407, max: 672
2016-01-15 00:00:22,401 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:22,402 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A70B3C98A3CF487E937CC69763D0B96C, mem on close (mb), free: 168, total: 407, max: 672
2016-01-15 00:00:22,421 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:22,421 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:22,430 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F0D97EB6809B43469770D1C3C918E3FB, ordinal: 1
2016-01-15 00:00:22,431 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-15 00:00:22,431 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountMerge/mergecount"]
2016-01-15 00:00:22,431 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F0D97EB6809B43469770D1C3C918E3FB, mem on start (mb), free: 163, total: 407, max: 672
2016-01-15 00:00:22,440 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F0D97EB6809B43469770D1C3C918E3FB, mem on close (mb), free: 162, total: 407, max: 672
2016-01-15 00:00:22,464 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountMerge/mergecount/_temporary
2016-01-15 00:00:22,465 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] completed in: 00:00.340
2016-01-15 00:00:22,509 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCountMerge/mergecount
2016-01-15 00:00:22,527 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:22,528 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:22,577 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.044
2016-01-15 00:00:22,578 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:22,578 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:22,602 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] starting
2016-01-15 00:00:22,603 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:22,603 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] sink: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByNullSafety/minbynullsafety"]
2016-01-15 00:00:22,603 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] parallel execution of steps is enabled: false
2016-01-15 00:00:22,604 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] executing total steps: 1
2016-01-15 00:00:22,604 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] allocating management threads: 1
2016-01-15 00:00:22,605 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] starting step: (1/1) ...ullSafety/minbynullsafety
2016-01-15 00:00:22,670 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1195052448/.staging/job_local1195052448_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:22,671 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1195052448/.staging/job_local1195052448_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:22,710 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1195052448_0008/job_local1195052448_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:22,711 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1195052448_0008/job_local1195052448_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:22,711 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] submitted hadoop job: job_local1195052448_0008
2016-01-15 00:00:22,712 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] tracking url: http://localhost:8080/
2016-01-15 00:00:22,717 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:22,821 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:22,821 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:22,828 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BBE6F21C91E14D358F70D97EFF03434D, ordinal: 0
2016-01-15 00:00:22,829 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:22,829 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(min)[by:[{1}:'char']]
2016-01-15 00:00:22,830 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BBE6F21C91E14D358F70D97EFF03434D, mem on start (mb), free: 111, total: 507, max: 672
2016-01-15 00:00:22,831 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:22,831 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 110, total: 507, max: 672
2016-01-15 00:00:22,832 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 75% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:22,833 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:22,833 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 110, total: 507, max: 672
2016-01-15 00:00:22,833 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 75% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:22,834 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:22,834 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 110, total: 507, max: 672
2016-01-15 00:00:22,834 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 75% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:22,835 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:22,835 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 110, total: 507, max: 672
2016-01-15 00:00:22,835 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 75% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-15 00:00:22,836 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BBE6F21C91E14D358F70D97EFF03434D, mem on close (mb), free: 110, total: 507, max: 672
2016-01-15 00:00:22,855 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:22,855 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:22,867 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E68550B96F534E6892D9ACA1FD0C05A1, ordinal: 1
2016-01-15 00:00:22,868 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(min)[by:[{1}:'char']]
2016-01-15 00:00:22,869 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByNullSafety/minbynullsafety"]
2016-01-15 00:00:22,869 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E68550B96F534E6892D9ACA1FD0C05A1, mem on start (mb), free: 106, total: 507, max: 672
2016-01-15 00:00:22,880 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E68550B96F534E6892D9ACA1FD0C05A1, mem on close (mb), free: 105, total: 507, max: 672
2016-01-15 00:00:22,903 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinByNullSafety/minbynullsafety/_temporary
2016-01-15 00:00:22,905 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] completed in: 00:00.301
2016-01-15 00:00:22,951 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMinByNullSafety/minbynullsafety
2016-01-15 00:00:22,968 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:22,968 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:23,013 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.040
2016-01-15 00:00:23,014 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:23,014 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:23,031 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting
2016-01-15 00:00:23,031 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:23,032 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] sink: Hfs["TextDelimited[['num', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByString/maxbystring"]
2016-01-15 00:00:23,032 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] parallel execution of steps is enabled: false
2016-01-15 00:00:23,032 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executing total steps: 1
2016-01-15 00:00:23,032 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] allocating management threads: 1
2016-01-15 00:00:23,032 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting step: (1/1) ...stMaxByString/maxbystring
2016-01-15 00:00:23,116 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1835534244/.staging/job_local1835534244_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:23,117 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1835534244/.staging/job_local1835534244_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:23,152 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1835534244_0009/job_local1835534244_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:23,153 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1835534244_0009/job_local1835534244_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:23,153 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] submitted hadoop job: job_local1835534244_0009
2016-01-15 00:00:23,154 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] tracking url: http://localhost:8080/
2016-01-15 00:00:23,159 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:23,262 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:23,263 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:23,269 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E9A5102AC5D34C33914C22A2DBE1F3D9, ordinal: 0
2016-01-15 00:00:23,269 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:23,269 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2016-01-15 00:00:23,270 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E9A5102AC5D34C33914C22A2DBE1F3D9, mem on start (mb), free: 170, total: 608, max: 672
2016-01-15 00:00:23,272 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:23,272 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 169, total: 608, max: 672
2016-01-15 00:00:23,273 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:23,273 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 169, total: 608, max: 672
2016-01-15 00:00:23,274 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E9A5102AC5D34C33914C22A2DBE1F3D9, mem on close (mb), free: 169, total: 608, max: 672
2016-01-15 00:00:23,288 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:23,288 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:23,295 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F53F3A15025944239D08CB849B17C859, ordinal: 1
2016-01-15 00:00:23,295 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2016-01-15 00:00:23,296 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['num', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByString/maxbystring"]
2016-01-15 00:00:23,296 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F53F3A15025944239D08CB849B17C859, mem on start (mb), free: 164, total: 608, max: 672
2016-01-15 00:00:23,304 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F53F3A15025944239D08CB849B17C859, mem on close (mb), free: 164, total: 608, max: 672
2016-01-15 00:00:23,325 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByString/maxbystring/_temporary
2016-01-15 00:00:23,326 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] completed in: 00:00.293
2016-01-15 00:00:23,385 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMaxByString/maxbystring
2016-01-15 00:00:23,410 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:23,411 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:23,445 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-15 00:00:23,446 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:23,447 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:23,468 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-15 00:00:23,469 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] source: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2016-01-15 00:00:23,470 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstBy/firstnfields"]
2016-01-15 00:00:23,470 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] parallel execution of steps is enabled: false
2016-01-15 00:00:23,470 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executing total steps: 1
2016-01-15 00:00:23,470 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] allocating management threads: 1
2016-01-15 00:00:23,472 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) .../testFirstBy/firstnfields
2016-01-15 00:00:23,533 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1548315485/.staging/job_local1548315485_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:23,533 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1548315485/.staging/job_local1548315485_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:23,571 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1548315485_0010/job_local1548315485_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:23,573 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1548315485_0010/job_local1548315485_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:23,573 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted hadoop job: job_local1548315485_0010
2016-01-15 00:00:23,574 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tracking url: http://localhost:8080/
2016-01-15 00:00:23,578 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2016-01-15 00:00:23,601 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:23,602 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:23,608 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F669F1789ADF4032AEC701F868522D93, ordinal: 0
2016-01-15 00:00:23,608 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2016-01-15 00:00:23,609 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(first)[by:[{1}:'num']]
2016-01-15 00:00:23,609 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F669F1789ADF4032AEC701F868522D93, mem on start (mb), free: 151, total: 666, max: 672
2016-01-15 00:00:23,612 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:23,612 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 151, total: 666, max: 672
2016-01-15 00:00:23,614 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:23,614 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 151, total: 666, max: 672
2016-01-15 00:00:23,615 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F669F1789ADF4032AEC701F868522D93, mem on close (mb), free: 151, total: 666, max: 672
2016-01-15 00:00:23,633 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:23,633 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:23,643 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: ED880F9A01994CB0A8A39DE75783647A, ordinal: 1
2016-01-15 00:00:23,644 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(first)[by:[{1}:'num']]
2016-01-15 00:00:23,645 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstBy/firstnfields"]
2016-01-15 00:00:23,645 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ED880F9A01994CB0A8A39DE75783647A, mem on start (mb), free: 145, total: 666, max: 672
2016-01-15 00:00:23,654 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ED880F9A01994CB0A8A39DE75783647A, mem on close (mb), free: 145, total: 666, max: 672
2016-01-15 00:00:23,673 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstBy/firstnfields/_temporary
2016-01-15 00:00:23,673 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] completed in: 00:00.205
2016-01-15 00:00:23,695 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testFirstBy/firstnfields
2016-01-15 00:00:23,716 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:23,716 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:23,752 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.030
2016-01-15 00:00:23,753 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 00:00:23,753 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:23,765 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] starting
2016-01-15 00:00:23,765 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt"]
2016-01-15 00:00:23,766 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] sink: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerceFields/coercefields"]
2016-01-15 00:00:23,766 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] parallel execution of steps is enabled: false
2016-01-15 00:00:23,766 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] executing total steps: 1
2016-01-15 00:00:23,767 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] allocating management threads: 1
2016-01-15 00:00:23,767 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] starting step: (1/1) ...CoerceFields/coercefields
2016-01-15 00:00:23,833 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity962640566/.staging/job_local962640566_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:23,834 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity962640566/.staging/job_local962640566_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:23,883 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local962640566_0011/job_local962640566_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:23,884 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local962640566_0011/job_local962640566_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:23,885 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] submitted hadoop job: job_local962640566_0011
2016-01-15 00:00:23,885 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] tracking url: http://localhost:8080/
2016-01-15 00:00:23,889 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt
2016-01-15 00:00:23,895 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:23,896 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:23,902 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: ACC8CBCA0F7940B881498ED87E80749D, ordinal: 0
2016-01-15 00:00:23,903 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt"]
2016-01-15 00:00:23,904 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerceFields/coercefields"]
2016-01-15 00:00:23,904 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: ACC8CBCA0F7940B881498ED87E80749D, mem on start (mb), free: 248, total: 666, max: 672
2016-01-15 00:00:23,911 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: ACC8CBCA0F7940B881498ED87E80749D, mem on close (mb), free: 248, total: 666, max: 672
2016-01-15 00:00:23,929 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerceFields/coercefields/_temporary
2016-01-15 00:00:23,929 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] completed in: 00:00.164
2016-01-15 00:00:23,951 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCoerceFields/coercefields
2016-01-15 00:00:23,970 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:23,971 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:24,011 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.035
2016-01-15 00:00:24,011 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:24,011 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:24,027 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting
2016-01-15 00:00:24,027 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:24,027 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCount/count"]
2016-01-15 00:00:24,027 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] parallel execution of steps is enabled: false
2016-01-15 00:00:24,027 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executing total steps: 1
2016-01-15 00:00:24,027 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] allocating management threads: 1
2016-01-15 00:00:24,028 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (1/1) ...splatform/testCount/count
2016-01-15 00:00:24,085 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity2146258923/.staging/job_local2146258923_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:24,086 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity2146258923/.staging/job_local2146258923_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:24,125 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2146258923_0012/job_local2146258923_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:24,126 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2146258923_0012/job_local2146258923_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:24,127 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local2146258923_0012
2016-01-15 00:00:24,127 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-15 00:00:24,132 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:24,154 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:24,154 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:24,165 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C0A7A6FF98BD474CA6F6597E0DD9459D, ordinal: 0
2016-01-15 00:00:24,165 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:24,166 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2016-01-15 00:00:24,166 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C0A7A6FF98BD474CA6F6597E0DD9459D, mem on start (mb), free: 197, total: 712, max: 712
2016-01-15 00:00:24,168 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:24,168 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 197, total: 712, max: 712
2016-01-15 00:00:24,170 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:24,170 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 197, total: 712, max: 712
2016-01-15 00:00:24,171 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:24,171 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 197, total: 712, max: 712
2016-01-15 00:00:24,171 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:24,172 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 197, total: 712, max: 712
2016-01-15 00:00:24,173 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C0A7A6FF98BD474CA6F6597E0DD9459D, mem on close (mb), free: 197, total: 712, max: 712
2016-01-15 00:00:24,188 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:24,188 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:24,195 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D5AE5CBA56E845A9A8FBA2B617FA459C, ordinal: 1
2016-01-15 00:00:24,195 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2016-01-15 00:00:24,195 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCount/count"]
2016-01-15 00:00:24,195 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D5AE5CBA56E845A9A8FBA2B617FA459C, mem on start (mb), free: 191, total: 712, max: 712
2016-01-15 00:00:24,203 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D5AE5CBA56E845A9A8FBA2B617FA459C, mem on close (mb), free: 190, total: 712, max: 712
2016-01-15 00:00:24,226 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCount/count/_temporary
2016-01-15 00:00:24,226 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] completed in: 00:00.198
2016-01-15 00:00:24,274 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCount/count
2016-01-15 00:00:24,293 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:24,293 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:24,322 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.026
2016-01-15 00:00:24,323 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:24,323 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:24,336 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting
2016-01-15 00:00:24,336 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:24,337 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] sink: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxBy/maxby"]
2016-01-15 00:00:24,337 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] parallel execution of steps is enabled: false
2016-01-15 00:00:24,337 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executing total steps: 1
2016-01-15 00:00:24,337 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] allocating management threads: 1
2016-01-15 00:00:24,338 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting step: (1/1) ...splatform/testMaxBy/maxby
2016-01-15 00:00:24,394 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity778698921/.staging/job_local778698921_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:24,395 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity778698921/.staging/job_local778698921_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:24,440 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local778698921_0013/job_local778698921_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:24,441 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local778698921_0013/job_local778698921_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:24,442 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] submitted hadoop job: job_local778698921_0013
2016-01-15 00:00:24,442 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] tracking url: http://localhost:8080/
2016-01-15 00:00:24,447 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:24,469 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:24,469 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:24,475 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AABEDC215B7E46A68A4354CECC996CD5, ordinal: 0
2016-01-15 00:00:24,476 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:24,477 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(max)[by:[{1}:'char']]
2016-01-15 00:00:24,477 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AABEDC215B7E46A68A4354CECC996CD5, mem on start (mb), free: 198, total: 712, max: 712
2016-01-15 00:00:24,479 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:24,479 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 712, max: 712
2016-01-15 00:00:24,480 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:24,480 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 712, max: 712
2016-01-15 00:00:24,481 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:24,481 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 712, max: 712
2016-01-15 00:00:24,482 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:24,483 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 197, total: 712, max: 712
2016-01-15 00:00:24,483 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AABEDC215B7E46A68A4354CECC996CD5, mem on close (mb), free: 197, total: 712, max: 712
2016-01-15 00:00:24,498 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:24,498 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:24,505 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: AE3178495B684AE887CA45012603ED7D, ordinal: 1
2016-01-15 00:00:24,505 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(max)[by:[{1}:'char']]
2016-01-15 00:00:24,506 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxBy/maxby"]
2016-01-15 00:00:24,507 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AE3178495B684AE887CA45012603ED7D, mem on start (mb), free: 192, total: 712, max: 712
2016-01-15 00:00:24,514 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AE3178495B684AE887CA45012603ED7D, mem on close (mb), free: 191, total: 712, max: 712
2016-01-15 00:00:24,531 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxBy/maxby/_temporary
2016-01-15 00:00:24,532 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] completed in: 00:00.195
2016-01-15 00:00:24,576 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMaxBy/maxby
2016-01-15 00:00:24,593 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:24,594 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:24,622 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.024
2016-01-15 00:00:24,622 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:24,623 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:24,634 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] starting
2016-01-15 00:00:24,634 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:24,634 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] sink: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinBy/minby"]
2016-01-15 00:00:24,635 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] parallel execution of steps is enabled: false
2016-01-15 00:00:24,635 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] executing total steps: 1
2016-01-15 00:00:24,635 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] allocating management threads: 1
2016-01-15 00:00:24,636 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] starting step: (1/1) ...splatform/testMinBy/minby
2016-01-15 00:00:24,692 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1789042309/.staging/job_local1789042309_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:24,693 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1789042309/.staging/job_local1789042309_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:24,730 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1789042309_0014/job_local1789042309_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:24,732 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1789042309_0014/job_local1789042309_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:24,733 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] submitted hadoop job: job_local1789042309_0014
2016-01-15 00:00:24,733 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] tracking url: http://localhost:8080/
2016-01-15 00:00:24,739 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:24,760 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:24,760 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:24,766 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F41BE06626D649DD8A2B35623F437F8F, ordinal: 0
2016-01-15 00:00:24,766 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:24,767 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(min)[by:[{1}:'char']]
2016-01-15 00:00:24,767 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F41BE06626D649DD8A2B35623F437F8F, mem on start (mb), free: 227, total: 741, max: 741
2016-01-15 00:00:24,769 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:24,769 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 227, total: 741, max: 741
2016-01-15 00:00:24,770 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:24,770 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 227, total: 741, max: 741
2016-01-15 00:00:24,771 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:24,771 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 227, total: 741, max: 741
2016-01-15 00:00:24,772 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:24,772 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 227, total: 741, max: 741
2016-01-15 00:00:24,773 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F41BE06626D649DD8A2B35623F437F8F, mem on close (mb), free: 227, total: 741, max: 741
2016-01-15 00:00:24,790 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:24,790 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:24,796 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CBB4398F9AFF4D53A06E535C1603D796, ordinal: 1
2016-01-15 00:00:24,797 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(min)[by:[{1}:'char']]
2016-01-15 00:00:24,797 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinBy/minby"]
2016-01-15 00:00:24,798 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CBB4398F9AFF4D53A06E535C1603D796, mem on start (mb), free: 222, total: 741, max: 741
2016-01-15 00:00:24,806 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CBB4398F9AFF4D53A06E535C1603D796, mem on close (mb), free: 221, total: 741, max: 741
2016-01-15 00:00:24,824 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMinBy/minby/_temporary
2016-01-15 00:00:24,825 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] completed in: 00:00.190
2016-01-15 00:00:24,873 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMinBy/minby
2016-01-15 00:00:24,886 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:24,886 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:24,913 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.023
2016-01-15 00:00:24,914 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:24,914 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:24,924 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] starting
2016-01-15 00:00:24,925 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:24,925 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumBy/sum"]
2016-01-15 00:00:24,926 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] parallel execution of steps is enabled: false
2016-01-15 00:00:24,926 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] executing total steps: 1
2016-01-15 00:00:24,926 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] allocating management threads: 1
2016-01-15 00:00:24,928 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] starting step: (1/1) ...ersplatform/testSumBy/sum
2016-01-15 00:00:24,981 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1057864987/.staging/job_local1057864987_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:24,982 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1057864987/.staging/job_local1057864987_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:25,014 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1057864987_0015/job_local1057864987_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:25,015 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1057864987_0015/job_local1057864987_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:25,015 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] submitted hadoop job: job_local1057864987_0015
2016-01-15 00:00:25,016 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] tracking url: http://localhost:8080/
2016-01-15 00:00:25,020 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:25,040 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:25,040 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:25,046 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BAA635AC28FB4069AC6326B7A8E7C143, ordinal: 0
2016-01-15 00:00:25,047 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:25,047 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2016-01-15 00:00:25,047 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BAA635AC28FB4069AC6326B7A8E7C143, mem on start (mb), free: 227, total: 741, max: 741
2016-01-15 00:00:25,049 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:25,049 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 227, total: 741, max: 741
2016-01-15 00:00:25,049 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:25,050 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 227, total: 741, max: 741
2016-01-15 00:00:25,050 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:25,050 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 227, total: 741, max: 741
2016-01-15 00:00:25,051 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:25,051 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 227, total: 741, max: 741
2016-01-15 00:00:25,051 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BAA635AC28FB4069AC6326B7A8E7C143, mem on close (mb), free: 227, total: 741, max: 741
2016-01-15 00:00:25,065 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:25,065 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:25,071 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B9B7CA1800E5487EB0F3B8809DDF81FE, ordinal: 1
2016-01-15 00:00:25,072 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2016-01-15 00:00:25,072 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumBy/sum"]
2016-01-15 00:00:25,072 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B9B7CA1800E5487EB0F3B8809DDF81FE, mem on start (mb), free: 221, total: 741, max: 741
2016-01-15 00:00:25,079 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B9B7CA1800E5487EB0F3B8809DDF81FE, mem on close (mb), free: 221, total: 741, max: 741
2016-01-15 00:00:25,095 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumBy/sum/_temporary
2016-01-15 00:00:25,095 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] completed in: 00:00.171
2016-01-15 00:00:25,137 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testSumBy/sum
2016-01-15 00:00:25,155 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:25,155 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:25,193 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.035
2016-01-15 00:00:25,193 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:25,194 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:25,205 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] starting
2016-01-15 00:00:25,205 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt"]
2016-01-15 00:00:25,205 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:25,205 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumMerge/mergesum"]
2016-01-15 00:00:25,205 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] parallel execution of steps is enabled: false
2016-01-15 00:00:25,205 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] executing total steps: 1
2016-01-15 00:00:25,205 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] allocating management threads: 1
2016-01-15 00:00:25,206 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] starting step: (1/1) ...orm/testSumMerge/mergesum
2016-01-15 00:00:25,262 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity108924537/.staging/job_local108924537_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:25,263 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity108924537/.staging/job_local108924537_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:25,294 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local108924537_0016/job_local108924537_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:25,295 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local108924537_0016/job_local108924537_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:25,296 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] submitted hadoop job: job_local108924537_0016
2016-01-15 00:00:25,296 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] tracking url: http://localhost:8080/
2016-01-15 00:00:25,300 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:25,319 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:25,319 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:25,325 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E5F206D17AEC412D8B3565095560B5D9, ordinal: 0
2016-01-15 00:00:25,326 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:25,326 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2016-01-15 00:00:25,326 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E5F206D17AEC412D8B3565095560B5D9, mem on start (mb), free: 228, total: 742, max: 742
2016-01-15 00:00:25,327 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:25,328 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 228, total: 742, max: 742
2016-01-15 00:00:25,328 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:25,328 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 228, total: 742, max: 742
2016-01-15 00:00:25,329 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:25,329 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 228, total: 742, max: 742
2016-01-15 00:00:25,330 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:25,330 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 228, total: 742, max: 742
2016-01-15 00:00:25,330 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E5F206D17AEC412D8B3565095560B5D9, mem on close (mb), free: 228, total: 742, max: 742
2016-01-15 00:00:25,338 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt
2016-01-15 00:00:25,383 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:25,383 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:25,391 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E5F206D17AEC412D8B3565095560B5D9, ordinal: 0
2016-01-15 00:00:25,392 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt"]
2016-01-15 00:00:25,393 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2016-01-15 00:00:25,393 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E5F206D17AEC412D8B3565095560B5D9, mem on start (mb), free: 126, total: 742, max: 742
2016-01-15 00:00:25,396 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:25,397 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 126, total: 742, max: 742
2016-01-15 00:00:25,397 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:25,397 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 126, total: 742, max: 742
2016-01-15 00:00:25,398 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:25,399 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 126, total: 742, max: 742
2016-01-15 00:00:25,399 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:25,399 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 126, total: 742, max: 742
2016-01-15 00:00:25,400 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E5F206D17AEC412D8B3565095560B5D9, mem on close (mb), free: 126, total: 742, max: 742
2016-01-15 00:00:25,418 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:25,419 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:25,425 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: EBFCB74F231849E98CB026DB4DDF9E9D, ordinal: 1
2016-01-15 00:00:25,426 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2016-01-15 00:00:25,426 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumMerge/mergesum"]
2016-01-15 00:00:25,426 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EBFCB74F231849E98CB026DB4DDF9E9D, mem on start (mb), free: 120, total: 742, max: 742
2016-01-15 00:00:25,434 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EBFCB74F231849E98CB026DB4DDF9E9D, mem on close (mb), free: 119, total: 742, max: 742
2016-01-15 00:00:25,456 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumMerge/mergesum/_temporary
2016-01-15 00:00:25,456 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] completed in: 00:00.251
2016-01-15 00:00:25,505 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testSumMerge/mergesum
2016-01-15 00:00:25,526 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:25,526 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:25,546 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-15 00:00:25,547 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 00:00:25,547 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:25,554 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-15 00:00:25,554 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt"]
2016-01-15 00:00:25,554 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testDiscardNarrow/discardnarrow"]
2016-01-15 00:00:25,554 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-15 00:00:25,554 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-15 00:00:25,554 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-15 00:00:25,555 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...scardNarrow/discardnarrow
2016-01-15 00:00:25,613 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1953267469/.staging/job_local1953267469_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:25,614 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1953267469/.staging/job_local1953267469_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:25,646 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1953267469_0017/job_local1953267469_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:25,647 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1953267469_0017/job_local1953267469_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:25,648 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local1953267469_0017
2016-01-15 00:00:25,648 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-15 00:00:25,653 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt
2016-01-15 00:00:25,658 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:25,659 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:25,663 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F314BFCDAC534B69A42B6AD59DF43047, ordinal: 0
2016-01-15 00:00:25,664 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt"]
2016-01-15 00:00:25,664 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testDiscardNarrow/discardnarrow"]
2016-01-15 00:00:25,664 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F314BFCDAC534B69A42B6AD59DF43047, mem on start (mb), free: 292, total: 742, max: 742
2016-01-15 00:00:25,666 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F314BFCDAC534B69A42B6AD59DF43047, mem on close (mb), free: 292, total: 742, max: 742
2016-01-15 00:00:25,681 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testDiscardNarrow/discardnarrow/_temporary
2016-01-15 00:00:25,684 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:00.127
2016-01-15 00:00:25,712 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testDiscardNarrow/discardnarrow
2016-01-15 00:00:25,729 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:25,730 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:25,782 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.048
2016-01-15 00:00:25,783 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:25,784 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:25,804 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-15 00:00:25,804 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:25,805 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt"]
2016-01-15 00:00:25,805 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMergeLegacyHash/multimerge+true599"]
2016-01-15 00:00:25,805 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] parallel execution of steps is enabled: false
2016-01-15 00:00:25,805 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executing total steps: 1
2016-01-15 00:00:25,805 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] allocating management threads: 1
2016-01-15 00:00:25,806 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...cyHash/multimerge+true599
2016-01-15 00:00:25,864 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity2145155901/.staging/job_local2145155901_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:25,865 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity2145155901/.staging/job_local2145155901_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:25,898 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2145155901_0018/job_local2145155901_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:25,899 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2145155901_0018/job_local2145155901_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:25,900 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local2145155901_0018
2016-01-15 00:00:25,900 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-15 00:00:25,904 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:25,919 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:25,919 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:25,927 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E76ACEC2C951495AA483717D6DA34C86, ordinal: 0
2016-01-15 00:00:25,928 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:25,928 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-15 00:00:25,928 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E76ACEC2C951495AA483717D6DA34C86, mem on start (mb), free: 143, total: 742, max: 742
2016-01-15 00:00:25,930 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:25,930 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 142, total: 742, max: 742
2016-01-15 00:00:25,931 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:25,931 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 142, total: 742, max: 742
2016-01-15 00:00:25,932 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:25,932 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 142, total: 742, max: 742
2016-01-15 00:00:25,932 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:25,932 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 142, total: 742, max: 742
2016-01-15 00:00:25,933 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E76ACEC2C951495AA483717D6DA34C86, mem on close (mb), free: 142, total: 742, max: 742
2016-01-15 00:00:25,941 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt
2016-01-15 00:00:25,963 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:25,964 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:25,971 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E76ACEC2C951495AA483717D6DA34C86, ordinal: 0
2016-01-15 00:00:25,972 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt"]
2016-01-15 00:00:25,972 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-15 00:00:25,972 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E76ACEC2C951495AA483717D6DA34C86, mem on start (mb), free: 228, total: 742, max: 742
2016-01-15 00:00:25,976 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:25,976 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 228, total: 742, max: 742
2016-01-15 00:00:25,977 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:25,977 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 228, total: 742, max: 742
2016-01-15 00:00:25,979 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:25,979 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 228, total: 742, max: 742
2016-01-15 00:00:25,979 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:25,980 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 228, total: 742, max: 742
2016-01-15 00:00:25,981 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E76ACEC2C951495AA483717D6DA34C86, mem on close (mb), free: 228, total: 742, max: 742
2016-01-15 00:00:25,998 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:25,998 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:26,006 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: ED6C1055EBC74B2D929D838E58589D37, ordinal: 1
2016-01-15 00:00:26,007 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2016-01-15 00:00:26,007 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMergeLegacyHash/multimerge+true599"]
2016-01-15 00:00:26,007 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ED6C1055EBC74B2D929D838E58589D37, mem on start (mb), free: 221, total: 742, max: 742
2016-01-15 00:00:26,016 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ED6C1055EBC74B2D929D838E58589D37, mem on close (mb), free: 220, total: 742, max: 742
2016-01-15 00:00:26,033 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMergeLegacyHash/multimerge+true599/_temporary
2016-01-15 00:00:26,034 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] completed in: 00:00.229
2016-01-15 00:00:26,075 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMergeLegacyHash/multimerge+true599
2016-01-15 00:00:26,086 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:26,087 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:26,117 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.026
2016-01-15 00:00:26,118 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 00:00:26,118 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:26,127 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-15 00:00:26,127 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt"]
2016-01-15 00:00:26,127 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNamed/rename"]
2016-01-15 00:00:26,128 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-15 00:00:26,128 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-15 00:00:26,128 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-15 00:00:26,129 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...rm/testRenameNamed/rename
2016-01-15 00:00:26,195 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1463356414/.staging/job_local1463356414_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:26,197 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1463356414/.staging/job_local1463356414_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:26,236 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1463356414_0019/job_local1463356414_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:26,237 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1463356414_0019/job_local1463356414_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:26,238 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local1463356414_0019
2016-01-15 00:00:26,238 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-15 00:00:26,243 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt
2016-01-15 00:00:26,250 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:26,250 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:26,255 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D7076F1E98B5472783014982E6EBFDAE, ordinal: 0
2016-01-15 00:00:26,256 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt"]
2016-01-15 00:00:26,256 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNamed/rename"]
2016-01-15 00:00:26,256 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D7076F1E98B5472783014982E6EBFDAE, mem on start (mb), free: 166, total: 742, max: 742
2016-01-15 00:00:26,258 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D7076F1E98B5472783014982E6EBFDAE, mem on close (mb), free: 166, total: 742, max: 742
2016-01-15 00:00:26,272 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNamed/rename/_temporary
2016-01-15 00:00:26,273 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:00.145
2016-01-15 00:00:26,302 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testRenameNamed/rename
2016-01-15 00:00:26,317 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:26,317 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:26,371 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.050
2016-01-15 00:00:26,373 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:26,373 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:26,391 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-15 00:00:26,392 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:26,392 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt"]
2016-01-15 00:00:26,392 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMerge/multimerge+true598"]
2016-01-15 00:00:26,393 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] parallel execution of steps is enabled: false
2016-01-15 00:00:26,393 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executing total steps: 1
2016-01-15 00:00:26,393 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] allocating management threads: 1
2016-01-15 00:00:26,394 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...rMerge/multimerge+true598
2016-01-15 00:00:26,466 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1006484094/.staging/job_local1006484094_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:26,467 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1006484094/.staging/job_local1006484094_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:26,504 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1006484094_0020/job_local1006484094_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:26,505 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1006484094_0020/job_local1006484094_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:26,505 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local1006484094_0020
2016-01-15 00:00:26,505 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-15 00:00:26,509 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:26,531 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:26,531 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:26,539 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: CBCCDEE651394123AD3B737AE8C1D2F7, ordinal: 0
2016-01-15 00:00:26,540 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:26,540 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-15 00:00:26,541 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CBCCDEE651394123AD3B737AE8C1D2F7, mem on start (mb), free: 228, total: 743, max: 743
2016-01-15 00:00:26,542 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:26,543 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 228, total: 743, max: 743
2016-01-15 00:00:26,544 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:26,544 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 228, total: 743, max: 743
2016-01-15 00:00:26,545 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:26,546 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 228, total: 743, max: 743
2016-01-15 00:00:26,547 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:26,547 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 228, total: 743, max: 743
2016-01-15 00:00:26,548 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CBCCDEE651394123AD3B737AE8C1D2F7, mem on close (mb), free: 228, total: 743, max: 743
2016-01-15 00:00:26,555 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt
2016-01-15 00:00:26,570 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:26,571 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:26,577 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: CBCCDEE651394123AD3B737AE8C1D2F7, ordinal: 0
2016-01-15 00:00:26,578 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt"]
2016-01-15 00:00:26,578 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-15 00:00:26,579 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CBCCDEE651394123AD3B737AE8C1D2F7, mem on start (mb), free: 126, total: 743, max: 743
2016-01-15 00:00:26,582 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:26,582 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 126, total: 743, max: 743
2016-01-15 00:00:26,583 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:26,584 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 126, total: 743, max: 743
2016-01-15 00:00:26,584 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:26,585 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 126, total: 743, max: 743
2016-01-15 00:00:26,585 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:26,586 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 126, total: 743, max: 743
2016-01-15 00:00:26,586 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CBCCDEE651394123AD3B737AE8C1D2F7, mem on close (mb), free: 126, total: 743, max: 743
2016-01-15 00:00:26,602 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:26,603 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:26,609 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: EE46676853344ECFA628C720EA842A0C, ordinal: 1
2016-01-15 00:00:26,610 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2016-01-15 00:00:26,610 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMerge/multimerge+true598"]
2016-01-15 00:00:26,610 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EE46676853344ECFA628C720EA842A0C, mem on start (mb), free: 119, total: 743, max: 743
2016-01-15 00:00:26,619 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EE46676853344ECFA628C720EA842A0C, mem on close (mb), free: 118, total: 743, max: 743
2016-01-15 00:00:26,637 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMerge/multimerge+true598/_temporary
2016-01-15 00:00:26,638 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] completed in: 00:00.246
2016-01-15 00:00:26,692 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesPriorMerge/multimerge+true598
2016-01-15 00:00:26,716 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:26,716 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:26,766 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.046
2016-01-15 00:00:26,767 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 4
2016-01-15 00:00:26,768 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:26,789 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting
2016-01-15 00:00:26,789 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:26,789 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMerge/samesourcemergecount"]
2016-01-15 00:00:26,790 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] parallel execution of steps is enabled: false
2016-01-15 00:00:26,790 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executing total steps: 2
2016-01-15 00:00:26,790 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] allocating management threads: 1
2016-01-15 00:00:26,791 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting step: (1/2)
2016-01-15 00:00:26,845 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1760731227/.staging/job_local1760731227_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:26,846 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1760731227/.staging/job_local1760731227_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:26,877 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1760731227_0021/job_local1760731227_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:26,878 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1760731227_0021/job_local1760731227_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:26,878 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] submitted hadoop job: job_local1760731227_0021
2016-01-15 00:00:26,879 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tracking url: http://localhost:8080/
2016-01-15 00:00:26,882 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:26,897 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:26,897 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:26,902 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E4AEC03B7EF04E99A304D15D227CC09E, ordinal: 0
2016-01-15 00:00:26,903 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:26,903 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(first)[by:[{1}:'char']]
2016-01-15 00:00:26,904 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E4AEC03B7EF04E99A304D15D227CC09E, mem on start (mb), free: 188, total: 743, max: 743
2016-01-15 00:00:26,907 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:26,907 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 188, total: 743, max: 743
2016-01-15 00:00:26,908 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:26,908 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 188, total: 743, max: 743
2016-01-15 00:00:26,909 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:26,909 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 188, total: 743, max: 743
2016-01-15 00:00:26,910 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:26,910 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 188, total: 743, max: 743
2016-01-15 00:00:26,910 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E4AEC03B7EF04E99A304D15D227CC09E, mem on close (mb), free: 188, total: 743, max: 743
2016-01-15 00:00:26,923 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:26,924 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:26,928 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: AF6A314909074366BBF7E214D51616F2, ordinal: 1
2016-01-15 00:00:26,929 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(first)[by:[{1}:'char']]
2016-01-15 00:00:26,929 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][5119173804/first/]
2016-01-15 00:00:26,929 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AF6A314909074366BBF7E214D51616F2, mem on start (mb), free: 181, total: 743, max: 743
2016-01-15 00:00:26,936 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AF6A314909074366BBF7E214D51616F2, mem on close (mb), free: 180, total: 743, max: 743
2016-01-15 00:00:26,950 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting step: (2/2) ...erge/samesourcemergecount
2016-01-15 00:00:27,012 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity2089099513/.staging/job_local2089099513_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:27,013 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity2089099513/.staging/job_local2089099513_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:27,045 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2089099513_0022/job_local2089099513_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:27,046 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2089099513_0022/job_local2089099513_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:27,047 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] submitted hadoop job: job_local2089099513_0022
2016-01-15 00:00:27,047 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tracking url: http://localhost:8080/
2016-01-15 00:00:27,051 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/5119173804_first_1BD221E9A66146D98550BF73B7C6EBE2/part-00000
2016-01-15 00:00:27,074 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:27,074 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:27,079 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C1EC1EC76C494F06ABD95A2692CBFA22, ordinal: 0
2016-01-15 00:00:27,079 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][5119173804/first/]
2016-01-15 00:00:27,080 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(second)[by:[{1}:'char']]
2016-01-15 00:00:27,080 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C1EC1EC76C494F06ABD95A2692CBFA22, mem on start (mb), free: 228, total: 743, max: 743
2016-01-15 00:00:27,081 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:27,081 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 228, total: 743, max: 743
2016-01-15 00:00:27,081 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:27,082 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 228, total: 743, max: 743
2016-01-15 00:00:27,082 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C1EC1EC76C494F06ABD95A2692CBFA22, mem on close (mb), free: 228, total: 743, max: 743
2016-01-15 00:00:27,097 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:27,097 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:27,105 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: FAE4AC3550D24B569D29306216CE368D, ordinal: 1
2016-01-15 00:00:27,106 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(second)[by:[{1}:'char']]
2016-01-15 00:00:27,107 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMerge/samesourcemergecount"]
2016-01-15 00:00:27,107 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FAE4AC3550D24B569D29306216CE368D, mem on start (mb), free: 222, total: 743, max: 743
2016-01-15 00:00:27,115 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FAE4AC3550D24B569D29306216CE368D, mem on close (mb), free: 221, total: 743, max: 743
2016-01-15 00:00:27,136 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMerge/samesourcemergecount/_temporary
2016-01-15 00:00:27,137 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] completed in: 00:00.347
2016-01-15 00:00:27,184 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testSameSourceMerge/samesourcemergecount
2016-01-15 00:00:27,197 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:27,197 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:27,216 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.016
2016-01-15 00:00:27,217 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:27,217 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:27,225 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] starting
2016-01-15 00:00:27,225 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:27,225 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageBy/average"]
2016-01-15 00:00:27,226 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] parallel execution of steps is enabled: false
2016-01-15 00:00:27,226 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] executing total steps: 1
2016-01-15 00:00:27,226 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] allocating management threads: 1
2016-01-15 00:00:27,227 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] starting step: (1/1) ...orm/testAverageBy/average
2016-01-15 00:00:27,280 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity626769331/.staging/job_local626769331_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:27,281 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity626769331/.staging/job_local626769331_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:27,313 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local626769331_0023/job_local626769331_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:27,313 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local626769331_0023/job_local626769331_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:27,314 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] submitted hadoop job: job_local626769331_0023
2016-01-15 00:00:27,314 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] tracking url: http://localhost:8080/
2016-01-15 00:00:27,318 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:27,339 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:27,339 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:27,343 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: CB24D8AACC614A5FB449C8C93AEEE69B, ordinal: 0
2016-01-15 00:00:27,343 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:27,343 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2016-01-15 00:00:27,344 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CB24D8AACC614A5FB449C8C93AEEE69B, mem on start (mb), free: 230, total: 744, max: 744
2016-01-15 00:00:27,345 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:27,345 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 230, total: 744, max: 744
2016-01-15 00:00:27,345 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:27,346 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 230, total: 744, max: 744
2016-01-15 00:00:27,346 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:27,346 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 230, total: 744, max: 744
2016-01-15 00:00:27,347 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:27,347 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 230, total: 744, max: 744
2016-01-15 00:00:27,347 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CB24D8AACC614A5FB449C8C93AEEE69B, mem on close (mb), free: 230, total: 744, max: 744
2016-01-15 00:00:27,363 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:27,364 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:27,368 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: ADE4E2C0A8DA4068BA60951C6DC1ACCE, ordinal: 1
2016-01-15 00:00:27,368 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2016-01-15 00:00:27,369 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageBy/average"]
2016-01-15 00:00:27,369 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ADE4E2C0A8DA4068BA60951C6DC1ACCE, mem on start (mb), free: 224, total: 744, max: 744
2016-01-15 00:00:27,377 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ADE4E2C0A8DA4068BA60951C6DC1ACCE, mem on close (mb), free: 222, total: 744, max: 744
2016-01-15 00:00:27,393 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageBy/average/_temporary
2016-01-15 00:00:27,393 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] completed in: 00:00.167
2016-01-15 00:00:27,443 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testAverageBy/average
2016-01-15 00:00:27,457 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:27,457 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:27,477 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-15 00:00:27,478 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:27,478 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:27,487 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting
2016-01-15 00:00:27,487 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:27,487 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] sink: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByNullSafety/maxbynullsafety"]
2016-01-15 00:00:27,487 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] parallel execution of steps is enabled: false
2016-01-15 00:00:27,488 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executing total steps: 1
2016-01-15 00:00:27,488 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] allocating management threads: 1
2016-01-15 00:00:27,489 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting step: (1/1) ...ullSafety/maxbynullsafety
2016-01-15 00:00:27,553 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1889632577/.staging/job_local1889632577_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:27,554 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1889632577/.staging/job_local1889632577_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:27,594 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1889632577_0024/job_local1889632577_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:27,595 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1889632577_0024/job_local1889632577_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:27,596 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] submitted hadoop job: job_local1889632577_0024
2016-01-15 00:00:27,596 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] tracking url: http://localhost:8080/
2016-01-15 00:00:27,600 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:27,622 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:27,622 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:27,626 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AAD1DE5574FB43848045433022DC55E2, ordinal: 0
2016-01-15 00:00:27,627 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:27,627 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(max)[by:[{1}:'char']]
2016-01-15 00:00:27,628 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AAD1DE5574FB43848045433022DC55E2, mem on start (mb), free: 230, total: 744, max: 744
2016-01-15 00:00:27,629 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:27,629 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 230, total: 744, max: 744
2016-01-15 00:00:27,630 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:27,630 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 230, total: 744, max: 744
2016-01-15 00:00:27,631 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:27,631 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 230, total: 744, max: 744
2016-01-15 00:00:27,632 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:27,632 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 230, total: 744, max: 744
2016-01-15 00:00:27,633 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AAD1DE5574FB43848045433022DC55E2, mem on close (mb), free: 230, total: 744, max: 744
2016-01-15 00:00:27,646 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:27,647 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:27,651 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: EE1B087814664202BE16DEB22B72F101, ordinal: 1
2016-01-15 00:00:27,652 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(max)[by:[{1}:'char']]
2016-01-15 00:00:27,652 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByNullSafety/maxbynullsafety"]
2016-01-15 00:00:27,652 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EE1B087814664202BE16DEB22B72F101, mem on start (mb), free: 225, total: 744, max: 744
2016-01-15 00:00:27,660 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EE1B087814664202BE16DEB22B72F101, mem on close (mb), free: 224, total: 744, max: 744
2016-01-15 00:00:27,674 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testMaxByNullSafety/maxbynullsafety/_temporary
2016-01-15 00:00:27,675 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] completed in: 00:00.187
2016-01-15 00:00:27,719 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testMaxByNullSafety/maxbynullsafety
2016-01-15 00:00:27,732 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:27,733 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:27,753 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-15 00:00:27,753 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:27,754 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:27,763 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] starting
2016-01-15 00:00:27,763 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:27,764 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumByNulls/sumnulls"]
2016-01-15 00:00:27,764 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] parallel execution of steps is enabled: false
2016-01-15 00:00:27,764 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] executing total steps: 1
2016-01-15 00:00:27,764 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] allocating management threads: 1
2016-01-15 00:00:27,765 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] starting step: (1/1) ...m/testSumByNulls/sumnulls
2016-01-15 00:00:27,816 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity791428598/.staging/job_local791428598_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:27,817 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity791428598/.staging/job_local791428598_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:27,850 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local791428598_0025/job_local791428598_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:27,851 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local791428598_0025/job_local791428598_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:27,852 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] submitted hadoop job: job_local791428598_0025
2016-01-15 00:00:27,852 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] tracking url: http://localhost:8080/
2016-01-15 00:00:27,856 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:27,878 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:27,878 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:27,881 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C3AB4EC0BF8547F8B751599559BCF731, ordinal: 0
2016-01-15 00:00:27,883 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:27,883 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2016-01-15 00:00:27,883 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C3AB4EC0BF8547F8B751599559BCF731, mem on start (mb), free: 231, total: 745, max: 745
2016-01-15 00:00:27,890 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:27,890 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 231, total: 745, max: 745
2016-01-15 00:00:27,890 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:27,890 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 231, total: 745, max: 745
2016-01-15 00:00:27,891 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:27,891 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 231, total: 745, max: 745
2016-01-15 00:00:27,891 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:27,892 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 231, total: 745, max: 745
2016-01-15 00:00:27,892 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C3AB4EC0BF8547F8B751599559BCF731, mem on close (mb), free: 231, total: 745, max: 745
2016-01-15 00:00:27,909 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:27,910 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:27,914 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CCF67B706D6047C3B5AA14A65BB04F95, ordinal: 1
2016-01-15 00:00:27,914 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2016-01-15 00:00:27,914 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumByNulls/sumnulls"]
2016-01-15 00:00:27,914 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CCF67B706D6047C3B5AA14A65BB04F95, mem on start (mb), free: 225, total: 745, max: 745
2016-01-15 00:00:27,923 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CCF67B706D6047C3B5AA14A65BB04F95, mem on close (mb), free: 224, total: 745, max: 745
2016-01-15 00:00:27,941 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSumByNulls/sumnulls/_temporary
2016-01-15 00:00:27,941 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] completed in: 00:00.178
2016-01-15 00:00:27,982 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testSumByNulls/sumnulls
2016-01-15 00:00:27,993 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:27,994 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:28,017 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.021
2016-01-15 00:00:28,018 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:28,018 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:28,027 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting
2016-01-15 00:00:28,027 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:28,028 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] sink: Hfs["TextDelimited[['count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountAll/countall"]
2016-01-15 00:00:28,028 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] parallel execution of steps is enabled: false
2016-01-15 00:00:28,028 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executing total steps: 1
2016-01-15 00:00:28,028 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] allocating management threads: 1
2016-01-15 00:00:28,029 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (1/1) ...orm/testCountAll/countall
2016-01-15 00:00:28,081 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity107348249/.staging/job_local107348249_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:28,082 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity107348249/.staging/job_local107348249_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:28,112 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local107348249_0026/job_local107348249_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:28,113 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local107348249_0026/job_local107348249_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:28,114 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local107348249_0026
2016-01-15 00:00:28,115 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-15 00:00:28,119 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:28,142 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:28,142 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:28,146 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E1FBFCFDB7014B4ABADCFBB734359693, ordinal: 0
2016-01-15 00:00:28,146 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:28,147 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2016-01-15 00:00:28,147 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E1FBFCFDB7014B4ABADCFBB734359693, mem on start (mb), free: 231, total: 745, max: 745
2016-01-15 00:00:28,148 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E1FBFCFDB7014B4ABADCFBB734359693, mem on close (mb), free: 231, total: 745, max: 745
2016-01-15 00:00:28,160 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:28,161 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:28,165 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: EA0C695E3F3245E5874E4524EB5D1378, ordinal: 1
2016-01-15 00:00:28,165 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2016-01-15 00:00:28,165 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountAll/countall"]
2016-01-15 00:00:28,165 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EA0C695E3F3245E5874E4524EB5D1378, mem on start (mb), free: 226, total: 745, max: 745
2016-01-15 00:00:28,172 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EA0C695E3F3245E5874E4524EB5D1378, mem on close (mb), free: 225, total: 745, max: 745
2016-01-15 00:00:28,192 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountAll/countall/_temporary
2016-01-15 00:00:28,192 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] completed in: 00:00.165
2016-01-15 00:00:28,232 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCountAll/countall
2016-01-15 00:00:28,245 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:28,245 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:28,270 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-01-15 00:00:28,270 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:28,271 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:28,280 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-15 00:00:28,280 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:28,281 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregates/multi"]
2016-01-15 00:00:28,281 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] parallel execution of steps is enabled: false
2016-01-15 00:00:28,281 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executing total steps: 1
2016-01-15 00:00:28,281 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] allocating management threads: 1
2016-01-15 00:00:28,282 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...tParallelAggregates/multi
2016-01-15 00:00:28,336 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity819502/.staging/job_local819502_0027/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:28,336 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity819502/.staging/job_local819502_0027/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:28,366 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local819502_0027/job_local819502_0027.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:28,366 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local819502_0027/job_local819502_0027.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:28,367 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local819502_0027
2016-01-15 00:00:28,367 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-15 00:00:28,370 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:28,393 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:28,394 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:28,400 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D3603A42707C4E039522E82EBFAB0D3A, ordinal: 0
2016-01-15 00:00:28,401 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:28,401 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-15 00:00:28,402 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D3603A42707C4E039522E82EBFAB0D3A, mem on start (mb), free: 232, total: 746, max: 746
2016-01-15 00:00:28,404 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:28,404 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 232, total: 746, max: 746
2016-01-15 00:00:28,406 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:28,406 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 232, total: 746, max: 746
2016-01-15 00:00:28,407 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:28,407 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 232, total: 746, max: 746
2016-01-15 00:00:28,408 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:28,409 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 232, total: 746, max: 746
2016-01-15 00:00:28,409 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D3603A42707C4E039522E82EBFAB0D3A, mem on close (mb), free: 232, total: 746, max: 746
2016-01-15 00:00:28,424 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:28,424 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:28,430 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C39C403558394B878CFF9A4CBA472540, ordinal: 1
2016-01-15 00:00:28,430 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2016-01-15 00:00:28,431 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregates/multi"]
2016-01-15 00:00:28,431 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C39C403558394B878CFF9A4CBA472540, mem on start (mb), free: 225, total: 746, max: 746
2016-01-15 00:00:28,440 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C39C403558394B878CFF9A4CBA472540, mem on close (mb), free: 225, total: 746, max: 746
2016-01-15 00:00:28,454 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregates/multi/_temporary
2016-01-15 00:00:28,454 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] completed in: 00:00.174
2016-01-15 00:00:28,503 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testParallelAggregates/multi
2016-01-15 00:00:28,515 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:28,515 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:28,529 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.011
2016-01-15 00:00:28,530 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 00:00:28,530 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:28,536 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-15 00:00:28,536 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt"]
2016-01-15 00:00:28,536 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRetainNarrow/retainnarrow"]
2016-01-15 00:00:28,536 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-15 00:00:28,536 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-15 00:00:28,537 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-15 00:00:28,537 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...RetainNarrow/retainnarrow
2016-01-15 00:00:28,589 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1832336823/.staging/job_local1832336823_0028/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:28,589 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1832336823/.staging/job_local1832336823_0028/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:28,623 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1832336823_0028/job_local1832336823_0028.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:28,624 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1832336823_0028/job_local1832336823_0028.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:28,625 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local1832336823_0028
2016-01-15 00:00:28,625 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-15 00:00:28,629 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt
2016-01-15 00:00:28,637 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:28,637 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:28,640 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BBE075BA0FFE46EC99E55C3EECBE8090, ordinal: 0
2016-01-15 00:00:28,641 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt"]
2016-01-15 00:00:28,642 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRetainNarrow/retainnarrow"]
2016-01-15 00:00:28,642 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BBE075BA0FFE46EC99E55C3EECBE8090, mem on start (mb), free: 173, total: 746, max: 746
2016-01-15 00:00:28,644 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BBE075BA0FFE46EC99E55C3EECBE8090, mem on close (mb), free: 173, total: 746, max: 746
2016-01-15 00:00:28,658 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRetainNarrow/retainnarrow/_temporary
2016-01-15 00:00:28,659 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:00.122
2016-01-15 00:00:28,678 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testRetainNarrow/retainnarrow
2016-01-15 00:00:28,689 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:28,689 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:28,704 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.012
2016-01-15 00:00:28,704 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 00:00:28,704 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:28,709 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-15 00:00:28,709 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt"]
2016-01-15 00:00:28,709 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['item']->['char', 'item']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNarrow/renamenarrow"]
2016-01-15 00:00:28,709 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-15 00:00:28,709 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-15 00:00:28,709 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-15 00:00:28,711 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...RenameNarrow/renamenarrow
2016-01-15 00:00:28,763 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity2019206354/.staging/job_local2019206354_0029/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:28,764 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity2019206354/.staging/job_local2019206354_0029/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:28,797 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2019206354_0029/job_local2019206354_0029.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:28,798 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2019206354_0029/job_local2019206354_0029.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:28,799 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local2019206354_0029
2016-01-15 00:00:28,799 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-15 00:00:28,802 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt
2016-01-15 00:00:28,808 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:28,808 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:28,812 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D424F1366BE24C7FAF7901B81DD2A5AF, ordinal: 0
2016-01-15 00:00:28,812 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt"]
2016-01-15 00:00:28,812 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['item']->['char', 'item']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNarrow/renamenarrow"]
2016-01-15 00:00:28,812 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D424F1366BE24C7FAF7901B81DD2A5AF, mem on start (mb), free: 125, total: 746, max: 746
2016-01-15 00:00:28,814 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D424F1366BE24C7FAF7901B81DD2A5AF, mem on close (mb), free: 125, total: 746, max: 746
2016-01-15 00:00:28,832 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testRenameNarrow/renamenarrow/_temporary
2016-01-15 00:00:28,832 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:00.123
2016-01-15 00:00:28,852 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testRenameNarrow/renamenarrow
2016-01-15 00:00:28,864 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:28,864 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:28,885 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-15 00:00:28,886 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:28,886 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:28,898 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] starting
2016-01-15 00:00:28,899 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:28,899 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageByNull/averagenull"]
2016-01-15 00:00:28,900 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] parallel execution of steps is enabled: false
2016-01-15 00:00:28,900 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] executing total steps: 1
2016-01-15 00:00:28,900 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] allocating management threads: 1
2016-01-15 00:00:28,901 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] starting step: (1/1) ...AverageByNull/averagenull
2016-01-15 00:00:28,967 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity990314388/.staging/job_local990314388_0030/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:28,968 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity990314388/.staging/job_local990314388_0030/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:28,998 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local990314388_0030/job_local990314388_0030.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:28,999 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local990314388_0030/job_local990314388_0030.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:29,000 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] submitted hadoop job: job_local990314388_0030
2016-01-15 00:00:29,000 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] tracking url: http://localhost:8080/
2016-01-15 00:00:29,003 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:29,018 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:29,018 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:29,023 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F4634561B12E427F9CBFE045A9C19BA8, ordinal: 0
2016-01-15 00:00:29,023 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:29,023 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2016-01-15 00:00:29,024 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F4634561B12E427F9CBFE045A9C19BA8, mem on start (mb), free: 212, total: 746, max: 746
2016-01-15 00:00:29,027 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:29,028 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 211, total: 746, max: 746
2016-01-15 00:00:29,029 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:29,029 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 211, total: 746, max: 746
2016-01-15 00:00:29,029 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:29,029 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 211, total: 746, max: 746
2016-01-15 00:00:29,031 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:29,031 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 211, total: 746, max: 746
2016-01-15 00:00:29,031 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F4634561B12E427F9CBFE045A9C19BA8, mem on close (mb), free: 211, total: 746, max: 746
2016-01-15 00:00:29,044 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:29,044 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:29,051 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: EA9B104F257A44CDB597F8FF038FD534, ordinal: 1
2016-01-15 00:00:29,052 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2016-01-15 00:00:29,052 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageByNull/averagenull"]
2016-01-15 00:00:29,053 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EA9B104F257A44CDB597F8FF038FD534, mem on start (mb), free: 207, total: 746, max: 746
2016-01-15 00:00:29,061 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EA9B104F257A44CDB597F8FF038FD534, mem on close (mb), free: 205, total: 746, max: 746
2016-01-15 00:00:29,075 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testAverageByNull/averagenull/_temporary
2016-01-15 00:00:29,076 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] completed in: 00:00.177
2016-01-15 00:00:29,117 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testAverageByNull/averagenull
2016-01-15 00:00:29,129 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:29,129 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:29,144 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.012
2016-01-15 00:00:29,144 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 00:00:29,144 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:29,149 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] starting
2016-01-15 00:00:29,149 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt"]
2016-01-15 00:00:29,150 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] sink: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerce/coerce"]
2016-01-15 00:00:29,150 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] parallel execution of steps is enabled: false
2016-01-15 00:00:29,150 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] executing total steps: 1
2016-01-15 00:00:29,150 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] allocating management threads: 1
2016-01-15 00:00:29,152 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] starting step: (1/1) ...latform/testCoerce/coerce
2016-01-15 00:00:29,203 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1002523416/.staging/job_local1002523416_0031/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:29,204 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1002523416/.staging/job_local1002523416_0031/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:29,234 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1002523416_0031/job_local1002523416_0031.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:29,235 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1002523416_0031/job_local1002523416_0031.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:29,236 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] submitted hadoop job: job_local1002523416_0031
2016-01-15 00:00:29,236 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] tracking url: http://localhost:8080/
2016-01-15 00:00:29,239 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt
2016-01-15 00:00:29,245 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:29,245 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:29,248 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A960C05429934CCCA6FADBE794374880, ordinal: 0
2016-01-15 00:00:29,249 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt"]
2016-01-15 00:00:29,249 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerce/coerce"]
2016-01-15 00:00:29,249 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A960C05429934CCCA6FADBE794374880, mem on start (mb), free: 153, total: 746, max: 746
2016-01-15 00:00:29,252 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A960C05429934CCCA6FADBE794374880, mem on close (mb), free: 153, total: 746, max: 746
2016-01-15 00:00:29,270 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCoerce/coerce/_temporary
2016-01-15 00:00:29,270 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] completed in: 00:00.121
2016-01-15 00:00:29,290 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCoerce/coerce
2016-01-15 00:00:29,301 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:29,301 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:29,320 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.016
2016-01-15 00:00:29,320 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:29,320 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:29,327 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-15 00:00:29,327 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] source: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs+rhs-cross-rev.txt"]
2016-01-15 00:00:29,327 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstByWithoutComparator/firstnfieldswithoutcomparator"]
2016-01-15 00:00:29,327 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] parallel execution of steps is enabled: false
2016-01-15 00:00:29,328 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executing total steps: 1
2016-01-15 00:00:29,328 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] allocating management threads: 1
2016-01-15 00:00:29,331 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) ...tnfieldswithoutcomparator
2016-01-15 00:00:29,383 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1839524477/.staging/job_local1839524477_0032/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:29,384 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1839524477/.staging/job_local1839524477_0032/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:29,413 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1839524477_0032/job_local1839524477_0032.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:29,413 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1839524477_0032/job_local1839524477_0032.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:29,414 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted hadoop job: job_local1839524477_0032
2016-01-15 00:00:29,414 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tracking url: http://localhost:8080/
2016-01-15 00:00:29,418 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs+rhs-cross-rev.txt
2016-01-15 00:00:29,439 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:29,439 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:29,443 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A03DB6071F054027B148A6B44F55FC63, ordinal: 0
2016-01-15 00:00:29,443 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs+rhs-cross-rev.txt"]
2016-01-15 00:00:29,443 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(first)[by:[{1}:'num']]
2016-01-15 00:00:29,444 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A03DB6071F054027B148A6B44F55FC63, mem on start (mb), free: 231, total: 746, max: 746
2016-01-15 00:00:29,446 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:29,446 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 231, total: 746, max: 746
2016-01-15 00:00:29,447 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:29,447 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 231, total: 746, max: 746
2016-01-15 00:00:29,448 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A03DB6071F054027B148A6B44F55FC63, mem on close (mb), free: 231, total: 746, max: 746
2016-01-15 00:00:29,463 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:29,463 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:29,470 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A4259EBE3DBB4C238D1C8966EFB4E535, ordinal: 1
2016-01-15 00:00:29,471 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(first)[by:[{1}:'num']]
2016-01-15 00:00:29,471 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstByWithoutComparator/firstnfieldswithoutcomparator"]
2016-01-15 00:00:29,471 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A4259EBE3DBB4C238D1C8966EFB4E535, mem on start (mb), free: 226, total: 746, max: 746
2016-01-15 00:00:29,479 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A4259EBE3DBB4C238D1C8966EFB4E535, mem on close (mb), free: 224, total: 746, max: 746
2016-01-15 00:00:29,494 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testFirstByWithoutComparator/firstnfieldswithoutcomparator/_temporary
2016-01-15 00:00:29,494 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] completed in: 00:00.167
2016-01-15 00:00:29,515 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testFirstByWithoutComparator/firstnfieldswithoutcomparator
2016-01-15 00:00:29,531 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:29,531 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:29,569 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.034
2016-01-15 00:00:29,569 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:29,570 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:29,578 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-15 00:00:29,578 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:29,578 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt"]
2016-01-15 00:00:29,579 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMergeLegacyHash/multimerge+false599"]
2016-01-15 00:00:29,579 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] parallel execution of steps is enabled: false
2016-01-15 00:00:29,579 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executing total steps: 1
2016-01-15 00:00:29,579 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] allocating management threads: 1
2016-01-15 00:00:29,580 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...yHash/multimerge+false599
2016-01-15 00:00:29,631 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity672801433/.staging/job_local672801433_0033/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:29,632 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity672801433/.staging/job_local672801433_0033/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:29,662 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local672801433_0033/job_local672801433_0033.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:29,663 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local672801433_0033/job_local672801433_0033.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:29,663 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local672801433_0033
2016-01-15 00:00:29,663 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-15 00:00:29,668 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:29,689 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:29,689 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:29,694 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D574019731A6450AB41AE58A0542D843, ordinal: 0
2016-01-15 00:00:29,695 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:29,695 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-15 00:00:29,695 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D574019731A6450AB41AE58A0542D843, mem on start (mb), free: 232, total: 747, max: 747
2016-01-15 00:00:29,697 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:29,697 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 232, total: 747, max: 747
2016-01-15 00:00:29,698 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:29,698 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 232, total: 747, max: 747
2016-01-15 00:00:29,699 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:29,699 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 232, total: 747, max: 747
2016-01-15 00:00:29,700 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:29,700 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 232, total: 747, max: 747
2016-01-15 00:00:29,701 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D574019731A6450AB41AE58A0542D843, mem on close (mb), free: 232, total: 747, max: 747
2016-01-15 00:00:29,708 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt
2016-01-15 00:00:29,722 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:29,723 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:29,728 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D574019731A6450AB41AE58A0542D843, ordinal: 0
2016-01-15 00:00:29,729 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt"]
2016-01-15 00:00:29,729 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-15 00:00:29,729 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D574019731A6450AB41AE58A0542D843, mem on start (mb), free: 131, total: 747, max: 747
2016-01-15 00:00:29,733 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:29,733 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 131, total: 747, max: 747
2016-01-15 00:00:29,734 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:29,734 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 131, total: 747, max: 747
2016-01-15 00:00:29,735 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:29,735 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 131, total: 747, max: 747
2016-01-15 00:00:29,736 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:29,736 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 131, total: 747, max: 747
2016-01-15 00:00:29,737 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D574019731A6450AB41AE58A0542D843, mem on close (mb), free: 131, total: 747, max: 747
2016-01-15 00:00:29,754 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:29,755 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:29,763 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A2B5442F045B43E7903289776E5393BB, ordinal: 1
2016-01-15 00:00:29,764 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-15 00:00:29,764 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMergeLegacyHash/multimerge+false599"]
2016-01-15 00:00:29,764 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A2B5442F045B43E7903289776E5393BB, mem on start (mb), free: 125, total: 747, max: 747
2016-01-15 00:00:29,774 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A2B5442F045B43E7903289776E5393BB, mem on close (mb), free: 124, total: 747, max: 747
2016-01-15 00:00:29,794 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMergeLegacyHash/multimerge+false599/_temporary
2016-01-15 00:00:29,794 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] completed in: 00:00.216
2016-01-15 00:00:29,836 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testParallelAggregatesMergeLegacyHash/multimerge+false599
2016-01-15 00:00:29,851 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:29,851 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:29,956 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.100
2016-01-15 00:00:29,959 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 5, nodes: 10
2016-01-15 00:00:29,959 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:29,996 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting
2016-01-15 00:00:29,997 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:29,998 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMergeThreeWay/samesourcemergethreeway"]
2016-01-15 00:00:29,998 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] parallel execution of steps is enabled: false
2016-01-15 00:00:29,999 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] executing total steps: 5
2016-01-15 00:00:29,999 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] allocating management threads: 1
2016-01-15 00:00:30,000 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (1/5)
2016-01-15 00:00:30,063 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1041134373/.staging/job_local1041134373_0034/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:30,065 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1041134373/.staging/job_local1041134373_0034/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:30,102 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1041134373_0034/job_local1041134373_0034.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:30,103 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1041134373_0034/job_local1041134373_0034.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:30,103 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local1041134373_0034
2016-01-15 00:00:30,103 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-15 00:00:30,108 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:30,124 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:30,124 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:30,128 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B5265F441E834EE0A080F92D57503DA1, ordinal: 0
2016-01-15 00:00:30,128 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:30,129 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(source)[by:[{1}:'char']]
2016-01-15 00:00:30,129 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B5265F441E834EE0A080F92D57503DA1, mem on start (mb), free: 197, total: 748, max: 748
2016-01-15 00:00:30,130 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:30,130 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 197, total: 748, max: 748
2016-01-15 00:00:30,131 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:30,131 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 197, total: 748, max: 748
2016-01-15 00:00:30,132 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-15 00:00:30,132 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 197, total: 748, max: 748
2016-01-15 00:00:30,133 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-15 00:00:30,133 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 197, total: 748, max: 748
2016-01-15 00:00:30,133 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B5265F441E834EE0A080F92D57503DA1, mem on close (mb), free: 197, total: 748, max: 748
2016-01-15 00:00:30,147 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:30,147 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:30,151 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D531CD14AC744C4BB8CB8E0EE280DD90, ordinal: 1
2016-01-15 00:00:30,151 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(source)[by:[{1}:'char']]
2016-01-15 00:00:30,151 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][2318830252/source/]
2016-01-15 00:00:30,151 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D531CD14AC744C4BB8CB8E0EE280DD90, mem on start (mb), free: 191, total: 748, max: 748
2016-01-15 00:00:30,160 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D531CD14AC744C4BB8CB8E0EE280DD90, mem on close (mb), free: 189, total: 748, max: 748
2016-01-15 00:00:30,179 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (2/5)
2016-01-15 00:00:30,240 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity211858655/.staging/job_local211858655_0035/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:30,241 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity211858655/.staging/job_local211858655_0035/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:30,272 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local211858655_0035/job_local211858655_0035.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:30,273 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local211858655_0035/job_local211858655_0035.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:30,274 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local211858655_0035
2016-01-15 00:00:30,274 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-15 00:00:30,277 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/2318830252_source_85EF65E9564242FB8E83A262B0A99C02/part-00000
2016-01-15 00:00:30,303 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:30,303 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:30,307 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E139F03EDA8248BF963E2D9CED54634A, ordinal: 0
2016-01-15 00:00:30,308 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][2318830252/source/]
2016-01-15 00:00:30,308 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count-rhs)[by:[{1}:'char']]
2016-01-15 00:00:30,308 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E139F03EDA8248BF963E2D9CED54634A, mem on start (mb), free: 233, total: 748, max: 748
2016-01-15 00:00:30,309 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:30,309 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 233, total: 748, max: 748
2016-01-15 00:00:30,309 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:30,310 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 233, total: 748, max: 748
2016-01-15 00:00:30,310 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E139F03EDA8248BF963E2D9CED54634A, mem on close (mb), free: 233, total: 748, max: 748
2016-01-15 00:00:30,322 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:30,322 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:30,325 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: AE17059611CD4590A77789A75D23BE57, ordinal: 1
2016-01-15 00:00:30,326 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count-rhs)[by:[{1}:'char']]
2016-01-15 00:00:30,326 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][8305514226/count-rhs/]
2016-01-15 00:00:30,326 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AE17059611CD4590A77789A75D23BE57, mem on start (mb), free: 227, total: 748, max: 748
2016-01-15 00:00:30,332 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AE17059611CD4590A77789A75D23BE57, mem on close (mb), free: 225, total: 748, max: 748
2016-01-15 00:00:30,344 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (3/5)
2016-01-15 00:00:30,404 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity858787966/.staging/job_local858787966_0036/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:30,405 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity858787966/.staging/job_local858787966_0036/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:30,435 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local858787966_0036/job_local858787966_0036.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:30,436 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local858787966_0036/job_local858787966_0036.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:30,436 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local858787966_0036
2016-01-15 00:00:30,437 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-15 00:00:30,440 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/2318830252_source_85EF65E9564242FB8E83A262B0A99C02/part-00000
2016-01-15 00:00:30,461 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:30,461 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:30,466 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A0FD6CF7072C428F8097AFBD13191543, ordinal: 0
2016-01-15 00:00:30,466 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][2318830252/source/]
2016-01-15 00:00:30,467 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count-lhs)[by:[{1}:'char']]
2016-01-15 00:00:30,467 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A0FD6CF7072C428F8097AFBD13191543, mem on start (mb), free: 233, total: 748, max: 748
2016-01-15 00:00:30,468 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-15 00:00:30,468 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 233, total: 748, max: 748
2016-01-15 00:00:30,469 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-15 00:00:30,469 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 233, total: 748, max: 748
2016-01-15 00:00:30,470 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A0FD6CF7072C428F8097AFBD13191543, mem on close (mb), free: 233, total: 748, max: 748
2016-01-15 00:00:30,487 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:30,487 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:30,491 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: FB7E4D1617494B568A20A77CD9EF6777, ordinal: 1
2016-01-15 00:00:30,492 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count-lhs)[by:[{1}:'char']]
2016-01-15 00:00:30,492 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][4543224610/count-lhs/]
2016-01-15 00:00:30,492 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FB7E4D1617494B568A20A77CD9EF6777, mem on start (mb), free: 227, total: 748, max: 748
2016-01-15 00:00:30,499 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FB7E4D1617494B568A20A77CD9EF6777, mem on close (mb), free: 225, total: 748, max: 748
2016-01-15 00:00:30,512 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (4/5)
2016-01-15 00:00:30,590 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1416477503/.staging/job_local1416477503_0037/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:30,591 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1416477503/.staging/job_local1416477503_0037/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:30,621 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1416477503_0037/job_local1416477503_0037.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:30,622 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1416477503_0037/job_local1416477503_0037.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:30,623 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local1416477503_0037
2016-01-15 00:00:30,623 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-15 00:00:30,627 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/2318830252_source_85EF65E9564242FB8E83A262B0A99C02/part-00000
2016-01-15 00:00:30,648 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:30,648 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:30,652 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DA1CDD9A249246E587E2949BF39ADCEA, ordinal: 0
2016-01-15 00:00:30,653 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][2318830252/source/]
2016-01-15 00:00:30,653 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-15 00:00:30,654 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DA1CDD9A249246E587E2949BF39ADCEA, mem on start (mb), free: 233, total: 748, max: 748
2016-01-15 00:00:30,655 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DA1CDD9A249246E587E2949BF39ADCEA, mem on close (mb), free: 233, total: 748, max: 748
2016-01-15 00:00:30,661 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/8305514226_count_rhs_F2D9B3149DF34D15895018B879998CED/part-00000
2016-01-15 00:00:30,675 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:30,675 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:30,680 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DA1CDD9A249246E587E2949BF39ADCEA, ordinal: 0
2016-01-15 00:00:30,681 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][8305514226/count-rhs/]
2016-01-15 00:00:30,681 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-15 00:00:30,681 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DA1CDD9A249246E587E2949BF39ADCEA, mem on start (mb), free: 131, total: 748, max: 748
2016-01-15 00:00:30,683 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DA1CDD9A249246E587E2949BF39ADCEA, mem on close (mb), free: 131, total: 748, max: 748
2016-01-15 00:00:30,696 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:30,697 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:30,700 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A8BEDB1B9A88412F9D10B0DF8AEA36EA, ordinal: 1
2016-01-15 00:00:30,701 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-15 00:00:30,701 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][2718722599/source_count-rhs/]
2016-01-15 00:00:30,701 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A8BEDB1B9A88412F9D10B0DF8AEA36EA, mem on start (mb), free: 125, total: 748, max: 748
2016-01-15 00:00:30,711 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-15 00:00:30,711 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-15 00:00:30,717 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A8BEDB1B9A88412F9D10B0DF8AEA36EA, mem on close (mb), free: 123, total: 748, max: 748
2016-01-15 00:00:30,728 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (5/5) ...y/samesourcemergethreeway
2016-01-15 00:00:30,800 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity693138559/.staging/job_local693138559_0038/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:30,801 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity693138559/.staging/job_local693138559_0038/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:30,840 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local693138559_0038/job_local693138559_0038.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:30,841 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local693138559_0038/job_local693138559_0038.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:30,842 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local693138559_0038
2016-01-15 00:00:30,842 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-15 00:00:30,846 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/2718722599_source_count_rhs_7BB796E819B648AE92091C6C3E8ADCC5/part-00000
2016-01-15 00:00:30,860 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:30,860 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:30,864 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A1749CF44BCB4E68ADF73662DBCE43B6, ordinal: 0
2016-01-15 00:00:30,865 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][2718722599/source_count-rhs/]
2016-01-15 00:00:30,865 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2016-01-15 00:00:30,865 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A1749CF44BCB4E68ADF73662DBCE43B6, mem on start (mb), free: 225, total: 750, max: 750
2016-01-15 00:00:30,866 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A1749CF44BCB4E68ADF73662DBCE43B6, mem on close (mb), free: 225, total: 750, max: 750
2016-01-15 00:00:30,872 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/4543224610_count_lhs_0AD46E71963F47BDB19BE94434C430CD/part-00000
2016-01-15 00:00:30,887 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:30,887 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:30,891 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A1749CF44BCB4E68ADF73662DBCE43B6, ordinal: 0
2016-01-15 00:00:30,891 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][4543224610/count-lhs/]
2016-01-15 00:00:30,892 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2016-01-15 00:00:30,892 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A1749CF44BCB4E68ADF73662DBCE43B6, mem on start (mb), free: 123, total: 750, max: 750
2016-01-15 00:00:30,893 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A1749CF44BCB4E68ADF73662DBCE43B6, mem on close (mb), free: 123, total: 750, max: 750
2016-01-15 00:00:30,906 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:30,906 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:30,910 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B29D48B666DA42E9A7ECF4244245679D, ordinal: 1
2016-01-15 00:00:30,911 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2016-01-15 00:00:30,911 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMergeThreeWay/samesourcemergethreeway"]
2016-01-15 00:00:30,911 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B29D48B666DA42E9A7ECF4244245679D, mem on start (mb), free: 115, total: 750, max: 750
2016-01-15 00:00:30,917 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-15 00:00:30,917 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-15 00:00:30,919 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B29D48B666DA42E9A7ECF4244245679D, mem on close (mb), free: 113, total: 750, max: 750
2016-01-15 00:00:30,938 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testSameSourceMergeThreeWay/samesourcemergethreeway/_temporary
2016-01-15 00:00:30,939 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] completed in: 00:00.941
2016-01-15 00:00:30,982 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testSameSourceMergeThreeWay/samesourcemergethreeway
2016-01-15 00:00:31,004 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:31,004 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:31,027 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-01-15 00:00:31,028 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:31,028 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:31,039 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] starting
2016-01-15 00:00:31,039 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt"]
2016-01-15 00:00:31,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:31,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] sink: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUniqueMerge/uniquemerge-nondeterministic"]
2016-01-15 00:00:31,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] parallel execution of steps is enabled: false
2016-01-15 00:00:31,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] executing total steps: 1
2016-01-15 00:00:31,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] allocating management threads: 1
2016-01-15 00:00:31,041 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] starting step: (1/1) ...quemerge-nondeterministic
2016-01-15 00:00:31,092 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1253060874/.staging/job_local1253060874_0039/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:31,094 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity1253060874/.staging/job_local1253060874_0039/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:31,126 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1253060874_0039/job_local1253060874_0039.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:31,127 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1253060874_0039/job_local1253060874_0039.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:31,128 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] submitted hadoop job: job_local1253060874_0039
2016-01-15 00:00:31,128 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] tracking url: http://localhost:8080/
2016-01-15 00:00:31,132 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:31,146 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:31,146 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:31,149 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FDDC084687AD44F1A0FA6B0A5F800A28, ordinal: 0
2016-01-15 00:00:31,150 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:31,150 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2016-01-15 00:00:31,150 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FDDC084687AD44F1A0FA6B0A5F800A28, mem on start (mb), free: 193, total: 750, max: 750
2016-01-15 00:00:31,155 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FDDC084687AD44F1A0FA6B0A5F800A28, mem on close (mb), free: 193, total: 750, max: 750
2016-01-15 00:00:31,161 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt
2016-01-15 00:00:31,181 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:31,181 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:31,184 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FDDC084687AD44F1A0FA6B0A5F800A28, ordinal: 0
2016-01-15 00:00:31,185 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/rhs.txt"]
2016-01-15 00:00:31,185 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2016-01-15 00:00:31,185 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FDDC084687AD44F1A0FA6B0A5F800A28, mem on start (mb), free: 234, total: 749, max: 749
2016-01-15 00:00:31,188 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FDDC084687AD44F1A0FA6B0A5F800A28, mem on close (mb), free: 234, total: 749, max: 749
2016-01-15 00:00:31,203 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:31,203 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:31,206 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CA98B47FD0C0458CBDC4BCACA06C2D5B, ordinal: 1
2016-01-15 00:00:31,208 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2016-01-15 00:00:31,208 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUniqueMerge/uniquemerge-nondeterministic"]
2016-01-15 00:00:31,208 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CA98B47FD0C0458CBDC4BCACA06C2D5B, mem on start (mb), free: 226, total: 749, max: 749
2016-01-15 00:00:31,217 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CA98B47FD0C0458CBDC4BCACA06C2D5B, mem on close (mb), free: 225, total: 749, max: 749
2016-01-15 00:00:31,237 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUniqueMerge/uniquemerge-nondeterministic/_temporary
2016-01-15 00:00:31,238 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] completed in: 00:00.198
2016-01-15 00:00:31,264 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testUniqueMerge/uniquemerge-nondeterministic
2016-01-15 00:00:31,281 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:31,282 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:31,305 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-01-15 00:00:31,305 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:31,306 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:31,312 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-15 00:00:31,312 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:31,313 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUnique/unique"]
2016-01-15 00:00:31,313 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-15 00:00:31,313 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-15 00:00:31,313 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-15 00:00:31,314 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...latform/testUnique/unique
2016-01-15 00:00:31,363 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity419716989/.staging/job_local419716989_0040/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:31,364 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity419716989/.staging/job_local419716989_0040/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:31,392 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local419716989_0040/job_local419716989_0040.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:31,393 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local419716989_0040/job_local419716989_0040.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:31,393 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local419716989_0040
2016-01-15 00:00:31,394 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-15 00:00:31,397 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:31,417 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:31,418 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:31,421 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A31F26158D534FB7876F01DF357BCF2B, ordinal: 0
2016-01-15 00:00:31,421 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:31,421 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(shape)[by:[{1}:'num']]
2016-01-15 00:00:31,422 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A31F26158D534FB7876F01DF357BCF2B, mem on start (mb), free: 235, total: 749, max: 749
2016-01-15 00:00:31,424 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A31F26158D534FB7876F01DF357BCF2B, mem on close (mb), free: 235, total: 749, max: 749
2016-01-15 00:00:31,435 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:31,436 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:31,439 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: EEE27CAB857942A69540E64BFCC731FC, ordinal: 1
2016-01-15 00:00:31,439 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(shape)[by:[{1}:'num']]
2016-01-15 00:00:31,439 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUnique/unique"]
2016-01-15 00:00:31,439 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EEE27CAB857942A69540E64BFCC731FC, mem on start (mb), free: 228, total: 749, max: 749
2016-01-15 00:00:31,446 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EEE27CAB857942A69540E64BFCC731FC, mem on close (mb), free: 227, total: 749, max: 749
2016-01-15 00:00:31,459 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testUnique/unique/_temporary
2016-01-15 00:00:31,459 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:00.147
2016-01-15 00:00:31,483 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testUnique/unique
2016-01-15 00:00:31,496 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:00:31,496 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:00:31,514 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.015
2016-01-15 00:00:31,515 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-15 00:00:31,515 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:00:31,521 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting
2016-01-15 00:00:31,522 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:31,522 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] sink: Hfs["TextDelimited[['notnull', 'null']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountNullNotNull/countnullnotnull"]
2016-01-15 00:00:31,522 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] parallel execution of steps is enabled: false
2016-01-15 00:00:31,522 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executing total steps: 1
2016-01-15 00:00:31,523 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] allocating management threads: 1
2016-01-15 00:00:31,523 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (1/1) ...lNotNull/countnullnotnull
2016-01-15 00:00:31,575 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity2139790218/.staging/job_local2139790218_0041/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:31,576 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/tmp/cascading/staging/teamcity2139790218/.staging/job_local2139790218_0041/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:31,607 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2139790218_0041/job_local2139790218_0041.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2016-01-15 00:00:31,607 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2139790218_0041/job_local2139790218_0041.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2016-01-15 00:00:31,608 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local2139790218_0041
2016-01-15 00:00:31,608 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-15 00:00:31,612 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt
2016-01-15 00:00:31,635 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-15 00:00:31,635 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-15 00:00:31,639 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B054A5199D2B4032B4CBCE3A016D868E, ordinal: 0
2016-01-15 00:00:31,640 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lhs.txt"]
2016-01-15 00:00:31,640 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2016-01-15 00:00:31,640 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B054A5199D2B4032B4CBCE3A016D868E, mem on start (mb), free: 236, total: 750, max: 750
2016-01-15 00:00:31,645 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B054A5199D2B4032B4CBCE3A016D868E, mem on close (mb), free: 236, total: 750, max: 750
2016-01-15 00:00:31,656 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-15 00:00:31,657 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-15 00:00:31,661 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D2D16F887EC64A6597F8649F4DE455E0, ordinal: 1
2016-01-15 00:00:31,661 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2016-01-15 00:00:31,661 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['notnull', 'null']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountNullNotNull/countnullnotnull"]
2016-01-15 00:00:31,662 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D2D16F887EC64A6597F8649F4DE455E0, mem on start (mb), free: 230, total: 750, max: 750
2016-01-15 00:00:31,667 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D2D16F887EC64A6597F8649F4DE455E0, mem on close (mb), free: 228, total: 750, max: 750
2016-01-15 00:00:31,684 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/assemblyhelpersplatform/testCountNullNotNull/countnullnotnull/_temporary
2016-01-15 00:00:31,685 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] completed in: 00:00.163
2016-01-15 00:00:31,724 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/assemblyhelpersplatform/testCountNullNotNull/countnullnotnull