2016-01-14 17:36:52,198 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 17:36:52,214 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.pipe.assembly.AssemblyHelpersPlatformTest, with platform: hadoop
2016-01-14 17:36:52,244 INFO hadoop.HadoopPlatform (HadoopPlatform.java:setUp(127)) - not using cluster
2016-01-14 17:36:52,450 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2016-01-14 17:36:52,751 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:36:52,753 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:36:52,853 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: E303DB7095544D328A831B8188C3BF32
2016-01-14 17:36:53,086 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.195
2016-01-14 17:36:53,090 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:36:53,091 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:36:53,280 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 17:36:53,282 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-14 17:36:53,283 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:36:53,283 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt"]
2016-01-14 17:36:53,283 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testParallelAggregatesMerge/multimerge+false163"]
2016-01-14 17:36:53,284 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] parallel execution of steps is enabled: false
2016-01-14 17:36:53,285 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executing total steps: 1
2016-01-14 17:36:53,286 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] allocating management threads: 1
2016-01-14 17:36:53,287 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...Merge/multimerge+false163
2016-01-14 17:36:53,330 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(52)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-01-14 17:36:53,575 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local_0001
2016-01-14 17:36:53,576 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-14 17:36:53,641 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:36:53,775 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:36:53,776 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:36:53,800 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AF475E1D01D347D3B267C1C2F2BB0069, ordinal: 0
2016-01-14 17:36:53,839 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:36:53,840 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 17:36:53,841 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AF475E1D01D347D3B267C1C2F2BB0069, mem on start (mb), free: 78, total: 223, max: 672
2016-01-14 17:36:53,859 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:36:53,859 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 77, total: 223, max: 672
2016-01-14 17:36:53,860 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 33% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:36:53,861 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:36:53,861 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 77, total: 223, max: 672
2016-01-14 17:36:53,861 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 33% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:36:53,862 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:36:53,863 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 77, total: 223, max: 672
2016-01-14 17:36:53,863 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 33% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:36:53,864 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:36:53,864 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 77, total: 223, max: 672
2016-01-14 17:36:53,864 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 33% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:36:53,865 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AF475E1D01D347D3B267C1C2F2BB0069, mem on close (mb), free: 77, total: 223, max: 672
2016-01-14 17:36:56,619 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt
2016-01-14 17:36:56,720 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:36:56,720 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:36:56,742 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AF475E1D01D347D3B267C1C2F2BB0069, ordinal: 0
2016-01-14 17:36:56,743 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt"]
2016-01-14 17:36:56,744 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 17:36:56,744 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AF475E1D01D347D3B267C1C2F2BB0069, mem on start (mb), free: 71, total: 318, max: 672
2016-01-14 17:36:56,820 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:36:56,821 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 68, total: 318, max: 672
2016-01-14 17:36:56,821 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 47% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:36:56,823 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:36:56,823 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 68, total: 318, max: 672
2016-01-14 17:36:56,824 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 47% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:36:56,825 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:36:56,826 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 68, total: 318, max: 672
2016-01-14 17:36:56,826 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 47% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:36:56,827 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:36:56,828 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 68, total: 318, max: 672
2016-01-14 17:36:56,828 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 47% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:36:56,829 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AF475E1D01D347D3B267C1C2F2BB0069, mem on close (mb), free: 68, total: 318, max: 672
2016-01-14 17:36:59,639 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:36:59,639 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:36:59,659 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B9D76567D8BC4EA886BE89592548D986, ordinal: 1
2016-01-14 17:36:59,663 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 17:36:59,663 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testParallelAggregatesMerge/multimerge+false163"]
2016-01-14 17:36:59,664 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B9D76567D8BC4EA886BE89592548D986, mem on start (mb), free: 66, total: 318, max: 672
2016-01-14 17:36:59,682 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B9D76567D8BC4EA886BE89592548D986, mem on close (mb), free: 64, total: 318, max: 672
2016-01-14 17:37:02,636 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testParallelAggregatesMerge/multimerge+false163/_temporary
2016-01-14 17:37:02,638 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] completed in: 00:09.353
2016-01-14 17:37:02,692 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testParallelAggregatesMerge/multimerge+false163
2016-01-14 17:37:02,744 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:37:02,745 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:37:02,836 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.086
2016-01-14 17:37:02,838 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:37:02,838 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:37:02,867 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting
2016-01-14 17:37:02,867 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:37:02,868 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] sink: Hfs["TextDelimited[['num', 'min']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testMinByString/minbystring"]
2016-01-14 17:37:02,868 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] parallel execution of steps is enabled: false
2016-01-14 17:37:02,868 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executing total steps: 1
2016-01-14 17:37:02,869 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] allocating management threads: 1
2016-01-14 17:37:02,869 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting step: (1/1) ...stMinByString/minbystring
2016-01-14 17:37:02,956 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] submitted hadoop job: job_local_0002
2016-01-14 17:37:02,958 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] tracking url: http://localhost:8080/
2016-01-14 17:37:02,963 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:37:03,060 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:37:03,060 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:37:03,069 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B6BC30DC8F8A49C9AA91E67D9BE9A068, ordinal: 0
2016-01-14 17:37:03,070 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:37:03,070 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2016-01-14 17:37:03,070 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B6BC30DC8F8A49C9AA91E67D9BE9A068, mem on start (mb), free: 105, total: 413, max: 672
2016-01-14 17:37:03,072 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:37:03,072 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 105, total: 413, max: 672
2016-01-14 17:37:03,073 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:37:03,074 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:37:03,074 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 105, total: 413, max: 672
2016-01-14 17:37:03,074 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:37:03,075 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B6BC30DC8F8A49C9AA91E67D9BE9A068, mem on close (mb), free: 105, total: 413, max: 672
2016-01-14 17:37:05,967 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:37:05,968 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:37:05,978 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: FA4FD81AD68C4133AFAC813DAB0ED586, ordinal: 1
2016-01-14 17:37:05,979 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2016-01-14 17:37:05,980 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['num', 'min']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testMinByString/minbystring"]
2016-01-14 17:37:05,980 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FA4FD81AD68C4133AFAC813DAB0ED586, mem on start (mb), free: 104, total: 413, max: 672
2016-01-14 17:37:05,986 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FA4FD81AD68C4133AFAC813DAB0ED586, mem on close (mb), free: 104, total: 413, max: 672
2016-01-14 17:37:08,973 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testMinByString/minbystring/_temporary
2016-01-14 17:37:08,974 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] completed in: 00:06.105
2016-01-14 17:37:09,007 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testMinByString/minbystring
2016-01-14 17:37:09,030 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:37:09,031 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:37:09,153 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.115
2016-01-14 17:37:09,157 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:37:09,157 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:37:09,194 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] starting
2016-01-14 17:37:09,195 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt"]
2016-01-14 17:37:09,195 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:37:09,195 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testAverageMerge/mergeaverage"]
2016-01-14 17:37:09,196 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] parallel execution of steps is enabled: false
2016-01-14 17:37:09,196 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] executing total steps: 1
2016-01-14 17:37:09,196 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] allocating management threads: 1
2016-01-14 17:37:09,197 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] starting step: (1/1) ...AverageMerge/mergeaverage
2016-01-14 17:37:09,278 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] submitted hadoop job: job_local_0003
2016-01-14 17:37:09,279 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] tracking url: http://localhost:8080/
2016-01-14 17:37:09,283 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:37:09,377 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:37:09,378 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:37:09,391 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BEC51C35E19B4F5EA8588C3F4DB28B1F, ordinal: 0
2016-01-14 17:37:09,392 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:37:09,392 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2016-01-14 17:37:09,392 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BEC51C35E19B4F5EA8588C3F4DB28B1F, mem on start (mb), free: 86, total: 509, max: 672
2016-01-14 17:37:09,393 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:37:09,394 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 86, total: 509, max: 672
2016-01-14 17:37:09,394 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 75% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:37:09,395 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:37:09,395 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 86, total: 509, max: 672
2016-01-14 17:37:09,395 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 75% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:37:09,396 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:37:09,396 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 86, total: 509, max: 672
2016-01-14 17:37:09,396 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 75% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:37:09,397 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:37:09,397 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 86, total: 509, max: 672
2016-01-14 17:37:09,397 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 75% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:37:09,398 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BEC51C35E19B4F5EA8588C3F4DB28B1F, mem on close (mb), free: 86, total: 509, max: 672
2016-01-14 17:37:12,286 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt
2016-01-14 17:37:12,381 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:37:12,381 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:37:12,395 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BEC51C35E19B4F5EA8588C3F4DB28B1F, ordinal: 0
2016-01-14 17:37:12,396 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt"]
2016-01-14 17:37:12,396 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2016-01-14 17:37:12,396 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BEC51C35E19B4F5EA8588C3F4DB28B1F, mem on start (mb), free: 48, total: 571, max: 672
2016-01-14 17:37:12,399 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:37:12,400 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 47, total: 571, max: 672
2016-01-14 17:37:12,401 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:37:12,401 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 47, total: 571, max: 672
2016-01-14 17:37:12,402 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:37:12,402 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 47, total: 571, max: 672
2016-01-14 17:37:12,402 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:37:12,403 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 47, total: 571, max: 672
2016-01-14 17:37:12,403 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BEC51C35E19B4F5EA8588C3F4DB28B1F, mem on close (mb), free: 47, total: 571, max: 672
2016-01-14 17:37:15,293 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:37:15,293 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:37:15,304 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: ED85423C9305489F9EC63584289418F8, ordinal: 1
2016-01-14 17:37:15,304 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2016-01-14 17:37:15,305 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testAverageMerge/mergeaverage"]
2016-01-14 17:37:15,305 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ED85423C9305489F9EC63584289418F8, mem on start (mb), free: 46, total: 571, max: 672
2016-01-14 17:37:15,310 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ED85423C9305489F9EC63584289418F8, mem on close (mb), free: 46, total: 571, max: 672
2016-01-14 17:37:18,299 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testAverageMerge/mergeaverage/_temporary
2016-01-14 17:37:18,300 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average-lhs+average-rhs] completed in: 00:09.105
2016-01-14 17:37:18,320 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testAverageMerge/mergeaverage
2016-01-14 17:37:18,332 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:37:18,332 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:37:18,366 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.030
2016-01-14 17:37:18,368 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:37:18,368 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:37:18,383 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 17:37:18,384 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt"]
2016-01-14 17:37:18,385 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testRenameAll/renameall"]
2016-01-14 17:37:18,386 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-14 17:37:18,386 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-14 17:37:18,386 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-14 17:37:18,387 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...m/testRenameAll/renameall
2016-01-14 17:37:18,421 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local_0004
2016-01-14 17:37:18,422 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 17:37:18,426 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt
2016-01-14 17:37:18,430 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:37:18,431 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:37:18,440 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: CD1B22D8B9B847E399F5E48F470B9EF9, ordinal: 0
2016-01-14 17:37:18,441 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt"]
2016-01-14 17:37:18,442 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testRenameAll/renameall"]
2016-01-14 17:37:18,442 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CD1B22D8B9B847E399F5E48F470B9EF9, mem on start (mb), free: 35, total: 571, max: 672
2016-01-14 17:37:18,446 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CD1B22D8B9B847E399F5E48F470B9EF9, mem on close (mb), free: 35, total: 571, max: 672
2016-01-14 17:37:21,431 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testRenameAll/renameall/_temporary
2016-01-14 17:37:21,432 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:03.048
2016-01-14 17:37:21,443 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testRenameAll/renameall
2016-01-14 17:37:21,458 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:37:21,459 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:37:21,570 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.107
2016-01-14 17:37:21,572 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 4
2016-01-14 17:37:21,572 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:37:21,609 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting
2016-01-14 17:37:21,609 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:37:21,610 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] sink: Hfs["TextDelimited[['count', 'count2']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCountCount/countcount"]
2016-01-14 17:37:21,610 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] parallel execution of steps is enabled: false
2016-01-14 17:37:21,610 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executing total steps: 2
2016-01-14 17:37:21,610 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] allocating management threads: 1
2016-01-14 17:37:21,611 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (1/2)
2016-01-14 17:37:21,651 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local_0005
2016-01-14 17:37:21,652 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-14 17:37:21,656 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:37:21,714 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:37:21,714 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:37:21,727 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AE7ED1F0851241A19C7959D2787B3B1D, ordinal: 0
2016-01-14 17:37:21,727 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:37:21,728 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2016-01-14 17:37:21,728 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AE7ED1F0851241A19C7959D2787B3B1D, mem on start (mb), free: 39, total: 621, max: 672
2016-01-14 17:37:21,729 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:37:21,729 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 39, total: 621, max: 672
2016-01-14 17:37:21,730 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:37:21,731 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 39, total: 621, max: 672
2016-01-14 17:37:21,731 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:37:21,731 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 39, total: 621, max: 672
2016-01-14 17:37:21,732 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:37:21,732 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 39, total: 621, max: 672
2016-01-14 17:37:21,733 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AE7ED1F0851241A19C7959D2787B3B1D, mem on close (mb), free: 39, total: 621, max: 672
2016-01-14 17:37:24,661 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:37:24,662 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:37:24,670 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E71711A297954BC29925142064EE5531, ordinal: 1
2016-01-14 17:37:24,672 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2016-01-14 17:37:24,672 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['count', 'count2']]"][3107318295/count/]
2016-01-14 17:37:24,672 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E71711A297954BC29925142064EE5531, mem on start (mb), free: 36, total: 621, max: 672
2016-01-14 17:37:24,683 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:37:24,683 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 36, total: 621, max: 672
2016-01-14 17:37:24,684 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E71711A297954BC29925142064EE5531, mem on close (mb), free: 36, total: 621, max: 672
2016-01-14 17:37:27,664 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (2/2) ...testCountCount/countcount
2016-01-14 17:37:27,733 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local_0006
2016-01-14 17:37:27,734 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-14 17:37:27,738 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/3107318295_count_D59476DD7BB046F5A43CA334FFB599A4/part-00000
2016-01-14 17:37:27,769 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:37:27,770 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:37:27,777 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D9E43917644B44EB8D7235EC91B19DFF, ordinal: 0
2016-01-14 17:37:27,778 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['count', 'count2']]"][3107318295/count/]
2016-01-14 17:37:27,778 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{1}:'count']]
2016-01-14 17:37:27,779 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D9E43917644B44EB8D7235EC91B19DFF, mem on start (mb), free: 44, total: 626, max: 672
2016-01-14 17:37:27,780 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D9E43917644B44EB8D7235EC91B19DFF, mem on close (mb), free: 44, total: 626, max: 672
2016-01-14 17:37:30,742 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:37:30,743 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:37:30,752 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: FAF8FA7C67B2479B8B20972DE22B87B3, ordinal: 1
2016-01-14 17:37:30,753 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{1}:'count']]
2016-01-14 17:37:30,754 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['count', 'count2']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCountCount/countcount"]
2016-01-14 17:37:30,754 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FAF8FA7C67B2479B8B20972DE22B87B3, mem on start (mb), free: 42, total: 626, max: 672
2016-01-14 17:37:30,759 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FAF8FA7C67B2479B8B20972DE22B87B3, mem on close (mb), free: 42, total: 626, max: 672
2016-01-14 17:37:33,747 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCountCount/countcount/_temporary
2016-01-14 17:37:33,748 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] completed in: 00:12.137
2016-01-14 17:37:33,769 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testCountCount/countcount
2016-01-14 17:37:33,785 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:37:33,786 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:37:33,848 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.058
2016-01-14 17:37:33,849 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:37:33,849 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:37:33,870 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] starting
2016-01-14 17:37:33,871 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:37:33,871 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt"]
2016-01-14 17:37:33,872 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCountMerge/mergecount"]
2016-01-14 17:37:33,873 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] parallel execution of steps is enabled: false
2016-01-14 17:37:33,874 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] executing total steps: 1
2016-01-14 17:37:33,874 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] allocating management threads: 1
2016-01-14 17:37:33,875 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] starting step: (1/1) ...testCountMerge/mergecount
2016-01-14 17:37:33,921 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] submitted hadoop job: job_local_0007
2016-01-14 17:37:33,922 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] tracking url: http://localhost:8080/
2016-01-14 17:37:33,927 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:37:33,943 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:37:33,944 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:37:33,956 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: EBA1F6A7B08A4EDCA9DB6374504BA416, ordinal: 0
2016-01-14 17:37:33,957 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:37:33,958 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 17:37:33,958 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EBA1F6A7B08A4EDCA9DB6374504BA416, mem on start (mb), free: 154, total: 740, max: 740
2016-01-14 17:37:33,960 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:37:33,960 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 154, total: 740, max: 740
2016-01-14 17:37:33,961 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:37:33,962 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 154, total: 740, max: 740
2016-01-14 17:37:33,963 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:37:33,963 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 154, total: 740, max: 740
2016-01-14 17:37:33,964 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:37:33,964 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 154, total: 740, max: 740
2016-01-14 17:37:33,965 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EBA1F6A7B08A4EDCA9DB6374504BA416, mem on close (mb), free: 154, total: 740, max: 740
2016-01-14 17:37:36,929 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt
2016-01-14 17:37:37,011 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:37:37,012 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:37:37,021 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: EBA1F6A7B08A4EDCA9DB6374504BA416, ordinal: 0
2016-01-14 17:37:37,022 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt"]
2016-01-14 17:37:37,023 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 17:37:37,023 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EBA1F6A7B08A4EDCA9DB6374504BA416, mem on start (mb), free: 52, total: 740, max: 740
2016-01-14 17:37:37,027 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:37:37,027 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 52, total: 740, max: 740
2016-01-14 17:37:37,028 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:37:37,028 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 52, total: 740, max: 740
2016-01-14 17:37:37,029 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:37:37,029 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 52, total: 740, max: 740
2016-01-14 17:37:37,030 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:37:37,030 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 52, total: 740, max: 740
2016-01-14 17:37:37,030 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EBA1F6A7B08A4EDCA9DB6374504BA416, mem on close (mb), free: 52, total: 740, max: 740
2016-01-14 17:37:39,938 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:37:39,938 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:37:39,947 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CA263C21F7714BD0812F3C8D5599CDCD, ordinal: 1
2016-01-14 17:37:39,948 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 17:37:39,948 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCountMerge/mergecount"]
2016-01-14 17:37:39,948 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CA263C21F7714BD0812F3C8D5599CDCD, mem on start (mb), free: 49, total: 740, max: 740
2016-01-14 17:37:39,953 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CA263C21F7714BD0812F3C8D5599CDCD, mem on close (mb), free: 49, total: 740, max: 740
2016-01-14 17:37:42,944 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCountMerge/mergecount/_temporary
2016-01-14 17:37:42,945 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs+count-rhs] completed in: 00:09.074
2016-01-14 17:37:42,963 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testCountMerge/mergecount
2016-01-14 17:37:42,976 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:37:42,976 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:37:43,019 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.039
2016-01-14 17:37:43,021 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:37:43,021 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:37:43,039 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] starting
2016-01-14 17:37:43,039 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:37:43,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] sink: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testMinByNullSafety/minbynullsafety"]
2016-01-14 17:37:43,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] parallel execution of steps is enabled: false
2016-01-14 17:37:43,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] executing total steps: 1
2016-01-14 17:37:43,041 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] allocating management threads: 1
2016-01-14 17:37:43,043 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] starting step: (1/1) ...ullSafety/minbynullsafety
2016-01-14 17:37:43,095 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] submitted hadoop job: job_local_0008
2016-01-14 17:37:43,096 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] tracking url: http://localhost:8080/
2016-01-14 17:37:43,104 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:37:43,135 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:37:43,136 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:37:43,147 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E3743ADB986D44D5864F89A453A41370, ordinal: 0
2016-01-14 17:37:43,148 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:37:43,148 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(min)[by:[{1}:'char']]
2016-01-14 17:37:43,148 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E3743ADB986D44D5864F89A453A41370, mem on start (mb), free: 158, total: 740, max: 740
2016-01-14 17:37:43,150 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:37:43,150 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 158, total: 740, max: 740
2016-01-14 17:37:43,151 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:37:43,151 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 158, total: 740, max: 740
2016-01-14 17:37:43,152 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:37:43,152 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 158, total: 740, max: 740
2016-01-14 17:37:43,153 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:37:43,153 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 158, total: 740, max: 740
2016-01-14 17:37:43,154 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E3743ADB986D44D5864F89A453A41370, mem on close (mb), free: 158, total: 740, max: 740
2016-01-14 17:37:46,107 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:37:46,107 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:37:46,114 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CE9D2FFBBD4F43849C974241D9716E29, ordinal: 1
2016-01-14 17:37:46,114 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(min)[by:[{1}:'char']]
2016-01-14 17:37:46,115 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testMinByNullSafety/minbynullsafety"]
2016-01-14 17:37:46,115 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CE9D2FFBBD4F43849C974241D9716E29, mem on start (mb), free: 156, total: 740, max: 740
2016-01-14 17:37:46,119 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CE9D2FFBBD4F43849C974241D9716E29, mem on close (mb), free: 155, total: 740, max: 740
2016-01-14 17:37:49,109 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testMinByNullSafety/minbynullsafety/_temporary
2016-01-14 17:37:49,110 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] completed in: 00:06.070
2016-01-14 17:37:49,125 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testMinByNullSafety/minbynullsafety
2016-01-14 17:37:49,138 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:37:49,140 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:37:49,184 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.040
2016-01-14 17:37:49,185 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:37:49,186 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:37:49,208 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting
2016-01-14 17:37:49,209 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:37:49,209 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] sink: Hfs["TextDelimited[['num', 'max']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testMaxByString/maxbystring"]
2016-01-14 17:37:49,210 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] parallel execution of steps is enabled: false
2016-01-14 17:37:49,210 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executing total steps: 1
2016-01-14 17:37:49,211 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] allocating management threads: 1
2016-01-14 17:37:49,212 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting step: (1/1) ...stMaxByString/maxbystring
2016-01-14 17:37:49,249 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] submitted hadoop job: job_local_0009
2016-01-14 17:37:49,250 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] tracking url: http://localhost:8080/
2016-01-14 17:37:49,256 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:37:49,273 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:37:49,273 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:37:49,280 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AEA3FC5BB0E54B069A9938155992D1D8, ordinal: 0
2016-01-14 17:37:49,280 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:37:49,281 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2016-01-14 17:37:49,281 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AEA3FC5BB0E54B069A9938155992D1D8, mem on start (mb), free: 42, total: 740, max: 740
2016-01-14 17:37:49,282 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:37:49,283 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 42, total: 740, max: 740
2016-01-14 17:37:49,283 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:37:49,284 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 42, total: 740, max: 740
2016-01-14 17:37:49,284 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AEA3FC5BB0E54B069A9938155992D1D8, mem on close (mb), free: 42, total: 740, max: 740
2016-01-14 17:37:52,259 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:37:52,260 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:37:52,267 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A4B873A96C3E4F08B3DB6B6AF6B39A80, ordinal: 1
2016-01-14 17:37:52,267 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2016-01-14 17:37:52,268 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['num', 'max']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testMaxByString/maxbystring"]
2016-01-14 17:37:52,268 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A4B873A96C3E4F08B3DB6B6AF6B39A80, mem on start (mb), free: 40, total: 740, max: 740
2016-01-14 17:37:52,272 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A4B873A96C3E4F08B3DB6B6AF6B39A80, mem on close (mb), free: 40, total: 740, max: 740
2016-01-14 17:37:55,267 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testMaxByString/maxbystring/_temporary
2016-01-14 17:37:55,268 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] completed in: 00:06.059
2016-01-14 17:37:55,286 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testMaxByString/maxbystring
2016-01-14 17:37:55,303 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:37:55,303 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:37:55,354 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.046
2016-01-14 17:37:55,355 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:37:55,356 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:37:55,388 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-14 17:37:55,389 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] source: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs+rhs-cross.txt"]
2016-01-14 17:37:55,389 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testFirstBy/firstnfields"]
2016-01-14 17:37:55,390 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] parallel execution of steps is enabled: false
2016-01-14 17:37:55,391 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executing total steps: 1
2016-01-14 17:37:55,391 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] allocating management threads: 1
2016-01-14 17:37:55,392 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) .../testFirstBy/firstnfields
2016-01-14 17:37:55,419 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted hadoop job: job_local_0010
2016-01-14 17:37:55,420 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tracking url: http://localhost:8080/
2016-01-14 17:37:55,424 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs+rhs-cross.txt
2016-01-14 17:37:55,439 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:37:55,439 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:37:55,446 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B253184C49F54D0798FBBF808CDF5DC5, ordinal: 0
2016-01-14 17:37:55,447 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs+rhs-cross.txt"]
2016-01-14 17:37:55,447 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(first)[by:[{1}:'num']]
2016-01-14 17:37:55,448 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B253184C49F54D0798FBBF808CDF5DC5, mem on start (mb), free: 156, total: 744, max: 744
2016-01-14 17:37:55,451 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:37:55,451 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 156, total: 744, max: 744
2016-01-14 17:37:55,452 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:37:55,453 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 156, total: 744, max: 744
2016-01-14 17:37:55,454 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B253184C49F54D0798FBBF808CDF5DC5, mem on close (mb), free: 156, total: 744, max: 744
2016-01-14 17:37:58,432 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:37:58,433 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:37:58,444 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CCA009E4438E42759D02CEDDE74C6242, ordinal: 1
2016-01-14 17:37:58,445 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(first)[by:[{1}:'num']]
2016-01-14 17:37:58,445 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testFirstBy/firstnfields"]
2016-01-14 17:37:58,446 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CCA009E4438E42759D02CEDDE74C6242, mem on start (mb), free: 153, total: 744, max: 744
2016-01-14 17:37:58,453 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CCA009E4438E42759D02CEDDE74C6242, mem on close (mb), free: 153, total: 744, max: 744
2016-01-14 17:38:01,432 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testFirstBy/firstnfields/_temporary
2016-01-14 17:38:01,432 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] completed in: 00:06.044
2016-01-14 17:38:01,440 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testFirstBy/firstnfields
2016-01-14 17:38:01,451 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:38:01,451 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:38:01,485 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.031
2016-01-14 17:38:01,486 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:38:01,486 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:38:01,497 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] starting
2016-01-14 17:38:01,497 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt"]
2016-01-14 17:38:01,498 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] sink: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCoerceFields/coercefields"]
2016-01-14 17:38:01,499 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] parallel execution of steps is enabled: false
2016-01-14 17:38:01,499 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] executing total steps: 1
2016-01-14 17:38:01,499 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] allocating management threads: 1
2016-01-14 17:38:01,500 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] starting step: (1/1) ...CoerceFields/coercefields
2016-01-14 17:38:01,525 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] submitted hadoop job: job_local_0011
2016-01-14 17:38:01,525 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] tracking url: http://localhost:8080/
2016-01-14 17:38:01,532 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt
2016-01-14 17:38:01,534 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:38:01,534 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:38:01,541 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DE0F2222D6604DDB8BE16FAFC2063A6F, ordinal: 0
2016-01-14 17:38:01,542 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt"]
2016-01-14 17:38:01,542 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCoerceFields/coercefields"]
2016-01-14 17:38:01,542 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DE0F2222D6604DDB8BE16FAFC2063A6F, mem on start (mb), free: 141, total: 744, max: 744
2016-01-14 17:38:01,548 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DE0F2222D6604DDB8BE16FAFC2063A6F, mem on close (mb), free: 141, total: 744, max: 744
2016-01-14 17:38:04,540 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCoerceFields/coercefields/_temporary
2016-01-14 17:38:04,541 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] completed in: 00:03.043
2016-01-14 17:38:04,548 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testCoerceFields/coercefields
2016-01-14 17:38:04,560 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:38:04,561 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:38:04,599 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.035
2016-01-14 17:38:04,600 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:38:04,600 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:38:04,615 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting
2016-01-14 17:38:04,616 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:38:04,617 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCount/count"]
2016-01-14 17:38:04,617 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] parallel execution of steps is enabled: false
2016-01-14 17:38:04,617 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executing total steps: 1
2016-01-14 17:38:04,619 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] allocating management threads: 1
2016-01-14 17:38:04,619 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (1/1) ...splatform/testCount/count
2016-01-14 17:38:04,650 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local_0012
2016-01-14 17:38:04,650 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-14 17:38:04,655 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:38:04,873 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:38:04,873 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:38:04,880 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F1D20BB945B94FDD964BE3A38D9A9029, ordinal: 0
2016-01-14 17:38:04,880 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:38:04,880 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2016-01-14 17:38:04,881 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F1D20BB945B94FDD964BE3A38D9A9029, mem on start (mb), free: 312, total: 419, max: 672
2016-01-14 17:38:04,882 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:38:04,882 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 312, total: 419, max: 672
2016-01-14 17:38:04,882 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 62% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:04,883 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:38:04,883 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 312, total: 419, max: 672
2016-01-14 17:38:04,883 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 62% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:04,883 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:38:04,884 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 312, total: 419, max: 672
2016-01-14 17:38:04,884 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 62% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:04,884 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:38:04,884 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 312, total: 419, max: 672
2016-01-14 17:38:04,885 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 62% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:04,885 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F1D20BB945B94FDD964BE3A38D9A9029, mem on close (mb), free: 312, total: 419, max: 672
2016-01-14 17:38:07,659 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:38:07,659 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:38:07,667 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A4B1B47C59104BE282BF9C351A410C2B, ordinal: 1
2016-01-14 17:38:07,668 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2016-01-14 17:38:07,668 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCount/count"]
2016-01-14 17:38:07,668 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A4B1B47C59104BE282BF9C351A410C2B, mem on start (mb), free: 310, total: 419, max: 672
2016-01-14 17:38:07,671 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A4B1B47C59104BE282BF9C351A410C2B, mem on close (mb), free: 309, total: 419, max: 672
2016-01-14 17:38:10,663 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCount/count/_temporary
2016-01-14 17:38:10,663 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] completed in: 00:06.047
2016-01-14 17:38:10,676 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testCount/count
2016-01-14 17:38:10,684 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:38:10,685 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:38:10,713 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.026
2016-01-14 17:38:10,714 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:38:10,714 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:38:10,725 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting
2016-01-14 17:38:10,725 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:38:10,725 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] sink: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testMaxBy/maxby"]
2016-01-14 17:38:10,726 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] parallel execution of steps is enabled: false
2016-01-14 17:38:10,727 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executing total steps: 1
2016-01-14 17:38:10,727 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] allocating management threads: 1
2016-01-14 17:38:10,728 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting step: (1/1) ...splatform/testMaxBy/maxby
2016-01-14 17:38:10,754 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] submitted hadoop job: job_local_0013
2016-01-14 17:38:10,754 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] tracking url: http://localhost:8080/
2016-01-14 17:38:10,758 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:38:10,773 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:38:10,773 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:38:10,778 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AE4384C90F4846F9940053B2D67B4D5B, ordinal: 0
2016-01-14 17:38:10,779 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:38:10,779 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(max)[by:[{1}:'char']]
2016-01-14 17:38:10,779 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AE4384C90F4846F9940053B2D67B4D5B, mem on start (mb), free: 192, total: 419, max: 672
2016-01-14 17:38:10,781 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:38:10,781 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 192, total: 419, max: 672
2016-01-14 17:38:10,781 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 62% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:10,782 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:38:10,782 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 192, total: 419, max: 672
2016-01-14 17:38:10,782 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 62% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:10,783 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:38:10,783 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 192, total: 419, max: 672
2016-01-14 17:38:10,784 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 62% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:10,784 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:38:10,784 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 192, total: 419, max: 672
2016-01-14 17:38:10,785 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 62% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:10,785 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AE4384C90F4846F9940053B2D67B4D5B, mem on close (mb), free: 192, total: 419, max: 672
2016-01-14 17:38:13,762 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:38:13,762 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:38:13,768 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: EDA8CAABB38D41F5B2BBE65F8BC45E83, ordinal: 1
2016-01-14 17:38:13,769 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(max)[by:[{1}:'char']]
2016-01-14 17:38:13,769 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testMaxBy/maxby"]
2016-01-14 17:38:13,769 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EDA8CAABB38D41F5B2BBE65F8BC45E83, mem on start (mb), free: 190, total: 419, max: 672
2016-01-14 17:38:13,773 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EDA8CAABB38D41F5B2BBE65F8BC45E83, mem on close (mb), free: 190, total: 419, max: 672
2016-01-14 17:38:16,765 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testMaxBy/maxby/_temporary
2016-01-14 17:38:16,765 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] completed in: 00:06.040
2016-01-14 17:38:16,778 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testMaxBy/maxby
2016-01-14 17:38:16,791 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:38:16,791 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:38:16,819 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-01-14 17:38:16,820 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:38:16,820 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:38:16,832 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] starting
2016-01-14 17:38:16,832 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:38:16,833 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] sink: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testMinBy/minby"]
2016-01-14 17:38:16,833 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] parallel execution of steps is enabled: false
2016-01-14 17:38:16,833 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] executing total steps: 1
2016-01-14 17:38:16,833 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] allocating management threads: 1
2016-01-14 17:38:16,835 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] starting step: (1/1) ...splatform/testMinBy/minby
2016-01-14 17:38:16,864 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] submitted hadoop job: job_local_0014
2016-01-14 17:38:16,864 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] tracking url: http://localhost:8080/
2016-01-14 17:38:16,868 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:38:16,889 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:38:16,889 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:38:16,895 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B59EECDC6753425E844AD5203FBC389A, ordinal: 0
2016-01-14 17:38:16,895 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:38:16,896 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(min)[by:[{1}:'char']]
2016-01-14 17:38:16,896 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B59EECDC6753425E844AD5203FBC389A, mem on start (mb), free: 198, total: 406, max: 672
2016-01-14 17:38:16,897 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:38:16,897 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 406, max: 672
2016-01-14 17:38:16,897 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:16,898 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:38:16,898 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 406, max: 672
2016-01-14 17:38:16,899 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:16,900 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:38:16,900 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 406, max: 672
2016-01-14 17:38:16,900 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:16,901 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:38:16,901 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 406, max: 672
2016-01-14 17:38:16,901 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:16,902 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B59EECDC6753425E844AD5203FBC389A, mem on close (mb), free: 198, total: 406, max: 672
2016-01-14 17:38:19,871 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:38:19,872 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:38:19,878 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A9CB60313A8E44E7A251D47B267255BE, ordinal: 1
2016-01-14 17:38:19,879 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(min)[by:[{1}:'char']]
2016-01-14 17:38:19,879 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testMinBy/minby"]
2016-01-14 17:38:19,879 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A9CB60313A8E44E7A251D47B267255BE, mem on start (mb), free: 196, total: 406, max: 672
2016-01-14 17:38:19,883 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A9CB60313A8E44E7A251D47B267255BE, mem on close (mb), free: 196, total: 406, max: 672
2016-01-14 17:38:22,878 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testMinBy/minby/_temporary
2016-01-14 17:38:22,879 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [min] completed in: 00:06.046
2016-01-14 17:38:22,892 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testMinBy/minby
2016-01-14 17:38:22,901 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:38:22,901 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:38:22,928 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.024
2016-01-14 17:38:22,928 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:38:22,929 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:38:22,945 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] starting
2016-01-14 17:38:22,946 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:38:22,946 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testSumBy/sum"]
2016-01-14 17:38:22,946 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] parallel execution of steps is enabled: false
2016-01-14 17:38:22,947 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] executing total steps: 1
2016-01-14 17:38:22,947 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] allocating management threads: 1
2016-01-14 17:38:22,948 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] starting step: (1/1) ...ersplatform/testSumBy/sum
2016-01-14 17:38:22,975 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] submitted hadoop job: job_local_0015
2016-01-14 17:38:22,975 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] tracking url: http://localhost:8080/
2016-01-14 17:38:22,979 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:38:22,996 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:38:22,997 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:38:23,006 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FFB8043289864EC2B9135A784DA464ED, ordinal: 0
2016-01-14 17:38:23,006 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:38:23,007 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2016-01-14 17:38:23,007 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FFB8043289864EC2B9135A784DA464ED, mem on start (mb), free: 83, total: 406, max: 672
2016-01-14 17:38:23,009 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:38:23,009 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 83, total: 406, max: 672
2016-01-14 17:38:23,009 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:23,010 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:38:23,011 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 83, total: 406, max: 672
2016-01-14 17:38:23,011 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:23,012 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:38:23,012 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 83, total: 406, max: 672
2016-01-14 17:38:23,012 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:23,013 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:38:23,013 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 83, total: 406, max: 672
2016-01-14 17:38:23,013 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:23,014 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FFB8043289864EC2B9135A784DA464ED, mem on close (mb), free: 83, total: 406, max: 672
2016-01-14 17:38:25,982 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:38:25,983 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:38:25,990 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F21396327ABA4A8C83167C6B62A9D824, ordinal: 1
2016-01-14 17:38:25,991 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2016-01-14 17:38:25,991 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testSumBy/sum"]
2016-01-14 17:38:25,992 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F21396327ABA4A8C83167C6B62A9D824, mem on start (mb), free: 81, total: 406, max: 672
2016-01-14 17:38:25,996 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F21396327ABA4A8C83167C6B62A9D824, mem on close (mb), free: 80, total: 406, max: 672
2016-01-14 17:38:28,988 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testSumBy/sum/_temporary
2016-01-14 17:38:28,989 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] completed in: 00:06.043
2016-01-14 17:38:29,001 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testSumBy/sum
2016-01-14 17:38:29,019 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:38:29,019 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:38:29,071 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.048
2016-01-14 17:38:29,072 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:38:29,073 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:38:29,088 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] starting
2016-01-14 17:38:29,088 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt"]
2016-01-14 17:38:29,088 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:38:29,088 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testSumMerge/mergesum"]
2016-01-14 17:38:29,089 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] parallel execution of steps is enabled: false
2016-01-14 17:38:29,089 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] executing total steps: 1
2016-01-14 17:38:29,089 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] allocating management threads: 1
2016-01-14 17:38:29,089 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] starting step: (1/1) ...orm/testSumMerge/mergesum
2016-01-14 17:38:29,117 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] submitted hadoop job: job_local_0016
2016-01-14 17:38:29,117 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] tracking url: http://localhost:8080/
2016-01-14 17:38:29,121 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:38:29,136 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:38:29,136 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:38:29,144 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B1FCF104F7714DF6B1FF580697512B5E, ordinal: 0
2016-01-14 17:38:29,145 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:38:29,145 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2016-01-14 17:38:29,145 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B1FCF104F7714DF6B1FF580697512B5E, mem on start (mb), free: 178, total: 396, max: 672
2016-01-14 17:38:29,147 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:38:29,147 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 178, total: 396, max: 672
2016-01-14 17:38:29,148 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 58% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:29,148 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:38:29,149 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 178, total: 396, max: 672
2016-01-14 17:38:29,149 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 58% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:29,150 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:38:29,151 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 178, total: 396, max: 672
2016-01-14 17:38:29,151 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 58% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:29,152 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:38:29,152 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 178, total: 396, max: 672
2016-01-14 17:38:29,153 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 58% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:29,154 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B1FCF104F7714DF6B1FF580697512B5E, mem on close (mb), free: 178, total: 396, max: 672
2016-01-14 17:38:32,123 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt
2016-01-14 17:38:32,196 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:38:32,196 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:38:32,203 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B1FCF104F7714DF6B1FF580697512B5E, ordinal: 0
2016-01-14 17:38:32,204 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt"]
2016-01-14 17:38:32,204 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2016-01-14 17:38:32,204 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B1FCF104F7714DF6B1FF580697512B5E, mem on start (mb), free: 272, total: 480, max: 672
2016-01-14 17:38:32,207 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:38:32,207 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 272, total: 480, max: 672
2016-01-14 17:38:32,207 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 71% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:32,208 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:38:32,208 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 272, total: 480, max: 672
2016-01-14 17:38:32,208 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 71% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:32,209 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:38:32,209 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 272, total: 480, max: 672
2016-01-14 17:38:32,209 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 71% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:32,210 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:38:32,210 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 272, total: 480, max: 672
2016-01-14 17:38:32,210 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 71% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:32,210 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B1FCF104F7714DF6B1FF580697512B5E, mem on close (mb), free: 272, total: 480, max: 672
2016-01-14 17:38:35,128 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:38:35,128 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:38:35,134 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B5B7185D89824BCA9B17A42ABE0967CD, ordinal: 1
2016-01-14 17:38:35,135 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2016-01-14 17:38:35,135 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testSumMerge/mergesum"]
2016-01-14 17:38:35,135 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B5B7185D89824BCA9B17A42ABE0967CD, mem on start (mb), free: 270, total: 480, max: 672
2016-01-14 17:38:35,139 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B5B7185D89824BCA9B17A42ABE0967CD, mem on close (mb), free: 270, total: 480, max: 672
2016-01-14 17:38:38,136 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testSumMerge/mergesum/_temporary
2016-01-14 17:38:38,136 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum-lhs+sum-rhs] completed in: 00:09.048
2016-01-14 17:38:38,148 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testSumMerge/mergesum
2016-01-14 17:38:38,157 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:38:38,157 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:38:38,177 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 17:38:38,178 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:38:38,178 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:38:38,184 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 17:38:38,185 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt"]
2016-01-14 17:38:38,185 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testDiscardNarrow/discardnarrow"]
2016-01-14 17:38:38,185 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-14 17:38:38,185 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-14 17:38:38,185 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-14 17:38:38,186 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...scardNarrow/discardnarrow
2016-01-14 17:38:38,206 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local_0017
2016-01-14 17:38:38,207 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 17:38:38,211 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt
2016-01-14 17:38:38,214 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:38:38,214 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:38:38,221 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DE40A5BFE93B4A0CA8D042CFEA83A889, ordinal: 0
2016-01-14 17:38:38,221 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt"]
2016-01-14 17:38:38,222 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testDiscardNarrow/discardnarrow"]
2016-01-14 17:38:38,222 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DE40A5BFE93B4A0CA8D042CFEA83A889, mem on start (mb), free: 256, total: 480, max: 672
2016-01-14 17:38:38,224 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DE40A5BFE93B4A0CA8D042CFEA83A889, mem on close (mb), free: 256, total: 480, max: 672
2016-01-14 17:38:41,217 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testDiscardNarrow/discardnarrow/_temporary
2016-01-14 17:38:41,218 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:03.033
2016-01-14 17:38:41,228 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testDiscardNarrow/discardnarrow
2016-01-14 17:38:41,237 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:38:41,238 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:38:41,289 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.048
2016-01-14 17:38:41,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:38:41,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:38:41,305 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-14 17:38:41,305 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:38:41,305 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt"]
2016-01-14 17:38:41,306 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testParallelAggregatesPriorMergeLegacyHash/multimerge+true164"]
2016-01-14 17:38:41,307 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] parallel execution of steps is enabled: false
2016-01-14 17:38:41,307 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executing total steps: 1
2016-01-14 17:38:41,307 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] allocating management threads: 1
2016-01-14 17:38:41,307 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...cyHash/multimerge+true164
2016-01-14 17:38:41,327 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local_0018
2016-01-14 17:38:41,329 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-14 17:38:41,332 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:38:41,347 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:38:41,347 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:38:41,355 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A07A72769B9444D9BE837DA2465CF128, ordinal: 0
2016-01-14 17:38:41,356 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:38:41,356 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:38:41,357 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A07A72769B9444D9BE837DA2465CF128, mem on start (mb), free: 143, total: 480, max: 672
2016-01-14 17:38:41,360 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:38:41,360 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 143, total: 480, max: 672
2016-01-14 17:38:41,360 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 71% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:41,362 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:38:41,362 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 143, total: 480, max: 672
2016-01-14 17:38:41,362 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 71% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:41,363 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:38:41,364 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 143, total: 480, max: 672
2016-01-14 17:38:41,364 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 71% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:41,365 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:38:41,365 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 143, total: 480, max: 672
2016-01-14 17:38:41,366 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 71% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:41,367 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A07A72769B9444D9BE837DA2465CF128, mem on close (mb), free: 142, total: 480, max: 672
2016-01-14 17:38:44,334 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt
2016-01-14 17:38:44,355 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:38:44,355 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:38:44,364 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A07A72769B9444D9BE837DA2465CF128, ordinal: 0
2016-01-14 17:38:44,365 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt"]
2016-01-14 17:38:44,365 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:38:44,366 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A07A72769B9444D9BE837DA2465CF128, mem on start (mb), free: 168, total: 472, max: 672
2016-01-14 17:38:44,369 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:38:44,369 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 168, total: 472, max: 672
2016-01-14 17:38:44,370 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 70% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:44,372 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:38:44,372 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 168, total: 472, max: 672
2016-01-14 17:38:44,372 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 70% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:44,373 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:38:44,373 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 168, total: 472, max: 672
2016-01-14 17:38:44,373 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 70% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:44,374 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:38:44,374 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 168, total: 472, max: 672
2016-01-14 17:38:44,375 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 70% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:44,375 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A07A72769B9444D9BE837DA2465CF128, mem on close (mb), free: 168, total: 472, max: 672
2016-01-14 17:38:47,340 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:38:47,340 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:38:47,348 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D8C1FFE9162548339198D2BDE90E1424, ordinal: 1
2016-01-14 17:38:47,349 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:38:47,349 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testParallelAggregatesPriorMergeLegacyHash/multimerge+true164"]
2016-01-14 17:38:47,349 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D8C1FFE9162548339198D2BDE90E1424, mem on start (mb), free: 166, total: 472, max: 672
2016-01-14 17:38:47,355 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D8C1FFE9162548339198D2BDE90E1424, mem on close (mb), free: 166, total: 472, max: 672
2016-01-14 17:38:50,344 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testParallelAggregatesPriorMergeLegacyHash/multimerge+true164/_temporary
2016-01-14 17:38:50,345 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] completed in: 00:09.039
2016-01-14 17:38:50,361 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testParallelAggregatesPriorMergeLegacyHash/multimerge+true164
2016-01-14 17:38:50,369 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:38:50,370 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:38:50,391 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-01-14 17:38:50,391 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:38:50,391 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:38:50,397 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 17:38:50,397 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt"]
2016-01-14 17:38:50,397 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testRenameNamed/rename"]
2016-01-14 17:38:50,398 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-14 17:38:50,398 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-14 17:38:50,398 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-14 17:38:50,399 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...rm/testRenameNamed/rename
2016-01-14 17:38:50,420 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local_0019
2016-01-14 17:38:50,420 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 17:38:50,423 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt
2016-01-14 17:38:50,425 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:38:50,425 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:38:50,428 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E6EFF3C500D8418E9C9560268BF0F773, ordinal: 0
2016-01-14 17:38:50,429 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt"]
2016-01-14 17:38:50,429 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testRenameNamed/rename"]
2016-01-14 17:38:50,429 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E6EFF3C500D8418E9C9560268BF0F773, mem on start (mb), free: 154, total: 472, max: 672
2016-01-14 17:38:50,430 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E6EFF3C500D8418E9C9560268BF0F773, mem on close (mb), free: 154, total: 472, max: 672
2016-01-14 17:38:53,426 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testRenameNamed/rename/_temporary
2016-01-14 17:38:53,427 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:03.029
2016-01-14 17:38:53,434 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testRenameNamed/rename
2016-01-14 17:38:53,442 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:38:53,443 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:38:53,488 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.043
2016-01-14 17:38:53,489 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:38:53,490 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:38:53,510 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-14 17:38:53,510 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:38:53,511 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt"]
2016-01-14 17:38:53,512 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testParallelAggregatesPriorMerge/multimerge+true163"]
2016-01-14 17:38:53,514 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] parallel execution of steps is enabled: false
2016-01-14 17:38:53,514 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executing total steps: 1
2016-01-14 17:38:53,515 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] allocating management threads: 1
2016-01-14 17:38:53,517 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...rMerge/multimerge+true163
2016-01-14 17:38:53,547 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local_0020
2016-01-14 17:38:53,549 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-14 17:38:53,556 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:38:53,577 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:38:53,577 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:38:53,588 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BCEE9853F5E646E6AB538645C7546D23, ordinal: 0
2016-01-14 17:38:53,589 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:38:53,589 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:38:53,590 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BCEE9853F5E646E6AB538645C7546D23, mem on start (mb), free: 161, total: 464, max: 672
2016-01-14 17:38:53,592 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:38:53,592 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 161, total: 464, max: 672
2016-01-14 17:38:53,592 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 69% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:53,593 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:38:53,594 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 161, total: 464, max: 672
2016-01-14 17:38:53,594 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 69% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:53,595 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:38:53,595 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 161, total: 464, max: 672
2016-01-14 17:38:53,595 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 69% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:53,596 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:38:53,597 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 161, total: 464, max: 672
2016-01-14 17:38:53,597 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 69% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:38:53,598 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BCEE9853F5E646E6AB538645C7546D23, mem on close (mb), free: 161, total: 464, max: 672
2016-01-14 17:38:56,557 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt
2016-01-14 17:38:56,657 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:38:56,657 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:38:56,664 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BCEE9853F5E646E6AB538645C7546D23, ordinal: 0
2016-01-14 17:38:56,664 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt"]
2016-01-14 17:38:56,665 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:38:56,665 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BCEE9853F5E646E6AB538645C7546D23, mem on start (mb), free: 154, total: 560, max: 672
2016-01-14 17:38:56,668 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:38:56,668 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 154, total: 560, max: 672
2016-01-14 17:38:56,669 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:38:56,670 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 154, total: 560, max: 672
2016-01-14 17:38:56,670 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:38:56,671 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 154, total: 560, max: 672
2016-01-14 17:38:56,671 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:38:56,672 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 154, total: 560, max: 672
2016-01-14 17:38:56,672 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BCEE9853F5E646E6AB538645C7546D23, mem on close (mb), free: 154, total: 560, max: 672
2016-01-14 17:38:59,563 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:38:59,564 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:38:59,573 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D7C2397C2AA645D98098071CEC0BDD77, ordinal: 1
2016-01-14 17:38:59,574 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:38:59,574 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testParallelAggregatesPriorMerge/multimerge+true163"]
2016-01-14 17:38:59,575 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D7C2397C2AA645D98098071CEC0BDD77, mem on start (mb), free: 152, total: 560, max: 672
2016-01-14 17:38:59,580 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D7C2397C2AA645D98098071CEC0BDD77, mem on close (mb), free: 152, total: 560, max: 672
2016-01-14 17:39:02,566 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testParallelAggregatesPriorMerge/multimerge+true163/_temporary
2016-01-14 17:39:02,566 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] completed in: 00:09.056
2016-01-14 17:39:02,579 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testParallelAggregatesPriorMerge/multimerge+true163
2016-01-14 17:39:02,588 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:39:02,589 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:39:02,659 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.067
2016-01-14 17:39:02,662 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 4
2016-01-14 17:39:02,662 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:39:02,688 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting
2016-01-14 17:39:02,689 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:39:02,690 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testSameSourceMerge/samesourcemergecount"]
2016-01-14 17:39:02,691 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] parallel execution of steps is enabled: false
2016-01-14 17:39:02,692 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executing total steps: 2
2016-01-14 17:39:02,692 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] allocating management threads: 1
2016-01-14 17:39:02,694 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting step: (1/2)
2016-01-14 17:39:02,714 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] submitted hadoop job: job_local_0021
2016-01-14 17:39:02,719 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tracking url: http://localhost:8080/
2016-01-14 17:39:02,721 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:39:02,821 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:39:02,821 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:39:02,830 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C7792A4C7F19407D95C812E5DF164B52, ordinal: 0
2016-01-14 17:39:02,832 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:39:02,832 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(first)[by:[{1}:'char']]
2016-01-14 17:39:02,833 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C7792A4C7F19407D95C812E5DF164B52, mem on start (mb), free: 132, total: 655, max: 672
2016-01-14 17:39:02,837 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:39:02,837 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 132, total: 655, max: 672
2016-01-14 17:39:02,838 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:39:02,839 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 132, total: 655, max: 672
2016-01-14 17:39:02,840 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:39:02,840 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 132, total: 655, max: 672
2016-01-14 17:39:02,841 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:39:02,841 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 132, total: 655, max: 672
2016-01-14 17:39:02,841 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C7792A4C7F19407D95C812E5DF164B52, mem on close (mb), free: 131, total: 655, max: 672
2016-01-14 17:39:05,726 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:39:05,726 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:39:05,732 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F7EF427A229F4904B93D8BA7E46C1A7A, ordinal: 1
2016-01-14 17:39:05,732 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(first)[by:[{1}:'char']]
2016-01-14 17:39:05,732 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][5367822350/first/]
2016-01-14 17:39:05,733 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F7EF427A229F4904B93D8BA7E46C1A7A, mem on start (mb), free: 130, total: 655, max: 672
2016-01-14 17:39:05,735 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F7EF427A229F4904B93D8BA7E46C1A7A, mem on close (mb), free: 129, total: 655, max: 672
2016-01-14 17:39:08,727 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting step: (2/2) ...erge/samesourcemergecount
2016-01-14 17:39:08,747 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] submitted hadoop job: job_local_0022
2016-01-14 17:39:08,749 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tracking url: http://localhost:8080/
2016-01-14 17:39:08,751 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/5367822350_first_A423BD5CC3F6481EA10FCF566B758380/part-00000
2016-01-14 17:39:08,853 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:39:08,853 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:39:08,859 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D5A78CDF5B8042F892E8919302F8A7BD, ordinal: 0
2016-01-14 17:39:08,860 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][5367822350/first/]
2016-01-14 17:39:08,860 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(second)[by:[{1}:'char']]
2016-01-14 17:39:08,860 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D5A78CDF5B8042F892E8919302F8A7BD, mem on start (mb), free: 63, total: 693, max: 693
2016-01-14 17:39:08,862 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:39:08,862 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 63, total: 693, max: 693
2016-01-14 17:39:08,863 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:39:08,863 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 63, total: 693, max: 693
2016-01-14 17:39:08,864 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D5A78CDF5B8042F892E8919302F8A7BD, mem on close (mb), free: 63, total: 693, max: 693
2016-01-14 17:39:11,754 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:39:11,754 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:39:11,763 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E60CA4DEA4F348E1A1B781A7EF33F7CA, ordinal: 1
2016-01-14 17:39:11,764 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(second)[by:[{1}:'char']]
2016-01-14 17:39:11,764 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testSameSourceMerge/samesourcemergecount"]
2016-01-14 17:39:11,764 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E60CA4DEA4F348E1A1B781A7EF33F7CA, mem on start (mb), free: 61, total: 693, max: 693
2016-01-14 17:39:11,768 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E60CA4DEA4F348E1A1B781A7EF33F7CA, mem on close (mb), free: 61, total: 693, max: 693
2016-01-14 17:39:14,762 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testSameSourceMerge/samesourcemergecount/_temporary
2016-01-14 17:39:14,763 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] completed in: 00:12.074
2016-01-14 17:39:14,777 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testSameSourceMerge/samesourcemergecount
2016-01-14 17:39:14,784 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:39:14,784 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:39:14,809 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.023
2016-01-14 17:39:14,810 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:39:14,810 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:39:14,821 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] starting
2016-01-14 17:39:14,821 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:39:14,821 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testAverageBy/average"]
2016-01-14 17:39:14,822 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] parallel execution of steps is enabled: false
2016-01-14 17:39:14,822 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] executing total steps: 1
2016-01-14 17:39:14,822 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] allocating management threads: 1
2016-01-14 17:39:14,823 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] starting step: (1/1) ...orm/testAverageBy/average
2016-01-14 17:39:14,846 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] submitted hadoop job: job_local_0023
2016-01-14 17:39:14,846 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] tracking url: http://localhost:8080/
2016-01-14 17:39:14,852 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:39:15,012 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:39:15,012 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:39:15,019 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E96552EDEFBE4BBBB2418B95020E2FBF, ordinal: 0
2016-01-14 17:39:15,020 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:39:15,020 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2016-01-14 17:39:15,020 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E96552EDEFBE4BBBB2418B95020E2FBF, mem on start (mb), free: 198, total: 305, max: 672
2016-01-14 17:39:15,021 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:39:15,022 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 305, max: 672
2016-01-14 17:39:15,022 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:39:15,023 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:39:15,023 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 305, max: 672
2016-01-14 17:39:15,023 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:39:15,024 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:39:15,024 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 305, max: 672
2016-01-14 17:39:15,024 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:39:15,024 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:39:15,025 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 305, max: 672
2016-01-14 17:39:15,025 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:39:15,025 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E96552EDEFBE4BBBB2418B95020E2FBF, mem on close (mb), free: 198, total: 305, max: 672
2016-01-14 17:39:17,853 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:39:17,854 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:39:17,858 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F47D33686678474293C3126E396BC19A, ordinal: 1
2016-01-14 17:39:17,858 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2016-01-14 17:39:17,859 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testAverageBy/average"]
2016-01-14 17:39:17,859 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F47D33686678474293C3126E396BC19A, mem on start (mb), free: 196, total: 305, max: 672
2016-01-14 17:39:17,862 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F47D33686678474293C3126E396BC19A, mem on close (mb), free: 195, total: 305, max: 672
2016-01-14 17:39:20,858 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testAverageBy/average/_temporary
2016-01-14 17:39:20,859 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] completed in: 00:06.037
2016-01-14 17:39:20,871 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testAverageBy/average
2016-01-14 17:39:20,882 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:39:20,882 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:39:20,907 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.021
2016-01-14 17:39:20,907 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:39:20,908 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:39:20,917 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting
2016-01-14 17:39:20,917 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:39:20,917 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] sink: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testMaxByNullSafety/maxbynullsafety"]
2016-01-14 17:39:20,917 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] parallel execution of steps is enabled: false
2016-01-14 17:39:20,917 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] executing total steps: 1
2016-01-14 17:39:20,917 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] allocating management threads: 1
2016-01-14 17:39:20,919 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] starting step: (1/1) ...ullSafety/maxbynullsafety
2016-01-14 17:39:20,938 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] submitted hadoop job: job_local_0024
2016-01-14 17:39:20,940 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] tracking url: http://localhost:8080/
2016-01-14 17:39:20,943 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:39:20,958 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:39:20,958 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:39:20,964 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D530552FC2494A8EA0FAC61CD5096ECD, ordinal: 0
2016-01-14 17:39:20,966 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:39:20,966 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(max)[by:[{1}:'char']]
2016-01-14 17:39:20,966 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D530552FC2494A8EA0FAC61CD5096ECD, mem on start (mb), free: 83, total: 305, max: 672
2016-01-14 17:39:20,969 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:39:20,969 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 83, total: 305, max: 672
2016-01-14 17:39:20,970 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:39:20,972 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:39:20,972 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 83, total: 305, max: 672
2016-01-14 17:39:20,973 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:39:20,975 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:39:20,975 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 83, total: 305, max: 672
2016-01-14 17:39:20,976 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:39:20,977 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:39:20,978 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 83, total: 305, max: 672
2016-01-14 17:39:20,978 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:39:20,979 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D530552FC2494A8EA0FAC61CD5096ECD, mem on close (mb), free: 83, total: 305, max: 672
2016-01-14 17:39:23,946 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:39:23,946 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:39:23,951 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F04D16F0C344407EA70D5582C25C9527, ordinal: 1
2016-01-14 17:39:23,951 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(max)[by:[{1}:'char']]
2016-01-14 17:39:23,951 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testMaxByNullSafety/maxbynullsafety"]
2016-01-14 17:39:23,951 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F04D16F0C344407EA70D5582C25C9527, mem on start (mb), free: 81, total: 305, max: 672
2016-01-14 17:39:23,955 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F04D16F0C344407EA70D5582C25C9527, mem on close (mb), free: 80, total: 305, max: 672
2016-01-14 17:39:26,955 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testMaxByNullSafety/maxbynullsafety/_temporary
2016-01-14 17:39:26,956 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [max] completed in: 00:06.038
2016-01-14 17:39:26,972 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testMaxByNullSafety/maxbynullsafety
2016-01-14 17:39:26,983 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:39:26,983 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:39:27,007 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-01-14 17:39:27,007 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:39:27,008 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:39:27,015 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] starting
2016-01-14 17:39:27,016 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:39:27,016 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testSumByNulls/sumnulls"]
2016-01-14 17:39:27,016 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] parallel execution of steps is enabled: false
2016-01-14 17:39:27,016 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] executing total steps: 1
2016-01-14 17:39:27,017 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] allocating management threads: 1
2016-01-14 17:39:27,017 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] starting step: (1/1) ...m/testSumByNulls/sumnulls
2016-01-14 17:39:27,038 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] submitted hadoop job: job_local_0025
2016-01-14 17:39:27,038 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] tracking url: http://localhost:8080/
2016-01-14 17:39:27,046 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:39:27,133 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:39:27,134 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:39:27,137 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B743E238F67A483BB82992D444A56FB8, ordinal: 0
2016-01-14 17:39:27,138 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:39:27,138 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2016-01-14 17:39:27,139 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B743E238F67A483BB82992D444A56FB8, mem on start (mb), free: 64, total: 401, max: 672
2016-01-14 17:39:27,145 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:39:27,145 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 63, total: 401, max: 672
2016-01-14 17:39:27,145 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 59% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:39:27,146 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:39:27,146 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 63, total: 401, max: 672
2016-01-14 17:39:27,147 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 59% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:39:27,147 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:39:27,147 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 63, total: 401, max: 672
2016-01-14 17:39:27,148 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 59% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:39:27,148 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:39:27,148 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 63, total: 401, max: 672
2016-01-14 17:39:27,149 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 59% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:39:27,149 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B743E238F67A483BB82992D444A56FB8, mem on close (mb), free: 63, total: 401, max: 672
2016-01-14 17:39:30,049 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:39:30,050 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:39:30,054 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D5E90BEA50824B0CA1F666191D0B7C5A, ordinal: 1
2016-01-14 17:39:30,054 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2016-01-14 17:39:30,054 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testSumByNulls/sumnulls"]
2016-01-14 17:39:30,055 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D5E90BEA50824B0CA1F666191D0B7C5A, mem on start (mb), free: 61, total: 401, max: 672
2016-01-14 17:39:30,059 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D5E90BEA50824B0CA1F666191D0B7C5A, mem on close (mb), free: 61, total: 401, max: 672
2016-01-14 17:39:33,057 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testSumByNulls/sumnulls/_temporary
2016-01-14 17:39:33,058 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [sum] completed in: 00:06.042
2016-01-14 17:39:33,070 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testSumByNulls/sumnulls
2016-01-14 17:39:33,078 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:39:33,078 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:39:33,101 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-01-14 17:39:33,102 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:39:33,102 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:39:33,109 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting
2016-01-14 17:39:33,109 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:39:33,110 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] sink: Hfs["TextDelimited[['count']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCountAll/countall"]
2016-01-14 17:39:33,111 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] parallel execution of steps is enabled: false
2016-01-14 17:39:33,111 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executing total steps: 1
2016-01-14 17:39:33,111 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] allocating management threads: 1
2016-01-14 17:39:33,113 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (1/1) ...orm/testCountAll/countall
2016-01-14 17:39:33,132 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local_0026
2016-01-14 17:39:33,132 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-14 17:39:33,135 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:39:33,233 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:39:33,233 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:39:33,238 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C3E0F955159A4355962E28244A9249F7, ordinal: 0
2016-01-14 17:39:33,238 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:39:33,238 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2016-01-14 17:39:33,239 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C3E0F955159A4355962E28244A9249F7, mem on start (mb), free: 45, total: 496, max: 672
2016-01-14 17:39:33,241 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C3E0F955159A4355962E28244A9249F7, mem on close (mb), free: 45, total: 496, max: 672
2016-01-14 17:39:36,138 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:39:36,138 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:39:36,143 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E8BC9C7F69E44ECABC55B63C06609E91, ordinal: 1
2016-01-14 17:39:36,143 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2016-01-14 17:39:36,143 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['count']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCountAll/countall"]
2016-01-14 17:39:36,143 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E8BC9C7F69E44ECABC55B63C06609E91, mem on start (mb), free: 43, total: 496, max: 672
2016-01-14 17:39:36,146 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E8BC9C7F69E44ECABC55B63C06609E91, mem on close (mb), free: 42, total: 496, max: 672
2016-01-14 17:39:39,147 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCountAll/countall/_temporary
2016-01-14 17:39:39,148 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] completed in: 00:06.038
2016-01-14 17:39:39,161 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testCountAll/countall
2016-01-14 17:39:39,170 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:39:39,171 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:39:39,202 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 17:39:39,203 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:39:39,203 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:39:39,211 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-14 17:39:39,211 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:39:39,211 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testParallelAggregates/multi"]
2016-01-14 17:39:39,212 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] parallel execution of steps is enabled: false
2016-01-14 17:39:39,212 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executing total steps: 1
2016-01-14 17:39:39,212 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] allocating management threads: 1
2016-01-14 17:39:39,213 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...tParallelAggregates/multi
2016-01-14 17:39:39,232 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local_0027
2016-01-14 17:39:39,232 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-14 17:39:39,235 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:39:39,338 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:39:39,339 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:39:39,345 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DDD2E2ADD0504F5B91EF91BE1F6C7543, ordinal: 0
2016-01-14 17:39:39,346 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:39:39,346 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:39:39,346 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DDD2E2ADD0504F5B91EF91BE1F6C7543, mem on start (mb), free: 25, total: 592, max: 672
2016-01-14 17:39:39,348 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:39:39,349 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 25, total: 592, max: 672
2016-01-14 17:39:39,350 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:39:39,350 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 25, total: 592, max: 672
2016-01-14 17:39:39,352 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:39:39,352 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 25, total: 592, max: 672
2016-01-14 17:39:39,353 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:39:39,354 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 25, total: 592, max: 672
2016-01-14 17:39:39,354 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DDD2E2ADD0504F5B91EF91BE1F6C7543, mem on close (mb), free: 25, total: 592, max: 672
2016-01-14 17:39:42,239 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:39:42,239 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:39:42,246 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F90B33611DD94CE791A57F5588B4B085, ordinal: 1
2016-01-14 17:39:42,246 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2016-01-14 17:39:42,246 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testParallelAggregates/multi"]
2016-01-14 17:39:42,247 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F90B33611DD94CE791A57F5588B4B085, mem on start (mb), free: 23, total: 592, max: 672
2016-01-14 17:39:42,250 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F90B33611DD94CE791A57F5588B4B085, mem on close (mb), free: 23, total: 592, max: 672
2016-01-14 17:39:45,245 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testParallelAggregates/multi/_temporary
2016-01-14 17:39:45,245 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] completed in: 00:06.033
2016-01-14 17:39:45,260 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testParallelAggregates/multi
2016-01-14 17:39:45,266 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:39:45,266 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:39:45,283 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.015
2016-01-14 17:39:45,283 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:39:45,283 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:39:45,288 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 17:39:45,288 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt"]
2016-01-14 17:39:45,289 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testRetainNarrow/retainnarrow"]
2016-01-14 17:39:45,289 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-14 17:39:45,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-14 17:39:45,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-14 17:39:45,432 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...RetainNarrow/retainnarrow
2016-01-14 17:39:45,453 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local_0028
2016-01-14 17:39:45,453 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 17:39:45,455 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt
2016-01-14 17:39:45,457 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:39:45,458 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:39:45,460 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D1074236F83B4F1BB00A2CEBF5CDE1B9, ordinal: 0
2016-01-14 17:39:45,461 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt"]
2016-01-14 17:39:45,461 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testRetainNarrow/retainnarrow"]
2016-01-14 17:39:45,461 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D1074236F83B4F1BB00A2CEBF5CDE1B9, mem on start (mb), free: 293, total: 304, max: 672
2016-01-14 17:39:45,462 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D1074236F83B4F1BB00A2CEBF5CDE1B9, mem on close (mb), free: 293, total: 304, max: 672
2016-01-14 17:39:48,459 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testRetainNarrow/retainnarrow/_temporary
2016-01-14 17:39:48,460 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:03.171
2016-01-14 17:39:48,466 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testRetainNarrow/retainnarrow
2016-01-14 17:39:48,472 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:39:48,473 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:39:48,487 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.012
2016-01-14 17:39:48,488 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:39:48,488 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:39:48,493 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 17:39:48,493 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt"]
2016-01-14 17:39:48,493 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['item']->['char', 'item']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testRenameNarrow/renamenarrow"]
2016-01-14 17:39:48,494 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-14 17:39:48,494 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-14 17:39:48,494 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-14 17:39:48,495 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...RenameNarrow/renamenarrow
2016-01-14 17:39:48,516 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local_0029
2016-01-14 17:39:48,522 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 17:39:48,524 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt
2016-01-14 17:39:48,526 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:39:48,526 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:39:48,529 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C27594383CFA4146BBB2164C0ABDF8AF, ordinal: 0
2016-01-14 17:39:48,530 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt"]
2016-01-14 17:39:48,530 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['item']->['char', 'item']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testRenameNarrow/renamenarrow"]
2016-01-14 17:39:48,530 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C27594383CFA4146BBB2164C0ABDF8AF, mem on start (mb), free: 282, total: 304, max: 672
2016-01-14 17:39:48,531 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C27594383CFA4146BBB2164C0ABDF8AF, mem on close (mb), free: 282, total: 304, max: 672
2016-01-14 17:39:51,535 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testRenameNarrow/renamenarrow/_temporary
2016-01-14 17:39:51,535 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:03.041
2016-01-14 17:39:51,541 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testRenameNarrow/renamenarrow
2016-01-14 17:39:51,552 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:39:51,552 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:39:51,576 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.021
2016-01-14 17:39:51,576 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:39:51,577 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:39:51,584 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] starting
2016-01-14 17:39:51,584 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:39:51,584 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testAverageByNull/averagenull"]
2016-01-14 17:39:51,585 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] parallel execution of steps is enabled: false
2016-01-14 17:39:51,585 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] executing total steps: 1
2016-01-14 17:39:51,585 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] allocating management threads: 1
2016-01-14 17:39:51,586 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] starting step: (1/1) ...AverageByNull/averagenull
2016-01-14 17:39:51,605 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] submitted hadoop job: job_local_0030
2016-01-14 17:39:51,605 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] tracking url: http://localhost:8080/
2016-01-14 17:39:51,608 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:39:51,622 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:39:51,622 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:39:51,626 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F531448301864E40BD76B7F511731BA8, ordinal: 0
2016-01-14 17:39:51,627 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:39:51,627 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2016-01-14 17:39:51,627 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F531448301864E40BD76B7F511731BA8, mem on start (mb), free: 170, total: 304, max: 672
2016-01-14 17:39:51,630 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:39:51,630 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 170, total: 304, max: 672
2016-01-14 17:39:51,631 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:39:51,631 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:39:51,632 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 170, total: 304, max: 672
2016-01-14 17:39:51,632 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:39:51,632 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:39:51,633 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 170, total: 304, max: 672
2016-01-14 17:39:51,633 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:39:51,634 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:39:51,634 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 170, total: 304, max: 672
2016-01-14 17:39:51,634 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:39:51,635 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F531448301864E40BD76B7F511731BA8, mem on close (mb), free: 169, total: 304, max: 672
2016-01-14 17:39:54,611 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:39:54,612 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:39:54,616 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: FE3F321B18834478900E34DAE9152ECA, ordinal: 1
2016-01-14 17:39:54,617 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2016-01-14 17:39:54,617 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testAverageByNull/averagenull"]
2016-01-14 17:39:54,617 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FE3F321B18834478900E34DAE9152ECA, mem on start (mb), free: 168, total: 304, max: 672
2016-01-14 17:39:54,620 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FE3F321B18834478900E34DAE9152ECA, mem on close (mb), free: 168, total: 304, max: 672
2016-01-14 17:39:57,619 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testAverageByNull/averagenull/_temporary
2016-01-14 17:39:57,619 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [average] completed in: 00:06.035
2016-01-14 17:39:57,631 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testAverageByNull/averagenull
2016-01-14 17:39:57,637 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:39:57,637 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:39:57,658 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-01-14 17:39:57,658 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:39:57,659 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:39:57,663 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] starting
2016-01-14 17:39:57,663 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt"]
2016-01-14 17:39:57,663 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] sink: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCoerce/coerce"]
2016-01-14 17:39:57,664 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] parallel execution of steps is enabled: false
2016-01-14 17:39:57,664 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] executing total steps: 1
2016-01-14 17:39:57,664 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] allocating management threads: 1
2016-01-14 17:39:57,665 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] starting step: (1/1) ...latform/testCoerce/coerce
2016-01-14 17:39:57,682 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] submitted hadoop job: job_local_0031
2016-01-14 17:39:57,682 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] tracking url: http://localhost:8080/
2016-01-14 17:39:57,687 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt
2016-01-14 17:39:57,689 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:39:57,689 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:39:57,692 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C3B3D9FA52F441A894F708DA775B641B, ordinal: 0
2016-01-14 17:39:57,692 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lower.txt"]
2016-01-14 17:39:57,693 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCoerce/coerce"]
2016-01-14 17:39:57,693 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C3B3D9FA52F441A894F708DA775B641B, mem on start (mb), free: 157, total: 304, max: 672
2016-01-14 17:39:57,694 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C3B3D9FA52F441A894F708DA775B641B, mem on close (mb), free: 157, total: 304, max: 672
2016-01-14 17:40:00,693 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCoerce/coerce/_temporary
2016-01-14 17:40:00,694 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [coerce] completed in: 00:03.030
2016-01-14 17:40:00,700 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testCoerce/coerce
2016-01-14 17:40:00,707 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:40:00,707 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:40:00,729 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-01-14 17:40:00,730 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:40:00,730 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:40:00,737 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-14 17:40:00,737 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] source: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs+rhs-cross-rev.txt"]
2016-01-14 17:40:00,737 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testFirstByWithoutComparator/firstnfieldswithoutcomparator"]
2016-01-14 17:40:00,738 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] parallel execution of steps is enabled: false
2016-01-14 17:40:00,738 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executing total steps: 1
2016-01-14 17:40:00,738 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] allocating management threads: 1
2016-01-14 17:40:00,739 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) ...tnfieldswithoutcomparator
2016-01-14 17:40:00,756 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted hadoop job: job_local_0032
2016-01-14 17:40:00,757 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tracking url: http://localhost:8080/
2016-01-14 17:40:00,760 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs+rhs-cross-rev.txt
2016-01-14 17:40:00,775 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:40:00,775 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:40:00,780 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F35AA744D6EA45EBA276A7F3DE8F9894, ordinal: 0
2016-01-14 17:40:00,781 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs+rhs-cross-rev.txt"]
2016-01-14 17:40:00,782 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(first)[by:[{1}:'num']]
2016-01-14 17:40:00,782 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F35AA744D6EA45EBA276A7F3DE8F9894, mem on start (mb), free: 46, total: 304, max: 672
2016-01-14 17:40:00,784 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:40:00,784 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 46, total: 304, max: 672
2016-01-14 17:40:00,785 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:40:00,786 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:40:00,787 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 46, total: 304, max: 672
2016-01-14 17:40:00,787 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:40:00,788 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F35AA744D6EA45EBA276A7F3DE8F9894, mem on close (mb), free: 46, total: 304, max: 672
2016-01-14 17:40:03,763 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:40:03,764 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:40:03,768 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: EA3437698BF14A7C9C23A84059630C45, ordinal: 1
2016-01-14 17:40:03,769 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(first)[by:[{1}:'num']]
2016-01-14 17:40:03,769 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testFirstByWithoutComparator/firstnfieldswithoutcomparator"]
2016-01-14 17:40:03,770 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EA3437698BF14A7C9C23A84059630C45, mem on start (mb), free: 45, total: 304, max: 672
2016-01-14 17:40:03,773 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EA3437698BF14A7C9C23A84059630C45, mem on close (mb), free: 44, total: 304, max: 672
2016-01-14 17:40:06,764 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testFirstByWithoutComparator/firstnfieldswithoutcomparator/_temporary
2016-01-14 17:40:06,765 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] completed in: 00:06.027
2016-01-14 17:40:06,772 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testFirstByWithoutComparator/firstnfieldswithoutcomparator
2016-01-14 17:40:06,781 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:40:06,781 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:40:06,818 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.035
2016-01-14 17:40:06,819 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:40:06,819 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:40:06,840 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting
2016-01-14 17:40:06,841 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:40:06,841 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt"]
2016-01-14 17:40:06,842 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testParallelAggregatesMergeLegacyHash/multimerge+false164"]
2016-01-14 17:40:06,842 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] parallel execution of steps is enabled: false
2016-01-14 17:40:06,843 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] executing total steps: 1
2016-01-14 17:40:06,844 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] allocating management threads: 1
2016-01-14 17:40:06,844 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] starting step: (1/1) ...yHash/multimerge+false164
2016-01-14 17:40:06,866 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] submitted hadoop job: job_local_0033
2016-01-14 17:40:06,866 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] tracking url: http://localhost:8080/
2016-01-14 17:40:06,869 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:40:06,957 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:40:06,957 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:40:06,963 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C5101DAA9B0740FC85A92C91CE70020A, ordinal: 0
2016-01-14 17:40:06,963 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:40:06,963 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 17:40:06,964 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C5101DAA9B0740FC85A92C91CE70020A, mem on start (mb), free: 28, total: 400, max: 672
2016-01-14 17:40:06,965 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:40:06,965 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 28, total: 400, max: 672
2016-01-14 17:40:06,965 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 59% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:40:06,966 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:40:06,966 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 27, total: 400, max: 672
2016-01-14 17:40:06,966 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 59% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:40:06,967 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:40:06,967 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 27, total: 400, max: 672
2016-01-14 17:40:06,967 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 59% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:40:06,968 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:40:06,968 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 27, total: 400, max: 672
2016-01-14 17:40:06,968 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 59% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:40:06,969 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C5101DAA9B0740FC85A92C91CE70020A, mem on close (mb), free: 27, total: 400, max: 672
2016-01-14 17:40:09,871 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt
2016-01-14 17:40:09,969 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:40:09,970 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:40:09,975 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C5101DAA9B0740FC85A92C91CE70020A, ordinal: 0
2016-01-14 17:40:09,976 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt"]
2016-01-14 17:40:09,976 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 17:40:09,976 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C5101DAA9B0740FC85A92C91CE70020A, mem on start (mb), free: 21, total: 495, max: 672
2016-01-14 17:40:09,980 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:40:09,980 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 21, total: 495, max: 672
2016-01-14 17:40:09,980 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 73% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:40:09,981 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:40:09,981 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 21, total: 495, max: 672
2016-01-14 17:40:09,982 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 73% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:40:09,982 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:40:09,983 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 21, total: 495, max: 672
2016-01-14 17:40:09,983 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 73% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:40:09,984 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:40:09,984 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 21, total: 495, max: 672
2016-01-14 17:40:09,984 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 73% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:40:09,985 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C5101DAA9B0740FC85A92C91CE70020A, mem on close (mb), free: 21, total: 495, max: 672
2016-01-14 17:40:12,876 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:40:12,877 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:40:12,883 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B094E84FFB5449EC8CA4D025B69F9FA0, ordinal: 1
2016-01-14 17:40:12,883 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2016-01-14 17:40:12,884 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testParallelAggregatesMergeLegacyHash/multimerge+false164"]
2016-01-14 17:40:12,884 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B094E84FFB5449EC8CA4D025B69F9FA0, mem on start (mb), free: 20, total: 495, max: 672
2016-01-14 17:40:12,889 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B094E84FFB5449EC8CA4D025B69F9FA0, mem on close (mb), free: 19, total: 495, max: 672
2016-01-14 17:40:15,883 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testParallelAggregatesMergeLegacyHash/multimerge+false164/_temporary
2016-01-14 17:40:15,883 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [name] completed in: 00:09.042
2016-01-14 17:40:15,896 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testParallelAggregatesMergeLegacyHash/multimerge+false164
2016-01-14 17:40:15,991 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:40:15,991 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:40:16,067 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.072
2016-01-14 17:40:16,069 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 5, nodes: 10
2016-01-14 17:40:16,069 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:40:16,102 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting
2016-01-14 17:40:16,103 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:40:16,103 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testSameSourceMergeThreeWay/samesourcemergethreeway"]
2016-01-14 17:40:16,103 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] parallel execution of steps is enabled: false
2016-01-14 17:40:16,104 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] executing total steps: 5
2016-01-14 17:40:16,104 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] allocating management threads: 1
2016-01-14 17:40:16,106 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (1/5)
2016-01-14 17:40:16,125 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local_0034
2016-01-14 17:40:16,126 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-14 17:40:16,128 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:40:16,142 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:40:16,142 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:40:16,147 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D4EB111394B54E1681EE0A10C9BA398B, ordinal: 0
2016-01-14 17:40:16,147 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:40:16,148 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(source)[by:[{1}:'char']]
2016-01-14 17:40:16,148 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D4EB111394B54E1681EE0A10C9BA398B, mem on start (mb), free: 181, total: 304, max: 672
2016-01-14 17:40:16,149 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:40:16,149 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 181, total: 304, max: 672
2016-01-14 17:40:16,149 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:40:16,150 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:40:16,150 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 181, total: 304, max: 672
2016-01-14 17:40:16,150 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:40:16,150 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2016-01-14 17:40:16,151 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 181, total: 304, max: 672
2016-01-14 17:40:16,151 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:40:16,151 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2016-01-14 17:40:16,151 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 181, total: 304, max: 672
2016-01-14 17:40:16,151 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:40:16,152 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D4EB111394B54E1681EE0A10C9BA398B, mem on close (mb), free: 181, total: 304, max: 672
2016-01-14 17:40:19,132 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:40:19,132 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:40:19,136 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: ACD2F997932348E38E5DCF789CF2962B, ordinal: 1
2016-01-14 17:40:19,137 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(source)[by:[{1}:'char']]
2016-01-14 17:40:19,137 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][4243676309/source/]
2016-01-14 17:40:19,137 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ACD2F997932348E38E5DCF789CF2962B, mem on start (mb), free: 179, total: 304, max: 672
2016-01-14 17:40:19,140 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ACD2F997932348E38E5DCF789CF2962B, mem on close (mb), free: 179, total: 304, max: 672
2016-01-14 17:40:22,138 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (2/5)
2016-01-14 17:40:22,156 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local_0035
2016-01-14 17:40:22,157 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-14 17:40:22,160 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/4243676309_source_D4329964D54A46C79D77F86821DBB442/part-00000
2016-01-14 17:40:22,174 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:40:22,174 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:40:22,178 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F8D32CC81DD444E8842CEEBB99017A0A, ordinal: 0
2016-01-14 17:40:22,179 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][4243676309/source/]
2016-01-14 17:40:22,179 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count-lhs)[by:[{1}:'char']]
2016-01-14 17:40:22,179 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F8D32CC81DD444E8842CEEBB99017A0A, mem on start (mb), free: 75, total: 304, max: 672
2016-01-14 17:40:22,180 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:40:22,180 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 75, total: 304, max: 672
2016-01-14 17:40:22,180 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:40:22,181 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:40:22,181 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 75, total: 304, max: 672
2016-01-14 17:40:22,181 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 45% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:40:22,182 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F8D32CC81DD444E8842CEEBB99017A0A, mem on close (mb), free: 75, total: 304, max: 672
2016-01-14 17:40:25,163 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:40:25,163 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:40:25,167 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B18B3CDA3BA0406A8DB5AFAF13662359, ordinal: 1
2016-01-14 17:40:25,168 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count-lhs)[by:[{1}:'char']]
2016-01-14 17:40:25,168 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][9772144584/count-lhs/]
2016-01-14 17:40:25,168 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B18B3CDA3BA0406A8DB5AFAF13662359, mem on start (mb), free: 73, total: 304, max: 672
2016-01-14 17:40:25,171 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B18B3CDA3BA0406A8DB5AFAF13662359, mem on close (mb), free: 73, total: 304, max: 672
2016-01-14 17:40:28,170 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (3/5)
2016-01-14 17:40:28,189 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local_0036
2016-01-14 17:40:28,189 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-14 17:40:28,192 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/4243676309_source_D4329964D54A46C79D77F86821DBB442/part-00000
2016-01-14 17:40:28,280 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:40:28,280 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:40:28,284 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F816F6AF6C9D444EA1131627408CAB44, ordinal: 0
2016-01-14 17:40:28,284 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][4243676309/source/]
2016-01-14 17:40:28,284 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count-rhs)[by:[{1}:'char']]
2016-01-14 17:40:28,284 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F816F6AF6C9D444EA1131627408CAB44, mem on start (mb), free: 64, total: 400, max: 672
2016-01-14 17:40:28,285 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2016-01-14 17:40:28,285 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 64, total: 400, max: 672
2016-01-14 17:40:28,285 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 59% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:40:28,286 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2016-01-14 17:40:28,286 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 64, total: 400, max: 672
2016-01-14 17:40:28,286 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 59% of max mem, to better utilize unused memory consider increasing the cache size
2016-01-14 17:40:28,286 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F816F6AF6C9D444EA1131627408CAB44, mem on close (mb), free: 64, total: 400, max: 672
2016-01-14 17:40:31,195 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:40:31,195 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:40:31,200 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A6062EA13C6C429D974ECC0634ECF895, ordinal: 1
2016-01-14 17:40:31,200 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count-rhs)[by:[{1}:'char']]
2016-01-14 17:40:31,200 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][5427189855/count-rhs/]
2016-01-14 17:40:31,200 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A6062EA13C6C429D974ECC0634ECF895, mem on start (mb), free: 63, total: 400, max: 672
2016-01-14 17:40:31,203 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A6062EA13C6C429D974ECC0634ECF895, mem on close (mb), free: 63, total: 400, max: 672
2016-01-14 17:40:34,204 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (4/5)
2016-01-14 17:40:34,223 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local_0037
2016-01-14 17:40:34,224 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-14 17:40:34,227 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/5427189855_count_rhs_98D08AF4B1A64D4A948A481AC4661677/part-00000
2016-01-14 17:40:34,332 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:40:34,332 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:40:34,338 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C3950D698AA9411FB6CD7F9FAADC566F, ordinal: 0
2016-01-14 17:40:34,339 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][5427189855/count-rhs/]
2016-01-14 17:40:34,339 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 17:40:34,340 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C3950D698AA9411FB6CD7F9FAADC566F, mem on start (mb), free: 53, total: 495, max: 672
2016-01-14 17:40:34,342 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C3950D698AA9411FB6CD7F9FAADC566F, mem on close (mb), free: 53, total: 495, max: 672
2016-01-14 17:40:37,229 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/4243676309_source_D4329964D54A46C79D77F86821DBB442/part-00000
2016-01-14 17:40:37,327 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:40:37,327 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:40:37,331 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C3950D698AA9411FB6CD7F9FAADC566F, ordinal: 0
2016-01-14 17:40:37,331 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][4243676309/source/]
2016-01-14 17:40:37,331 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 17:40:37,331 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C3950D698AA9411FB6CD7F9FAADC566F, mem on start (mb), free: 47, total: 591, max: 672
2016-01-14 17:40:37,332 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C3950D698AA9411FB6CD7F9FAADC566F, mem on close (mb), free: 47, total: 591, max: 672
2016-01-14 17:40:40,246 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:40:40,246 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:40:40,252 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B0B3F1D935A9472A82CAA0E6185465CA, ordinal: 1
2016-01-14 17:40:40,253 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2016-01-14 17:40:40,253 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][589301980/source_count-rhs/]
2016-01-14 17:40:40,253 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B0B3F1D935A9472A82CAA0E6185465CA, mem on start (mb), free: 42, total: 591, max: 672
2016-01-14 17:40:40,262 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 17:40:40,262 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 17:40:40,269 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B0B3F1D935A9472A82CAA0E6185465CA, mem on close (mb), free: 41, total: 591, max: 672
2016-01-14 17:40:43,249 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] starting step: (5/5) ...y/samesourcemergethreeway
2016-01-14 17:40:43,267 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] submitted hadoop job: job_local_0038
2016-01-14 17:40:43,268 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2016-01-14 17:40:43,270 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/589301980_source_count_rhs_4E275042A6FB4FDC971897FE61C38C89/part-00000
2016-01-14 17:40:43,368 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:40:43,368 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:40:43,374 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B2AFA2CF85BA44EFB767D88E76CDAA91, ordinal: 0
2016-01-14 17:40:43,375 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][589301980/source_count-rhs/]
2016-01-14 17:40:43,375 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2016-01-14 17:40:43,375 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B2AFA2CF85BA44EFB767D88E76CDAA91, mem on start (mb), free: 33, total: 686, max: 686
2016-01-14 17:40:43,377 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B2AFA2CF85BA44EFB767D88E76CDAA91, mem on close (mb), free: 33, total: 686, max: 686
2016-01-14 17:40:46,272 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/9772144584_count_lhs_E376CBC3BE314767BEE17AC699A470B3/part-00000
2016-01-14 17:40:46,426 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:40:46,426 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:40:46,430 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B2AFA2CF85BA44EFB767D88E76CDAA91, ordinal: 0
2016-01-14 17:40:46,431 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][9772144584/count-lhs/]
2016-01-14 17:40:46,431 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2016-01-14 17:40:46,431 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B2AFA2CF85BA44EFB767D88E76CDAA91, mem on start (mb), free: 195, total: 305, max: 672
2016-01-14 17:40:46,432 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B2AFA2CF85BA44EFB767D88E76CDAA91, mem on close (mb), free: 195, total: 305, max: 672
2016-01-14 17:40:49,277 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:40:49,278 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:40:49,282 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CC1F2CA9EFBE47B3B5DEA559F8DF5BF9, ordinal: 1
2016-01-14 17:40:49,283 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2016-01-14 17:40:49,283 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testSameSourceMergeThreeWay/samesourcemergethreeway"]
2016-01-14 17:40:49,283 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CC1F2CA9EFBE47B3B5DEA559F8DF5BF9, mem on start (mb), free: 194, total: 305, max: 672
2016-01-14 17:40:49,285 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 17:40:49,285 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 17:40:49,287 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CC1F2CA9EFBE47B3B5DEA559F8DF5BF9, mem on close (mb), free: 193, total: 305, max: 672
2016-01-14 17:40:52,285 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testSameSourceMergeThreeWay/samesourcemergethreeway/_temporary
2016-01-14 17:40:52,286 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count-lhs*source*count...] completed in: 00:36.181
2016-01-14 17:40:52,297 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testSameSourceMergeThreeWay/samesourcemergethreeway
2016-01-14 17:40:52,306 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:40:52,307 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:40:52,332 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.023
2016-01-14 17:40:52,333 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:40:52,334 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:40:52,343 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] starting
2016-01-14 17:40:52,343 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt"]
2016-01-14 17:40:52,343 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:40:52,343 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] sink: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testUniqueMerge/uniquemerge-nondeterministic"]
2016-01-14 17:40:52,344 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] parallel execution of steps is enabled: false
2016-01-14 17:40:52,344 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] executing total steps: 1
2016-01-14 17:40:52,344 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] allocating management threads: 1
2016-01-14 17:40:52,345 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] starting step: (1/1) ...quemerge-nondeterministic
2016-01-14 17:40:52,371 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] submitted hadoop job: job_local_0039
2016-01-14 17:40:52,373 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] tracking url: http://localhost:8080/
2016-01-14 17:40:52,376 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:40:52,390 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:40:52,391 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:40:52,394 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A2CD97C0B4894B76B017B1722C474770, ordinal: 0
2016-01-14 17:40:52,395 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:40:52,395 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2016-01-14 17:40:52,395 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A2CD97C0B4894B76B017B1722C474770, mem on start (mb), free: 79, total: 305, max: 672
2016-01-14 17:40:52,399 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A2CD97C0B4894B76B017B1722C474770, mem on close (mb), free: 79, total: 305, max: 672
2016-01-14 17:40:55,378 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt
2016-01-14 17:40:55,466 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:40:55,467 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:40:55,470 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A2CD97C0B4894B76B017B1722C474770, ordinal: 0
2016-01-14 17:40:55,471 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/rhs.txt"]
2016-01-14 17:40:55,471 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2016-01-14 17:40:55,471 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A2CD97C0B4894B76B017B1722C474770, mem on start (mb), free: 73, total: 401, max: 672
2016-01-14 17:40:55,472 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A2CD97C0B4894B76B017B1722C474770, mem on close (mb), free: 73, total: 401, max: 672
2016-01-14 17:40:58,382 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:40:58,382 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:40:58,386 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CD9D8B1ACA7B4344995A6BEBF67B7C20, ordinal: 1
2016-01-14 17:40:58,387 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2016-01-14 17:40:58,387 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testUniqueMerge/uniquemerge-nondeterministic"]
2016-01-14 17:40:58,387 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CD9D8B1ACA7B4344995A6BEBF67B7C20, mem on start (mb), free: 71, total: 401, max: 672
2016-01-14 17:40:58,390 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CD9D8B1ACA7B4344995A6BEBF67B7C20, mem on close (mb), free: 71, total: 401, max: 672
2016-01-14 17:41:01,387 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testUniqueMerge/uniquemerge-nondeterministic/_temporary
2016-01-14 17:41:01,388 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [lhs+rhs] completed in: 00:09.044
2016-01-14 17:41:01,394 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testUniqueMerge/uniquemerge-nondeterministic
2016-01-14 17:41:01,401 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:41:01,401 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:41:01,419 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.015
2016-01-14 17:41:01,420 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:41:01,420 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:41:01,426 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting
2016-01-14 17:41:01,426 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:41:01,427 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] sink: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testUnique/unique"]
2016-01-14 17:41:01,427 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] parallel execution of steps is enabled: false
2016-01-14 17:41:01,427 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] executing total steps: 1
2016-01-14 17:41:01,427 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] allocating management threads: 1
2016-01-14 17:41:01,428 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] starting step: (1/1) ...latform/testUnique/unique
2016-01-14 17:41:01,446 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] submitted hadoop job: job_local_0040
2016-01-14 17:41:01,446 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] tracking url: http://localhost:8080/
2016-01-14 17:41:01,449 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:41:01,546 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:41:01,546 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:41:01,550 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AE790AD24F1D4226B044897052C3A7B0, ordinal: 0
2016-01-14 17:41:01,550 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:41:01,551 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(shape)[by:[{1}:'num']]
2016-01-14 17:41:01,551 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AE790AD24F1D4226B044897052C3A7B0, mem on start (mb), free: 55, total: 496, max: 672
2016-01-14 17:41:01,553 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AE790AD24F1D4226B044897052C3A7B0, mem on close (mb), free: 55, total: 496, max: 672
2016-01-14 17:41:04,456 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:41:04,456 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:41:04,460 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DA62F3CEDBCD45998CB8A42619A0E258, ordinal: 1
2016-01-14 17:41:04,460 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(shape)[by:[{1}:'num']]
2016-01-14 17:41:04,460 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testUnique/unique"]
2016-01-14 17:41:04,461 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DA62F3CEDBCD45998CB8A42619A0E258, mem on start (mb), free: 54, total: 496, max: 672
2016-01-14 17:41:04,463 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DA62F3CEDBCD45998CB8A42619A0E258, mem on close (mb), free: 53, total: 496, max: 672
2016-01-14 17:41:07,467 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testUnique/unique/_temporary
2016-01-14 17:41:07,467 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [shape] completed in: 00:06.041
2016-01-14 17:41:07,474 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testUnique/unique
2016-01-14 17:41:07,481 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:41:07,481 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/3.0.4/ab50b225eb80fe7b8e59368476a4bfb0fa1a0ef5/cascading-hadoop-3.0.4.jar
2016-01-14 17:41:07,511 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.027
2016-01-14 17:41:07,511 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 17:41:07,512 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:41:07,518 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting
2016-01-14 17:41:07,518 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:41:07,519 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] sink: Hfs["TextDelimited[['notnull', 'null']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCountNullNotNull/countnullnotnull"]
2016-01-14 17:41:07,519 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] parallel execution of steps is enabled: false
2016-01-14 17:41:07,519 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] executing total steps: 1
2016-01-14 17:41:07,521 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] allocating management threads: 1
2016-01-14 17:41:07,521 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] starting step: (1/1) ...lNotNull/countnullnotnull
2016-01-14 17:41:07,541 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] submitted hadoop job: job_local_0041
2016-01-14 17:41:07,542 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] tracking url: http://localhost:8080/
2016-01-14 17:41:07,544 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt
2016-01-14 17:41:07,642 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 17:41:07,642 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 17:41:07,647 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FE959F5277F04587BC81AEE25941BB2E, ordinal: 0
2016-01-14 17:41:07,647 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/classes/test/data/lhs.txt"]
2016-01-14 17:41:07,648 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2016-01-14 17:41:07,648 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FE959F5277F04587BC81AEE25941BB2E, mem on start (mb), free: 37, total: 592, max: 672
2016-01-14 17:41:07,652 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FE959F5277F04587BC81AEE25941BB2E, mem on close (mb), free: 37, total: 592, max: 672
2016-01-14 17:41:10,547 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 17:41:10,548 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 17:41:10,553 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A34B2E620D3D490EA5A4B3FC32480231, ordinal: 1
2016-01-14 17:41:10,554 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2016-01-14 17:41:10,554 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextDelimited[['notnull', 'null']]"]["/opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCountNullNotNull/countnullnotnull"]
2016-01-14 17:41:10,554 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A34B2E620D3D490EA5A4B3FC32480231, mem on start (mb), free: 35, total: 592, max: 672
2016-01-14 17:41:10,557 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A34B2E620D3D490EA5A4B3FC32480231, mem on close (mb), free: 35, total: 592, max: 672
2016-01-14 17:41:13,553 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output/hadoop/assemblyhelpersplatform/testCountNullNotNull/countnullnotnull/_temporary
2016-01-14 17:41:13,553 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [count] completed in: 00:06.034
2016-01-14 17:41:13,564 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/d1e2e77517c04a30/apache-0.20.205.0/build/test/output//hadoop/assemblyhelpersplatform/testCountNullNotNull/countnullnotnull