2015-11-23 15:28:24,391 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2015-11-23 15:28:24,405 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.SortedValuesPlatformTest, with platform: hadoop2-mr1
2015-11-23 15:28:24,422 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(119)) - not using cluster
2015-11-23 15:28:24,814 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-11-23 15:28:24,890 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2015-11-23 15:28:24,946 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:28:24,948 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:28:24,994 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: EBDCD9DE663F4AC5864DBD1C64A51D55
2015-11-23 15:28:25,107 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.079
2015-11-23 15:28:25,109 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:28:25,110 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:28:25,264 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.2
2015-11-23 15:28:25,265 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] starting
2015-11-23 15:28:25,265 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/apache.200.txt"]
2015-11-23 15:28:25,266 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/ips.20.txt"]
2015-11-23 15:28:25,266 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testCoGroupComparatorValuesReversed/cogroupcomparereversed"]
2015-11-23 15:28:25,267 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] parallel execution of steps is enabled: false
2015-11-23 15:28:25,267 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] executing total steps: 1
2015-11-23 15:28:25,267 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] allocating management threads: 1
2015-11-23 15:28:25,267 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] starting step: (1/1) ...ed/cogroupcomparereversed
2015-11-23 15:28:25,554 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] submitted hadoop job: job_local524388971_0001
2015-11-23 15:28:25,555 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] tracking url: http://localhost:8080/
2015-11-23 15:28:25,659 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/apache.200.txt
2015-11-23 15:28:25,702 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:28:25,702 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:28:25,715 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B290D85135CF4AC7A380EBFF0269CE1E, ordinal: 0
2015-11-23 15:28:25,741 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/apache.200.txt"]
2015-11-23 15:28:25,741 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(apache*ip)[by: apache:[{1}:'octet'] ip:[{1}:'rawoctet']]
2015-11-23 15:28:25,741 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B290D85135CF4AC7A380EBFF0269CE1E, mem on start (mb), free: 216, total: 337, max: 672
2015-11-23 15:28:25,769 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B290D85135CF4AC7A380EBFF0269CE1E, mem on close (mb), free: 215, total: 337, max: 672
2015-11-23 15:28:39,023 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/ips.20.txt
2015-11-23 15:28:39,042 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:28:39,042 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:28:39,050 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B290D85135CF4AC7A380EBFF0269CE1E, ordinal: 0
2015-11-23 15:28:39,051 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/ips.20.txt"]
2015-11-23 15:28:39,051 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(apache*ip)[by: apache:[{1}:'octet'] ip:[{1}:'rawoctet']]
2015-11-23 15:28:39,051 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B290D85135CF4AC7A380EBFF0269CE1E, mem on start (mb), free: 272, total: 613, max: 672
2015-11-23 15:28:39,053 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B290D85135CF4AC7A380EBFF0269CE1E, mem on close (mb), free: 272, total: 613, max: 672
2015-11-23 15:28:43,250 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:28:43,250 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:28:43,256 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C44507F67A3A460CB2A7E948824516FB, ordinal: 1
2015-11-23 15:28:43,258 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(apache*ip)[by: apache:[{1}:'octet'] ip:[{1}:'rawoctet']]
2015-11-23 15:28:43,258 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testCoGroupComparatorValuesReversed/cogroupcomparereversed"]
2015-11-23 15:28:43,258 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C44507F67A3A460CB2A7E948824516FB, mem on start (mb), free: 593, total: 721, max: 721
2015-11-23 15:28:43,274 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-11-23 15:28:43,274 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-11-23 15:28:43,294 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C44507F67A3A460CB2A7E948824516FB, mem on close (mb), free: 588, total: 721, max: 721
2015-11-23 15:28:43,345 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testCoGroupComparatorValuesReversed/cogroupcomparereversed/_temporary
2015-11-23 15:28:43,345 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] completed in: 00:18.078
2015-11-23 15:28:43,381 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testCoGroupComparatorValuesReversed/cogroupcomparereversed
2015-11-23 15:28:43,397 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:28:43,397 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:28:43,437 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.035
2015-11-23 15:28:43,438 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:28:43,439 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:28:43,458 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] starting
2015-11-23 15:28:43,459 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/apache.200.txt"]
2015-11-23 15:28:43,459 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/ips.20.txt"]
2015-11-23 15:28:43,459 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testCoGroupComparatorValues/cogroupcompareforward"]
2015-11-23 15:28:43,459 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] parallel execution of steps is enabled: false
2015-11-23 15:28:43,459 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] executing total steps: 1
2015-11-23 15:28:43,459 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] allocating management threads: 1
2015-11-23 15:28:43,460 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] starting step: (1/1) ...ues/cogroupcompareforward
2015-11-23 15:28:43,563 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] submitted hadoop job: job_local1546652841_0002
2015-11-23 15:28:43,563 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] tracking url: http://localhost:8080/
2015-11-23 15:28:43,569 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/apache.200.txt
2015-11-23 15:28:43,587 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:28:43,588 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:28:43,594 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A829DD5E43934585875E88EEC96E21E1, ordinal: 0
2015-11-23 15:28:43,595 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/apache.200.txt"]
2015-11-23 15:28:43,595 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(apache*ip)[by: apache:[{1}:'octet'] ip:[{1}:'rawoctet']]
2015-11-23 15:28:43,595 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A829DD5E43934585875E88EEC96E21E1, mem on start (mb), free: 379, total: 721, max: 721
2015-11-23 15:28:43,606 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A829DD5E43934585875E88EEC96E21E1, mem on close (mb), free: 379, total: 721, max: 721
2015-11-23 15:28:55,225 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/ips.20.txt
2015-11-23 15:28:55,252 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:28:55,252 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:28:55,257 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A829DD5E43934585875E88EEC96E21E1, ordinal: 0
2015-11-23 15:28:55,258 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/ips.20.txt"]
2015-11-23 15:28:55,258 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(apache*ip)[by: apache:[{1}:'octet'] ip:[{1}:'rawoctet']]
2015-11-23 15:28:55,258 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A829DD5E43934585875E88EEC96E21E1, mem on start (mb), free: 520, total: 742, max: 742
2015-11-23 15:28:55,259 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A829DD5E43934585875E88EEC96E21E1, mem on close (mb), free: 520, total: 742, max: 742
2015-11-23 15:28:59,260 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:28:59,261 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:28:59,265 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B34C9FB5897D4A4CB11B0193236A69BD, ordinal: 1
2015-11-23 15:28:59,266 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(apache*ip)[by: apache:[{1}:'octet'] ip:[{1}:'rawoctet']]
2015-11-23 15:28:59,266 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testCoGroupComparatorValues/cogroupcompareforward"]
2015-11-23 15:28:59,266 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B34C9FB5897D4A4CB11B0193236A69BD, mem on start (mb), free: 564, total: 744, max: 744
2015-11-23 15:28:59,274 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-11-23 15:28:59,275 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-11-23 15:28:59,288 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B34C9FB5897D4A4CB11B0193236A69BD, mem on close (mb), free: 560, total: 744, max: 744
2015-11-23 15:28:59,310 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testCoGroupComparatorValues/cogroupcompareforward/_temporary
2015-11-23 15:28:59,311 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache*ip] completed in: 00:15.851
2015-11-23 15:28:59,341 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testCoGroupComparatorValues/cogroupcompareforward
2015-11-23 15:28:59,354 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:28:59,355 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:28:59,372 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache] executed rule registry: MapReduceHadoopRuleRegistry, completed as: ILLEGAL, in: 00:00.012
2015-11-23 15:28:59,372 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [apache] rule registry: MapReduceHadoopRuleRegistry, found assembly to be malformed
2015-11-23 15:28:59,385 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:28:59,385 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:28:59,410 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.020
2015-11-23 15:28:59,411 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:28:59,411 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:28:59,425 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:28:59,425 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:28:59,425 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_null_false_false"]
2015-11-23 15:28:59,426 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:28:59,426 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:28:59,426 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:28:59,427 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...ve/false_null_false_false
2015-11-23 15:28:59,506 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local1305021379_0003
2015-11-23 15:28:59,506 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:28:59,511 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:28:59,536 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:28:59,537 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:28:59,540 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A4443678EA1B4C13991876C27D16A388, ordinal: 0
2015-11-23 15:28:59,540 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:28:59,540 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:28:59,541 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A4443678EA1B4C13991876C27D16A388, mem on start (mb), free: 522, total: 743, max: 743
2015-11-23 15:28:59,542 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A4443678EA1B4C13991876C27D16A388, mem on close (mb), free: 522, total: 743, max: 743
2015-11-23 15:28:59,554 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:28:59,554 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:28:59,558 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: FAAF6B5EABE842458299F30E99069148, ordinal: 1
2015-11-23 15:28:59,558 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:28:59,558 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_null_false_false"]
2015-11-23 15:28:59,559 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FAAF6B5EABE842458299F30E99069148, mem on start (mb), free: 513, total: 743, max: 743
2015-11-23 15:28:59,567 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FAAF6B5EABE842458299F30E99069148, mem on close (mb), free: 508, total: 743, max: 743
2015-11-23 15:28:59,591 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_null_false_false/_temporary
2015-11-23 15:28:59,591 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:00.165
2015-11-23 15:28:59,625 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:28:59,625 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:28:59,644 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.015
2015-11-23 15:28:59,645 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:28:59,645 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:28:59,655 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:28:59,656 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:28:59,656 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_null_false_false"]
2015-11-23 15:28:59,656 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:28:59,656 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:28:59,656 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:28:59,657 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...ive/true_null_false_false
2015-11-23 15:28:59,727 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local1156241652_0004
2015-11-23 15:28:59,727 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:28:59,732 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:28:59,759 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:28:59,760 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:28:59,763 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: ADA6AADBC2BB4077BE2B0A3B06F88046, ordinal: 0
2015-11-23 15:28:59,763 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:28:59,764 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:28:59,764 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: ADA6AADBC2BB4077BE2B0A3B06F88046, mem on start (mb), free: 517, total: 734, max: 734
2015-11-23 15:28:59,766 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: ADA6AADBC2BB4077BE2B0A3B06F88046, mem on close (mb), free: 517, total: 734, max: 734
2015-11-23 15:29:01,189 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:01,189 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:01,195 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D740566FE3954AB8962ABF5E4C2BC44B, ordinal: 1
2015-11-23 15:29:01,195 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:01,195 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_null_false_false"]
2015-11-23 15:29:01,196 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D740566FE3954AB8962ABF5E4C2BC44B, mem on start (mb), free: 525, total: 743, max: 743
2015-11-23 15:29:01,204 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D740566FE3954AB8962ABF5E4C2BC44B, mem on close (mb), free: 521, total: 743, max: 743
2015-11-23 15:29:01,222 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_null_false_false/_temporary
2015-11-23 15:29:01,223 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:01.567
2015-11-23 15:29:01,260 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:01,260 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:01,278 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.014
2015-11-23 15:29:01,279 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:01,279 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:01,289 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:01,289 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:01,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_null_true_false"]
2015-11-23 15:29:01,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:01,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:01,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:01,291 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...ive/false_null_true_false
2015-11-23 15:29:01,375 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local93899184_0005
2015-11-23 15:29:01,375 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:01,380 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:01,408 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:01,408 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:01,411 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D69BC0F26262411EBCEC4A243AC55A4F, ordinal: 0
2015-11-23 15:29:01,412 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:01,412 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:01,412 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D69BC0F26262411EBCEC4A243AC55A4F, mem on start (mb), free: 520, total: 742, max: 742
2015-11-23 15:29:01,413 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D69BC0F26262411EBCEC4A243AC55A4F, mem on close (mb), free: 520, total: 742, max: 742
2015-11-23 15:29:01,423 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:01,423 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:01,426 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E4F97DCE8F1A4F2CB9127689173727D8, ordinal: 1
2015-11-23 15:29:01,426 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:01,426 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_null_true_false"]
2015-11-23 15:29:01,427 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E4F97DCE8F1A4F2CB9127689173727D8, mem on start (mb), free: 515, total: 742, max: 742
2015-11-23 15:29:01,433 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E4F97DCE8F1A4F2CB9127689173727D8, mem on close (mb), free: 511, total: 742, max: 742
2015-11-23 15:29:01,451 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_null_true_false/_temporary
2015-11-23 15:29:01,452 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:00.162
2015-11-23 15:29:01,489 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:01,489 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:01,506 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.013
2015-11-23 15:29:01,507 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:01,507 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:01,518 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:01,518 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:01,518 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_null_true_false"]
2015-11-23 15:29:01,518 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:01,518 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:01,519 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:01,519 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...sive/true_null_true_false
2015-11-23 15:29:01,591 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local847457854_0006
2015-11-23 15:29:01,592 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:01,596 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:01,621 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:01,621 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:01,624 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C5E2E6EC4DC142D5A71681D9E92AD3F3, ordinal: 0
2015-11-23 15:29:01,624 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:01,624 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:01,624 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C5E2E6EC4DC142D5A71681D9E92AD3F3, mem on start (mb), free: 514, total: 731, max: 731
2015-11-23 15:29:01,626 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C5E2E6EC4DC142D5A71681D9E92AD3F3, mem on close (mb), free: 514, total: 731, max: 731
2015-11-23 15:29:02,992 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:02,992 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:02,996 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C32FE710431446568BC3E60118E735EE, ordinal: 1
2015-11-23 15:29:02,996 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:02,996 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_null_true_false"]
2015-11-23 15:29:02,996 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C32FE710431446568BC3E60118E735EE, mem on start (mb), free: 515, total: 742, max: 742
2015-11-23 15:29:03,006 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C32FE710431446568BC3E60118E735EE, mem on close (mb), free: 512, total: 742, max: 742
2015-11-23 15:29:03,024 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_null_true_false/_temporary
2015-11-23 15:29:03,025 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:01.506
2015-11-23 15:29:03,067 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:03,068 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:03,089 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.018
2015-11-23 15:29:03,090 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:03,090 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:03,106 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:03,107 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:03,107 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_false_false_false"]
2015-11-23 15:29:03,107 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:03,107 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:03,107 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:03,108 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...e/false_false_false_false
2015-11-23 15:29:03,185 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local1837770710_0007
2015-11-23 15:29:03,185 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:03,191 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:03,217 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:03,218 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:03,220 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B69EF59378AD4A04879FA8138022DD57, ordinal: 0
2015-11-23 15:29:03,220 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:03,220 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:03,221 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B69EF59378AD4A04879FA8138022DD57, mem on start (mb), free: 519, total: 742, max: 742
2015-11-23 15:29:03,222 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B69EF59378AD4A04879FA8138022DD57, mem on close (mb), free: 519, total: 742, max: 742
2015-11-23 15:29:03,231 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:03,231 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:03,234 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A43EE51EE2BD4CA09CD9DA1B838C576E, ordinal: 1
2015-11-23 15:29:03,235 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:03,235 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_false_false_false"]
2015-11-23 15:29:03,235 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A43EE51EE2BD4CA09CD9DA1B838C576E, mem on start (mb), free: 513, total: 742, max: 742
2015-11-23 15:29:03,242 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A43EE51EE2BD4CA09CD9DA1B838C576E, mem on close (mb), free: 510, total: 742, max: 742
2015-11-23 15:29:03,259 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_false_false_false/_temporary
2015-11-23 15:29:03,259 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:00.152
2015-11-23 15:29:03,292 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:03,292 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:03,308 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.012
2015-11-23 15:29:03,308 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:03,308 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:03,321 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:03,321 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:03,321 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_false_false_false"]
2015-11-23 15:29:03,321 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:03,321 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:03,321 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:03,322 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...ve/true_false_false_false
2015-11-23 15:29:03,407 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local1337410084_0008
2015-11-23 15:29:03,408 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:03,414 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:03,439 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:03,439 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:03,442 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: EB0DCFB14AEB4793B67B7094F8FAB92F, ordinal: 0
2015-11-23 15:29:03,442 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:03,442 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:03,443 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EB0DCFB14AEB4793B67B7094F8FAB92F, mem on start (mb), free: 511, total: 730, max: 730
2015-11-23 15:29:03,444 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EB0DCFB14AEB4793B67B7094F8FAB92F, mem on close (mb), free: 511, total: 730, max: 730
2015-11-23 15:29:05,541 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:05,542 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:05,546 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: FFDD3379AEFF48AE99BC851C2EA6A8A6, ordinal: 1
2015-11-23 15:29:05,546 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:05,546 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_false_false_false"]
2015-11-23 15:29:05,546 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FFDD3379AEFF48AE99BC851C2EA6A8A6, mem on start (mb), free: 579, total: 741, max: 741
2015-11-23 15:29:05,552 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FFDD3379AEFF48AE99BC851C2EA6A8A6, mem on close (mb), free: 576, total: 741, max: 741
2015-11-23 15:29:05,570 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_false_false_false/_temporary
2015-11-23 15:29:05,571 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:02.249
2015-11-23 15:29:05,610 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:05,611 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:05,627 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.012
2015-11-23 15:29:05,628 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:05,628 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:05,640 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:05,641 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:05,641 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_true_false_false"]
2015-11-23 15:29:05,641 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:05,641 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:05,641 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:05,642 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...ive/true_true_false_false
2015-11-23 15:29:05,727 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local1782848054_0009
2015-11-23 15:29:05,728 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:05,733 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:05,752 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:05,753 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:05,755 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C97EFECF972E4B6999F6920BE05A83B6, ordinal: 0
2015-11-23 15:29:05,756 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:05,756 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:05,756 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C97EFECF972E4B6999F6920BE05A83B6, mem on start (mb), free: 396, total: 741, max: 741
2015-11-23 15:29:05,757 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C97EFECF972E4B6999F6920BE05A83B6, mem on close (mb), free: 396, total: 741, max: 741
2015-11-23 15:29:08,422 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:08,422 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:08,427 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F905E51EABC14B36B5D1AD1D2F8283F8, ordinal: 1
2015-11-23 15:29:08,427 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:08,428 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_true_false_false"]
2015-11-23 15:29:08,428 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F905E51EABC14B36B5D1AD1D2F8283F8, mem on start (mb), free: 591, total: 741, max: 741
2015-11-23 15:29:08,437 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F905E51EABC14B36B5D1AD1D2F8283F8, mem on close (mb), free: 586, total: 741, max: 741
2015-11-23 15:29:08,451 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_true_false_false/_temporary
2015-11-23 15:29:08,451 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:02.811
2015-11-23 15:29:08,491 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:08,491 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:08,509 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.014
2015-11-23 15:29:08,510 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:08,510 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:08,520 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:08,521 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:08,521 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_true_false_false"]
2015-11-23 15:29:08,521 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:08,521 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:08,521 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:08,521 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...ve/false_true_false_false
2015-11-23 15:29:08,616 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local379175703_0010
2015-11-23 15:29:08,616 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:08,622 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:08,645 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:08,645 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:08,648 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DBA3EE57FE5A4185B5B9F1131F0F9123, ordinal: 0
2015-11-23 15:29:08,648 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:08,648 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:08,648 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DBA3EE57FE5A4185B5B9F1131F0F9123, mem on start (mb), free: 522, total: 741, max: 741
2015-11-23 15:29:08,649 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DBA3EE57FE5A4185B5B9F1131F0F9123, mem on close (mb), free: 522, total: 741, max: 741
2015-11-23 15:29:09,932 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:09,933 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:09,935 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B760EC5F464F491FA7F4B494E9CABC8F, ordinal: 1
2015-11-23 15:29:09,935 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:09,936 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_true_false_false"]
2015-11-23 15:29:09,936 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B760EC5F464F491FA7F4B494E9CABC8F, mem on start (mb), free: 552, total: 741, max: 741
2015-11-23 15:29:09,941 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B760EC5F464F491FA7F4B494E9CABC8F, mem on close (mb), free: 548, total: 741, max: 741
2015-11-23 15:29:09,953 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_true_false_false/_temporary
2015-11-23 15:29:09,953 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:01.432
2015-11-23 15:29:09,981 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:09,982 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:09,999 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.013
2015-11-23 15:29:10,000 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:10,000 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:10,009 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:10,009 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:10,009 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_false_true_false"]
2015-11-23 15:29:10,010 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:10,010 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:10,010 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:10,010 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...ve/false_false_true_false
2015-11-23 15:29:10,093 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local1406894226_0011
2015-11-23 15:29:10,094 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:10,098 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:10,121 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:10,121 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:10,124 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DFABD157AA6D4C828036ACC59888DA00, ordinal: 0
2015-11-23 15:29:10,124 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:10,124 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:10,124 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DFABD157AA6D4C828036ACC59888DA00, mem on start (mb), free: 508, total: 731, max: 731
2015-11-23 15:29:10,125 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DFABD157AA6D4C828036ACC59888DA00, mem on close (mb), free: 508, total: 731, max: 731
2015-11-23 15:29:10,134 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:10,134 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:10,138 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E9314AFF96DB48969CDF40DD39B978E7, ordinal: 1
2015-11-23 15:29:10,139 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:10,139 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_false_true_false"]
2015-11-23 15:29:10,139 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E9314AFF96DB48969CDF40DD39B978E7, mem on start (mb), free: 502, total: 731, max: 731
2015-11-23 15:29:10,144 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E9314AFF96DB48969CDF40DD39B978E7, mem on close (mb), free: 500, total: 731, max: 731
2015-11-23 15:29:10,152 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_false_true_false/_temporary
2015-11-23 15:29:10,152 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:00.143
2015-11-23 15:29:10,180 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:10,180 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:10,194 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.010
2015-11-23 15:29:10,195 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:10,195 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:10,207 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:10,208 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:10,208 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_false_true_false"]
2015-11-23 15:29:10,208 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:10,208 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:10,208 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:10,209 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...ive/true_false_true_false
2015-11-23 15:29:10,280 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local1366285870_0012
2015-11-23 15:29:10,281 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:10,284 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:10,307 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:10,307 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:10,310 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C498B63235C0478B966240F828AE548C, ordinal: 0
2015-11-23 15:29:10,310 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:10,310 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:10,310 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C498B63235C0478B966240F828AE548C, mem on start (mb), free: 520, total: 741, max: 741
2015-11-23 15:29:10,311 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C498B63235C0478B966240F828AE548C, mem on close (mb), free: 520, total: 741, max: 741
2015-11-23 15:29:12,399 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:12,399 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:12,401 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B3387BEFA6664C38BABDB1FB678879A6, ordinal: 1
2015-11-23 15:29:12,402 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:12,402 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_false_true_false"]
2015-11-23 15:29:12,402 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B3387BEFA6664C38BABDB1FB678879A6, mem on start (mb), free: 568, total: 739, max: 739
2015-11-23 15:29:12,409 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B3387BEFA6664C38BABDB1FB678879A6, mem on close (mb), free: 565, total: 739, max: 739
2015-11-23 15:29:12,425 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_false_true_false/_temporary
2015-11-23 15:29:12,426 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:02.218
2015-11-23 15:29:12,458 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:12,459 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:12,473 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.011
2015-11-23 15:29:12,474 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:12,474 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:12,481 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:12,482 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:12,482 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_true_true_false"]
2015-11-23 15:29:12,482 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:12,482 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:12,482 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:12,483 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...sive/true_true_true_false
2015-11-23 15:29:12,564 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local1571129065_0013
2015-11-23 15:29:12,564 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:12,569 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:12,594 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:12,594 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:12,596 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BB1D9781E3D04A8FBD381AF0950E4AB5, ordinal: 0
2015-11-23 15:29:12,597 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:12,597 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:12,597 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BB1D9781E3D04A8FBD381AF0950E4AB5, mem on start (mb), free: 517, total: 740, max: 740
2015-11-23 15:29:12,598 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BB1D9781E3D04A8FBD381AF0950E4AB5, mem on close (mb), free: 517, total: 740, max: 740
2015-11-23 15:29:15,297 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:15,297 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:15,301 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E41FDA28B63E4DDEBA5A5596C02EFC02, ordinal: 1
2015-11-23 15:29:15,301 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:15,301 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_true_true_false"]
2015-11-23 15:29:15,302 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E41FDA28B63E4DDEBA5A5596C02EFC02, mem on start (mb), free: 475, total: 740, max: 740
2015-11-23 15:29:15,309 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E41FDA28B63E4DDEBA5A5596C02EFC02, mem on close (mb), free: 470, total: 740, max: 740
2015-11-23 15:29:15,323 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_true_true_false/_temporary
2015-11-23 15:29:15,324 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:02.842
2015-11-23 15:29:15,368 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:15,368 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:15,383 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.010
2015-11-23 15:29:15,383 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:15,383 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:15,395 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:15,396 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:15,396 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_true_true_false"]
2015-11-23 15:29:15,396 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:15,396 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:15,396 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:15,397 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...ive/false_true_true_false
2015-11-23 15:29:15,491 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local2011443901_0014
2015-11-23 15:29:15,491 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:15,498 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:15,518 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:15,518 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:15,520 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F6839F49B21D4A4AB2DD127017F60CB8, ordinal: 0
2015-11-23 15:29:15,520 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:15,521 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:15,521 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F6839F49B21D4A4AB2DD127017F60CB8, mem on start (mb), free: 502, total: 740, max: 740
2015-11-23 15:29:15,522 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F6839F49B21D4A4AB2DD127017F60CB8, mem on close (mb), free: 502, total: 740, max: 740
2015-11-23 15:29:16,807 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:16,807 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:16,810 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A887A996357D40CEA306601B1481A825, ordinal: 1
2015-11-23 15:29:16,811 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:16,811 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_true_true_false"]
2015-11-23 15:29:16,811 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A887A996357D40CEA306601B1481A825, mem on start (mb), free: 541, total: 741, max: 741
2015-11-23 15:29:16,818 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A887A996357D40CEA306601B1481A825, mem on close (mb), free: 538, total: 741, max: 741
2015-11-23 15:29:16,830 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_true_true_false/_temporary
2015-11-23 15:29:16,830 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:01.434
2015-11-23 15:29:16,862 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:16,862 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:16,879 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.013
2015-11-23 15:29:16,879 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:16,879 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:16,889 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:16,890 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:16,890 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_null_false_true"]
2015-11-23 15:29:16,890 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:16,890 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:16,890 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:16,891 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...ive/false_null_false_true
2015-11-23 15:29:16,981 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local1252462740_0015
2015-11-23 15:29:16,982 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:16,987 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:17,012 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:17,013 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:17,015 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BB28C1D23EE7455EB7BD5C45C7C0EA3D, ordinal: 0
2015-11-23 15:29:17,015 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:17,015 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:17,015 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BB28C1D23EE7455EB7BD5C45C7C0EA3D, mem on start (mb), free: 519, total: 742, max: 742
2015-11-23 15:29:17,016 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BB28C1D23EE7455EB7BD5C45C7C0EA3D, mem on close (mb), free: 519, total: 742, max: 742
2015-11-23 15:29:17,024 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:17,025 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:17,027 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CA5BCA0C491743DCBD9241BA781AD48E, ordinal: 1
2015-11-23 15:29:17,027 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:17,027 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_null_false_true"]
2015-11-23 15:29:17,028 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CA5BCA0C491743DCBD9241BA781AD48E, mem on start (mb), free: 513, total: 742, max: 742
2015-11-23 15:29:17,033 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CA5BCA0C491743DCBD9241BA781AD48E, mem on close (mb), free: 511, total: 742, max: 742
2015-11-23 15:29:17,045 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_null_false_true/_temporary
2015-11-23 15:29:17,045 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:00.155
2015-11-23 15:29:17,090 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:17,090 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:17,103 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.009
2015-11-23 15:29:17,104 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:17,104 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:17,112 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:17,113 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:17,113 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_null_false_true"]
2015-11-23 15:29:17,113 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:17,113 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:17,113 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:17,114 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...sive/true_null_false_true
2015-11-23 15:29:17,192 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local1775368717_0016
2015-11-23 15:29:17,193 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:17,197 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:17,220 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:17,221 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:17,224 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FCCEBEC79679404F93EDF9D6DEE462B4, ordinal: 0
2015-11-23 15:29:17,224 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:17,224 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:17,224 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FCCEBEC79679404F93EDF9D6DEE462B4, mem on start (mb), free: 510, total: 730, max: 730
2015-11-23 15:29:17,225 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FCCEBEC79679404F93EDF9D6DEE462B4, mem on close (mb), free: 510, total: 730, max: 730
2015-11-23 15:29:17,234 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:17,234 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:17,237 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B4606C6CFA864C3B9EC30648C9281EDA, ordinal: 1
2015-11-23 15:29:17,237 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:17,238 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_null_false_true"]
2015-11-23 15:29:17,238 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B4606C6CFA864C3B9EC30648C9281EDA, mem on start (mb), free: 505, total: 730, max: 730
2015-11-23 15:29:17,245 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B4606C6CFA864C3B9EC30648C9281EDA, mem on close (mb), free: 502, total: 730, max: 730
2015-11-23 15:29:17,262 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_null_false_true/_temporary
2015-11-23 15:29:17,263 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:00.150
2015-11-23 15:29:17,299 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:17,300 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:17,313 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.010
2015-11-23 15:29:17,313 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:17,313 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:17,321 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:17,321 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:17,321 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_null_true_true"]
2015-11-23 15:29:17,321 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:17,321 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:17,322 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:17,322 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...sive/false_null_true_true
2015-11-23 15:29:17,386 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local614657890_0017
2015-11-23 15:29:17,387 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:17,390 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:17,415 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:17,415 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:17,417 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D3FE179241CB4ACC881D42FAE8FDD8C2, ordinal: 0
2015-11-23 15:29:17,418 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:17,418 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:17,418 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D3FE179241CB4ACC881D42FAE8FDD8C2, mem on start (mb), free: 520, total: 740, max: 740
2015-11-23 15:29:17,419 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D3FE179241CB4ACC881D42FAE8FDD8C2, mem on close (mb), free: 520, total: 740, max: 740
2015-11-23 15:29:17,426 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:17,426 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:17,428 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DACF84065DFF4482B028A32F9F404590, ordinal: 1
2015-11-23 15:29:17,429 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:17,429 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_null_true_true"]
2015-11-23 15:29:17,429 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DACF84065DFF4482B028A32F9F404590, mem on start (mb), free: 515, total: 740, max: 740
2015-11-23 15:29:17,434 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DACF84065DFF4482B028A32F9F404590, mem on close (mb), free: 514, total: 740, max: 740
2015-11-23 15:29:17,447 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_null_true_true/_temporary
2015-11-23 15:29:17,448 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:00.126
2015-11-23 15:29:17,488 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:17,488 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:17,501 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.010
2015-11-23 15:29:17,501 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:17,502 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:17,513 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:17,513 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:17,513 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_null_true_true"]
2015-11-23 15:29:17,513 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:17,513 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:17,513 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:17,514 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...nsive/true_null_true_true
2015-11-23 15:29:17,593 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local468930230_0018
2015-11-23 15:29:17,593 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:17,599 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:17,622 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:17,623 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:17,625 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D125405DCC384EEB86AC90901EADAC9A, ordinal: 0
2015-11-23 15:29:17,625 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:17,625 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:17,625 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D125405DCC384EEB86AC90901EADAC9A, mem on start (mb), free: 520, total: 741, max: 741
2015-11-23 15:29:17,626 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D125405DCC384EEB86AC90901EADAC9A, mem on close (mb), free: 520, total: 741, max: 741
2015-11-23 15:29:17,637 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:17,637 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:17,642 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E07423C8615147AA87D69F45838B7B05, ordinal: 1
2015-11-23 15:29:17,642 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:17,642 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_null_true_true"]
2015-11-23 15:29:17,642 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E07423C8615147AA87D69F45838B7B05, mem on start (mb), free: 516, total: 741, max: 741
2015-11-23 15:29:17,650 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E07423C8615147AA87D69F45838B7B05, mem on close (mb), free: 514, total: 741, max: 741
2015-11-23 15:29:17,664 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_null_true_true/_temporary
2015-11-23 15:29:17,665 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:00.151
2015-11-23 15:29:17,701 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:17,701 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:17,717 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.013
2015-11-23 15:29:17,718 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:17,718 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:17,728 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:17,728 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:17,728 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_false_false_true"]
2015-11-23 15:29:17,728 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:17,728 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:17,729 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:17,729 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...ve/false_false_false_true
2015-11-23 15:29:17,811 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local988109396_0019
2015-11-23 15:29:17,811 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:17,817 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:17,840 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:17,840 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:17,843 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B699F27637F342D08048CFE5BAD629C7, ordinal: 0
2015-11-23 15:29:17,844 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:17,844 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:17,844 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B699F27637F342D08048CFE5BAD629C7, mem on start (mb), free: 519, total: 741, max: 741
2015-11-23 15:29:17,845 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B699F27637F342D08048CFE5BAD629C7, mem on close (mb), free: 519, total: 741, max: 741
2015-11-23 15:29:17,854 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:17,854 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:17,857 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F828626785E34FA78959061282AA11D2, ordinal: 1
2015-11-23 15:29:17,857 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:17,857 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_false_false_true"]
2015-11-23 15:29:17,857 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F828626785E34FA78959061282AA11D2, mem on start (mb), free: 515, total: 741, max: 741
2015-11-23 15:29:17,863 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F828626785E34FA78959061282AA11D2, mem on close (mb), free: 514, total: 741, max: 741
2015-11-23 15:29:17,871 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_false_false_true/_temporary
2015-11-23 15:29:17,872 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:00.143
2015-11-23 15:29:17,906 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:17,906 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:17,918 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.009
2015-11-23 15:29:17,918 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:17,918 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:17,928 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:17,928 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:17,929 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_false_false_true"]
2015-11-23 15:29:17,929 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:17,929 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:17,929 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:17,930 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...ive/true_false_false_true
2015-11-23 15:29:18,002 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local1505543969_0020
2015-11-23 15:29:18,002 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:18,006 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:18,031 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:18,031 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:18,034 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: CCF7F6E0263E49548A16739149451EF9, ordinal: 0
2015-11-23 15:29:18,034 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:18,034 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:18,034 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CCF7F6E0263E49548A16739149451EF9, mem on start (mb), free: 519, total: 741, max: 741
2015-11-23 15:29:18,035 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CCF7F6E0263E49548A16739149451EF9, mem on close (mb), free: 518, total: 741, max: 741
2015-11-23 15:29:18,055 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:18,055 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:18,058 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B3E7F5BD677F426CA00D50DCEC365183, ordinal: 1
2015-11-23 15:29:18,058 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:18,058 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_false_false_true"]
2015-11-23 15:29:18,059 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B3E7F5BD677F426CA00D50DCEC365183, mem on start (mb), free: 514, total: 741, max: 741
2015-11-23 15:29:18,066 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B3E7F5BD677F426CA00D50DCEC365183, mem on close (mb), free: 513, total: 741, max: 741
2015-11-23 15:29:18,084 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_false_false_true/_temporary
2015-11-23 15:29:18,084 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:00.155
2015-11-23 15:29:18,122 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:18,122 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:18,134 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.009
2015-11-23 15:29:18,135 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:18,135 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:18,171 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:18,172 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:18,172 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_true_false_true"]
2015-11-23 15:29:18,172 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:18,172 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:18,172 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:18,173 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...sive/true_true_false_true
2015-11-23 15:29:18,253 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local23454062_0021
2015-11-23 15:29:18,253 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:18,259 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:18,283 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:18,283 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:18,286 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A69C14AFB951473CAE944418D4059D13, ordinal: 0
2015-11-23 15:29:18,286 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:18,287 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:18,287 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A69C14AFB951473CAE944418D4059D13, mem on start (mb), free: 517, total: 740, max: 740
2015-11-23 15:29:18,287 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A69C14AFB951473CAE944418D4059D13, mem on close (mb), free: 517, total: 740, max: 740
2015-11-23 15:29:18,297 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:18,297 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:18,299 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D500DE8FA1C348ECAE474656B6F2CA0A, ordinal: 1
2015-11-23 15:29:18,299 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:18,299 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_true_false_true"]
2015-11-23 15:29:18,299 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D500DE8FA1C348ECAE474656B6F2CA0A, mem on start (mb), free: 513, total: 740, max: 740
2015-11-23 15:29:18,304 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D500DE8FA1C348ECAE474656B6F2CA0A, mem on close (mb), free: 512, total: 740, max: 740
2015-11-23 15:29:18,313 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_true_false_true/_temporary
2015-11-23 15:29:18,314 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:00.142
2015-11-23 15:29:18,349 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:18,349 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:18,366 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.014
2015-11-23 15:29:18,367 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:18,367 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:18,376 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:18,376 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:18,376 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_true_false_true"]
2015-11-23 15:29:18,376 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:18,376 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:18,377 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:18,377 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...ive/false_true_false_true
2015-11-23 15:29:18,463 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local136701499_0022
2015-11-23 15:29:18,464 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:18,468 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:18,493 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:18,493 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:18,495 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A7BBA928AC964F66828D21A90920F35D, ordinal: 0
2015-11-23 15:29:18,496 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:18,496 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:18,496 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A7BBA928AC964F66828D21A90920F35D, mem on start (mb), free: 518, total: 740, max: 740
2015-11-23 15:29:18,497 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A7BBA928AC964F66828D21A90920F35D, mem on close (mb), free: 518, total: 740, max: 740
2015-11-23 15:29:18,505 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:18,505 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:18,507 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F07A4E0A09E34525950E4CC5FE07AAE1, ordinal: 1
2015-11-23 15:29:18,508 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:18,508 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_true_false_true"]
2015-11-23 15:29:18,508 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F07A4E0A09E34525950E4CC5FE07AAE1, mem on start (mb), free: 514, total: 740, max: 740
2015-11-23 15:29:18,514 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F07A4E0A09E34525950E4CC5FE07AAE1, mem on close (mb), free: 513, total: 740, max: 740
2015-11-23 15:29:18,524 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_true_false_true/_temporary
2015-11-23 15:29:18,524 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:00.148
2015-11-23 15:29:18,558 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:18,559 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:18,577 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.015
2015-11-23 15:29:18,577 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:18,578 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:18,584 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:18,584 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:18,584 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_false_true_true"]
2015-11-23 15:29:18,584 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:18,584 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:18,584 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:18,585 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...ive/false_false_true_true
2015-11-23 15:29:18,672 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local175651139_0023
2015-11-23 15:29:18,672 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:18,676 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:18,701 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:18,701 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:18,704 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AB3AC825B11C49EDA1F8EE4C20C1F27B, ordinal: 0
2015-11-23 15:29:18,704 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:18,704 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:18,704 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AB3AC825B11C49EDA1F8EE4C20C1F27B, mem on start (mb), free: 519, total: 741, max: 741
2015-11-23 15:29:18,705 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AB3AC825B11C49EDA1F8EE4C20C1F27B, mem on close (mb), free: 519, total: 741, max: 741
2015-11-23 15:29:18,713 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:18,714 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:18,716 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F94E440D63C44A14948D11792A591C46, ordinal: 1
2015-11-23 15:29:18,717 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:18,717 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_false_true_true"]
2015-11-23 15:29:18,717 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F94E440D63C44A14948D11792A591C46, mem on start (mb), free: 515, total: 741, max: 741
2015-11-23 15:29:18,724 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F94E440D63C44A14948D11792A591C46, mem on close (mb), free: 514, total: 741, max: 741
2015-11-23 15:29:18,733 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_false_true_true/_temporary
2015-11-23 15:29:18,734 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:00.149
2015-11-23 15:29:18,771 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:18,771 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:18,787 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.013
2015-11-23 15:29:18,788 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:18,788 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:18,798 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:18,798 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:18,798 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_false_true_true"]
2015-11-23 15:29:18,798 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:18,798 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:18,798 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:18,799 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...sive/true_false_true_true
2015-11-23 15:29:18,880 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local1010972420_0024
2015-11-23 15:29:18,881 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:18,883 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:18,905 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:18,906 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:18,908 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: EE366A47BFA540C98EBC38B02E390E3A, ordinal: 0
2015-11-23 15:29:18,908 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:18,908 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:18,908 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EE366A47BFA540C98EBC38B02E390E3A, mem on start (mb), free: 519, total: 741, max: 741
2015-11-23 15:29:18,909 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EE366A47BFA540C98EBC38B02E390E3A, mem on close (mb), free: 519, total: 741, max: 741
2015-11-23 15:29:18,920 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:18,920 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:18,924 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DB525833D5E7405495BD625FF1B83DDB, ordinal: 1
2015-11-23 15:29:18,924 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:18,924 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_false_true_true"]
2015-11-23 15:29:18,924 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DB525833D5E7405495BD625FF1B83DDB, mem on start (mb), free: 515, total: 741, max: 741
2015-11-23 15:29:18,931 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DB525833D5E7405495BD625FF1B83DDB, mem on close (mb), free: 514, total: 741, max: 741
2015-11-23 15:29:18,947 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_false_true_true/_temporary
2015-11-23 15:29:18,948 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:00.149
2015-11-23 15:29:18,983 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:18,984 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:18,995 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.008
2015-11-23 15:29:18,996 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:18,996 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:19,007 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:19,007 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:19,008 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_true_true_true"]
2015-11-23 15:29:19,008 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:19,008 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:19,008 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:19,008 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...nsive/true_true_true_true
2015-11-23 15:29:19,094 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local2005999121_0025
2015-11-23 15:29:19,094 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:19,097 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:19,121 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:19,121 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:19,123 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B63DB41F5E134DD6A0EF2564660DE117, ordinal: 0
2015-11-23 15:29:19,124 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:19,124 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:19,124 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B63DB41F5E134DD6A0EF2564660DE117, mem on start (mb), free: 519, total: 741, max: 741
2015-11-23 15:29:19,125 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B63DB41F5E134DD6A0EF2564660DE117, mem on close (mb), free: 519, total: 741, max: 741
2015-11-23 15:29:19,133 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:19,133 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:19,135 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F38450584CA44AB6949061196F100D7A, ordinal: 1
2015-11-23 15:29:19,135 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:19,135 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_true_true_true"]
2015-11-23 15:29:19,136 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F38450584CA44AB6949061196F100D7A, mem on start (mb), free: 515, total: 741, max: 741
2015-11-23 15:29:19,142 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F38450584CA44AB6949061196F100D7A, mem on close (mb), free: 514, total: 741, max: 741
2015-11-23 15:29:19,153 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_true_true_true/_temporary
2015-11-23 15:29:19,153 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:00.145
2015-11-23 15:29:19,188 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 15:29:19,189 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 15:29:19,200 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.008
2015-11-23 15:29:19,200 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 15:29:19,201 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 15:29:19,210 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting
2015-11-23 15:29:19,210 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:19,210 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_true_true_true"]
2015-11-23 15:29:19,210 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] parallel execution of steps is enabled: false
2015-11-23 15:29:19,210 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] executing total steps: 1
2015-11-23 15:29:19,210 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] allocating management threads: 1
2015-11-23 15:29:19,211 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] starting step: (1/1) ...sive/false_true_true_true
2015-11-23 15:29:19,284 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] submitted hadoop job: job_local1441504488_0026
2015-11-23 15:29:19,285 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-11-23 15:29:19,288 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt
2015-11-23 15:29:19,309 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 15:29:19,309 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 15:29:19,311 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F631F34B002C48D2BEF624193A59666D, ordinal: 0
2015-11-23 15:29:19,312 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 15:29:19,312 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:19,312 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F631F34B002C48D2BEF624193A59666D, mem on start (mb), free: 519, total: 741, max: 741
2015-11-23 15:29:19,313 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F631F34B002C48D2BEF624193A59666D, mem on close (mb), free: 519, total: 741, max: 741
2015-11-23 15:29:19,322 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 15:29:19,322 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 15:29:19,324 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DC59CEA57B0C4275A7CADE11EEE47973, ordinal: 1
2015-11-23 15:29:19,324 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-11-23 15:29:19,324 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_true_true_true"]
2015-11-23 15:29:19,325 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DC59CEA57B0C4275A7CADE11EEE47973, mem on start (mb), free: 515, total: 741, max: 741
2015-11-23 15:29:19,330 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DC59CEA57B0C4275A7CADE11EEE47973, mem on close (mb), free: 514, total: 741, max: 741
2015-11-23 15:29:19,341 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_true_true_true/_temporary
2015-11-23 15:29:19,341 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [comprehensivesort] completed in: 00:00.131
2015-11-23 15:29:19,362 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_false_true_true
2015-11-23 15:29:19,362 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_true_false_false
2015-11-23 15:29:19,362 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_null_false_true
2015-11-23 15:29:19,362 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_true_false_true
2015-11-23 15:29:19,362 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_true_true_false
2015-11-23 15:29:19,362 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_true_true_true
2015-11-23 15:29:19,362 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_null_true_false
2015-11-23 15:29:19,363 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_true_true_true
2015-11-23 15:29:19,363 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_false_false_false
2015-11-23 15:29:19,363 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_true_false_true
2015-11-23 15:29:19,363 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_null_false_false
2015-11-23 15:29:19,363 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_false_true_false
2015-11-23 15:29:19,363 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_false_true_false
2015-11-23 15:29:19,363 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_null_false_true
2015-11-23 15:29:19,363 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_null_false_false
2015-11-23 15:29:19,363 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_false_true_true
2015-11-23 15:29:19,363 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_null_true_false
2015-11-23 15:29:19,364 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_false_false_true
2015-11-23 15:29:19,364 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_false_false_false
2015-11-23 15:29:19,364 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_false_false_true
2015-11-23 15:29:19,364 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_null_true_true
2015-11-23 15:29:19,364 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_true_true_false
2015-11-23 15:29:19,364 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/false_true_false_false
2015-11-23 15:29:19,364 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/sortedvaluesplatform/testComprehensiveGroupBy/comprehensive/true_null_true_true