2015-11-23 16:31:26,549 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2015-11-23 16:31:26,566 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.detail.EveryPipeAssemblyPlatformTest, with platform: hadoop2-mr1
2015-11-23 16:31:26,711 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(119)) - not using cluster
2015-11-23 16:31:27,103 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-11-23 16:31:27,182 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2015-11-23 16:31:27,227 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:27,229 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:27,275 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: 61B5556EE70C4A2C97B34AC5931B614F
2015-11-23 16:31:27,378 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.055
2015-11-23 16:31:27,380 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:27,380 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:27,495 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.2
2015-11-23 16:31:27,496 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:27,497 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:27,497 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1"]
2015-11-23 16:31:27,497 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:27,498 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:27,498 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:27,499 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...blyplatform/-1_'field'_-1
2015-11-23 16:31:27,801 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1711850781_0001
2015-11-23 16:31:27,801 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:27,906 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:27,945 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:27,945 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:27,953 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A0015028C191442CA5830EC831A419E1, ordinal: 0
2015-11-23 16:31:27,969 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:27,969 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:27,969 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A0015028C191442CA5830EC831A419E1, mem on start (mb), free: 230, total: 349, max: 672
2015-11-23 16:31:27,981 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A0015028C191442CA5830EC831A419E1, mem on close (mb), free: 229, total: 349, max: 672
2015-11-23 16:31:28,050 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:28,050 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:28,056 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: AE383353919C4C60AAC45CB801943A79, ordinal: 1
2015-11-23 16:31:28,062 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:28,062 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1"]
2015-11-23 16:31:28,062 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AE383353919C4C60AAC45CB801943A79, mem on start (mb), free: 218, total: 349, max: 672
2015-11-23 16:31:28,081 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AE383353919C4C60AAC45CB801943A79, mem on close (mb), free: 217, total: 349, max: 672
2015-11-23 16:31:28,119 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1/_temporary
2015-11-23 16:31:28,119 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.621
2015-11-23 16:31:28,166 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_'field'_-1
2015-11-23 16:31:28,185 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:28,185 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:28,215 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.025
2015-11-23 16:31:28,215 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:28,216 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:28,229 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:28,230 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:28,230 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'"]
2015-11-23 16:31:28,230 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:28,230 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:28,230 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:28,231 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...atform/-1_'field'_'field'
2015-11-23 16:31:28,333 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local203536906_0002
2015-11-23 16:31:28,333 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:28,337 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:28,380 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:28,380 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:28,385 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: CB91316F1AB146348EE61D2F025B7CDC, ordinal: 0
2015-11-23 16:31:28,385 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:28,385 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:28,385 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CB91316F1AB146348EE61D2F025B7CDC, mem on start (mb), free: 176, total: 349, max: 672
2015-11-23 16:31:28,387 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CB91316F1AB146348EE61D2F025B7CDC, mem on close (mb), free: 176, total: 349, max: 672
2015-11-23 16:31:28,400 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:28,400 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:28,410 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B16E4773B2D74372BB5D1910B43A9B39, ordinal: 1
2015-11-23 16:31:28,411 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:28,411 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'"]
2015-11-23 16:31:28,411 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B16E4773B2D74372BB5D1910B43A9B39, mem on start (mb), free: 173, total: 349, max: 672
2015-11-23 16:31:28,422 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B16E4773B2D74372BB5D1910B43A9B39, mem on close (mb), free: 171, total: 349, max: 672
2015-11-23 16:31:28,441 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'/_temporary
2015-11-23 16:31:28,441 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.211
2015-11-23 16:31:28,481 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_'field'_'field'
2015-11-23 16:31:28,495 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:28,496 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:28,520 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.019
2015-11-23 16:31:28,521 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:28,521 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:28,532 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:28,532 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:28,532 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS"]
2015-11-23 16:31:28,533 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:28,533 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:28,533 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:28,533 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...atform/-1_'field'_RESULTS
2015-11-23 16:31:28,618 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local367109692_0003
2015-11-23 16:31:28,623 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:28,627 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:28,648 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:28,648 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:28,653 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BA0CC75EF92E4CB8B962F07C6AD1FE0F, ordinal: 0
2015-11-23 16:31:28,653 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:28,653 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:28,653 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BA0CC75EF92E4CB8B962F07C6AD1FE0F, mem on start (mb), free: 183, total: 400, max: 672
2015-11-23 16:31:28,655 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BA0CC75EF92E4CB8B962F07C6AD1FE0F, mem on close (mb), free: 183, total: 400, max: 672
2015-11-23 16:31:28,666 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:28,666 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:28,674 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: FC907B8B643C4EAA82E10A21E5209CD9, ordinal: 1
2015-11-23 16:31:28,674 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:28,675 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS"]
2015-11-23 16:31:28,675 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FC907B8B643C4EAA82E10A21E5209CD9, mem on start (mb), free: 179, total: 400, max: 672
2015-11-23 16:31:28,682 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FC907B8B643C4EAA82E10A21E5209CD9, mem on close (mb), free: 176, total: 400, max: 672
2015-11-23 16:31:28,697 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS/_temporary
2015-11-23 16:31:28,697 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.165
2015-11-23 16:31:28,736 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_'field'_RESULTS
2015-11-23 16:31:28,749 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:28,749 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:28,771 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.017
2015-11-23 16:31:28,772 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:28,773 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:28,782 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:28,783 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:28,783 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL"]
2015-11-23 16:31:28,783 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:28,783 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:28,783 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:28,783 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...lyplatform/-1_'field'_ALL
2015-11-23 16:31:28,884 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local382621811_0004
2015-11-23 16:31:28,884 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:28,888 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:28,932 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:28,932 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:28,936 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F917B211DF354BFD8660F7F5B052D45D, ordinal: 0
2015-11-23 16:31:28,936 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:28,936 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:28,936 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F917B211DF354BFD8660F7F5B052D45D, mem on start (mb), free: 114, total: 501, max: 672
2015-11-23 16:31:28,938 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F917B211DF354BFD8660F7F5B052D45D, mem on close (mb), free: 114, total: 501, max: 672
2015-11-23 16:31:28,947 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:28,947 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:28,951 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: ED423A59CD1A4A4CA9D8DF7551F32A58, ordinal: 1
2015-11-23 16:31:28,952 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:28,952 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL"]
2015-11-23 16:31:28,952 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ED423A59CD1A4A4CA9D8DF7551F32A58, mem on start (mb), free: 109, total: 501, max: 672
2015-11-23 16:31:28,962 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ED423A59CD1A4A4CA9D8DF7551F32A58, mem on close (mb), free: 107, total: 501, max: 672
2015-11-23 16:31:28,980 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL/_temporary
2015-11-23 16:31:28,981 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.198
2015-11-23 16:31:29,023 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_'field'_ALL
2015-11-23 16:31:29,040 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:29,040 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:29,051 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: ILLEGAL, in: 00:00.007
2015-11-23 16:31:29,051 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, found assembly to be malformed
2015-11-23 16:31:29,051 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_'field'_REPLACE
2015-11-23 16:31:29,063 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:29,064 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:29,084 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.016
2015-11-23 16:31:29,084 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:29,085 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:29,093 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:29,093 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:29,093 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP"]
2015-11-23 16:31:29,093 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:29,094 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:29,094 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:29,094 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...yplatform/-1_'field'_SWAP
2015-11-23 16:31:29,171 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1036527653_0005
2015-11-23 16:31:29,172 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:29,175 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:29,195 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:29,195 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:29,198 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B0ADAB05FE3C47649376B69681D1FEE2, ordinal: 0
2015-11-23 16:31:29,198 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:29,199 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:29,199 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B0ADAB05FE3C47649376B69681D1FEE2, mem on start (mb), free: 125, total: 504, max: 672
2015-11-23 16:31:29,200 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B0ADAB05FE3C47649376B69681D1FEE2, mem on close (mb), free: 125, total: 504, max: 672
2015-11-23 16:31:29,208 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:29,208 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:29,211 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DDD5C6BB83F34ECA8126565804143A6D, ordinal: 1
2015-11-23 16:31:29,212 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:29,212 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP"]
2015-11-23 16:31:29,212 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DDD5C6BB83F34ECA8126565804143A6D, mem on start (mb), free: 122, total: 504, max: 672
2015-11-23 16:31:29,219 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DDD5C6BB83F34ECA8126565804143A6D, mem on close (mb), free: 120, total: 504, max: 672
2015-11-23 16:31:29,235 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP/_temporary
2015-11-23 16:31:29,236 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.142
2015-11-23 16:31:29,281 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_'field'_SWAP
2015-11-23 16:31:29,295 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:29,295 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:29,320 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.021
2015-11-23 16:31:29,321 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:29,321 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:29,331 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:29,332 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:29,332 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1"]
2015-11-23 16:31:29,332 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:29,332 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:29,332 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:29,333 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...blyplatform/-1_UNKNOWN_-1
2015-11-23 16:31:29,556 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local2112469565_0006
2015-11-23 16:31:29,556 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:29,559 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:29,581 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:29,581 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:29,584 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B3838EFF5F024BB3824D59697F539845, ordinal: 0
2015-11-23 16:31:29,584 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:29,584 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:29,584 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B3838EFF5F024BB3824D59697F539845, mem on start (mb), free: 163, total: 532, max: 672
2015-11-23 16:31:29,586 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B3838EFF5F024BB3824D59697F539845, mem on close (mb), free: 163, total: 532, max: 672
2015-11-23 16:31:29,596 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:29,596 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:29,602 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D8EDF194BF8644E3ADB71B4B0F048243, ordinal: 1
2015-11-23 16:31:29,602 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:29,603 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1"]
2015-11-23 16:31:29,603 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D8EDF194BF8644E3ADB71B4B0F048243, mem on start (mb), free: 157, total: 532, max: 672
2015-11-23 16:31:29,610 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D8EDF194BF8644E3ADB71B4B0F048243, mem on close (mb), free: 155, total: 532, max: 672
2015-11-23 16:31:29,621 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1/_temporary
2015-11-23 16:31:29,621 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.290
2015-11-23 16:31:29,664 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_UNKNOWN_-1
2015-11-23 16:31:29,676 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:29,677 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:29,685 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: ILLEGAL, in: 00:00.004
2015-11-23 16:31:29,686 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, found assembly to be malformed
2015-11-23 16:31:29,686 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_UNKNOWN_'field'
2015-11-23 16:31:29,701 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:29,701 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:29,720 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.015
2015-11-23 16:31:29,721 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:29,721 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:29,732 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:29,732 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:29,732 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS"]
2015-11-23 16:31:29,732 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:29,732 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:29,732 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:29,733 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...atform/-1_UNKNOWN_RESULTS
2015-11-23 16:31:29,838 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1967623375_0007
2015-11-23 16:31:29,838 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:29,842 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:29,861 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:29,861 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:29,863 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B081E8F9487C4DC98F4440CDEE0439F4, ordinal: 0
2015-11-23 16:31:29,864 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:29,864 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:29,864 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B081E8F9487C4DC98F4440CDEE0439F4, mem on start (mb), free: 200, total: 532, max: 672
2015-11-23 16:31:29,865 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B081E8F9487C4DC98F4440CDEE0439F4, mem on close (mb), free: 200, total: 532, max: 672
2015-11-23 16:31:29,873 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:29,873 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:29,876 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F01B66D4DD004B2C82990825E8CF8760, ordinal: 1
2015-11-23 16:31:29,876 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:29,876 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS"]
2015-11-23 16:31:29,876 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F01B66D4DD004B2C82990825E8CF8760, mem on start (mb), free: 195, total: 532, max: 672
2015-11-23 16:31:29,883 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F01B66D4DD004B2C82990825E8CF8760, mem on close (mb), free: 193, total: 532, max: 672
2015-11-23 16:31:29,901 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS/_temporary
2015-11-23 16:31:29,901 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.169
2015-11-23 16:31:29,936 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_UNKNOWN_RESULTS
2015-11-23 16:31:29,948 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:29,949 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:29,968 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.016
2015-11-23 16:31:29,969 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:29,969 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:29,978 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:29,978 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:29,978 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL"]
2015-11-23 16:31:29,978 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:29,978 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:29,978 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:29,979 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...lyplatform/-1_UNKNOWN_ALL
2015-11-23 16:31:30,056 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local442929752_0008
2015-11-23 16:31:30,056 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:30,059 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:30,086 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:30,086 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:30,089 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E2933E9BA0E54AE2903DC1EE54A248F6, ordinal: 0
2015-11-23 16:31:30,089 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:30,089 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:30,089 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E2933E9BA0E54AE2903DC1EE54A248F6, mem on start (mb), free: 226, total: 540, max: 672
2015-11-23 16:31:30,090 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E2933E9BA0E54AE2903DC1EE54A248F6, mem on close (mb), free: 226, total: 540, max: 672
2015-11-23 16:31:30,100 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:30,100 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:30,103 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A5BA99D94E314EA9A5E531A8496614ED, ordinal: 1
2015-11-23 16:31:30,103 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:30,103 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL"]
2015-11-23 16:31:30,104 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A5BA99D94E314EA9A5E531A8496614ED, mem on start (mb), free: 222, total: 540, max: 672
2015-11-23 16:31:30,110 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A5BA99D94E314EA9A5E531A8496614ED, mem on close (mb), free: 220, total: 540, max: 672
2015-11-23 16:31:30,131 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL/_temporary
2015-11-23 16:31:30,131 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.153
2015-11-23 16:31:30,166 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_UNKNOWN_ALL
2015-11-23 16:31:30,178 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:30,178 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:30,193 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.011
2015-11-23 16:31:30,194 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:30,194 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:30,202 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:30,202 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:30,202 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_REPLACE"]
2015-11-23 16:31:30,202 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:30,202 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:30,202 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:30,203 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...atform/-1_UNKNOWN_REPLACE
2015-11-23 16:31:30,299 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1022015060_0009
2015-11-23 16:31:30,299 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:30,304 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:30,333 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:30,333 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:30,335 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FA35B037EC6D41F1A2F7D9B36BA0C1E7, ordinal: 0
2015-11-23 16:31:30,336 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:30,336 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:30,336 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FA35B037EC6D41F1A2F7D9B36BA0C1E7, mem on start (mb), free: 226, total: 540, max: 672
2015-11-23 16:31:30,337 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FA35B037EC6D41F1A2F7D9B36BA0C1E7, mem on close (mb), free: 226, total: 540, max: 672
2015-11-23 16:31:30,346 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:30,346 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:30,349 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E49D9682D0354C67A77653BEEA01C57B, ordinal: 1
2015-11-23 16:31:30,349 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:30,349 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_REPLACE"]
2015-11-23 16:31:30,349 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E49D9682D0354C67A77653BEEA01C57B, mem on start (mb), free: 222, total: 540, max: 672
2015-11-23 16:31:30,354 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:30,356 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E49D9682D0354C67A77653BEEA01C57B, mem on close (mb), free: 220, total: 540, max: 672
2015-11-23 16:31:30,358 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1022015060_0009
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:30,362 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local1022015060_0009 state at FAILED
2015-11-23 16:31:30,362 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:30,363 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:30,363 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:30,368 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:30,368 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...atform/-1_UNKNOWN_REPLACE
2015-11-23 16:31:30,368 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:30,369 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_REPLACE/_temporary
2015-11-23 16:31:30,369 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.166
2015-11-23 16:31:30,369 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_UNKNOWN_REPLACE
2015-11-23 16:31:30,381 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:30,381 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:30,398 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.013
2015-11-23 16:31:30,399 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:30,399 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:30,408 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:30,408 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:30,408 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP"]
2015-11-23 16:31:30,409 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:30,409 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:30,409 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:30,410 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...yplatform/-1_UNKNOWN_SWAP
2015-11-23 16:31:30,511 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local947263169_0010
2015-11-23 16:31:30,511 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:30,517 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:30,544 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:30,544 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:30,546 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B2A8489F565E424D9D30B4CB8C8ACE0F, ordinal: 0
2015-11-23 16:31:30,547 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:30,547 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:30,547 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B2A8489F565E424D9D30B4CB8C8ACE0F, mem on start (mb), free: 227, total: 541, max: 672
2015-11-23 16:31:30,548 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B2A8489F565E424D9D30B4CB8C8ACE0F, mem on close (mb), free: 227, total: 541, max: 672
2015-11-23 16:31:30,559 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:30,559 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:30,562 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B6AB770B0E7C4705981366C0F2D5F2AD, ordinal: 1
2015-11-23 16:31:30,562 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:30,563 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP"]
2015-11-23 16:31:30,563 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B6AB770B0E7C4705981366C0F2D5F2AD, mem on start (mb), free: 223, total: 541, max: 672
2015-11-23 16:31:30,571 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B6AB770B0E7C4705981366C0F2D5F2AD, mem on close (mb), free: 222, total: 541, max: 672
2015-11-23 16:31:30,588 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP/_temporary
2015-11-23 16:31:30,589 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.180
2015-11-23 16:31:30,628 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_UNKNOWN_SWAP
2015-11-23 16:31:30,640 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:30,641 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:30,659 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.015
2015-11-23 16:31:30,660 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:30,660 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:30,671 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:30,672 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:30,672 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_-1"]
2015-11-23 16:31:30,672 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:30,672 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:30,672 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:30,673 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...mblyplatform/-1_VALUES_-1
2015-11-23 16:31:30,754 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1030461611_0011
2015-11-23 16:31:30,754 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:30,759 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:30,788 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:30,788 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:30,790 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A648BEB473C9428C9A1480FEB1FAEE0E, ordinal: 0
2015-11-23 16:31:30,790 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:30,790 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:30,790 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A648BEB473C9428C9A1480FEB1FAEE0E, mem on start (mb), free: 227, total: 541, max: 672
2015-11-23 16:31:30,792 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A648BEB473C9428C9A1480FEB1FAEE0E, mem on close (mb), free: 227, total: 541, max: 672
2015-11-23 16:31:30,803 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:30,803 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:30,805 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A6BE68174BDA431BA7201AA4F066C9DB, ordinal: 1
2015-11-23 16:31:30,806 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:30,806 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_-1"]
2015-11-23 16:31:30,806 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A6BE68174BDA431BA7201AA4F066C9DB, mem on start (mb), free: 223, total: 541, max: 672
2015-11-23 16:31:30,811 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:30,812 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A6BE68174BDA431BA7201AA4F066C9DB, mem on close (mb), free: 222, total: 541, max: 672
2015-11-23 16:31:30,814 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1030461611_0011
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:30,817 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local1030461611_0011 state at FAILED
2015-11-23 16:31:30,817 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:30,817 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:30,817 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:30,819 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:30,820 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...mblyplatform/-1_VALUES_-1
2015-11-23 16:31:30,820 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:30,820 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_-1/_temporary
2015-11-23 16:31:30,820 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.149
2015-11-23 16:31:30,821 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_VALUES_-1
2015-11-23 16:31:30,833 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:30,834 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:30,844 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: ILLEGAL, in: 00:00.006
2015-11-23 16:31:30,844 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, found assembly to be malformed
2015-11-23 16:31:30,845 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_VALUES_'field'
2015-11-23 16:31:30,858 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:30,858 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:30,872 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.010
2015-11-23 16:31:30,873 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:30,873 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:30,881 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:30,881 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:30,881 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_RESULTS"]
2015-11-23 16:31:30,881 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:30,881 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:30,881 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:30,882 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...latform/-1_VALUES_RESULTS
2015-11-23 16:31:30,956 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1194095258_0012
2015-11-23 16:31:30,956 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:30,961 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:30,988 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:30,988 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:30,990 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DD37729EAD2E4385834FB8B9AD33D388, ordinal: 0
2015-11-23 16:31:30,990 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:30,990 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:30,990 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DD37729EAD2E4385834FB8B9AD33D388, mem on start (mb), free: 228, total: 542, max: 672
2015-11-23 16:31:30,991 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DD37729EAD2E4385834FB8B9AD33D388, mem on close (mb), free: 228, total: 542, max: 672
2015-11-23 16:31:31,000 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:31,000 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:31,002 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: EC12AC56FB614BCA8D1D2D763D7C6080, ordinal: 1
2015-11-23 16:31:31,003 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:31,003 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_RESULTS"]
2015-11-23 16:31:31,003 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EC12AC56FB614BCA8D1D2D763D7C6080, mem on start (mb), free: 225, total: 542, max: 672
2015-11-23 16:31:31,007 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:31,007 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EC12AC56FB614BCA8D1D2D763D7C6080, mem on close (mb), free: 223, total: 542, max: 672
2015-11-23 16:31:31,009 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1194095258_0012
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:31,018 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local1194095258_0012 state at FAILED
2015-11-23 16:31:31,018 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:31,018 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:31,018 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:31,021 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:31,021 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...latform/-1_VALUES_RESULTS
2015-11-23 16:31:31,021 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:31,022 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_RESULTS/_temporary
2015-11-23 16:31:31,022 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.140
2015-11-23 16:31:31,022 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_VALUES_RESULTS
2015-11-23 16:31:31,035 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:31,035 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:31,053 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.014
2015-11-23 16:31:31,054 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:31,054 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:31,062 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:31,062 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:31,062 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_ALL"]
2015-11-23 16:31:31,062 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:31,062 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:31,062 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:31,063 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...blyplatform/-1_VALUES_ALL
2015-11-23 16:31:31,147 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local499078038_0013
2015-11-23 16:31:31,148 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:31,152 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:31,179 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:31,180 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:31,182 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C0EE3661D1274E8CA8C4E22561695F6D, ordinal: 0
2015-11-23 16:31:31,182 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:31,182 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:31,182 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C0EE3661D1274E8CA8C4E22561695F6D, mem on start (mb), free: 227, total: 542, max: 672
2015-11-23 16:31:31,183 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C0EE3661D1274E8CA8C4E22561695F6D, mem on close (mb), free: 227, total: 542, max: 672
2015-11-23 16:31:31,193 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:31,193 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:31,195 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DAE7E1723F4745D2BFBED91D320982F6, ordinal: 1
2015-11-23 16:31:31,195 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:31,196 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_ALL"]
2015-11-23 16:31:31,196 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DAE7E1723F4745D2BFBED91D320982F6, mem on start (mb), free: 224, total: 542, max: 672
2015-11-23 16:31:31,200 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:31,201 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DAE7E1723F4745D2BFBED91D320982F6, mem on close (mb), free: 222, total: 542, max: 672
2015-11-23 16:31:31,202 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local499078038_0013
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:31,209 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local499078038_0013 state at FAILED
2015-11-23 16:31:31,209 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:31,209 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:31,209 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:31,211 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:31,212 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...blyplatform/-1_VALUES_ALL
2015-11-23 16:31:31,212 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:31,212 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_ALL/_temporary
2015-11-23 16:31:31,213 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.150
2015-11-23 16:31:31,213 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_VALUES_ALL
2015-11-23 16:31:31,227 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:31,227 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:31,240 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.009
2015-11-23 16:31:31,241 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:31,241 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:31,248 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:31,248 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:31,248 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_REPLACE"]
2015-11-23 16:31:31,248 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:31,248 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:31,248 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:31,249 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...latform/-1_VALUES_REPLACE
2015-11-23 16:31:31,329 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1513712491_0014
2015-11-23 16:31:31,330 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:31,335 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:31,362 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:31,362 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:31,365 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F8E31BB0F20F4EBB83567D2B13F985F2, ordinal: 0
2015-11-23 16:31:31,365 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:31,366 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:31,366 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F8E31BB0F20F4EBB83567D2B13F985F2, mem on start (mb), free: 228, total: 543, max: 672
2015-11-23 16:31:31,366 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F8E31BB0F20F4EBB83567D2B13F985F2, mem on close (mb), free: 228, total: 543, max: 672
2015-11-23 16:31:31,375 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:31,375 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:31,378 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F3C72CE56778473A885524F8959E9CE1, ordinal: 1
2015-11-23 16:31:31,378 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:31,378 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_REPLACE"]
2015-11-23 16:31:31,378 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F3C72CE56778473A885524F8959E9CE1, mem on start (mb), free: 225, total: 543, max: 672
2015-11-23 16:31:31,383 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:31,383 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F3C72CE56778473A885524F8959E9CE1, mem on close (mb), free: 223, total: 543, max: 672
2015-11-23 16:31:31,385 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1513712491_0014
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:31,391 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local1513712491_0014 state at FAILED
2015-11-23 16:31:31,391 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:31,391 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:31,391 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:31,394 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:31,395 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...latform/-1_VALUES_REPLACE
2015-11-23 16:31:31,395 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:31,396 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_REPLACE/_temporary
2015-11-23 16:31:31,396 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.147
2015-11-23 16:31:31,396 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_VALUES_REPLACE
2015-11-23 16:31:31,416 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:31,416 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:31,435 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.016
2015-11-23 16:31:31,436 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:31,436 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:31,447 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:31,447 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:31,448 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_SWAP"]
2015-11-23 16:31:31,448 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:31,448 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:31,448 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:31,448 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...lyplatform/-1_VALUES_SWAP
2015-11-23 16:31:31,534 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1855313753_0015
2015-11-23 16:31:31,535 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:31,540 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:31,570 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:31,571 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:31,574 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DCAD237D77054C8DA57637739B4BD31E, ordinal: 0
2015-11-23 16:31:31,574 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:31,574 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:31,574 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DCAD237D77054C8DA57637739B4BD31E, mem on start (mb), free: 228, total: 543, max: 672
2015-11-23 16:31:31,575 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DCAD237D77054C8DA57637739B4BD31E, mem on close (mb), free: 228, total: 543, max: 672
2015-11-23 16:31:31,584 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:31,584 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:31,587 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E6CCE9D199A04F4D9857D7285F4247C6, ordinal: 1
2015-11-23 16:31:31,587 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:31,587 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_SWAP"]
2015-11-23 16:31:31,587 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E6CCE9D199A04F4D9857D7285F4247C6, mem on start (mb), free: 224, total: 543, max: 672
2015-11-23 16:31:31,593 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:31,593 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E6CCE9D199A04F4D9857D7285F4247C6, mem on close (mb), free: 222, total: 543, max: 672
2015-11-23 16:31:31,595 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1855313753_0015
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:31,605 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local1855313753_0015 state at FAILED
2015-11-23 16:31:31,605 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:31,605 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:31,605 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:31,608 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:31,609 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...lyplatform/-1_VALUES_SWAP
2015-11-23 16:31:31,609 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:31,610 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_SWAP/_temporary
2015-11-23 16:31:31,610 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.162
2015-11-23 16:31:31,610 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_VALUES_SWAP
2015-11-23 16:31:31,622 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:31,622 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:31,639 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.013
2015-11-23 16:31:31,639 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:31,639 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:31,649 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:31,649 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:31,649 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1"]
2015-11-23 16:31:31,649 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:31,649 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:31,650 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:31,650 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...semblyplatform/-1_ARGS_-1
2015-11-23 16:31:31,740 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local92122118_0016
2015-11-23 16:31:31,741 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:31,745 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:31,772 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:31,772 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:31,774 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C8130FEEE50E41E7AA6FDD7AA91D4A7E, ordinal: 0
2015-11-23 16:31:31,774 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:31,774 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:31,774 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C8130FEEE50E41E7AA6FDD7AA91D4A7E, mem on start (mb), free: 229, total: 544, max: 672
2015-11-23 16:31:31,775 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C8130FEEE50E41E7AA6FDD7AA91D4A7E, mem on close (mb), free: 229, total: 544, max: 672
2015-11-23 16:31:31,784 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:31,784 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:31,787 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: EE74653768E14C19BA4EDB8553C5A610, ordinal: 1
2015-11-23 16:31:31,787 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:31,787 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1"]
2015-11-23 16:31:31,787 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EE74653768E14C19BA4EDB8553C5A610, mem on start (mb), free: 225, total: 544, max: 672
2015-11-23 16:31:31,793 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EE74653768E14C19BA4EDB8553C5A610, mem on close (mb), free: 223, total: 544, max: 672
2015-11-23 16:31:31,803 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1/_temporary
2015-11-23 16:31:31,804 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.154
2015-11-23 16:31:31,848 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_ARGS_-1
2015-11-23 16:31:31,861 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:31,861 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:31,870 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: ILLEGAL, in: 00:00.005
2015-11-23 16:31:31,871 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, found assembly to be malformed
2015-11-23 16:31:31,871 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_ARGS_'field'
2015-11-23 16:31:31,883 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:31,883 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:31,899 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.013
2015-11-23 16:31:31,899 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:31,899 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:31,908 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:31,909 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:31,909 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS"]
2015-11-23 16:31:31,909 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:31,909 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:31,909 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:31,909 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...yplatform/-1_ARGS_RESULTS
2015-11-23 16:31:31,999 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1855577028_0017
2015-11-23 16:31:31,999 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:32,004 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:32,032 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:32,032 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:32,034 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B3FA594F08784B6F8ACD0ED7DA7A64A8, ordinal: 0
2015-11-23 16:31:32,034 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:32,034 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:32,034 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B3FA594F08784B6F8ACD0ED7DA7A64A8, mem on start (mb), free: 228, total: 544, max: 672
2015-11-23 16:31:32,035 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B3FA594F08784B6F8ACD0ED7DA7A64A8, mem on close (mb), free: 228, total: 544, max: 672
2015-11-23 16:31:32,045 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:32,046 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:32,049 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: EBB16CCBF2084465848A007DE80E17EA, ordinal: 1
2015-11-23 16:31:32,050 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:32,050 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS"]
2015-11-23 16:31:32,050 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EBB16CCBF2084465848A007DE80E17EA, mem on start (mb), free: 224, total: 544, max: 672
2015-11-23 16:31:32,058 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EBB16CCBF2084465848A007DE80E17EA, mem on close (mb), free: 222, total: 544, max: 672
2015-11-23 16:31:32,074 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS/_temporary
2015-11-23 16:31:32,075 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.166
2015-11-23 16:31:32,121 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_ARGS_RESULTS
2015-11-23 16:31:32,138 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:32,138 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:32,146 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: ILLEGAL, in: 00:00.005
2015-11-23 16:31:32,146 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, found assembly to be malformed
2015-11-23 16:31:32,146 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_ARGS_ALL
2015-11-23 16:31:32,160 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:32,160 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:32,177 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.013
2015-11-23 16:31:32,177 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:32,177 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:32,187 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:32,187 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:32,187 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE"]
2015-11-23 16:31:32,187 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:32,187 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:32,187 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:32,188 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...yplatform/-1_ARGS_REPLACE
2015-11-23 16:31:32,271 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1988441788_0018
2015-11-23 16:31:32,271 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:32,277 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:32,302 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:32,302 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:32,304 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: CE468FF879AB48C892B8F41E352BE7C3, ordinal: 0
2015-11-23 16:31:32,304 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:32,305 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:32,305 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CE468FF879AB48C892B8F41E352BE7C3, mem on start (mb), free: 229, total: 545, max: 672
2015-11-23 16:31:32,305 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CE468FF879AB48C892B8F41E352BE7C3, mem on close (mb), free: 229, total: 545, max: 672
2015-11-23 16:31:32,315 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:32,315 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:32,317 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F996104DF3714E8F9B037083A1E1A2BF, ordinal: 1
2015-11-23 16:31:32,318 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:32,318 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE"]
2015-11-23 16:31:32,318 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F996104DF3714E8F9B037083A1E1A2BF, mem on start (mb), free: 225, total: 545, max: 672
2015-11-23 16:31:32,326 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F996104DF3714E8F9B037083A1E1A2BF, mem on close (mb), free: 223, total: 545, max: 672
2015-11-23 16:31:32,344 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE/_temporary
2015-11-23 16:31:32,345 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.156
2015-11-23 16:31:32,387 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_ARGS_REPLACE
2015-11-23 16:31:32,401 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:32,401 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:32,413 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.009
2015-11-23 16:31:32,414 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:32,414 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:32,420 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:32,420 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:32,420 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP"]
2015-11-23 16:31:32,420 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:32,420 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:32,420 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:32,421 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...mblyplatform/-1_ARGS_SWAP
2015-11-23 16:31:32,501 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1371054929_0019
2015-11-23 16:31:32,501 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:32,505 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:32,528 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:32,529 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:32,530 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: EF9EF182F5F04DCFA47151FE91AD4DDD, ordinal: 0
2015-11-23 16:31:32,531 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:32,531 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:32,531 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EF9EF182F5F04DCFA47151FE91AD4DDD, mem on start (mb), free: 229, total: 545, max: 672
2015-11-23 16:31:32,532 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EF9EF182F5F04DCFA47151FE91AD4DDD, mem on close (mb), free: 229, total: 545, max: 672
2015-11-23 16:31:32,541 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:32,541 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:32,543 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F5B19BE3D6614ADBBB56E38DDE4336F8, ordinal: 1
2015-11-23 16:31:32,543 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:32,543 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP"]
2015-11-23 16:31:32,543 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F5B19BE3D6614ADBBB56E38DDE4336F8, mem on start (mb), free: 225, total: 545, max: 672
2015-11-23 16:31:32,550 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F5B19BE3D6614ADBBB56E38DDE4336F8, mem on close (mb), free: 224, total: 545, max: 672
2015-11-23 16:31:32,561 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP/_temporary
2015-11-23 16:31:32,561 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.140
2015-11-23 16:31:32,599 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//-1_ARGS_SWAP
2015-11-23 16:31:32,616 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:32,616 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:32,630 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.010
2015-11-23 16:31:32,630 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:32,630 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:32,639 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:32,639 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:32,639 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1"]
2015-11-23 16:31:32,639 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:32,639 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:32,639 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:32,640 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...mblyplatform/0_'field'_-1
2015-11-23 16:31:32,727 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1735633076_0020
2015-11-23 16:31:32,727 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:32,732 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:32,758 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:32,758 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:32,760 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FA7958C019D04E60AA1FB3EEDC2E762E, ordinal: 0
2015-11-23 16:31:32,760 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:32,760 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:32,760 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FA7958C019D04E60AA1FB3EEDC2E762E, mem on start (mb), free: 229, total: 545, max: 672
2015-11-23 16:31:32,761 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FA7958C019D04E60AA1FB3EEDC2E762E, mem on close (mb), free: 229, total: 545, max: 672
2015-11-23 16:31:32,771 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:32,772 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:32,775 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A13569A3CCF04141BD4F6CC5C090617D, ordinal: 1
2015-11-23 16:31:32,775 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:32,776 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1"]
2015-11-23 16:31:32,776 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A13569A3CCF04141BD4F6CC5C090617D, mem on start (mb), free: 225, total: 545, max: 672
2015-11-23 16:31:32,784 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A13569A3CCF04141BD4F6CC5C090617D, mem on close (mb), free: 223, total: 545, max: 672
2015-11-23 16:31:32,800 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1/_temporary
2015-11-23 16:31:32,801 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.161
2015-11-23 16:31:32,842 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_'field'_-1
2015-11-23 16:31:32,853 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:32,854 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:32,868 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.011
2015-11-23 16:31:32,868 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:32,869 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:32,877 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:32,878 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:32,878 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'"]
2015-11-23 16:31:32,878 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:32,878 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:32,878 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:32,879 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...latform/0_'field'_'field'
2015-11-23 16:31:32,972 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local392731400_0021
2015-11-23 16:31:32,973 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:32,977 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:33,001 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:33,001 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:33,003 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A9D7BFFC515148B783D93AD91EF23744, ordinal: 0
2015-11-23 16:31:33,003 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:33,003 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:33,003 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A9D7BFFC515148B783D93AD91EF23744, mem on start (mb), free: 228, total: 546, max: 672
2015-11-23 16:31:33,004 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A9D7BFFC515148B783D93AD91EF23744, mem on close (mb), free: 228, total: 546, max: 672
2015-11-23 16:31:33,037 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:33,038 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:33,041 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A00681C3757C46DC96149249DA12B71F, ordinal: 1
2015-11-23 16:31:33,041 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:33,042 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'"]
2015-11-23 16:31:33,042 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A00681C3757C46DC96149249DA12B71F, mem on start (mb), free: 225, total: 546, max: 672
2015-11-23 16:31:33,050 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A00681C3757C46DC96149249DA12B71F, mem on close (mb), free: 223, total: 546, max: 672
2015-11-23 16:31:33,063 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'/_temporary
2015-11-23 16:31:33,064 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.186
2015-11-23 16:31:33,114 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_'field'_'field'
2015-11-23 16:31:33,129 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:33,129 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:33,146 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.014
2015-11-23 16:31:33,146 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:33,146 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:33,156 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:33,156 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:33,156 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS"]
2015-11-23 16:31:33,157 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:33,157 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:33,157 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:33,158 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...latform/0_'field'_RESULTS
2015-11-23 16:31:33,263 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local658731837_0022
2015-11-23 16:31:33,263 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:33,269 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:33,295 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:33,295 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:33,297 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DC83F30B1D3843408E33AC59081B896C, ordinal: 0
2015-11-23 16:31:33,297 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:33,297 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:33,297 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DC83F30B1D3843408E33AC59081B896C, mem on start (mb), free: 228, total: 546, max: 672
2015-11-23 16:31:33,298 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DC83F30B1D3843408E33AC59081B896C, mem on close (mb), free: 228, total: 546, max: 672
2015-11-23 16:31:33,308 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:33,308 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:33,311 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F26BFC168D5B47EF9D911567E4D17DC3, ordinal: 1
2015-11-23 16:31:33,312 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:33,312 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS"]
2015-11-23 16:31:33,312 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F26BFC168D5B47EF9D911567E4D17DC3, mem on start (mb), free: 224, total: 546, max: 672
2015-11-23 16:31:33,320 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F26BFC168D5B47EF9D911567E4D17DC3, mem on close (mb), free: 223, total: 546, max: 672
2015-11-23 16:31:33,337 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS/_temporary
2015-11-23 16:31:33,337 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.181
2015-11-23 16:31:33,377 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_'field'_RESULTS
2015-11-23 16:31:33,392 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:33,392 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:33,408 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.013
2015-11-23 16:31:33,408 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:33,408 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:33,418 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:33,419 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:33,419 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL"]
2015-11-23 16:31:33,419 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:33,419 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:33,419 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:33,419 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...blyplatform/0_'field'_ALL
2015-11-23 16:31:33,503 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local658331287_0023
2015-11-23 16:31:33,503 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:33,508 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:33,532 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:33,533 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:33,534 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F8B780BE96A64433839BD6D37EB0321E, ordinal: 0
2015-11-23 16:31:33,535 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:33,535 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:33,535 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F8B780BE96A64433839BD6D37EB0321E, mem on start (mb), free: 228, total: 546, max: 672
2015-11-23 16:31:33,535 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F8B780BE96A64433839BD6D37EB0321E, mem on close (mb), free: 228, total: 546, max: 672
2015-11-23 16:31:33,545 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:33,546 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:33,548 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DDFA5B5E1DB14B65ADDE41F35701C64F, ordinal: 1
2015-11-23 16:31:33,548 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:33,548 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL"]
2015-11-23 16:31:33,548 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DDFA5B5E1DB14B65ADDE41F35701C64F, mem on start (mb), free: 224, total: 546, max: 672
2015-11-23 16:31:33,554 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DDFA5B5E1DB14B65ADDE41F35701C64F, mem on close (mb), free: 222, total: 546, max: 672
2015-11-23 16:31:33,563 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL/_temporary
2015-11-23 16:31:33,564 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.145
2015-11-23 16:31:33,601 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_'field'_ALL
2015-11-23 16:31:33,617 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:33,617 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:33,622 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: ILLEGAL, in: 00:00.002
2015-11-23 16:31:33,622 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, found assembly to be malformed
2015-11-23 16:31:33,622 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_'field'_REPLACE
2015-11-23 16:31:33,633 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:33,633 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:33,648 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.012
2015-11-23 16:31:33,648 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:33,648 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:33,657 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:33,657 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:33,657 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP"]
2015-11-23 16:31:33,657 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:33,657 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:33,657 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:33,658 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...lyplatform/0_'field'_SWAP
2015-11-23 16:31:33,745 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1977832122_0024
2015-11-23 16:31:33,745 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:33,749 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:33,773 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:33,773 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:33,775 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B400E65256A94D8E8A759B9AFCC6953C, ordinal: 0
2015-11-23 16:31:33,775 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:33,775 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:33,775 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B400E65256A94D8E8A759B9AFCC6953C, mem on start (mb), free: 227, total: 546, max: 672
2015-11-23 16:31:33,776 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B400E65256A94D8E8A759B9AFCC6953C, mem on close (mb), free: 227, total: 546, max: 672
2015-11-23 16:31:33,785 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:33,785 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:33,789 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E5039546AFA84503869DA23B9E0F78F9, ordinal: 1
2015-11-23 16:31:33,789 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:33,789 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP"]
2015-11-23 16:31:33,789 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E5039546AFA84503869DA23B9E0F78F9, mem on start (mb), free: 223, total: 546, max: 672
2015-11-23 16:31:33,796 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E5039546AFA84503869DA23B9E0F78F9, mem on close (mb), free: 222, total: 546, max: 672
2015-11-23 16:31:33,815 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP/_temporary
2015-11-23 16:31:33,815 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.157
2015-11-23 16:31:33,856 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_'field'_SWAP
2015-11-23 16:31:33,870 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:33,870 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:33,881 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.008
2015-11-23 16:31:33,882 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:33,882 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:33,888 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:33,888 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:33,889 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1"]
2015-11-23 16:31:33,889 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:33,889 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:33,889 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:33,890 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...mblyplatform/0_UNKNOWN_-1
2015-11-23 16:31:33,973 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1371166092_0025
2015-11-23 16:31:33,974 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:33,980 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:34,006 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:34,006 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:34,008 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E1663901CD8345F7AE93DB95F9D5B6B1, ordinal: 0
2015-11-23 16:31:34,008 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:34,008 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:34,008 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E1663901CD8345F7AE93DB95F9D5B6B1, mem on start (mb), free: 227, total: 547, max: 672
2015-11-23 16:31:34,009 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E1663901CD8345F7AE93DB95F9D5B6B1, mem on close (mb), free: 227, total: 547, max: 672
2015-11-23 16:31:34,018 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:34,018 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:34,020 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DE01C801E09D4F018DB312C413207F45, ordinal: 1
2015-11-23 16:31:34,020 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:34,020 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1"]
2015-11-23 16:31:34,020 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DE01C801E09D4F018DB312C413207F45, mem on start (mb), free: 223, total: 547, max: 672
2015-11-23 16:31:34,026 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DE01C801E09D4F018DB312C413207F45, mem on close (mb), free: 222, total: 547, max: 672
2015-11-23 16:31:34,038 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1/_temporary
2015-11-23 16:31:34,039 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.150
2015-11-23 16:31:34,072 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_UNKNOWN_-1
2015-11-23 16:31:34,088 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:34,088 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:34,095 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: ILLEGAL, in: 00:00.004
2015-11-23 16:31:34,095 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, found assembly to be malformed
2015-11-23 16:31:34,096 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_UNKNOWN_'field'
2015-11-23 16:31:34,108 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:34,109 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:34,120 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.008
2015-11-23 16:31:34,121 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:34,121 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:34,127 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:34,127 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:34,127 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS"]
2015-11-23 16:31:34,127 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:34,127 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:34,127 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:34,128 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...latform/0_UNKNOWN_RESULTS
2015-11-23 16:31:34,209 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1447005815_0026
2015-11-23 16:31:34,209 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:34,213 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:34,236 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:34,236 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:34,238 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: EFF1D36173E842EDB59637B3D6C7D85B, ordinal: 0
2015-11-23 16:31:34,238 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:34,238 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:34,238 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EFF1D36173E842EDB59637B3D6C7D85B, mem on start (mb), free: 226, total: 547, max: 672
2015-11-23 16:31:34,239 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EFF1D36173E842EDB59637B3D6C7D85B, mem on close (mb), free: 226, total: 547, max: 672
2015-11-23 16:31:34,249 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:34,249 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:34,251 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D3316976641F44A9A7A397BD82CD2D06, ordinal: 1
2015-11-23 16:31:34,251 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:34,251 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS"]
2015-11-23 16:31:34,252 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D3316976641F44A9A7A397BD82CD2D06, mem on start (mb), free: 222, total: 547, max: 672
2015-11-23 16:31:34,257 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D3316976641F44A9A7A397BD82CD2D06, mem on close (mb), free: 221, total: 547, max: 672
2015-11-23 16:31:34,268 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS/_temporary
2015-11-23 16:31:34,269 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.141
2015-11-23 16:31:34,297 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_UNKNOWN_RESULTS
2015-11-23 16:31:34,308 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:34,308 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:34,318 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.007
2015-11-23 16:31:34,319 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:34,319 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:34,328 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:34,328 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:34,328 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL"]
2015-11-23 16:31:34,328 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:34,328 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:34,328 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:34,329 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...blyplatform/0_UNKNOWN_ALL
2015-11-23 16:31:34,410 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local193581204_0027
2015-11-23 16:31:34,410 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:34,413 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:34,437 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:34,437 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:34,439 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B4715559B34048448CE42C4A637FBEE1, ordinal: 0
2015-11-23 16:31:34,439 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:34,439 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:34,440 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B4715559B34048448CE42C4A637FBEE1, mem on start (mb), free: 226, total: 547, max: 672
2015-11-23 16:31:34,440 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B4715559B34048448CE42C4A637FBEE1, mem on close (mb), free: 226, total: 547, max: 672
2015-11-23 16:31:34,449 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:34,450 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:34,452 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: ED1B32AF5F214CDE921BC8B614F85BE4, ordinal: 1
2015-11-23 16:31:34,452 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:34,452 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL"]
2015-11-23 16:31:34,452 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ED1B32AF5F214CDE921BC8B614F85BE4, mem on start (mb), free: 222, total: 547, max: 672
2015-11-23 16:31:34,457 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ED1B32AF5F214CDE921BC8B614F85BE4, mem on close (mb), free: 221, total: 547, max: 672
2015-11-23 16:31:34,469 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL/_temporary
2015-11-23 16:31:34,469 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.141
2015-11-23 16:31:34,500 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_UNKNOWN_ALL
2015-11-23 16:31:34,510 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:34,511 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:34,521 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.007
2015-11-23 16:31:34,521 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:34,521 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:34,527 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:34,527 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:34,527 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_REPLACE"]
2015-11-23 16:31:34,527 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:34,527 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:34,527 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:34,528 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...latform/0_UNKNOWN_REPLACE
2015-11-23 16:31:34,652 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local2070812053_0028
2015-11-23 16:31:34,652 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:34,657 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:34,681 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:34,681 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:34,682 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AA0F9D24CF1B4DB3833A7330D19A88A1, ordinal: 0
2015-11-23 16:31:34,683 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:34,683 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:34,683 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AA0F9D24CF1B4DB3833A7330D19A88A1, mem on start (mb), free: 225, total: 547, max: 672
2015-11-23 16:31:34,683 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AA0F9D24CF1B4DB3833A7330D19A88A1, mem on close (mb), free: 225, total: 547, max: 672
2015-11-23 16:31:34,692 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:34,692 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:34,696 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: FAA9FD036A724771898B49DC7525319F, ordinal: 1
2015-11-23 16:31:34,696 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:34,696 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_REPLACE"]
2015-11-23 16:31:34,696 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FAA9FD036A724771898B49DC7525319F, mem on start (mb), free: 222, total: 547, max: 672
2015-11-23 16:31:34,702 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:34,703 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FAA9FD036A724771898B49DC7525319F, mem on close (mb), free: 220, total: 547, max: 672
2015-11-23 16:31:34,704 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local2070812053_0028
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:34,711 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local2070812053_0028 state at FAILED
2015-11-23 16:31:34,711 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:34,711 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:34,711 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:34,713 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:34,714 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...latform/0_UNKNOWN_REPLACE
2015-11-23 16:31:34,714 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:34,714 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_REPLACE/_temporary
2015-11-23 16:31:34,715 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.187
2015-11-23 16:31:34,715 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_UNKNOWN_REPLACE
2015-11-23 16:31:34,728 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:34,728 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:34,742 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.011
2015-11-23 16:31:34,742 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:34,743 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:34,749 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:34,749 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:34,749 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP"]
2015-11-23 16:31:34,749 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:34,749 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:34,749 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:34,750 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...lyplatform/0_UNKNOWN_SWAP
2015-11-23 16:31:34,826 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local177289179_0029
2015-11-23 16:31:34,827 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:34,830 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:34,854 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:34,854 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:34,855 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FC586235133646C4BE4048ECB2C82789, ordinal: 0
2015-11-23 16:31:34,856 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:34,856 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:34,856 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FC586235133646C4BE4048ECB2C82789, mem on start (mb), free: 225, total: 548, max: 672
2015-11-23 16:31:34,856 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FC586235133646C4BE4048ECB2C82789, mem on close (mb), free: 225, total: 548, max: 672
2015-11-23 16:31:34,864 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:34,864 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:34,866 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E56A79CC5D894A4F9817F73CFE0B0931, ordinal: 1
2015-11-23 16:31:34,866 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:34,866 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP"]
2015-11-23 16:31:34,866 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E56A79CC5D894A4F9817F73CFE0B0931, mem on start (mb), free: 222, total: 548, max: 672
2015-11-23 16:31:34,872 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E56A79CC5D894A4F9817F73CFE0B0931, mem on close (mb), free: 220, total: 548, max: 672
2015-11-23 16:31:34,885 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP/_temporary
2015-11-23 16:31:34,885 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.135
2015-11-23 16:31:34,916 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_UNKNOWN_SWAP
2015-11-23 16:31:34,926 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:34,926 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:34,936 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.007
2015-11-23 16:31:34,936 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:34,937 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:34,945 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:34,946 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:34,946 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_-1"]
2015-11-23 16:31:34,946 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:34,946 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:34,946 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:34,946 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...emblyplatform/0_VALUES_-1
2015-11-23 16:31:35,037 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local2127813575_0030
2015-11-23 16:31:35,037 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:35,041 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:35,065 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:35,065 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:35,066 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C97A9743B8304B23992B9A34CB081D77, ordinal: 0
2015-11-23 16:31:35,067 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:35,067 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:35,067 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C97A9743B8304B23992B9A34CB081D77, mem on start (mb), free: 224, total: 548, max: 672
2015-11-23 16:31:35,067 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C97A9743B8304B23992B9A34CB081D77, mem on close (mb), free: 224, total: 548, max: 672
2015-11-23 16:31:35,075 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:35,075 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:35,077 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DFA3C56740D7425CA507FCD154530F25, ordinal: 1
2015-11-23 16:31:35,077 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:35,077 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_-1"]
2015-11-23 16:31:35,077 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DFA3C56740D7425CA507FCD154530F25, mem on start (mb), free: 220, total: 548, max: 672
2015-11-23 16:31:35,082 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:35,083 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DFA3C56740D7425CA507FCD154530F25, mem on close (mb), free: 218, total: 548, max: 672
2015-11-23 16:31:35,084 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local2127813575_0030
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:35,084 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local2127813575_0030 state at FAILED
2015-11-23 16:31:35,085 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:35,085 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:35,085 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:35,086 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:35,087 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...emblyplatform/0_VALUES_-1
2015-11-23 16:31:35,087 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:35,087 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_-1/_temporary
2015-11-23 16:31:35,088 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.142
2015-11-23 16:31:35,088 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_VALUES_-1
2015-11-23 16:31:35,103 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:35,103 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:35,110 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: ILLEGAL, in: 00:00.003
2015-11-23 16:31:35,111 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, found assembly to be malformed
2015-11-23 16:31:35,111 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_VALUES_'field'
2015-11-23 16:31:35,123 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:35,124 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:35,137 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.010
2015-11-23 16:31:35,138 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:35,138 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:35,146 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:35,146 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:35,146 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_RESULTS"]
2015-11-23 16:31:35,147 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:35,147 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:35,147 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:35,147 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...platform/0_VALUES_RESULTS
2015-11-23 16:31:35,229 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1405598309_0031
2015-11-23 16:31:35,229 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:35,233 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:35,259 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:35,259 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:35,260 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D2BDB34335724FE4A1F774ACAD588DC8, ordinal: 0
2015-11-23 16:31:35,261 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:35,261 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:35,261 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D2BDB34335724FE4A1F774ACAD588DC8, mem on start (mb), free: 224, total: 548, max: 672
2015-11-23 16:31:35,261 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D2BDB34335724FE4A1F774ACAD588DC8, mem on close (mb), free: 224, total: 548, max: 672
2015-11-23 16:31:35,269 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:35,269 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:35,271 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CC4637F133204C56A5AA6EE0EA93AF85, ordinal: 1
2015-11-23 16:31:35,271 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:35,271 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_RESULTS"]
2015-11-23 16:31:35,272 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CC4637F133204C56A5AA6EE0EA93AF85, mem on start (mb), free: 221, total: 548, max: 672
2015-11-23 16:31:35,277 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:35,277 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CC4637F133204C56A5AA6EE0EA93AF85, mem on close (mb), free: 219, total: 548, max: 672
2015-11-23 16:31:35,279 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1405598309_0031
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:35,289 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local1405598309_0031 state at FAILED
2015-11-23 16:31:35,289 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:35,289 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:35,289 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:35,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:35,292 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...platform/0_VALUES_RESULTS
2015-11-23 16:31:35,293 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:35,293 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_RESULTS/_temporary
2015-11-23 16:31:35,294 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.147
2015-11-23 16:31:35,294 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_VALUES_RESULTS
2015-11-23 16:31:35,309 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:35,309 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:35,325 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.013
2015-11-23 16:31:35,325 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:35,325 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:35,333 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:35,333 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:35,333 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_ALL"]
2015-11-23 16:31:35,333 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:35,333 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:35,333 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:35,334 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...mblyplatform/0_VALUES_ALL
2015-11-23 16:31:35,411 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1639011018_0032
2015-11-23 16:31:35,411 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:35,415 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:35,439 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:35,439 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:35,441 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A33F34D67D34407293619D25E77C3ED5, ordinal: 0
2015-11-23 16:31:35,441 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:35,441 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:35,441 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A33F34D67D34407293619D25E77C3ED5, mem on start (mb), free: 225, total: 549, max: 672
2015-11-23 16:31:35,442 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A33F34D67D34407293619D25E77C3ED5, mem on close (mb), free: 225, total: 549, max: 672
2015-11-23 16:31:35,449 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:35,449 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:35,451 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: AAF3FC5E1B924A23883F96CED15E209B, ordinal: 1
2015-11-23 16:31:35,451 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:35,452 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_ALL"]
2015-11-23 16:31:35,452 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AAF3FC5E1B924A23883F96CED15E209B, mem on start (mb), free: 221, total: 549, max: 672
2015-11-23 16:31:35,455 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:35,456 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AAF3FC5E1B924A23883F96CED15E209B, mem on close (mb), free: 219, total: 549, max: 672
2015-11-23 16:31:35,457 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1639011018_0032
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:35,459 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local1639011018_0032 state at FAILED
2015-11-23 16:31:35,459 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:35,459 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:35,459 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:35,461 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:35,461 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...mblyplatform/0_VALUES_ALL
2015-11-23 16:31:35,462 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:35,462 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_ALL/_temporary
2015-11-23 16:31:35,462 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.129
2015-11-23 16:31:35,462 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_VALUES_ALL
2015-11-23 16:31:35,478 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:35,478 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:35,488 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.007
2015-11-23 16:31:35,489 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:35,489 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:35,497 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:35,497 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:35,497 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_REPLACE"]
2015-11-23 16:31:35,497 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:35,497 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:35,497 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:35,498 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...platform/0_VALUES_REPLACE
2015-11-23 16:31:35,575 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1592769344_0033
2015-11-23 16:31:35,576 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:35,578 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:35,602 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:35,602 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:35,604 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A0585E5E559343CAA37E3C13ACF8297A, ordinal: 0
2015-11-23 16:31:35,604 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:35,604 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:35,604 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A0585E5E559343CAA37E3C13ACF8297A, mem on start (mb), free: 221, total: 546, max: 672
2015-11-23 16:31:35,605 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A0585E5E559343CAA37E3C13ACF8297A, mem on close (mb), free: 221, total: 546, max: 672
2015-11-23 16:31:35,611 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:35,611 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:35,613 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C0F14D5359E0402CA585622E2551D662, ordinal: 1
2015-11-23 16:31:35,613 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:35,614 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_REPLACE"]
2015-11-23 16:31:35,614 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C0F14D5359E0402CA585622E2551D662, mem on start (mb), free: 216, total: 546, max: 672
2015-11-23 16:31:35,618 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:35,618 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C0F14D5359E0402CA585622E2551D662, mem on close (mb), free: 215, total: 546, max: 672
2015-11-23 16:31:35,619 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1592769344_0033
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:35,622 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local1592769344_0033 state at FAILED
2015-11-23 16:31:35,622 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:35,622 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:35,622 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:35,624 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:35,624 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...platform/0_VALUES_REPLACE
2015-11-23 16:31:35,625 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:35,625 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_REPLACE/_temporary
2015-11-23 16:31:35,625 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.128
2015-11-23 16:31:35,625 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_VALUES_REPLACE
2015-11-23 16:31:35,640 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:35,640 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:35,650 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.007
2015-11-23 16:31:35,650 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:35,651 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:35,658 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:35,658 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:35,658 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_SWAP"]
2015-11-23 16:31:35,658 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:35,658 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:35,658 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:35,659 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...blyplatform/0_VALUES_SWAP
2015-11-23 16:31:35,732 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1704605470_0034
2015-11-23 16:31:35,733 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:35,736 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:35,760 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:35,760 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:35,761 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A5AE09E549B94D499551E373D1AF0314, ordinal: 0
2015-11-23 16:31:35,762 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:35,762 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:35,762 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A5AE09E549B94D499551E373D1AF0314, mem on start (mb), free: 223, total: 549, max: 672
2015-11-23 16:31:35,762 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A5AE09E549B94D499551E373D1AF0314, mem on close (mb), free: 223, total: 549, max: 672
2015-11-23 16:31:35,770 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:35,770 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:35,772 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E7306762039D40A3999EA6575AFD82AC, ordinal: 1
2015-11-23 16:31:35,772 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:35,772 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_SWAP"]
2015-11-23 16:31:35,772 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E7306762039D40A3999EA6575AFD82AC, mem on start (mb), free: 219, total: 549, max: 672
2015-11-23 16:31:35,776 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:35,776 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E7306762039D40A3999EA6575AFD82AC, mem on close (mb), free: 217, total: 549, max: 672
2015-11-23 16:31:35,777 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1704605470_0034
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:35,780 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local1704605470_0034 state at FAILED
2015-11-23 16:31:35,780 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:35,780 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:35,780 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:35,781 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:35,781 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...blyplatform/0_VALUES_SWAP
2015-11-23 16:31:35,782 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:35,782 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_SWAP/_temporary
2015-11-23 16:31:35,782 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.124
2015-11-23 16:31:35,782 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_VALUES_SWAP
2015-11-23 16:31:35,793 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:35,793 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:35,806 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.010
2015-11-23 16:31:35,807 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:35,807 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:35,812 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:35,812 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:35,812 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1"]
2015-11-23 16:31:35,812 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:35,813 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:35,813 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:35,813 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...ssemblyplatform/0_ARGS_-1
2015-11-23 16:31:35,892 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1968695599_0035
2015-11-23 16:31:35,892 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:35,896 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:35,921 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:35,921 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:35,922 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: CB051AB1313F40CAB01B84D45A364A9F, ordinal: 0
2015-11-23 16:31:35,923 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:35,923 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:35,923 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CB051AB1313F40CAB01B84D45A364A9F, mem on start (mb), free: 222, total: 549, max: 672
2015-11-23 16:31:35,923 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CB051AB1313F40CAB01B84D45A364A9F, mem on close (mb), free: 222, total: 549, max: 672
2015-11-23 16:31:35,932 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:35,932 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:35,936 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: EECB58EF37254A838EFDFF7550548575, ordinal: 1
2015-11-23 16:31:35,936 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:35,936 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1"]
2015-11-23 16:31:35,937 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EECB58EF37254A838EFDFF7550548575, mem on start (mb), free: 218, total: 549, max: 672
2015-11-23 16:31:35,944 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EECB58EF37254A838EFDFF7550548575, mem on close (mb), free: 216, total: 549, max: 672
2015-11-23 16:31:35,962 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1/_temporary
2015-11-23 16:31:35,963 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.150
2015-11-23 16:31:36,005 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_ARGS_-1
2015-11-23 16:31:36,019 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:36,019 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:36,026 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: ILLEGAL, in: 00:00.003
2015-11-23 16:31:36,026 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, found assembly to be malformed
2015-11-23 16:31:36,026 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_ARGS_'field'
2015-11-23 16:31:36,038 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:36,038 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:36,052 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.012
2015-11-23 16:31:36,052 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:36,052 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:36,059 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:36,059 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:36,059 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS"]
2015-11-23 16:31:36,059 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:36,059 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:36,059 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:36,060 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...lyplatform/0_ARGS_RESULTS
2015-11-23 16:31:36,146 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local370291129_0036
2015-11-23 16:31:36,146 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:36,149 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:36,174 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:36,174 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:36,176 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DC52D116E632486EA6DE566544B77C7A, ordinal: 0
2015-11-23 16:31:36,176 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:36,176 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:36,176 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DC52D116E632486EA6DE566544B77C7A, mem on start (mb), free: 221, total: 549, max: 672
2015-11-23 16:31:36,177 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DC52D116E632486EA6DE566544B77C7A, mem on close (mb), free: 221, total: 549, max: 672
2015-11-23 16:31:36,186 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:36,186 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:36,189 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A8F7A002B89248A39E78EC2CA742A9FB, ordinal: 1
2015-11-23 16:31:36,189 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:36,190 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS"]
2015-11-23 16:31:36,190 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A8F7A002B89248A39E78EC2CA742A9FB, mem on start (mb), free: 217, total: 549, max: 672
2015-11-23 16:31:36,197 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A8F7A002B89248A39E78EC2CA742A9FB, mem on close (mb), free: 215, total: 549, max: 672
2015-11-23 16:31:36,216 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS/_temporary
2015-11-23 16:31:36,216 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.156
2015-11-23 16:31:36,255 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_ARGS_RESULTS
2015-11-23 16:31:36,269 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:36,270 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:36,276 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: ILLEGAL, in: 00:00.003
2015-11-23 16:31:36,276 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, found assembly to be malformed
2015-11-23 16:31:36,276 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_ARGS_ALL
2015-11-23 16:31:36,287 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:36,288 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:36,299 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.009
2015-11-23 16:31:36,300 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:36,300 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:36,307 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:36,307 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:36,308 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE"]
2015-11-23 16:31:36,308 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:36,308 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:36,308 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:36,308 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...lyplatform/0_ARGS_REPLACE
2015-11-23 16:31:36,393 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1801004802_0037
2015-11-23 16:31:36,394 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:36,398 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:36,423 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:36,423 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:36,425 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F635012BB0A442BCBFA787A20AFA2E64, ordinal: 0
2015-11-23 16:31:36,425 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:36,425 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:36,425 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F635012BB0A442BCBFA787A20AFA2E64, mem on start (mb), free: 221, total: 549, max: 672
2015-11-23 16:31:36,426 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F635012BB0A442BCBFA787A20AFA2E64, mem on close (mb), free: 221, total: 549, max: 672
2015-11-23 16:31:36,436 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:36,436 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:36,439 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F6E8BA99FA494E64AA77450D950659C0, ordinal: 1
2015-11-23 16:31:36,440 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:36,440 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE"]
2015-11-23 16:31:36,440 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F6E8BA99FA494E64AA77450D950659C0, mem on start (mb), free: 217, total: 549, max: 672
2015-11-23 16:31:36,447 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F6E8BA99FA494E64AA77450D950659C0, mem on close (mb), free: 215, total: 549, max: 672
2015-11-23 16:31:36,465 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE/_temporary
2015-11-23 16:31:36,465 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.157
2015-11-23 16:31:36,506 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_ARGS_REPLACE
2015-11-23 16:31:36,520 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:36,520 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:36,530 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.007
2015-11-23 16:31:36,531 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:36,531 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:36,537 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:36,537 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:36,538 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP"]
2015-11-23 16:31:36,538 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:36,538 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:36,538 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:36,538 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...emblyplatform/0_ARGS_SWAP
2015-11-23 16:31:36,624 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local472838081_0038
2015-11-23 16:31:36,625 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:36,628 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:36,653 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:36,653 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:36,655 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: ACF2389BD5EA4C0A854225F71A6845E6, ordinal: 0
2015-11-23 16:31:36,655 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:36,655 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:36,655 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: ACF2389BD5EA4C0A854225F71A6845E6, mem on start (mb), free: 220, total: 549, max: 672
2015-11-23 16:31:36,656 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: ACF2389BD5EA4C0A854225F71A6845E6, mem on close (mb), free: 220, total: 549, max: 672
2015-11-23 16:31:36,665 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:36,665 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:36,668 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E46E4A5A6E634A30821B58A9313348C4, ordinal: 1
2015-11-23 16:31:36,668 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:36,668 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP"]
2015-11-23 16:31:36,668 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E46E4A5A6E634A30821B58A9313348C4, mem on start (mb), free: 217, total: 549, max: 672
2015-11-23 16:31:36,676 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E46E4A5A6E634A30821B58A9313348C4, mem on close (mb), free: 215, total: 549, max: 672
2015-11-23 16:31:36,695 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP/_temporary
2015-11-23 16:31:36,695 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.158
2015-11-23 16:31:36,736 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//0_ARGS_SWAP
2015-11-23 16:31:36,748 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:36,748 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:36,762 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.012
2015-11-23 16:31:36,763 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:36,763 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:36,772 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:36,772 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:36,772 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1"]
2015-11-23 16:31:36,773 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:36,773 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:36,773 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:36,774 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...lyplatform/ALL_'field'_-1
2015-11-23 16:31:36,857 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local2113218655_0039
2015-11-23 16:31:36,857 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:36,860 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:36,884 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:36,884 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:36,886 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F34879500951485EA7DFD450195D536A, ordinal: 0
2015-11-23 16:31:36,886 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:36,886 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:36,886 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F34879500951485EA7DFD450195D536A, mem on start (mb), free: 220, total: 550, max: 672
2015-11-23 16:31:36,887 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F34879500951485EA7DFD450195D536A, mem on close (mb), free: 220, total: 550, max: 672
2015-11-23 16:31:36,894 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:36,894 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:36,896 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E7CA78B9B661417383C2A8D0F1E9A346, ordinal: 1
2015-11-23 16:31:36,896 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:36,896 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1"]
2015-11-23 16:31:36,896 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E7CA78B9B661417383C2A8D0F1E9A346, mem on start (mb), free: 217, total: 550, max: 672
2015-11-23 16:31:36,903 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E7CA78B9B661417383C2A8D0F1E9A346, mem on close (mb), free: 215, total: 550, max: 672
2015-11-23 16:31:36,916 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1/_temporary
2015-11-23 16:31:36,916 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.144
2015-11-23 16:31:36,957 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_'field'_-1
2015-11-23 16:31:36,972 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:36,972 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:36,986 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.011
2015-11-23 16:31:36,987 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:36,987 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:36,996 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:36,996 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:36,996 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'"]
2015-11-23 16:31:36,996 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:36,996 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:36,996 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:36,997 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...tform/ALL_'field'_'field'
2015-11-23 16:31:37,073 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local467441091_0040
2015-11-23 16:31:37,073 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:37,077 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:37,102 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:37,102 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:37,104 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: EDC5C72C95F84C9DB6DC36BDBC194FBE, ordinal: 0
2015-11-23 16:31:37,104 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:37,104 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:37,104 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EDC5C72C95F84C9DB6DC36BDBC194FBE, mem on start (mb), free: 221, total: 551, max: 672
2015-11-23 16:31:37,105 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EDC5C72C95F84C9DB6DC36BDBC194FBE, mem on close (mb), free: 221, total: 551, max: 672
2015-11-23 16:31:37,114 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:37,114 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:37,116 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B1825A21D88D43E0B417E1C9EE15F3F3, ordinal: 1
2015-11-23 16:31:37,116 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:37,117 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'"]
2015-11-23 16:31:37,117 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B1825A21D88D43E0B417E1C9EE15F3F3, mem on start (mb), free: 217, total: 551, max: 672
2015-11-23 16:31:37,124 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B1825A21D88D43E0B417E1C9EE15F3F3, mem on close (mb), free: 216, total: 551, max: 672
2015-11-23 16:31:37,135 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'/_temporary
2015-11-23 16:31:37,136 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.139
2015-11-23 16:31:37,175 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_'field'_'field'
2015-11-23 16:31:37,191 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:37,191 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:37,205 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.011
2015-11-23 16:31:37,206 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:37,206 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:37,215 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:37,215 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:37,215 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS"]
2015-11-23 16:31:37,215 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:37,215 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:37,215 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:37,216 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...tform/ALL_'field'_RESULTS
2015-11-23 16:31:37,305 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local538753685_0041
2015-11-23 16:31:37,305 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:37,309 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:37,334 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:37,334 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:37,335 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BEC0A2B40E64451D9AFB6F9FC25AB341, ordinal: 0
2015-11-23 16:31:37,335 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:37,335 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:37,336 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BEC0A2B40E64451D9AFB6F9FC25AB341, mem on start (mb), free: 218, total: 549, max: 672
2015-11-23 16:31:37,336 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BEC0A2B40E64451D9AFB6F9FC25AB341, mem on close (mb), free: 218, total: 549, max: 672
2015-11-23 16:31:37,344 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:37,344 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:37,346 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B23F6AB76B864CC490E7CB6B6E951B9C, ordinal: 1
2015-11-23 16:31:37,346 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:37,346 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS"]
2015-11-23 16:31:37,346 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B23F6AB76B864CC490E7CB6B6E951B9C, mem on start (mb), free: 215, total: 549, max: 672
2015-11-23 16:31:37,352 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B23F6AB76B864CC490E7CB6B6E951B9C, mem on close (mb), free: 213, total: 549, max: 672
2015-11-23 16:31:37,365 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS/_temporary
2015-11-23 16:31:37,366 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.150
2015-11-23 16:31:37,403 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_'field'_RESULTS
2015-11-23 16:31:37,418 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:37,418 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:37,433 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.011
2015-11-23 16:31:37,433 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:37,433 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:37,442 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:37,442 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:37,442 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL"]
2015-11-23 16:31:37,442 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:37,442 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:37,443 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:37,444 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...yplatform/ALL_'field'_ALL
2015-11-23 16:31:37,532 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local588784369_0042
2015-11-23 16:31:37,532 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:37,535 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:37,560 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:37,560 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:37,561 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FA13C1103F81415F9DB6176ECAA021E9, ordinal: 0
2015-11-23 16:31:37,562 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:37,562 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:37,562 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FA13C1103F81415F9DB6176ECAA021E9, mem on start (mb), free: 219, total: 550, max: 672
2015-11-23 16:31:37,562 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FA13C1103F81415F9DB6176ECAA021E9, mem on close (mb), free: 219, total: 550, max: 672
2015-11-23 16:31:37,570 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:37,570 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:37,573 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A237A50499F24FD9BF3E04068ED61DFA, ordinal: 1
2015-11-23 16:31:37,573 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:37,574 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL"]
2015-11-23 16:31:37,574 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A237A50499F24FD9BF3E04068ED61DFA, mem on start (mb), free: 216, total: 550, max: 672
2015-11-23 16:31:37,581 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A237A50499F24FD9BF3E04068ED61DFA, mem on close (mb), free: 214, total: 550, max: 672
2015-11-23 16:31:37,591 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL/_temporary
2015-11-23 16:31:37,592 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.149
2015-11-23 16:31:37,625 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_'field'_ALL
2015-11-23 16:31:37,638 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:37,638 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:37,644 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: ILLEGAL, in: 00:00.003
2015-11-23 16:31:37,644 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, found assembly to be malformed
2015-11-23 16:31:37,645 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_'field'_REPLACE
2015-11-23 16:31:37,655 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:37,655 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:37,668 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.010
2015-11-23 16:31:37,668 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:37,668 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:37,674 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:37,674 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:37,674 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP"]
2015-11-23 16:31:37,674 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:37,674 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:37,674 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:37,675 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...platform/ALL_'field'_SWAP
2015-11-23 16:31:37,756 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local958319166_0043
2015-11-23 16:31:37,757 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:37,761 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:37,786 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:37,786 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:37,787 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: CB52E10D7E88469EA0F4A079381BE49C, ordinal: 0
2015-11-23 16:31:37,788 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:37,788 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:37,788 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CB52E10D7E88469EA0F4A079381BE49C, mem on start (mb), free: 218, total: 550, max: 672
2015-11-23 16:31:37,788 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CB52E10D7E88469EA0F4A079381BE49C, mem on close (mb), free: 218, total: 550, max: 672
2015-11-23 16:31:37,797 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:37,797 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:37,799 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: AEAC40B514EA4870A0E7B4BEC134AB55, ordinal: 1
2015-11-23 16:31:37,799 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:37,799 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP"]
2015-11-23 16:31:37,799 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AEAC40B514EA4870A0E7B4BEC134AB55, mem on start (mb), free: 215, total: 550, max: 672
2015-11-23 16:31:37,806 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AEAC40B514EA4870A0E7B4BEC134AB55, mem on close (mb), free: 213, total: 550, max: 672
2015-11-23 16:31:37,817 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP/_temporary
2015-11-23 16:31:37,818 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.143
2015-11-23 16:31:37,854 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_'field'_SWAP
2015-11-23 16:31:37,868 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:37,869 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:37,883 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.012
2015-11-23 16:31:37,883 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:37,883 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:37,890 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:37,890 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:37,890 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1"]
2015-11-23 16:31:37,890 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:37,890 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:37,890 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:37,891 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...lyplatform/ALL_UNKNOWN_-1
2015-11-23 16:31:37,974 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local984218545_0044
2015-11-23 16:31:37,974 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:37,978 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:38,003 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:38,003 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:38,004 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: EEE602EA107B4A73AF30B86C36809540, ordinal: 0
2015-11-23 16:31:38,004 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:38,004 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:38,005 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EEE602EA107B4A73AF30B86C36809540, mem on start (mb), free: 219, total: 551, max: 672
2015-11-23 16:31:38,005 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EEE602EA107B4A73AF30B86C36809540, mem on close (mb), free: 219, total: 551, max: 672
2015-11-23 16:31:38,014 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:38,014 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:38,017 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: AE84F726AF38406C827EE05808D47D56, ordinal: 1
2015-11-23 16:31:38,017 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:38,018 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1"]
2015-11-23 16:31:38,018 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AE84F726AF38406C827EE05808D47D56, mem on start (mb), free: 215, total: 551, max: 672
2015-11-23 16:31:38,025 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AE84F726AF38406C827EE05808D47D56, mem on close (mb), free: 214, total: 551, max: 672
2015-11-23 16:31:38,034 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1/_temporary
2015-11-23 16:31:38,034 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.143
2015-11-23 16:31:38,066 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_UNKNOWN_-1
2015-11-23 16:31:38,080 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:38,080 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:38,084 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: ILLEGAL, in: 00:00.001
2015-11-23 16:31:38,085 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, found assembly to be malformed
2015-11-23 16:31:38,085 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_UNKNOWN_'field'
2015-11-23 16:31:38,099 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:38,099 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:38,108 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.006
2015-11-23 16:31:38,108 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:38,109 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:38,116 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:38,116 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:38,116 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS"]
2015-11-23 16:31:38,116 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:38,116 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:38,116 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:38,117 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...tform/ALL_UNKNOWN_RESULTS
2015-11-23 16:31:38,282 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local888887341_0045
2015-11-23 16:31:38,282 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:38,286 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:38,311 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:38,311 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:38,312 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D7F9FE7C35DE427AB255566954C27CFE, ordinal: 0
2015-11-23 16:31:38,313 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:38,313 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:38,313 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D7F9FE7C35DE427AB255566954C27CFE, mem on start (mb), free: 218, total: 551, max: 672
2015-11-23 16:31:38,313 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D7F9FE7C35DE427AB255566954C27CFE, mem on close (mb), free: 218, total: 551, max: 672
2015-11-23 16:31:38,319 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:38,320 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:38,321 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E57E39719404433A894B3E30DCA1EAEF, ordinal: 1
2015-11-23 16:31:38,321 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:38,321 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS"]
2015-11-23 16:31:38,322 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E57E39719404433A894B3E30DCA1EAEF, mem on start (mb), free: 214, total: 551, max: 672
2015-11-23 16:31:38,327 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E57E39719404433A894B3E30DCA1EAEF, mem on close (mb), free: 212, total: 551, max: 672
2015-11-23 16:31:38,342 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS/_temporary
2015-11-23 16:31:38,342 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.226
2015-11-23 16:31:38,384 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_UNKNOWN_RESULTS
2015-11-23 16:31:38,397 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:38,397 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:38,410 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.010
2015-11-23 16:31:38,411 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:38,411 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:38,419 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:38,419 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:38,419 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL"]
2015-11-23 16:31:38,420 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:38,420 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:38,420 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:38,421 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...yplatform/ALL_UNKNOWN_ALL
2015-11-23 16:31:38,502 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local445975987_0046
2015-11-23 16:31:38,502 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:38,505 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:38,528 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:38,528 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:38,529 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B2B0B10FB9A44D6E9B9C2A81AECAADE3, ordinal: 0
2015-11-23 16:31:38,530 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:38,530 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:38,530 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B2B0B10FB9A44D6E9B9C2A81AECAADE3, mem on start (mb), free: 217, total: 551, max: 672
2015-11-23 16:31:38,530 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B2B0B10FB9A44D6E9B9C2A81AECAADE3, mem on close (mb), free: 217, total: 551, max: 672
2015-11-23 16:31:38,540 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:38,540 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:38,542 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DB291ECBBD9A4420ACBAB8CA60B52C42, ordinal: 1
2015-11-23 16:31:38,542 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:38,542 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL"]
2015-11-23 16:31:38,542 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DB291ECBBD9A4420ACBAB8CA60B52C42, mem on start (mb), free: 213, total: 551, max: 672
2015-11-23 16:31:38,547 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DB291ECBBD9A4420ACBAB8CA60B52C42, mem on close (mb), free: 212, total: 551, max: 672
2015-11-23 16:31:38,559 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL/_temporary
2015-11-23 16:31:38,560 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.140
2015-11-23 16:31:38,601 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_UNKNOWN_ALL
2015-11-23 16:31:38,617 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:38,617 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:38,626 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.007
2015-11-23 16:31:38,627 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:38,627 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:38,635 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:38,635 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:38,635 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_REPLACE"]
2015-11-23 16:31:38,635 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:38,635 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:38,635 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:38,636 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...tform/ALL_UNKNOWN_REPLACE
2015-11-23 16:31:38,717 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local31768404_0047
2015-11-23 16:31:38,717 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:38,721 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:38,745 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:38,745 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:38,746 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AEDB31B79B774D31B5870F573EA9A0AC, ordinal: 0
2015-11-23 16:31:38,747 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:38,747 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:38,747 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AEDB31B79B774D31B5870F573EA9A0AC, mem on start (mb), free: 215, total: 550, max: 672
2015-11-23 16:31:38,747 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AEDB31B79B774D31B5870F573EA9A0AC, mem on close (mb), free: 215, total: 550, max: 672
2015-11-23 16:31:38,756 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:38,756 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:38,759 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: FBA4D373E85D44CBA832D95BB599AE2F, ordinal: 1
2015-11-23 16:31:38,759 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:38,759 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_REPLACE"]
2015-11-23 16:31:38,759 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FBA4D373E85D44CBA832D95BB599AE2F, mem on start (mb), free: 211, total: 550, max: 672
2015-11-23 16:31:38,764 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:38,765 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FBA4D373E85D44CBA832D95BB599AE2F, mem on close (mb), free: 210, total: 550, max: 672
2015-11-23 16:31:38,766 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local31768404_0047
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:38,775 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local31768404_0047 state at FAILED
2015-11-23 16:31:38,775 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:38,775 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:38,775 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:38,777 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:38,777 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...tform/ALL_UNKNOWN_REPLACE
2015-11-23 16:31:38,778 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:38,778 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_REPLACE/_temporary
2015-11-23 16:31:38,778 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.143
2015-11-23 16:31:38,778 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_UNKNOWN_REPLACE
2015-11-23 16:31:38,795 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:38,796 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:38,809 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.011
2015-11-23 16:31:38,810 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:38,810 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:38,817 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:38,817 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:38,818 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP"]
2015-11-23 16:31:38,818 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:38,818 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:38,818 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:38,819 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...platform/ALL_UNKNOWN_SWAP
2015-11-23 16:31:38,901 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local544092999_0048
2015-11-23 16:31:38,901 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:38,904 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:38,928 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:38,928 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:38,929 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A8C6B40C1DBE4B789C435F81645F74F0, ordinal: 0
2015-11-23 16:31:38,930 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:38,930 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:38,930 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A8C6B40C1DBE4B789C435F81645F74F0, mem on start (mb), free: 216, total: 551, max: 672
2015-11-23 16:31:38,930 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A8C6B40C1DBE4B789C435F81645F74F0, mem on close (mb), free: 216, total: 551, max: 672
2015-11-23 16:31:38,937 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:38,937 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:38,939 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F3623BE5CB014DB9BFA5CD31C84DCCE9, ordinal: 1
2015-11-23 16:31:38,939 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:38,939 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP"]
2015-11-23 16:31:38,939 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F3623BE5CB014DB9BFA5CD31C84DCCE9, mem on start (mb), free: 212, total: 551, max: 672
2015-11-23 16:31:38,945 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F3623BE5CB014DB9BFA5CD31C84DCCE9, mem on close (mb), free: 210, total: 551, max: 672
2015-11-23 16:31:38,959 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP/_temporary
2015-11-23 16:31:38,960 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.142
2015-11-23 16:31:39,004 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_UNKNOWN_SWAP
2015-11-23 16:31:39,018 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:39,018 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:39,029 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.009
2015-11-23 16:31:39,029 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:39,029 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:39,036 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:39,036 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:39,037 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_-1"]
2015-11-23 16:31:39,037 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:39,037 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:39,037 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:39,037 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...blyplatform/ALL_VALUES_-1
2015-11-23 16:31:39,120 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1007115812_0049
2015-11-23 16:31:39,120 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:39,122 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:39,146 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:39,146 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:39,148 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F06AE88642FF4F77A9FECF639ECECBB0, ordinal: 0
2015-11-23 16:31:39,148 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:39,148 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:39,148 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F06AE88642FF4F77A9FECF639ECECBB0, mem on start (mb), free: 215, total: 551, max: 672
2015-11-23 16:31:39,149 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F06AE88642FF4F77A9FECF639ECECBB0, mem on close (mb), free: 215, total: 551, max: 672
2015-11-23 16:31:39,156 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:39,156 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:39,159 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B4B8199046D943BBB78FFAF903E9DD54, ordinal: 1
2015-11-23 16:31:39,159 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:39,159 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_-1"]
2015-11-23 16:31:39,159 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B4B8199046D943BBB78FFAF903E9DD54, mem on start (mb), free: 211, total: 551, max: 672
2015-11-23 16:31:39,164 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:39,165 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B4B8199046D943BBB78FFAF903E9DD54, mem on close (mb), free: 209, total: 551, max: 672
2015-11-23 16:31:39,166 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1007115812_0049
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:39,171 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local1007115812_0049 state at FAILED
2015-11-23 16:31:39,171 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:39,171 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:39,171 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:39,172 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:39,173 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...blyplatform/ALL_VALUES_-1
2015-11-23 16:31:39,174 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:39,174 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_-1/_temporary
2015-11-23 16:31:39,174 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.138
2015-11-23 16:31:39,174 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_VALUES_-1
2015-11-23 16:31:39,189 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:39,189 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:39,195 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: ILLEGAL, in: 00:00.003
2015-11-23 16:31:39,195 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, found assembly to be malformed
2015-11-23 16:31:39,195 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_VALUES_'field'
2015-11-23 16:31:39,207 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:39,207 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:39,218 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.008
2015-11-23 16:31:39,219 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:39,219 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:39,226 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:39,226 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:39,226 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_RESULTS"]
2015-11-23 16:31:39,226 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:39,227 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:39,227 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:39,227 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...atform/ALL_VALUES_RESULTS
2015-11-23 16:31:39,301 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local944472283_0050
2015-11-23 16:31:39,301 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:39,304 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:39,328 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:39,328 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:39,330 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B14924D94EDC4A1D9E0A26DB76BD1DA4, ordinal: 0
2015-11-23 16:31:39,330 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:39,330 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:39,330 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B14924D94EDC4A1D9E0A26DB76BD1DA4, mem on start (mb), free: 215, total: 552, max: 672
2015-11-23 16:31:39,331 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B14924D94EDC4A1D9E0A26DB76BD1DA4, mem on close (mb), free: 215, total: 552, max: 672
2015-11-23 16:31:39,339 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:39,339 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:39,342 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C962BA94841B4B4CB91A009CCC4C35AA, ordinal: 1
2015-11-23 16:31:39,342 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:39,342 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_RESULTS"]
2015-11-23 16:31:39,342 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C962BA94841B4B4CB91A009CCC4C35AA, mem on start (mb), free: 211, total: 552, max: 672
2015-11-23 16:31:39,347 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:39,348 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C962BA94841B4B4CB91A009CCC4C35AA, mem on close (mb), free: 210, total: 552, max: 672
2015-11-23 16:31:39,349 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local944472283_0050
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:39,352 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local944472283_0050 state at FAILED
2015-11-23 16:31:39,352 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:39,352 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:39,352 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:39,353 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:39,354 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...atform/ALL_VALUES_RESULTS
2015-11-23 16:31:39,355 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:39,355 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_RESULTS/_temporary
2015-11-23 16:31:39,355 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.129
2015-11-23 16:31:39,355 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_VALUES_RESULTS
2015-11-23 16:31:39,369 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:39,369 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:39,380 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.008
2015-11-23 16:31:39,381 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:39,381 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:39,387 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:39,387 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:39,387 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_ALL"]
2015-11-23 16:31:39,387 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:39,388 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:39,388 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:39,388 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...lyplatform/ALL_VALUES_ALL
2015-11-23 16:31:39,476 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local2003262690_0051
2015-11-23 16:31:39,476 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:39,480 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:39,504 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:39,504 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:39,505 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F3202EE600EF4C2A9B5FF5C68ECC6BA2, ordinal: 0
2015-11-23 16:31:39,506 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:39,506 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:39,506 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F3202EE600EF4C2A9B5FF5C68ECC6BA2, mem on start (mb), free: 215, total: 552, max: 672
2015-11-23 16:31:39,506 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F3202EE600EF4C2A9B5FF5C68ECC6BA2, mem on close (mb), free: 215, total: 552, max: 672
2015-11-23 16:31:39,512 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:39,512 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:39,514 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CD09C5D7C9E04DA7B76B401E0676CCD4, ordinal: 1
2015-11-23 16:31:39,514 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:39,514 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_ALL"]
2015-11-23 16:31:39,514 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CD09C5D7C9E04DA7B76B401E0676CCD4, mem on start (mb), free: 211, total: 552, max: 672
2015-11-23 16:31:39,519 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:39,519 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CD09C5D7C9E04DA7B76B401E0676CCD4, mem on close (mb), free: 209, total: 552, max: 672
2015-11-23 16:31:39,520 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local2003262690_0051
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:39,528 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local2003262690_0051 state at FAILED
2015-11-23 16:31:39,528 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:39,528 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:39,528 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:39,529 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:39,529 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...lyplatform/ALL_VALUES_ALL
2015-11-23 16:31:39,530 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:39,530 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_ALL/_temporary
2015-11-23 16:31:39,531 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.143
2015-11-23 16:31:39,531 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_VALUES_ALL
2015-11-23 16:31:39,547 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:39,547 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:39,561 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.012
2015-11-23 16:31:39,562 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:39,562 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:39,567 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:39,567 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:39,568 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_REPLACE"]
2015-11-23 16:31:39,568 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:39,568 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:39,568 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:39,568 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...atform/ALL_VALUES_REPLACE
2015-11-23 16:31:39,676 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1392366973_0052
2015-11-23 16:31:39,676 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:39,679 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:39,704 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:39,704 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:39,706 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E6DEF0BCC0164CEA9F6CB83C2ED02D62, ordinal: 0
2015-11-23 16:31:39,706 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:39,707 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:39,707 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E6DEF0BCC0164CEA9F6CB83C2ED02D62, mem on start (mb), free: 214, total: 552, max: 672
2015-11-23 16:31:39,707 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E6DEF0BCC0164CEA9F6CB83C2ED02D62, mem on close (mb), free: 214, total: 552, max: 672
2015-11-23 16:31:39,721 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:39,721 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:39,724 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: FCF358A6C74145B29E4D0A2C84D0FB1D, ordinal: 1
2015-11-23 16:31:39,725 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:39,725 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_REPLACE"]
2015-11-23 16:31:39,725 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FCF358A6C74145B29E4D0A2C84D0FB1D, mem on start (mb), free: 210, total: 552, max: 672
2015-11-23 16:31:39,729 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:39,730 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FCF358A6C74145B29E4D0A2C84D0FB1D, mem on close (mb), free: 208, total: 552, max: 672
2015-11-23 16:31:39,730 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1392366973_0052
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:39,737 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local1392366973_0052 state at FAILED
2015-11-23 16:31:39,738 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:39,738 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:39,738 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:39,738 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:39,739 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...atform/ALL_VALUES_REPLACE
2015-11-23 16:31:39,739 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:39,739 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_REPLACE/_temporary
2015-11-23 16:31:39,740 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.172
2015-11-23 16:31:39,740 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_VALUES_REPLACE
2015-11-23 16:31:39,754 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:39,755 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:39,767 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.010
2015-11-23 16:31:39,767 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:39,768 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:39,775 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:39,775 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:39,775 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_SWAP"]
2015-11-23 16:31:39,775 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:39,775 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:39,775 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:39,776 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...yplatform/ALL_VALUES_SWAP
2015-11-23 16:31:39,858 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1653212803_0053
2015-11-23 16:31:39,858 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:39,862 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:39,885 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:39,885 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:39,887 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C55804D999614EE9AFAA86A5FBC35292, ordinal: 0
2015-11-23 16:31:39,887 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:39,887 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:39,887 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C55804D999614EE9AFAA86A5FBC35292, mem on start (mb), free: 213, total: 552, max: 672
2015-11-23 16:31:39,888 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C55804D999614EE9AFAA86A5FBC35292, mem on close (mb), free: 213, total: 552, max: 672
2015-11-23 16:31:39,895 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:39,895 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:39,898 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D732510D8D314EBFB1FF63F11F8488F1, ordinal: 1
2015-11-23 16:31:39,898 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:39,898 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_SWAP"]
2015-11-23 16:31:39,898 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D732510D8D314EBFB1FF63F11F8488F1, mem on start (mb), free: 209, total: 552, max: 672
2015-11-23 16:31:39,904 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:39,904 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D732510D8D314EBFB1FF63F11F8488F1, mem on close (mb), free: 208, total: 552, max: 672
2015-11-23 16:31:39,905 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1653212803_0053
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:39,910 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local1653212803_0053 state at FAILED
2015-11-23 16:31:39,910 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:39,910 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:39,910 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:39,911 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:39,911 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...yplatform/ALL_VALUES_SWAP
2015-11-23 16:31:39,912 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:39,912 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_SWAP/_temporary
2015-11-23 16:31:39,912 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.137
2015-11-23 16:31:39,913 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_VALUES_SWAP
2015-11-23 16:31:39,930 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:39,930 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:39,941 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.007
2015-11-23 16:31:39,941 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:39,941 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:39,947 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:39,947 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:39,948 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_-1"]
2015-11-23 16:31:39,948 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:39,948 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:39,948 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:39,948 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...emblyplatform/ALL_ARGS_-1
2015-11-23 16:31:40,031 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local16158243_0054
2015-11-23 16:31:40,031 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:40,033 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:40,057 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:40,057 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:40,058 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F86D686B832B47D5A77B12442931EE20, ordinal: 0
2015-11-23 16:31:40,059 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:40,059 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:40,059 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F86D686B832B47D5A77B12442931EE20, mem on start (mb), free: 212, total: 552, max: 672
2015-11-23 16:31:40,059 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F86D686B832B47D5A77B12442931EE20, mem on close (mb), free: 212, total: 552, max: 672
2015-11-23 16:31:40,067 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:40,067 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:40,070 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A5D3DBEB88DA4A5B897EC5CB2B25A834, ordinal: 1
2015-11-23 16:31:40,070 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:40,070 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_-1"]
2015-11-23 16:31:40,070 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A5D3DBEB88DA4A5B897EC5CB2B25A834, mem on start (mb), free: 208, total: 552, max: 672
2015-11-23 16:31:40,076 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:40,076 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A5D3DBEB88DA4A5B897EC5CB2B25A834, mem on close (mb), free: 206, total: 552, max: 672
2015-11-23 16:31:40,077 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local16158243_0054
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:40,082 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local16158243_0054 state at FAILED
2015-11-23 16:31:40,082 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:40,082 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:40,083 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:40,084 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:40,084 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...emblyplatform/ALL_ARGS_-1
2015-11-23 16:31:40,085 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:40,085 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_-1/_temporary
2015-11-23 16:31:40,085 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.138
2015-11-23 16:31:40,086 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_ARGS_-1
2015-11-23 16:31:40,099 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:40,100 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:40,105 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: ILLEGAL, in: 00:00.003
2015-11-23 16:31:40,106 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, found assembly to be malformed
2015-11-23 16:31:40,106 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_ARGS_'field'
2015-11-23 16:31:40,116 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:40,116 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:40,127 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.009
2015-11-23 16:31:40,128 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:40,128 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:40,135 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:40,135 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:40,136 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_RESULTS"]
2015-11-23 16:31:40,136 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:40,136 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:40,136 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:40,136 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...platform/ALL_ARGS_RESULTS
2015-11-23 16:31:40,212 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local870697338_0055
2015-11-23 16:31:40,213 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:40,216 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:40,241 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:40,241 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:40,243 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D15D1B594A7943EE847C555548CF00AA, ordinal: 0
2015-11-23 16:31:40,243 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:40,243 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:40,243 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D15D1B594A7943EE847C555548CF00AA, mem on start (mb), free: 211, total: 552, max: 672
2015-11-23 16:31:40,243 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D15D1B594A7943EE847C555548CF00AA, mem on close (mb), free: 211, total: 552, max: 672
2015-11-23 16:31:40,251 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:40,251 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:40,254 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F7EAD961A7F24BF5804A00A599CAE49C, ordinal: 1
2015-11-23 16:31:40,254 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:40,254 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_RESULTS"]
2015-11-23 16:31:40,254 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F7EAD961A7F24BF5804A00A599CAE49C, mem on start (mb), free: 207, total: 552, max: 672
2015-11-23 16:31:40,260 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:40,260 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F7EAD961A7F24BF5804A00A599CAE49C, mem on close (mb), free: 205, total: 552, max: 672
2015-11-23 16:31:40,262 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local870697338_0055
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:40,264 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local870697338_0055 state at FAILED
2015-11-23 16:31:40,264 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:40,264 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:40,264 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:40,265 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:40,266 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...platform/ALL_ARGS_RESULTS
2015-11-23 16:31:40,267 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:40,267 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_RESULTS/_temporary
2015-11-23 16:31:40,267 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.132
2015-11-23 16:31:40,268 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_ARGS_RESULTS
2015-11-23 16:31:40,285 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:40,286 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:40,291 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: ILLEGAL, in: 00:00.003
2015-11-23 16:31:40,292 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, found assembly to be malformed
2015-11-23 16:31:40,292 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_ARGS_ALL
2015-11-23 16:31:40,303 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:40,303 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:40,316 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.010
2015-11-23 16:31:40,317 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:40,317 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:40,321 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:40,321 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:40,321 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_REPLACE"]
2015-11-23 16:31:40,321 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:40,321 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:40,321 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:40,322 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...platform/ALL_ARGS_REPLACE
2015-11-23 16:31:40,393 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local1345274862_0056
2015-11-23 16:31:40,393 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:40,397 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:40,421 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:40,422 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:40,423 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D007AA855DC34F78A4CD2EA6CF51A04A, ordinal: 0
2015-11-23 16:31:40,423 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:40,423 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:40,423 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D007AA855DC34F78A4CD2EA6CF51A04A, mem on start (mb), free: 210, total: 551, max: 672
2015-11-23 16:31:40,424 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D007AA855DC34F78A4CD2EA6CF51A04A, mem on close (mb), free: 210, total: 551, max: 672
2015-11-23 16:31:40,431 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:40,432 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:40,434 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DCD88E992E794ADDAD264B43E7D8D2C8, ordinal: 1
2015-11-23 16:31:40,435 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:40,435 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_REPLACE"]
2015-11-23 16:31:40,435 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DCD88E992E794ADDAD264B43E7D8D2C8, mem on start (mb), free: 205, total: 551, max: 672
2015-11-23 16:31:40,440 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:40,441 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DCD88E992E794ADDAD264B43E7D8D2C8, mem on close (mb), free: 204, total: 551, max: 672
2015-11-23 16:31:40,442 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1345274862_0056
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:40,444 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local1345274862_0056 state at FAILED
2015-11-23 16:31:40,445 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:40,445 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:40,445 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:40,446 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:40,446 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...platform/ALL_ARGS_REPLACE
2015-11-23 16:31:40,447 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:40,447 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_REPLACE/_temporary
2015-11-23 16:31:40,447 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.126
2015-11-23 16:31:40,448 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_ARGS_REPLACE
2015-11-23 16:31:40,457 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:31:40,458 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:31:40,466 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.006
2015-11-23 16:31:40,467 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:31:40,467 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:31:40,472 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting
2015-11-23 16:31:40,472 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:40,472 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_SWAP"]
2015-11-23 16:31:40,472 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] parallel execution of steps is enabled: false
2015-11-23 16:31:40,472 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] executing total steps: 1
2015-11-23 16:31:40,472 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] allocating management threads: 1
2015-11-23 16:31:40,472 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] starting step: (1/1) ...blyplatform/ALL_ARGS_SWAP
2015-11-23 16:31:40,556 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] submitted hadoop job: job_local699861610_0057
2015-11-23 16:31:40,556 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] tracking url: http://localhost:8080/
2015-11-23 16:31:40,559 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt
2015-11-23 16:31:40,583 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 16:31:40,583 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 16:31:40,584 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A6D174B037F74E6E91E61C8F4CAD8444, ordinal: 0
2015-11-23 16:31:40,585 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/nums.20.txt"]
2015-11-23 16:31:40,585 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:40,585 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A6D174B037F74E6E91E61C8F4CAD8444, mem on start (mb), free: 210, total: 551, max: 672
2015-11-23 16:31:40,586 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A6D174B037F74E6E91E61C8F4CAD8444, mem on close (mb), free: 210, total: 551, max: 672
2015-11-23 16:31:40,593 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-11-23 16:31:40,593 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-11-23 16:31:40,596 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E6F24BE0227245FDA556867835F3D4AC, ordinal: 1
2015-11-23 16:31:40,596 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-11-23 16:31:40,596 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_SWAP"]
2015-11-23 16:31:40,597 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E6F24BE0227245FDA556867835F3D4AC, mem on start (mb), free: 205, total: 551, max: 672
2015-11-23 16:31:40,602 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:40,603 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E6F24BE0227245FDA556867835F3D4AC, mem on close (mb), free: 203, total: 551, max: 672
2015-11-23 16:31:40,604 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local699861610_0057
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:153)
at cascading.flow.stream.element.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:41)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-11-23 16:31:40,607 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] hadoop job job_local699861610_0057 state at FAILED
2015-11-23 16:31:40,607 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] failure info: NA
2015-11-23 16:31:40,608 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events identify failed tasks
2015-11-23 16:31:40,608 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every] task completion events count: 0
2015-11-23 16:31:40,609 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping all jobs
2015-11-23 16:31:40,609 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopping: (1/1) ...blyplatform/ALL_ARGS_SWAP
2015-11-23 16:31:40,610 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] stopped all jobs
2015-11-23 16:31:40,610 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_SWAP/_temporary
2015-11-23 16:31:40,610 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every] completed in: 00:00.138
2015-11-23 16:31:40,610 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/everypipeassemblyplatform//ALL_ARGS_SWAP