2015-11-23 17:06:43,701 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2015-11-23 17:06:43,716 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.scheme.TextDelimitedPlatformTest, with platform: hadoop2-mr1
2015-11-23 17:06:43,730 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(119)) - not using cluster
2015-11-23 17:06:44,138 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-11-23 17:06:44,213 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2015-11-23 17:06:44,270 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 17:06:44,272 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 17:06:44,319 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: 464062BE972A4BBABAF7FA6EE8805B42
2015-11-23 17:06:44,394 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.045
2015-11-23 17:06:44,396 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 17:06:44,396 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 17:06:44,524 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.2
2015-11-23 17:06:44,525 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2015-11-23 17:06:44,526 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited-spec-char.txt"]
2015-11-23 17:06:44,526 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse"]
2015-11-23 17:06:44,526 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2015-11-23 17:06:44,527 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2015-11-23 17:06:44,527 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2015-11-23 17:06:44,528 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...Char/quoted/speccharfalse
2015-11-23 17:06:44,831 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted hadoop job: job_local518286809_0001
2015-11-23 17:06:44,832 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tracking url: http://localhost:8080/
2015-11-23 17:06:44,935 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited-spec-char.txt
2015-11-23 17:06:44,949 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 17:06:44,949 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 17:06:44,957 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B5522E8F44CF49DC8EB5FFB38A43EBFA, ordinal: 0
2015-11-23 17:06:44,970 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited-spec-char.txt"]
2015-11-23 17:06:44,970 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse"]
2015-11-23 17:06:44,970 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B5522E8F44CF49DC8EB5FFB38A43EBFA, mem on start (mb), free: 319, total: 337, max: 672
2015-11-23 17:06:44,980 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B5522E8F44CF49DC8EB5FFB38A43EBFA, mem on close (mb), free: 318, total: 337, max: 672
2015-11-23 17:06:45,011 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse/_temporary
2015-11-23 17:06:45,011 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.484
2015-11-23 17:06:45,083 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse
2015-11-23 17:06:45,102 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 17:06:45,103 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 17:06:45,127 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.019
2015-11-23 17:06:45,128 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 17:06:45,128 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 17:06:45,141 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2015-11-23 17:06:45,141 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited.txt"]
2015-11-23 17:06:45,141 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue"]
2015-11-23 17:06:45,141 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2015-11-23 17:06:45,141 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2015-11-23 17:06:45,142 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2015-11-23 17:06:45,142 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...xtAll/quoted/normchartrue
2015-11-23 17:06:45,239 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted hadoop job: job_local762466495_0002
2015-11-23 17:06:45,239 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tracking url: http://localhost:8080/
2015-11-23 17:06:45,244 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited.txt
2015-11-23 17:06:45,250 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 17:06:45,250 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 17:06:45,256 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DA35875871574B7B96FCEF7023D8F571, ordinal: 0
2015-11-23 17:06:45,257 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited.txt"]
2015-11-23 17:06:45,257 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue"]
2015-11-23 17:06:45,257 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DA35875871574B7B96FCEF7023D8F571, mem on start (mb), free: 250, total: 337, max: 672
2015-11-23 17:06:45,259 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DA35875871574B7B96FCEF7023D8F571, mem on close (mb), free: 250, total: 337, max: 672
2015-11-23 17:06:45,273 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue/_temporary
2015-11-23 17:06:45,273 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.132
2015-11-23 17:06:45,336 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue
2015-11-23 17:06:45,351 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 17:06:45,352 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 17:06:45,370 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.014
2015-11-23 17:06:45,371 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 17:06:45,372 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 17:06:45,381 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2015-11-23 17:06:45,381 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited-spec-char.txt"]
2015-11-23 17:06:45,381 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue"]
2015-11-23 17:06:45,381 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2015-11-23 17:06:45,381 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2015-11-23 17:06:45,382 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2015-11-23 17:06:45,382 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...arAll/quoted/specchartrue
2015-11-23 17:06:45,480 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted hadoop job: job_local1737934431_0003
2015-11-23 17:06:45,481 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tracking url: http://localhost:8080/
2015-11-23 17:06:45,485 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited-spec-char.txt
2015-11-23 17:06:45,489 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 17:06:45,489 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 17:06:45,495 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DE52196981C548878EDA0BDD562B71B9, ordinal: 0
2015-11-23 17:06:45,495 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited-spec-char.txt"]
2015-11-23 17:06:45,495 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue"]
2015-11-23 17:06:45,495 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DE52196981C548878EDA0BDD562B71B9, mem on start (mb), free: 303, total: 337, max: 672
2015-11-23 17:06:45,497 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DE52196981C548878EDA0BDD562B71B9, mem on close (mb), free: 303, total: 337, max: 672
2015-11-23 17:06:45,513 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue/_temporary
2015-11-23 17:06:45,514 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.132
2015-11-23 17:06:45,572 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue
2015-11-23 17:06:45,586 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 17:06:45,587 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 17:06:45,609 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.018
2015-11-23 17:06:45,610 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 17:06:45,610 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 17:06:45,619 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2015-11-23 17:06:45,620 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited.txt"]
2015-11-23 17:06:45,620 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testHeaderAll/headerall"]
2015-11-23 17:06:45,620 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2015-11-23 17:06:45,620 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2015-11-23 17:06:45,620 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2015-11-23 17:06:45,620 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...m/testHeaderAll/headerall
2015-11-23 17:06:45,713 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted hadoop job: job_local873321293_0004
2015-11-23 17:06:45,713 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tracking url: http://localhost:8080/
2015-11-23 17:06:45,717 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited.txt
2015-11-23 17:06:45,722 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 17:06:45,722 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 17:06:45,731 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BA8A10E8FE5D4ECDB0B071284DF0BE89, ordinal: 0
2015-11-23 17:06:45,732 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited.txt"]
2015-11-23 17:06:45,732 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testHeaderAll/headerall"]
2015-11-23 17:06:45,732 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BA8A10E8FE5D4ECDB0B071284DF0BE89, mem on start (mb), free: 241, total: 337, max: 672
2015-11-23 17:06:45,735 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BA8A10E8FE5D4ECDB0B071284DF0BE89, mem on close (mb), free: 240, total: 337, max: 672
2015-11-23 17:06:45,757 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testHeaderAll/headerall/_temporary
2015-11-23 17:06:45,757 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.138
2015-11-23 17:06:45,784 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/textdelimitedplatform/testHeaderAll/headerall
2015-11-23 17:06:45,803 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 17:06:45,803 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 17:06:45,826 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.018
2015-11-23 17:06:45,827 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 17:06:45,827 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 17:06:45,838 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2015-11-23 17:06:45,838 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited.txt"]
2015-11-23 17:06:45,838 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testQuotedText/quoted/normcharfalse"]
2015-11-23 17:06:45,838 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2015-11-23 17:06:45,839 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2015-11-23 17:06:45,839 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2015-11-23 17:06:45,839 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...Text/quoted/normcharfalse
2015-11-23 17:06:45,952 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted hadoop job: job_local597758836_0005
2015-11-23 17:06:45,952 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tracking url: http://localhost:8080/
2015-11-23 17:06:45,957 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited.txt
2015-11-23 17:06:45,964 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 17:06:45,964 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 17:06:45,971 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FB5C0AE545D44C2FADCEAF45B63F2B34, ordinal: 0
2015-11-23 17:06:45,972 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited.txt"]
2015-11-23 17:06:45,972 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testQuotedText/quoted/normcharfalse"]
2015-11-23 17:06:45,972 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FB5C0AE545D44C2FADCEAF45B63F2B34, mem on start (mb), free: 366, total: 393, max: 672
2015-11-23 17:06:45,975 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FB5C0AE545D44C2FADCEAF45B63F2B34, mem on close (mb), free: 366, total: 393, max: 672
2015-11-23 17:06:45,996 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testQuotedText/quoted/normcharfalse/_temporary
2015-11-23 17:06:45,996 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.157
2015-11-23 17:06:46,048 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/textdelimitedplatform/testQuotedText/quoted/normcharfalse
2015-11-23 17:06:46,151 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 17:06:46,151 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 17:06:46,172 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.017
2015-11-23 17:06:46,172 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 17:06:46,172 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 17:06:46,189 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2015-11-23 17:06:46,189 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/apache-clean.10.txt"]
2015-11-23 17:06:46,189 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testFieldCoercion/testFieldCoercion"]
2015-11-23 17:06:46,189 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2015-11-23 17:06:46,189 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2015-11-23 17:06:46,189 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2015-11-23 17:06:46,190 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...oercion/testFieldCoercion
2015-11-23 17:06:46,279 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted hadoop job: job_local1998314268_0006
2015-11-23 17:06:46,279 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tracking url: http://localhost:8080/
2015-11-23 17:06:46,284 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/apache-clean.10.txt
2015-11-23 17:06:46,290 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 17:06:46,290 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 17:06:46,298 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E7D54F324DBC45F485A3D38FC194C9A2, ordinal: 0
2015-11-23 17:06:46,305 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/apache-clean.10.txt"]
2015-11-23 17:06:46,305 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testFieldCoercion/testFieldCoercion"]
2015-11-23 17:06:46,305 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E7D54F324DBC45F485A3D38FC194C9A2, mem on start (mb), free: 291, total: 393, max: 672
2015-11-23 17:06:46,365 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E7D54F324DBC45F485A3D38FC194C9A2, mem on close (mb), free: 288, total: 393, max: 672
2015-11-23 17:06:46,384 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testFieldCoercion/testFieldCoercion/_temporary
2015-11-23 17:06:46,384 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.194
2015-11-23 17:06:46,411 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/textdelimitedplatform/testFieldCoercion/testFieldCoercion
2015-11-23 17:06:46,427 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 17:06:46,427 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 17:06:46,455 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.012
2015-11-23 17:06:46,456 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 17:06:46,456 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 17:06:46,474 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2015-11-23 17:06:46,474 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited-header.txt"]
2015-11-23 17:06:46,474 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]]]
2015-11-23 17:06:46,475 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2015-11-23 17:06:46,475 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2015-11-23 17:06:46,475 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2015-11-23 17:06:46,475 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...5DD304EC5B31ECD57523423E5
2015-11-23 17:06:46,566 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted hadoop job: job_local315712938_0007
2015-11-23 17:06:46,566 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tracking url: http://localhost:8080/
2015-11-23 17:06:46,571 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited-header.txt
2015-11-23 17:06:46,572 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 17:06:46,572 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 17:06:46,576 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A8E9F3509AAD4459B515AC04A141EFF0, ordinal: 0
2015-11-23 17:06:46,576 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited-header.txt"]
2015-11-23 17:06:46,576 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]]]
2015-11-23 17:06:46,576 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A8E9F3509AAD4459B515AC04A141EFF0, mem on start (mb), free: 226, total: 393, max: 672
2015-11-23 17:06:46,577 INFO tap.MultiSinkTap (MultiSinkTap.java:<init>(80)) - opening for write: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"]
2015-11-23 17:06:46,579 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(105)) - setting up task: 'attempt_local315712938_0007_m_000000_0' - file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/_temporary/_attempt_local315712938_0007_m_000000_0
2015-11-23 17:06:46,579 INFO io.TapOutputCollector (TapOutputCollector.java:initialize(117)) - creating path: part-00000
2015-11-23 17:06:46,584 INFO tap.MultiSinkTap (MultiSinkTap.java:<init>(80)) - opening for write: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]
2015-11-23 17:06:46,585 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(105)) - setting up task: 'attempt_local315712938_0007_m_000000_0' - file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/_temporary/_attempt_local315712938_0007_m_000000_0
2015-11-23 17:06:46,585 INFO io.TapOutputCollector (TapOutputCollector.java:initialize(117)) - creating path: part-00000
2015-11-23 17:06:46,592 INFO io.TapOutputCollector (TapOutputCollector.java:close(150)) - closing tap collector for: /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/part-00000
2015-11-23 17:06:46,592 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(162)) - committing task: 'attempt_local315712938_0007_m_000000_0' - file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/_temporary/_attempt_local315712938_0007_m_000000_0
2015-11-23 17:06:46,595 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(179)) - saved output of task 'attempt_local315712938_0007_m_000000_0' to file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1
2015-11-23 17:06:46,595 INFO io.TapOutputCollector (TapOutputCollector.java:close(150)) - closing tap collector for: /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/part-00000
2015-11-23 17:06:46,596 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(162)) - committing task: 'attempt_local315712938_0007_m_000000_0' - file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/_temporary/_attempt_local315712938_0007_m_000000_0
2015-11-23 17:06:46,598 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(179)) - saved output of task 'attempt_local315712938_0007_m_000000_0' to file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2
2015-11-23 17:06:46,598 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A8E9F3509AAD4459B515AC04A141EFF0, mem on close (mb), free: 222, total: 393, max: 672
2015-11-23 17:06:46,610 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.135
2015-11-23 17:06:46,682 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2
2015-11-23 17:06:46,682 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1
2015-11-23 17:06:46,698 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 17:06:46,699 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 17:06:46,723 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.011
2015-11-23 17:06:46,724 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 17:06:46,724 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 17:06:46,731 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2015-11-23 17:06:46,731 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited.txt"]
2015-11-23 17:06:46,731 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testHeader/header"]
2015-11-23 17:06:46,731 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2015-11-23 17:06:46,731 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2015-11-23 17:06:46,731 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2015-11-23 17:06:46,731 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...latform/testHeader/header
2015-11-23 17:06:46,823 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted hadoop job: job_local1077296008_0008
2015-11-23 17:06:46,823 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tracking url: http://localhost:8080/
2015-11-23 17:06:46,827 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited.txt
2015-11-23 17:06:46,832 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 17:06:46,833 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 17:06:46,840 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A7C123DB25EC47439B1109EE53DB27A6, ordinal: 0
2015-11-23 17:06:46,840 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited.txt"]
2015-11-23 17:06:46,840 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testHeader/header"]
2015-11-23 17:06:46,841 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A7C123DB25EC47439B1109EE53DB27A6, mem on start (mb), free: 338, total: 397, max: 672
2015-11-23 17:06:46,843 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A7C123DB25EC47439B1109EE53DB27A6, mem on close (mb), free: 338, total: 397, max: 672
2015-11-23 17:06:46,855 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testHeader/header/_temporary
2015-11-23 17:06:46,855 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.124
2015-11-23 17:06:46,872 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/textdelimitedplatform/testHeader/header
2015-11-23 17:06:46,884 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 17:06:46,884 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 17:06:46,900 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.012
2015-11-23 17:06:46,901 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 17:06:46,901 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 17:06:46,908 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2015-11-23 17:06:46,908 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited-extra-field.txt"]
2015-11-23 17:06:46,908 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testStrict/strict-nondeterministic"]
2015-11-23 17:06:46,908 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2015-11-23 17:06:46,908 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2015-11-23 17:06:46,908 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2015-11-23 17:06:46,908 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...t/strict-nondeterministic
2015-11-23 17:06:46,996 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted hadoop job: job_local513796647_0009
2015-11-23 17:06:46,997 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tracking url: http://localhost:8080/
2015-11-23 17:06:47,001 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited-extra-field.txt
2015-11-23 17:06:47,005 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-11-23 17:06:47,006 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-11-23 17:06:47,010 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AB04B0CD1B3F407181BAA8AAB23D76A3, ordinal: 0
2015-11-23 17:06:47,010 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited-extra-field.txt"]
2015-11-23 17:06:47,010 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testStrict/strict-nondeterministic"]
2015-11-23 17:06:47,011 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AB04B0CD1B3F407181BAA8AAB23D76A3, mem on start (mb), free: 280, total: 397, max: 672
2015-11-23 17:06:47,013 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: unable to read from input identifier: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited-extra-field.txt
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.hadoop.FlowMapper.run(FlowMapper.java:142)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 11 more
2015-11-23 17:06:47,016 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: unable to read from input identifier: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited-extra-field.txt
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.hadoop.FlowMapper.run(FlowMapper.java:142)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 11 more
2015-11-23 17:06:47,016 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AB04B0CD1B3F407181BAA8AAB23D76A3, mem on close (mb), free: 280, total: 397, max: 672
2015-11-23 17:06:47,017 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local513796647_0009
java.lang.Exception: cascading.tuple.TupleException: unable to read from input identifier: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited-extra-field.txt
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: cascading.tuple.TupleException: unable to read from input identifier: file:/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/delimited-extra-field.txt
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.hadoop.FlowMapper.run(FlowMapper.java:142)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 11 more
2015-11-23 17:06:47,017 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] hadoop job job_local513796647_0009 state at FAILED
2015-11-23 17:06:47,017 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] failure info: NA
2015-11-23 17:06:47,018 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] task completion events identify failed tasks
2015-11-23 17:06:47,018 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] task completion events count: 0
2015-11-23 17:06:47,019 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] stopping all jobs
2015-11-23 17:06:47,019 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] stopping: (1/1) ...t/strict-nondeterministic
2015-11-23 17:06:47,019 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] stopped all jobs
2015-11-23 17:06:47,019 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/textdelimitedplatform/testStrict/strict-nondeterministic/_temporary
2015-11-23 17:06:47,019 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.111
2015-11-23 17:06:47,020 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/textdelimitedplatform/testStrict/strict-nondeterministic