Class cascading.DistanceUseCasePlatformTest

4

tests

0

failures

0

ignored

6.232s

duration

100%

successful

Tests

Test Duration Result
testEuclideanDistance 1.031s passed
testEuclideanDistanceComposite 3.214s passed
testEuclideanDistanceShort 0.811s passed
testPearsonDistanceComposite 1.176s passed

Standard output

2015-07-21 11:10:25,378 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2015-07-21 11:10:25,395 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.DistanceUseCasePlatformTest, with platform: hadoop2-mr1
2015-07-21 11:10:25,419 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(119)) - not using cluster
2015-07-21 11:10:25,961 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-07-21 11:10:26,071 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides: 
2015-07-21 11:10:26,182 INFO  util.Util (Util.java:findMainClass(1325)) - using default application jar, may cause class not found exceptions on the cluster
2015-07-21 11:10:26,183 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /Users/castillo/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.1/616db6028856ef10fd9ffb4ebd59ea94589475c4/cascading-hadoop2-mr1-3.0.1.jar
2015-07-21 11:10:26,260 INFO  property.AppProps (AppProps.java:getAppID(174)) - using app.id: 82464585194B4E238272DEB87468E319
2015-07-21 11:10:26,485 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.183
2015-07-21 11:10:26,489 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 6
2015-07-21 11:10:26,489 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-07-21 11:10:26,741 INFO  util.Version (Version.java:printBanner(81)) - Concurrent, Inc - Cascading 3.0.1
2015-07-21 11:10:26,743 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting
2015-07-21 11:10:26,743 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/critics.txt"]
2015-07-21 11:10:26,744 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceComposite/euclidean/composite"]
2015-07-21 11:10:26,744 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  parallel execution of steps is enabled: false
2015-07-21 11:10:26,745 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  executing total steps: 3
2015-07-21 11:10:26,745 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  allocating management threads: 1
2015-07-21 11:10:26,746 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (1/3)
2015-07-21 11:10:27,364 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local664159448_0001
2015-07-21 11:10:27,365 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2015-07-21 11:10:27,442 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/critics.txt
2015-07-21 11:10:27,544 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.1
2015-07-21 11:10:27,545 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-07-21 11:10:27,559 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D1DF4EE6E3F949928FD6B889CF94F2FE, ordinal: 0
2015-07-21 11:10:27,593 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/critics.txt"]
2015-07-21 11:10:27,593 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(euclidean)[by:[{1}:'l'][numSelfJoins:1]]
2015-07-21 11:10:27,594 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D1DF4EE6E3F949928FD6B889CF94F2FE, mem on start (mb), free: 119, total: 245, max: 672
2015-07-21 11:10:27,605 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D1DF4EE6E3F949928FD6B889CF94F2FE, mem on close (mb), free: 118, total: 245, max: 672
2015-07-21 11:10:27,696 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.1
2015-07-21 11:10:27,696 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-07-21 11:10:27,708 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E6E790CE5823405D9AFF3D4A0D3E7596, ordinal: 1
2015-07-21 11:10:27,710 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(euclidean)[by:[{1}:'l'][numSelfJoins:1]]
2015-07-21 11:10:27,710 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][5840485466/euclidean/]
2015-07-21 11:10:27,710 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E6E790CE5823405D9AFF3D4A0D3E7596, mem on start (mb), free: 104, total: 245, max: 672
2015-07-21 11:10:27,733 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 11:10:27,734 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 11:10:27,764 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E6E790CE5823405D9AFF3D4A0D3E7596, mem on close (mb), free: 100, total: 245, max: 672
2015-07-21 11:10:27,800 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (2/3)
2015-07-21 11:10:27,978 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local1420608791_0002
2015-07-21 11:10:27,978 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2015-07-21 11:10:27,982 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-castillo/5840485466_euclidean_D2B4ACD6762A4FA390CE4560BDA7F03B/part-00000
2015-07-21 11:10:28,010 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.1
2015-07-21 11:10:28,011 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-07-21 11:10:28,019 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D152BD6B255E426EB7C14C118E402D19, ordinal: 0
2015-07-21 11:10:28,019 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][5840485466/euclidean/]
2015-07-21 11:10:28,020 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{?}:ALL]]
2015-07-21 11:10:28,020 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D152BD6B255E426EB7C14C118E402D19, mem on start (mb), free: 89, total: 310, max: 672
2015-07-21 11:10:28,036 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D152BD6B255E426EB7C14C118E402D19, mem on close (mb), free: 89, total: 310, max: 672
2015-07-21 11:10:28,075 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.1
2015-07-21 11:10:28,075 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-07-21 11:10:28,083 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D0F10045E50149B4A59A5F913561EC86, ordinal: 1
2015-07-21 11:10:28,084 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{?}:ALL]]
2015-07-21 11:10:28,084 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][2530858993/euclidean/]
2015-07-21 11:10:28,084 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D0F10045E50149B4A59A5F913561EC86, mem on start (mb), free: 83, total: 310, max: 672
2015-07-21 11:10:28,110 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D0F10045E50149B4A59A5F913561EC86, mem on close (mb), free: 81, total: 310, max: 672
2015-07-21 11:10:28,137 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (3/3) ...osite/euclidean/composite
2015-07-21 11:10:28,404 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local844387718_0003
2015-07-21 11:10:28,404 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2015-07-21 11:10:28,409 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-castillo/2530858993_euclidean_ADE3F87EE5DE47C8B917940A6F6831B9/part-00000
2015-07-21 11:10:28,457 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.1
2015-07-21 11:10:28,457 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-07-21 11:10:28,465 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: EFBC6C6ED2DF463F9F663ABA2AD75BED, ordinal: 0
2015-07-21 11:10:28,466 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][2530858993/euclidean/]
2015-07-21 11:10:28,466 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{2}:'n1', 'n2']]
2015-07-21 11:10:28,466 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EFBC6C6ED2DF463F9F663ABA2AD75BED, mem on start (mb), free: 163, total: 410, max: 672
2015-07-21 11:10:28,474 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EFBC6C6ED2DF463F9F663ABA2AD75BED, mem on close (mb), free: 163, total: 410, max: 672
2015-07-21 11:10:28,494 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.1
2015-07-21 11:10:28,494 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-07-21 11:10:28,503 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CC3EF146762F44C898DBADC68AB7FA8A, ordinal: 1
2015-07-21 11:10:28,504 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{2}:'n1', 'n2']]
2015-07-21 11:10:28,505 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceComposite/euclidean/composite"]
2015-07-21 11:10:28,505 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CC3EF146762F44C898DBADC68AB7FA8A, mem on start (mb), free: 156, total: 410, max: 672
2015-07-21 11:10:28,530 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CC3EF146762F44C898DBADC68AB7FA8A, mem on close (mb), free: 153, total: 410, max: 672
2015-07-21 11:10:28,562 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceComposite/euclidean/composite/_temporary
2015-07-21 11:10:28,563 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  completed in: 00:01.816
2015-07-21 11:10:28,631 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output//hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceComposite/euclidean/composite
2015-07-21 11:10:28,656 INFO  util.Util (Util.java:findMainClass(1325)) - using default application jar, may cause class not found exceptions on the cluster
2015-07-21 11:10:28,657 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /Users/castillo/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.1/616db6028856ef10fd9ffb4ebd59ea94589475c4/cascading-hadoop2-mr1-3.0.1.jar
2015-07-21 11:10:28,751 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.087
2015-07-21 11:10:28,753 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 6
2015-07-21 11:10:28,753 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-07-21 11:10:28,805 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] starting
2015-07-21 11:10:28,806 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/critics.txt"]
2015-07-21 11:10:28,806 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/distanceusecaseplatform/testPearsonDistanceComposite/pearson/composite"]
2015-07-21 11:10:28,806 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson]  parallel execution of steps is enabled: false
2015-07-21 11:10:28,806 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson]  executing total steps: 3
2015-07-21 11:10:28,806 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson]  allocating management threads: 1
2015-07-21 11:10:28,807 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] starting step: (1/3)
2015-07-21 11:10:28,971 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] submitted hadoop job: job_local21207994_0004
2015-07-21 11:10:28,971 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] tracking url: http://localhost:8080/
2015-07-21 11:10:28,976 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/critics.txt
2015-07-21 11:10:29,046 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.1
2015-07-21 11:10:29,046 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-07-21 11:10:29,057 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: EB138CC62D844EC09463A199C873E406, ordinal: 0
2015-07-21 11:10:29,057 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/critics.txt"]
2015-07-21 11:10:29,058 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(pearson)[by:[{1}:'l'][numSelfJoins:1]]
2015-07-21 11:10:29,058 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EB138CC62D844EC09463A199C873E406, mem on start (mb), free: 302, total: 612, max: 672
2015-07-21 11:10:29,061 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EB138CC62D844EC09463A199C873E406, mem on close (mb), free: 302, total: 612, max: 672
2015-07-21 11:10:29,073 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.1
2015-07-21 11:10:29,074 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-07-21 11:10:29,083 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D955C59646EC4B1F8DC54E7F16B0D3CD, ordinal: 1
2015-07-21 11:10:29,084 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(pearson)[by:[{1}:'l'][numSelfJoins:1]]
2015-07-21 11:10:29,084 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][7720426492/pearson/]
2015-07-21 11:10:29,084 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D955C59646EC4B1F8DC54E7F16B0D3CD, mem on start (mb), free: 292, total: 612, max: 672
2015-07-21 11:10:29,097 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 11:10:29,097 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 11:10:29,117 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D955C59646EC4B1F8DC54E7F16B0D3CD, mem on close (mb), free: 289, total: 612, max: 672
2015-07-21 11:10:29,145 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] starting step: (2/3)
2015-07-21 11:10:29,306 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] submitted hadoop job: job_local433479987_0005
2015-07-21 11:10:29,306 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] tracking url: http://localhost:8080/
2015-07-21 11:10:29,312 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-castillo/7720426492_pearson_E9BE6C5B98F04E539133C14B9BA3F637/part-00000
2015-07-21 11:10:29,340 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.1
2015-07-21 11:10:29,340 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-07-21 11:10:29,346 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E606D88631FC44AD8B9BB71F873913E0, ordinal: 0
2015-07-21 11:10:29,346 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][7720426492/pearson/]
2015-07-21 11:10:29,347 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(pearson)[by:[{?}:ALL]]
2015-07-21 11:10:29,347 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E606D88631FC44AD8B9BB71F873913E0, mem on start (mb), free: 133, total: 612, max: 672
2015-07-21 11:10:29,358 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E606D88631FC44AD8B9BB71F873913E0, mem on close (mb), free: 133, total: 612, max: 672
2015-07-21 11:10:29,377 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.1
2015-07-21 11:10:29,378 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-07-21 11:10:29,386 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A639C45AF6FA4623A24E541468EA06E4, ordinal: 1
2015-07-21 11:10:29,386 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(pearson)[by:[{?}:ALL]]
2015-07-21 11:10:29,386 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][9067406689/pearson/]
2015-07-21 11:10:29,387 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A639C45AF6FA4623A24E541468EA06E4, mem on start (mb), free: 124, total: 612, max: 672
2015-07-21 11:10:29,412 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A639C45AF6FA4623A24E541468EA06E4, mem on close (mb), free: 121, total: 612, max: 672
2015-07-21 11:10:29,443 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] starting step: (3/3) ...mposite/pearson/composite
2015-07-21 11:10:29,657 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] submitted hadoop job: job_local2108731349_0006
2015-07-21 11:10:29,658 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] tracking url: http://localhost:8080/
2015-07-21 11:10:29,661 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-castillo/9067406689_pearson_CBEBCE75207847F68B0D9B50B90CE003/part-00000
2015-07-21 11:10:29,675 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.1
2015-07-21 11:10:29,675 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-07-21 11:10:29,680 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C308515CA83D4CC78BDC3206BCD328A3, ordinal: 0
2015-07-21 11:10:29,681 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][9067406689/pearson/]
2015-07-21 11:10:29,681 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(pearson)[by:[{2}:'n1', 'n2']]
2015-07-21 11:10:29,681 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C308515CA83D4CC78BDC3206BCD328A3, mem on start (mb), free: 193, total: 612, max: 672
2015-07-21 11:10:29,686 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C308515CA83D4CC78BDC3206BCD328A3, mem on close (mb), free: 193, total: 612, max: 672
2015-07-21 11:10:29,700 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.1
2015-07-21 11:10:29,700 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-07-21 11:10:29,706 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A772FABCFFE5479489F1CF0B2EF72477, ordinal: 1
2015-07-21 11:10:29,707 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(pearson)[by:[{2}:'n1', 'n2']]
2015-07-21 11:10:29,708 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/distanceusecaseplatform/testPearsonDistanceComposite/pearson/composite"]
2015-07-21 11:10:29,709 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A772FABCFFE5479489F1CF0B2EF72477, mem on start (mb), free: 182, total: 612, max: 672
2015-07-21 11:10:29,727 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A772FABCFFE5479489F1CF0B2EF72477, mem on close (mb), free: 179, total: 612, max: 672
2015-07-21 11:10:29,754 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/distanceusecaseplatform/testPearsonDistanceComposite/pearson/composite/_temporary
2015-07-21 11:10:29,754 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson]  completed in: 00:00.946
2015-07-21 11:10:29,807 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output//hadoop2-mr1/distanceusecaseplatform/testPearsonDistanceComposite/pearson/composite
2015-07-21 11:10:29,827 INFO  util.Util (Util.java:findMainClass(1325)) - using default application jar, may cause class not found exceptions on the cluster
2015-07-21 11:10:29,828 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /Users/castillo/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.1/616db6028856ef10fd9ffb4ebd59ea94589475c4/cascading-hadoop2-mr1-3.0.1.jar
2015-07-21 11:10:29,907 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.074
2015-07-21 11:10:29,909 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 6
2015-07-21 11:10:29,909 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-07-21 11:10:29,974 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting
2015-07-21 11:10:29,974 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/critics.txt"]
2015-07-21 11:10:29,974 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistance/euclidean/long"]
2015-07-21 11:10:29,975 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  parallel execution of steps is enabled: false
2015-07-21 11:10:29,975 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  executing total steps: 3
2015-07-21 11:10:29,975 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  allocating management threads: 1
2015-07-21 11:10:29,976 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (1/3)
2015-07-21 11:10:30,140 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local2008538955_0007
2015-07-21 11:10:30,140 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2015-07-21 11:10:30,146 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/critics.txt
2015-07-21 11:10:30,166 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.1
2015-07-21 11:10:30,167 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-07-21 11:10:30,173 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B789E6B6DFAB4F7C87C11C27EEE89765, ordinal: 0
2015-07-21 11:10:30,174 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/critics.txt"]
2015-07-21 11:10:30,174 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(euclidean)[by:[{1}:'movie'][numSelfJoins:1]]
2015-07-21 11:10:30,174 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B789E6B6DFAB4F7C87C11C27EEE89765, mem on start (mb), free: 200, total: 611, max: 672
2015-07-21 11:10:30,177 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B789E6B6DFAB4F7C87C11C27EEE89765, mem on close (mb), free: 200, total: 611, max: 672
2015-07-21 11:10:30,193 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.1
2015-07-21 11:10:30,193 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-07-21 11:10:30,198 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F5CE19F57B2E4C28AED7DBA809BA2627, ordinal: 1
2015-07-21 11:10:30,199 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(euclidean)[by:[{1}:'movie'][numSelfJoins:1]]
2015-07-21 11:10:30,199 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2']]"][9751220932/euclidean/]
2015-07-21 11:10:30,200 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F5CE19F57B2E4C28AED7DBA809BA2627, mem on start (mb), free: 191, total: 611, max: 672
2015-07-21 11:10:30,216 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 11:10:30,216 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 11:10:30,239 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F5CE19F57B2E4C28AED7DBA809BA2627, mem on close (mb), free: 187, total: 611, max: 672
2015-07-21 11:10:30,267 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (2/3)
2015-07-21 11:10:30,424 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local1402928060_0008
2015-07-21 11:10:30,425 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2015-07-21 11:10:30,428 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-castillo/9751220932_euclidean_9D17CFF335A2407DBB61EB8266C0E8BE/part-00000
2015-07-21 11:10:30,447 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.1
2015-07-21 11:10:30,447 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-07-21 11:10:30,451 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D962DE81DC5C4B0B9DC4974A092690B8, ordinal: 0
2015-07-21 11:10:30,452 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2']]"][9751220932/euclidean/]
2015-07-21 11:10:30,452 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{?}:ALL]]
2015-07-21 11:10:30,452 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D962DE81DC5C4B0B9DC4974A092690B8, mem on start (mb), free: 193, total: 603, max: 672
2015-07-21 11:10:30,458 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D962DE81DC5C4B0B9DC4974A092690B8, mem on close (mb), free: 193, total: 603, max: 672
2015-07-21 11:10:30,476 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.1
2015-07-21 11:10:30,476 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-07-21 11:10:30,481 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C41C0944B1ED485D8623F8FDDF89A21E, ordinal: 1
2015-07-21 11:10:30,482 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{?}:ALL]]
2015-07-21 11:10:30,482 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2', 'score']]"][1665002756/euclidean/]
2015-07-21 11:10:30,482 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C41C0944B1ED485D8623F8FDDF89A21E, mem on start (mb), free: 185, total: 603, max: 672
2015-07-21 11:10:30,508 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C41C0944B1ED485D8623F8FDDF89A21E, mem on close (mb), free: 182, total: 603, max: 672
2015-07-21 11:10:30,540 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (3/3) ...anDistance/euclidean/long
2015-07-21 11:10:30,671 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local1807901179_0009
2015-07-21 11:10:30,672 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2015-07-21 11:10:30,675 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-castillo/1665002756_euclidean_0587037B82E843CE9840A9D1BE45BB15/part-00000
2015-07-21 11:10:30,700 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.1
2015-07-21 11:10:30,700 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-07-21 11:10:30,706 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: CCCFF1FD58614AD59F82FF588DDE53DC, ordinal: 0
2015-07-21 11:10:30,707 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2', 'score']]"][1665002756/euclidean/]
2015-07-21 11:10:30,707 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{2}:'name1', 'name2']]
2015-07-21 11:10:30,707 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CCCFF1FD58614AD59F82FF588DDE53DC, mem on start (mb), free: 201, total: 611, max: 672
2015-07-21 11:10:30,711 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CCCFF1FD58614AD59F82FF588DDE53DC, mem on close (mb), free: 201, total: 611, max: 672
2015-07-21 11:10:30,730 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.1
2015-07-21 11:10:30,731 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-07-21 11:10:30,739 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F01C3620840941939E95F1DE4384EECE, ordinal: 1
2015-07-21 11:10:30,741 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{2}:'name1', 'name2']]
2015-07-21 11:10:30,741 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistance/euclidean/long"]
2015-07-21 11:10:30,741 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F01C3620840941939E95F1DE4384EECE, mem on start (mb), free: 194, total: 611, max: 672
2015-07-21 11:10:30,758 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F01C3620840941939E95F1DE4384EECE, mem on close (mb), free: 191, total: 611, max: 672
2015-07-21 11:10:30,787 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistance/euclidean/long/_temporary
2015-07-21 11:10:30,787 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  completed in: 00:00.811
2015-07-21 11:10:30,838 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output//hadoop2-mr1/distanceusecaseplatform/testEuclideanDistance/euclidean/long
2015-07-21 11:10:30,856 INFO  util.Util (Util.java:findMainClass(1325)) - using default application jar, may cause class not found exceptions on the cluster
2015-07-21 11:10:30,856 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /Users/castillo/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.1/616db6028856ef10fd9ffb4ebd59ea94589475c4/cascading-hadoop2-mr1-3.0.1.jar
2015-07-21 11:10:30,909 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.049
2015-07-21 11:10:30,910 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 6
2015-07-21 11:10:30,910 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-07-21 11:10:30,950 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting
2015-07-21 11:10:30,951 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/critics.txt"]
2015-07-21 11:10:30,951 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceShort/euclidean/short"]
2015-07-21 11:10:30,951 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  parallel execution of steps is enabled: false
2015-07-21 11:10:30,951 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  executing total steps: 3
2015-07-21 11:10:30,951 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  allocating management threads: 1
2015-07-21 11:10:30,952 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (1/3)
2015-07-21 11:10:31,067 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local966541961_0010
2015-07-21 11:10:31,068 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2015-07-21 11:10:31,071 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/critics.txt
2015-07-21 11:10:31,090 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.1
2015-07-21 11:10:31,091 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-07-21 11:10:31,094 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: CF4C827C876A42CE8722D8C7E1B1B2E8, ordinal: 0
2015-07-21 11:10:31,095 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/critics.txt"]
2015-07-21 11:10:31,095 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(euclidean)[by:[{1}:'movie'][numSelfJoins:1]]
2015-07-21 11:10:31,095 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CF4C827C876A42CE8722D8C7E1B1B2E8, mem on start (mb), free: 191, total: 602, max: 672
2015-07-21 11:10:31,097 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CF4C827C876A42CE8722D8C7E1B1B2E8, mem on close (mb), free: 191, total: 602, max: 672
2015-07-21 11:10:31,107 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.1
2015-07-21 11:10:31,107 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-07-21 11:10:31,111 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E80B4838C37E4D94ACE4DB1C316CB076, ordinal: 1
2015-07-21 11:10:31,112 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(euclidean)[by:[{1}:'movie'][numSelfJoins:1]]
2015-07-21 11:10:31,112 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2']]"][6137021716/euclidean/]
2015-07-21 11:10:31,112 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E80B4838C37E4D94ACE4DB1C316CB076, mem on start (mb), free: 184, total: 602, max: 672
2015-07-21 11:10:31,121 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 11:10:31,121 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 11:10:31,134 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E80B4838C37E4D94ACE4DB1C316CB076, mem on close (mb), free: 182, total: 602, max: 672
2015-07-21 11:10:31,162 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (2/3)
2015-07-21 11:10:31,284 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local1311765985_0011
2015-07-21 11:10:31,285 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2015-07-21 11:10:31,288 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-castillo/6137021716_euclidean_A49F52CE951743C4ACAF16004FA752E0/part-00000
2015-07-21 11:10:31,306 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.1
2015-07-21 11:10:31,307 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-07-21 11:10:31,310 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: ED2F91F909F14C018D1A3D9BBB988916, ordinal: 0
2015-07-21 11:10:31,311 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2']]"][6137021716/euclidean/]
2015-07-21 11:10:31,311 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{?}:ALL]]
2015-07-21 11:10:31,311 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: ED2F91F909F14C018D1A3D9BBB988916, mem on start (mb), free: 200, total: 611, max: 672
2015-07-21 11:10:31,316 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: ED2F91F909F14C018D1A3D9BBB988916, mem on close (mb), free: 200, total: 611, max: 672
2015-07-21 11:10:31,329 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.1
2015-07-21 11:10:31,329 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-07-21 11:10:31,334 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F303577708DD4C8F83FD9218EE2D9921, ordinal: 1
2015-07-21 11:10:31,335 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{?}:ALL]]
2015-07-21 11:10:31,335 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2', 'score']]"][573846547/euclidean/]
2015-07-21 11:10:31,335 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F303577708DD4C8F83FD9218EE2D9921, mem on start (mb), free: 192, total: 611, max: 672
2015-07-21 11:10:31,358 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F303577708DD4C8F83FD9218EE2D9921, mem on close (mb), free: 190, total: 611, max: 672
2015-07-21 11:10:31,377 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (3/3) ...anceShort/euclidean/short
2015-07-21 11:10:31,501 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local1264945061_0012
2015-07-21 11:10:31,501 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2015-07-21 11:10:31,505 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-castillo/573846547_euclidean_F1B2CA78506644D78DFD4DBA1103067D/part-00000
2015-07-21 11:10:31,524 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.1
2015-07-21 11:10:31,524 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-07-21 11:10:31,528 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D9222939B3B04703A6B7F15F63AE7B75, ordinal: 0
2015-07-21 11:10:31,528 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2', 'score']]"][573846547/euclidean/]
2015-07-21 11:10:31,528 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{2}:'name1', 'name2']]
2015-07-21 11:10:31,528 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D9222939B3B04703A6B7F15F63AE7B75, mem on start (mb), free: 200, total: 611, max: 672
2015-07-21 11:10:31,531 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D9222939B3B04703A6B7F15F63AE7B75, mem on close (mb), free: 200, total: 611, max: 672
2015-07-21 11:10:31,542 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.1
2015-07-21 11:10:31,542 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-07-21 11:10:31,547 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B08E260D902A4B83B9FC8D5B2330E08F, ordinal: 1
2015-07-21 11:10:31,548 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{2}:'name1', 'name2']]
2015-07-21 11:10:31,548 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceShort/euclidean/short"]
2015-07-21 11:10:31,548 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B08E260D902A4B83B9FC8D5B2330E08F, mem on start (mb), free: 192, total: 611, max: 672
2015-07-21 11:10:31,567 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B08E260D902A4B83B9FC8D5B2330E08F, mem on close (mb), free: 190, total: 611, max: 672
2015-07-21 11:10:31,593 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceShort/euclidean/short/_temporary
2015-07-21 11:10:31,593 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  completed in: 00:00.641
2015-07-21 11:10:31,650 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output//hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceShort/euclidean/short

Standard error

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/hadoop/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/Users/castillo/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.5/6edffc576ce104ec769d954618764f39f0f0f10d/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]