2015-09-24 11:06:39,724 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2015-09-24 11:06:39,768 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.DistanceUseCasePlatformTest, with platform: hadoop2-mr1
2015-09-24 11:06:39,788 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(119)) - not using cluster
2015-09-24 11:06:51,500 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-09-24 11:06:51,649 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2015-09-24 11:06:51,802 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-09-24 11:06:51,804 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /Users/ryan/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-09-24 11:06:51,892 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: EC4F154C0344464AB033DC299411AAB7
2015-09-24 11:06:52,240 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.294
2015-09-24 11:06:52,246 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 6
2015-09-24 11:06:52,246 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-09-24 11:06:52,489 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.2
2015-09-24 11:06:52,490 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting
2015-09-24 11:06:52,491 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/classes/test/data/critics.txt"]
2015-09-24 11:06:52,491 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceComposite/euclidean/composite"]
2015-09-24 11:06:52,492 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] parallel execution of steps is enabled: false
2015-09-24 11:06:52,493 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] executing total steps: 3
2015-09-24 11:06:52,493 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] allocating management threads: 1
2015-09-24 11:06:52,494 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (1/3)
2015-09-24 11:06:53,193 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local2040600507_0001
2015-09-24 11:06:53,194 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2015-09-24 11:06:53,266 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/classes/test/data/critics.txt
2015-09-24 11:06:53,380 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-09-24 11:06:53,380 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts:
2015-09-24 11:06:53,399 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B7D152E0E0A84A39ADFE44C8E69A4822, ordinal: 0
2015-09-24 11:06:53,458 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/classes/test/data/critics.txt"]
2015-09-24 11:06:53,458 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(euclidean)[by:[{1}:'l'][numSelfJoins:1]]
2015-09-24 11:06:53,459 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B7D152E0E0A84A39ADFE44C8E69A4822, mem on start (mb), free: 109, total: 223, max: 672
2015-09-24 11:06:53,480 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B7D152E0E0A84A39ADFE44C8E69A4822, mem on close (mb), free: 108, total: 223, max: 672
2015-09-24 11:06:53,596 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-09-24 11:06:53,597 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts:
2015-09-24 11:06:53,616 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A7F778FA124A4B48B86EE0B1AEE8DF29, ordinal: 1
2015-09-24 11:06:53,619 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(euclidean)[by:[{1}:'l'][numSelfJoins:1]]
2015-09-24 11:06:53,620 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][6668637088/euclidean/]
2015-09-24 11:06:53,620 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A7F778FA124A4B48B86EE0B1AEE8DF29, mem on start (mb), free: 100, total: 223, max: 672
2015-09-24 11:06:53,653 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-09-24 11:06:53,654 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-09-24 11:06:53,700 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A7F778FA124A4B48B86EE0B1AEE8DF29, mem on close (mb), free: 97, total: 223, max: 672
2015-09-24 11:06:53,742 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (2/3)
2015-09-24 11:06:53,966 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local206596940_0002
2015-09-24 11:06:53,966 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2015-09-24 11:06:53,976 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-ryan/6668637088_euclidean_11FDC7ECF8E54F22B7C98474546F8E09/part-00000
2015-09-24 11:06:54,066 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-09-24 11:06:54,067 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts:
2015-09-24 11:06:54,078 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E7D08C7EF4614873A272F56B4246A9D0, ordinal: 0
2015-09-24 11:06:54,079 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][6668637088/euclidean/]
2015-09-24 11:06:54,080 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{?}:ALL]]
2015-09-24 11:06:54,080 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E7D08C7EF4614873A272F56B4246A9D0, mem on start (mb), free: 133, total: 361, max: 672
2015-09-24 11:06:54,103 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E7D08C7EF4614873A272F56B4246A9D0, mem on close (mb), free: 133, total: 361, max: 672
2015-09-24 11:06:54,165 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-09-24 11:06:54,165 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts:
2015-09-24 11:06:54,176 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: EE3BD372B7E84CD9ABA8934D79D877E5, ordinal: 1
2015-09-24 11:06:54,178 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{?}:ALL]]
2015-09-24 11:06:54,178 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][6853879616/euclidean/]
2015-09-24 11:06:54,178 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EE3BD372B7E84CD9ABA8934D79D877E5, mem on start (mb), free: 129, total: 361, max: 672
2015-09-24 11:06:54,205 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EE3BD372B7E84CD9ABA8934D79D877E5, mem on close (mb), free: 128, total: 361, max: 672
2015-09-24 11:06:54,237 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (3/3) ...osite/euclidean/composite
2015-09-24 11:06:54,560 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local1596109056_0003
2015-09-24 11:06:54,561 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2015-09-24 11:06:54,571 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-ryan/6853879616_euclidean_D7C74AABBF7748D9BB439488559348F0/part-00000
2015-09-24 11:06:54,637 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-09-24 11:06:54,638 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts:
2015-09-24 11:06:54,647 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FEBD655F9F0B424EA7C9A47DB12802A4, ordinal: 0
2015-09-24 11:06:54,648 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][6853879616/euclidean/]
2015-09-24 11:06:54,649 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{2}:'n1', 'n2']]
2015-09-24 11:06:54,649 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FEBD655F9F0B424EA7C9A47DB12802A4, mem on start (mb), free: 94, total: 461, max: 672
2015-09-24 11:06:54,659 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FEBD655F9F0B424EA7C9A47DB12802A4, mem on close (mb), free: 94, total: 461, max: 672
2015-09-24 11:06:54,688 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-09-24 11:06:54,689 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts:
2015-09-24 11:06:54,702 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B14035DB753347D49F1EBAD0E2C67919, ordinal: 1
2015-09-24 11:06:54,704 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{2}:'n1', 'n2']]
2015-09-24 11:06:54,704 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceComposite/euclidean/composite"]
2015-09-24 11:06:54,704 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B14035DB753347D49F1EBAD0E2C67919, mem on start (mb), free: 90, total: 461, max: 672
2015-09-24 11:06:54,727 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B14035DB753347D49F1EBAD0E2C67919, mem on close (mb), free: 89, total: 461, max: 672
2015-09-24 11:06:54,767 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceComposite/euclidean/composite/_temporary
2015-09-24 11:06:54,769 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] completed in: 00:02.272
2015-09-24 11:06:54,879 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceComposite/euclidean/composite
2015-09-24 11:06:54,913 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-09-24 11:06:54,914 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /Users/ryan/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-09-24 11:06:55,075 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.151
2015-09-24 11:06:55,077 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 6
2015-09-24 11:06:55,077 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-09-24 11:06:55,149 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] starting
2015-09-24 11:06:55,149 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/classes/test/data/critics.txt"]
2015-09-24 11:06:55,150 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/distanceusecaseplatform/testPearsonDistanceComposite/pearson/composite"]
2015-09-24 11:06:55,150 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] parallel execution of steps is enabled: false
2015-09-24 11:06:55,150 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] executing total steps: 3
2015-09-24 11:06:55,150 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] allocating management threads: 1
2015-09-24 11:06:55,151 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] starting step: (1/3)
2015-09-24 11:06:55,310 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] submitted hadoop job: job_local355175614_0004
2015-09-24 11:06:55,311 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] tracking url: http://localhost:8080/
2015-09-24 11:06:55,316 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/classes/test/data/critics.txt
2015-09-24 11:06:55,374 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-09-24 11:06:55,375 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts:
2015-09-24 11:06:55,385 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FEF3EB242D4F48A08E21E0041259B24F, ordinal: 0
2015-09-24 11:06:55,386 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/classes/test/data/critics.txt"]
2015-09-24 11:06:55,386 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(pearson)[by:[{1}:'l'][numSelfJoins:1]]
2015-09-24 11:06:55,386 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FEF3EB242D4F48A08E21E0041259B24F, mem on start (mb), free: 97, total: 562, max: 672
2015-09-24 11:06:55,390 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FEF3EB242D4F48A08E21E0041259B24F, mem on close (mb), free: 97, total: 562, max: 672
2015-09-24 11:06:55,408 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-09-24 11:06:55,408 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts:
2015-09-24 11:06:55,420 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D8A05EE8B8C74DFE948F1CD4AD61B924, ordinal: 1
2015-09-24 11:06:55,421 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(pearson)[by:[{1}:'l'][numSelfJoins:1]]
2015-09-24 11:06:55,422 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][8984926707/pearson/]
2015-09-24 11:06:55,422 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D8A05EE8B8C74DFE948F1CD4AD61B924, mem on start (mb), free: 93, total: 562, max: 672
2015-09-24 11:06:55,431 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-09-24 11:06:55,431 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-09-24 11:06:55,465 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D8A05EE8B8C74DFE948F1CD4AD61B924, mem on close (mb), free: 92, total: 562, max: 672
2015-09-24 11:06:55,497 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] starting step: (2/3)
2015-09-24 11:06:55,684 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] submitted hadoop job: job_local434103649_0005
2015-09-24 11:06:55,685 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] tracking url: http://localhost:8080/
2015-09-24 11:06:55,690 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-ryan/8984926707_pearson_0ACC0B8A7521435083AAF3B0F55ACCA8/part-00000
2015-09-24 11:06:55,731 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-09-24 11:06:55,731 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts:
2015-09-24 11:06:55,741 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FF6F9B03ADDA4270BCD3E81F10791C6B, ordinal: 0
2015-09-24 11:06:55,742 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][8984926707/pearson/]
2015-09-24 11:06:55,742 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(pearson)[by:[{?}:ALL]]
2015-09-24 11:06:55,743 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FF6F9B03ADDA4270BCD3E81F10791C6B, mem on start (mb), free: 88, total: 627, max: 672
2015-09-24 11:06:55,756 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FF6F9B03ADDA4270BCD3E81F10791C6B, mem on close (mb), free: 87, total: 627, max: 672
2015-09-24 11:06:55,786 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-09-24 11:06:55,787 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts:
2015-09-24 11:06:55,797 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B691B4E429A14F6D9974B4CDEC8EF008, ordinal: 1
2015-09-24 11:06:55,798 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(pearson)[by:[{?}:ALL]]
2015-09-24 11:06:55,798 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][9386021655/pearson/]
2015-09-24 11:06:55,799 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B691B4E429A14F6D9974B4CDEC8EF008, mem on start (mb), free: 82, total: 627, max: 672
2015-09-24 11:06:55,831 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B691B4E429A14F6D9974B4CDEC8EF008, mem on close (mb), free: 212, total: 628, max: 672
2015-09-24 11:06:55,854 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] starting step: (3/3) ...mposite/pearson/composite
2015-09-24 11:06:56,024 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] submitted hadoop job: job_local1085072114_0006
2015-09-24 11:06:56,024 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] tracking url: http://localhost:8080/
2015-09-24 11:06:56,029 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-ryan/9386021655_pearson_E958BFD28BF042788694C905E63BE214/part-00000
2015-09-24 11:06:56,054 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-09-24 11:06:56,054 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts:
2015-09-24 11:06:56,061 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E132103822924AF98BBAA2E6BAEFE201, ordinal: 0
2015-09-24 11:06:56,062 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][9386021655/pearson/]
2015-09-24 11:06:56,062 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(pearson)[by:[{2}:'n1', 'n2']]
2015-09-24 11:06:56,062 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E132103822924AF98BBAA2E6BAEFE201, mem on start (mb), free: 207, total: 724, max: 724
2015-09-24 11:06:56,069 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E132103822924AF98BBAA2E6BAEFE201, mem on close (mb), free: 207, total: 724, max: 724
2015-09-24 11:06:56,087 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-09-24 11:06:56,088 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts:
2015-09-24 11:06:56,099 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: DF7BFEC8AD3D4D5DAD2353D2E5D27410, ordinal: 1
2015-09-24 11:06:56,100 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(pearson)[by:[{2}:'n1', 'n2']]
2015-09-24 11:06:56,101 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/distanceusecaseplatform/testPearsonDistanceComposite/pearson/composite"]
2015-09-24 11:06:56,101 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DF7BFEC8AD3D4D5DAD2353D2E5D27410, mem on start (mb), free: 199, total: 724, max: 724
2015-09-24 11:06:56,118 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: DF7BFEC8AD3D4D5DAD2353D2E5D27410, mem on close (mb), free: 198, total: 724, max: 724
2015-09-24 11:06:56,152 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/distanceusecaseplatform/testPearsonDistanceComposite/pearson/composite/_temporary
2015-09-24 11:06:56,153 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] completed in: 00:01.000
2015-09-24 11:06:56,230 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/distanceusecaseplatform/testPearsonDistanceComposite/pearson/composite
2015-09-24 11:06:56,273 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-09-24 11:06:56,274 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /Users/ryan/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-09-24 11:06:56,411 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.127
2015-09-24 11:06:56,413 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 6
2015-09-24 11:06:56,414 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-09-24 11:06:56,480 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting
2015-09-24 11:06:56,481 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/classes/test/data/critics.txt"]
2015-09-24 11:06:56,481 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistance/euclidean/long"]
2015-09-24 11:06:56,481 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] parallel execution of steps is enabled: false
2015-09-24 11:06:56,481 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] executing total steps: 3
2015-09-24 11:06:56,481 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] allocating management threads: 1
2015-09-24 11:06:56,483 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (1/3)
2015-09-24 11:06:56,659 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local1496956920_0007
2015-09-24 11:06:56,660 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2015-09-24 11:06:56,664 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/classes/test/data/critics.txt
2015-09-24 11:06:56,688 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-09-24 11:06:56,688 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts:
2015-09-24 11:06:56,696 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B7B36791599042A697D705B7593CED33, ordinal: 0
2015-09-24 11:06:56,697 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/classes/test/data/critics.txt"]
2015-09-24 11:06:56,697 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(euclidean)[by:[{1}:'movie'][numSelfJoins:1]]
2015-09-24 11:06:56,697 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B7B36791599042A697D705B7593CED33, mem on start (mb), free: 207, total: 724, max: 724
2015-09-24 11:06:56,701 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B7B36791599042A697D705B7593CED33, mem on close (mb), free: 207, total: 724, max: 724
2015-09-24 11:06:56,716 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-09-24 11:06:56,716 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts:
2015-09-24 11:06:56,722 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B80AE5105BC74782AD44D42E38048280, ordinal: 1
2015-09-24 11:06:56,724 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(euclidean)[by:[{1}:'movie'][numSelfJoins:1]]
2015-09-24 11:06:56,724 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2']]"][7049886377/euclidean/]
2015-09-24 11:06:56,724 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B80AE5105BC74782AD44D42E38048280, mem on start (mb), free: 200, total: 724, max: 724
2015-09-24 11:06:56,733 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-09-24 11:06:56,733 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-09-24 11:06:56,759 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B80AE5105BC74782AD44D42E38048280, mem on close (mb), free: 199, total: 724, max: 724
2015-09-24 11:06:56,783 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (2/3)
2015-09-24 11:06:56,944 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local1223098605_0008
2015-09-24 11:06:56,944 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2015-09-24 11:06:56,950 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-ryan/7049886377_euclidean_55588275509C4E4EB135664D84CC9939/part-00000
2015-09-24 11:06:56,972 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-09-24 11:06:56,972 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts:
2015-09-24 11:06:56,978 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DDF33226867745C4A9EC35EC45B56EEB, ordinal: 0
2015-09-24 11:06:56,978 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2']]"][7049886377/euclidean/]
2015-09-24 11:06:56,978 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{?}:ALL]]
2015-09-24 11:06:56,979 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DDF33226867745C4A9EC35EC45B56EEB, mem on start (mb), free: 228, total: 746, max: 746
2015-09-24 11:06:56,987 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DDF33226867745C4A9EC35EC45B56EEB, mem on close (mb), free: 228, total: 746, max: 746
2015-09-24 11:06:57,010 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-09-24 11:06:57,010 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts:
2015-09-24 11:06:57,020 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C4D768356B19478DB12AFFE06F560A22, ordinal: 1
2015-09-24 11:06:57,021 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{?}:ALL]]
2015-09-24 11:06:57,021 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2', 'score']]"][7167975651/euclidean/]
2015-09-24 11:06:57,021 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C4D768356B19478DB12AFFE06F560A22, mem on start (mb), free: 219, total: 746, max: 746
2015-09-24 11:06:57,055 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C4D768356B19478DB12AFFE06F560A22, mem on close (mb), free: 217, total: 746, max: 746
2015-09-24 11:06:57,076 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (3/3) ...anDistance/euclidean/long
2015-09-24 11:06:57,233 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local811713454_0009
2015-09-24 11:06:57,234 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2015-09-24 11:06:57,241 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-ryan/7167975651_euclidean_5EBD49101DB64908BE16993E297EBAD9/part-00000
2015-09-24 11:06:57,273 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-09-24 11:06:57,273 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts:
2015-09-24 11:06:57,280 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E4386943093B4096AA56F3EB35833117, ordinal: 0
2015-09-24 11:06:57,280 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2', 'score']]"][7167975651/euclidean/]
2015-09-24 11:06:57,280 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{2}:'name1', 'name2']]
2015-09-24 11:06:57,280 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E4386943093B4096AA56F3EB35833117, mem on start (mb), free: 228, total: 746, max: 746
2015-09-24 11:06:57,286 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E4386943093B4096AA56F3EB35833117, mem on close (mb), free: 228, total: 746, max: 746
2015-09-24 11:06:57,302 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-09-24 11:06:57,302 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts:
2015-09-24 11:06:57,311 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B22091634E4A43C28F5AD614B98821B6, ordinal: 1
2015-09-24 11:06:57,312 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{2}:'name1', 'name2']]
2015-09-24 11:06:57,313 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistance/euclidean/long"]
2015-09-24 11:06:57,313 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B22091634E4A43C28F5AD614B98821B6, mem on start (mb), free: 220, total: 746, max: 746
2015-09-24 11:06:57,327 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B22091634E4A43C28F5AD614B98821B6, mem on close (mb), free: 219, total: 746, max: 746
2015-09-24 11:06:57,353 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistance/euclidean/long/_temporary
2015-09-24 11:06:57,354 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] completed in: 00:00.871
2015-09-24 11:06:57,422 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/distanceusecaseplatform/testEuclideanDistance/euclidean/long
2015-09-24 11:06:57,446 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-09-24 11:06:57,446 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /Users/ryan/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-09-24 11:06:57,527 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.076
2015-09-24 11:06:57,529 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 6
2015-09-24 11:06:57,529 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-09-24 11:06:57,581 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting
2015-09-24 11:06:57,581 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/classes/test/data/critics.txt"]
2015-09-24 11:06:57,582 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceShort/euclidean/short"]
2015-09-24 11:06:57,582 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] parallel execution of steps is enabled: false
2015-09-24 11:06:57,583 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] executing total steps: 3
2015-09-24 11:06:57,583 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] allocating management threads: 1
2015-09-24 11:06:57,590 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (1/3)
2015-09-24 11:06:57,747 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local2069341257_0010
2015-09-24 11:06:57,747 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2015-09-24 11:06:57,752 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/classes/test/data/critics.txt
2015-09-24 11:06:57,774 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-09-24 11:06:57,774 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts:
2015-09-24 11:06:57,780 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: EBBB431CE9CB4CB3A2ED1458333E3824, ordinal: 0
2015-09-24 11:06:57,781 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/classes/test/data/critics.txt"]
2015-09-24 11:06:57,781 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(euclidean)[by:[{1}:'movie'][numSelfJoins:1]]
2015-09-24 11:06:57,781 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EBBB431CE9CB4CB3A2ED1458333E3824, mem on start (mb), free: 225, total: 746, max: 746
2015-09-24 11:06:57,784 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EBBB431CE9CB4CB3A2ED1458333E3824, mem on close (mb), free: 225, total: 746, max: 746
2015-09-24 11:06:57,799 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-09-24 11:06:57,799 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts:
2015-09-24 11:06:57,805 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: BDAFAAF6DE754DF79729C03B39AAB445, ordinal: 1
2015-09-24 11:06:57,806 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(euclidean)[by:[{1}:'movie'][numSelfJoins:1]]
2015-09-24 11:06:57,806 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2']]"][9131032587/euclidean/]
2015-09-24 11:06:57,806 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: BDAFAAF6DE754DF79729C03B39AAB445, mem on start (mb), free: 218, total: 746, max: 746
2015-09-24 11:06:57,813 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-09-24 11:06:57,814 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-09-24 11:06:57,833 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: BDAFAAF6DE754DF79729C03B39AAB445, mem on close (mb), free: 216, total: 746, max: 746
2015-09-24 11:06:57,860 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (2/3)
2015-09-24 11:06:58,005 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local1611551785_0011
2015-09-24 11:06:58,006 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2015-09-24 11:06:58,010 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-ryan/9131032587_euclidean_D215F786107B40B99B90B0C2FD618F00/part-00000
2015-09-24 11:06:58,036 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-09-24 11:06:58,036 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts:
2015-09-24 11:06:58,042 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FD52DA2335A346F7BADB5B7CBA584922, ordinal: 0
2015-09-24 11:06:58,043 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2']]"][9131032587/euclidean/]
2015-09-24 11:06:58,043 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{?}:ALL]]
2015-09-24 11:06:58,043 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FD52DA2335A346F7BADB5B7CBA584922, mem on start (mb), free: 217, total: 737, max: 737
2015-09-24 11:06:58,049 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FD52DA2335A346F7BADB5B7CBA584922, mem on close (mb), free: 217, total: 737, max: 737
2015-09-24 11:06:58,071 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-09-24 11:06:58,071 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts:
2015-09-24 11:06:58,078 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B897FA467561419D86F320730F349E02, ordinal: 1
2015-09-24 11:06:58,079 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{?}:ALL]]
2015-09-24 11:06:58,079 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2', 'score']]"][2023365619/euclidean/]
2015-09-24 11:06:58,079 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B897FA467561419D86F320730F349E02, mem on start (mb), free: 209, total: 737, max: 737
2015-09-24 11:06:58,100 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B897FA467561419D86F320730F349E02, mem on close (mb), free: 207, total: 737, max: 737
2015-09-24 11:06:58,129 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (3/3) ...anceShort/euclidean/short
2015-09-24 11:06:58,285 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local930388910_0012
2015-09-24 11:06:58,285 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2015-09-24 11:06:58,289 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-ryan/2023365619_euclidean_3D697554683141419CFE1C44768148C3/part-00000
2015-09-24 11:06:58,311 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.2
2015-09-24 11:06:58,311 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts:
2015-09-24 11:06:58,317 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: BD6C7429BEC84CD3AB7343FAE75E2F70, ordinal: 0
2015-09-24 11:06:58,318 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2', 'score']]"][2023365619/euclidean/]
2015-09-24 11:06:58,318 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{2}:'name1', 'name2']]
2015-09-24 11:06:58,318 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BD6C7429BEC84CD3AB7343FAE75E2F70, mem on start (mb), free: 225, total: 745, max: 745
2015-09-24 11:06:58,322 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: BD6C7429BEC84CD3AB7343FAE75E2F70, mem on close (mb), free: 225, total: 745, max: 745
2015-09-24 11:06:58,340 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.2
2015-09-24 11:06:58,340 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts:
2015-09-24 11:06:58,347 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: FD2976C53B8446E9B0573ABC4B4E529C, ordinal: 1
2015-09-24 11:06:58,347 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{2}:'name1', 'name2']]
2015-09-24 11:06:58,348 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceShort/euclidean/short"]
2015-09-24 11:06:58,348 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FD2976C53B8446E9B0573ABC4B4E529C, mem on start (mb), free: 218, total: 745, max: 745
2015-09-24 11:06:58,360 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FD2976C53B8446E9B0573ABC4B4E529C, mem on close (mb), free: 217, total: 745, max: 745
2015-09-24 11:06:58,384 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceShort/euclidean/short/_temporary
2015-09-24 11:06:58,385 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] completed in: 00:00.801
2015-09-24 11:06:58,458 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceShort/euclidean/short