2016-05-18 09:56:12,818 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(197)) - found 1 test platforms from classpath
2016-05-18 09:56:12,840 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(246)) - adding test: cascading.DistanceUseCasePlatformTest, with platform: hadoop2-mr1
2016-05-18 09:56:12,862 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(119)) - not using cluster
2016-05-18 09:56:13,577 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-05-18 09:56:13,738 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(75)) - platform property overrides:
2016-05-18 09:56:13,903 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 09:56:13,905 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 09:56:14,014 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: 7DBFAF0B155A41719B05BDCFFBB3EDA8
2016-05-18 09:56:14,379 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.289
2016-05-18 09:56:14,385 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 6
2016-05-18 09:56:14,385 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 09:56:14,651 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.1.0
2016-05-18 09:56:14,654 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] starting
2016-05-18 09:56:14,654 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/critics.txt"]
2016-05-18 09:56:14,655 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceComposite/euclidean/composite"]
2016-05-18 09:56:14,656 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] parallel execution of steps is enabled: false
2016-05-18 09:56:14,657 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] executing total steps: 3
2016-05-18 09:56:14,657 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] allocating management threads: 1
2016-05-18 09:56:14,658 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] starting step: (1/3)
2016-05-18 09:56:15,374 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] submitted hadoop job: job_local1551642941_0001
2016-05-18 09:56:15,374 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] tracking url: http://localhost:8080/
2016-05-18 09:56:15,465 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/critics.txt
2016-05-18 09:56:15,640 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.1.0
2016-05-18 09:56:15,640 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-05-18 09:56:15,656 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F1F49EBFA1B6405B9C7AC9EBC28F4BCA, ordinal: 0
2016-05-18 09:56:15,691 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/critics.txt"]
2016-05-18 09:56:15,691 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(euclidean)[by:[{1}:'l'][numSelfJoins:1]]
2016-05-18 09:56:15,691 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F1F49EBFA1B6405B9C7AC9EBC28F4BCA, mem on start (mb), free: 110, total: 281, max: 672
2016-05-18 09:56:15,703 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F1F49EBFA1B6405B9C7AC9EBC28F4BCA, mem on close (mb), free: 108, total: 281, max: 672
2016-05-18 09:56:15,792 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.1.0
2016-05-18 09:56:15,792 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-05-18 09:56:15,813 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C66D50099A604D88BCA786614464DC23, ordinal: 1
2016-05-18 09:56:15,816 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(euclidean)[by:[{1}:'l'][numSelfJoins:1]]
2016-05-18 09:56:15,817 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][6974105828/euclidean/]
2016-05-18 09:56:15,817 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C66D50099A604D88BCA786614464DC23, mem on start (mb), free: 97, total: 281, max: 672
2016-05-18 09:56:15,853 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 09:56:15,854 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 09:56:15,900 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C66D50099A604D88BCA786614464DC23, mem on close (mb), free: 94, total: 281, max: 672
2016-05-18 09:56:15,943 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] starting step: (2/3)
2016-05-18 09:56:16,174 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] submitted hadoop job: job_local1017099617_0002
2016-05-18 09:56:16,175 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] tracking url: http://localhost:8080/
2016-05-18 09:56:16,181 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/6974105828_euclidean_5CEDA6D6BAC649BC930E9A00A3287223/part-00000
2016-05-18 09:56:16,219 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.1.0
2016-05-18 09:56:16,220 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-05-18 09:56:16,232 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AB81DC6C4F784578B4B7A65E6D5E0630, ordinal: 0
2016-05-18 09:56:16,233 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][6974105828/euclidean/]
2016-05-18 09:56:16,233 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{?}:ALL]]
2016-05-18 09:56:16,233 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AB81DC6C4F784578B4B7A65E6D5E0630, mem on start (mb), free: 62, total: 281, max: 672
2016-05-18 09:56:16,254 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AB81DC6C4F784578B4B7A65E6D5E0630, mem on close (mb), free: 62, total: 281, max: 672
2016-05-18 09:56:16,308 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.1.0
2016-05-18 09:56:16,308 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-05-18 09:56:16,319 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: BB57920D369A4925BE0D5D599847E1CC, ordinal: 1
2016-05-18 09:56:16,320 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{?}:ALL]]
2016-05-18 09:56:16,320 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][9637980553/euclidean/]
2016-05-18 09:56:16,321 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: BB57920D369A4925BE0D5D599847E1CC, mem on start (mb), free: 56, total: 281, max: 672
2016-05-18 09:56:16,352 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: BB57920D369A4925BE0D5D599847E1CC, mem on close (mb), free: 55, total: 281, max: 672
2016-05-18 09:56:16,406 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] starting step: (3/3) ...osite/euclidean/composite
2016-05-18 09:56:16,713 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] submitted hadoop job: job_local538413998_0003
2016-05-18 09:56:16,718 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] tracking url: http://localhost:8080/
2016-05-18 09:56:16,727 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/9637980553_euclidean_B59689BD5B234BBFBFA616B85BA0F26C/part-00000
2016-05-18 09:56:16,759 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.1.0
2016-05-18 09:56:16,759 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-05-18 09:56:16,770 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F88F742C92004BE0A85307F6F104C28A, ordinal: 0
2016-05-18 09:56:16,771 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][9637980553/euclidean/]
2016-05-18 09:56:16,771 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{2}:'n1', 'n2']]
2016-05-18 09:56:16,772 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F88F742C92004BE0A85307F6F104C28A, mem on start (mb), free: 133, total: 397, max: 672
2016-05-18 09:56:16,784 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F88F742C92004BE0A85307F6F104C28A, mem on close (mb), free: 132, total: 397, max: 672
2016-05-18 09:56:16,814 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.1.0
2016-05-18 09:56:16,814 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-05-18 09:56:16,827 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: AAFA272BBDA741B8B3F6089489876716, ordinal: 1
2016-05-18 09:56:16,828 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{2}:'n1', 'n2']]
2016-05-18 09:56:16,829 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceComposite/euclidean/composite"]
2016-05-18 09:56:16,829 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AAFA272BBDA741B8B3F6089489876716, mem on start (mb), free: 122, total: 397, max: 672
2016-05-18 09:56:16,856 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AAFA272BBDA741B8B3F6089489876716, mem on close (mb), free: 120, total: 397, max: 672
2016-05-18 09:56:16,885 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceComposite/euclidean/composite/_temporary
2016-05-18 09:56:16,886 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] completed in: 00:02.229
2016-05-18 09:56:16,954 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output//hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceComposite/euclidean/composite
2016-05-18 09:56:16,993 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 09:56:16,994 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 09:56:17,153 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pearson] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.149
2016-05-18 09:56:17,157 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pearson] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 6
2016-05-18 09:56:17,157 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pearson] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 09:56:17,251 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pearson] starting
2016-05-18 09:56:17,251 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pearson] source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/critics.txt"]
2016-05-18 09:56:17,252 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pearson] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testPearsonDistanceComposite/pearson/composite"]
2016-05-18 09:56:17,252 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pearson] parallel execution of steps is enabled: false
2016-05-18 09:56:17,252 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pearson] executing total steps: 3
2016-05-18 09:56:17,252 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pearson] allocating management threads: 1
2016-05-18 09:56:17,253 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pearson] starting step: (1/3)
2016-05-18 09:56:17,414 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pearson] submitted hadoop job: job_local955715985_0004
2016-05-18 09:56:17,416 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pearson] tracking url: http://localhost:8080/
2016-05-18 09:56:17,421 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/critics.txt
2016-05-18 09:56:17,436 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.1.0
2016-05-18 09:56:17,436 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-05-18 09:56:17,449 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AC15B7EBE8054D459E4D3DDCC3ACB322, ordinal: 0
2016-05-18 09:56:17,450 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/critics.txt"]
2016-05-18 09:56:17,450 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(pearson)[by:[{1}:'l'][numSelfJoins:1]]
2016-05-18 09:56:17,450 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AC15B7EBE8054D459E4D3DDCC3ACB322, mem on start (mb), free: 163, total: 395, max: 672
2016-05-18 09:56:17,454 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AC15B7EBE8054D459E4D3DDCC3ACB322, mem on close (mb), free: 163, total: 395, max: 672
2016-05-18 09:56:17,470 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.1.0
2016-05-18 09:56:17,471 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-05-18 09:56:17,482 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F385F8BC33D5497B8CD400CC47758908, ordinal: 1
2016-05-18 09:56:17,483 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(pearson)[by:[{1}:'l'][numSelfJoins:1]]
2016-05-18 09:56:17,483 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][9262137478/pearson/]
2016-05-18 09:56:17,483 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F385F8BC33D5497B8CD400CC47758908, mem on start (mb), free: 155, total: 395, max: 672
2016-05-18 09:56:17,493 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 09:56:17,493 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 09:56:17,520 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F385F8BC33D5497B8CD400CC47758908, mem on close (mb), free: 152, total: 395, max: 672
2016-05-18 09:56:17,545 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pearson] starting step: (2/3)
2016-05-18 09:56:17,686 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pearson] submitted hadoop job: job_local298704513_0005
2016-05-18 09:56:17,687 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pearson] tracking url: http://localhost:8080/
2016-05-18 09:56:17,693 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/9262137478_pearson_A05831CAABD4422D8E476E06A68679CE/part-00000
2016-05-18 09:56:17,726 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.1.0
2016-05-18 09:56:17,727 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-05-18 09:56:17,740 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B9630872BEF249BFA68F87D552719A6B, ordinal: 0
2016-05-18 09:56:17,741 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][9262137478/pearson/]
2016-05-18 09:56:17,741 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(pearson)[by:[{?}:ALL]]
2016-05-18 09:56:17,741 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B9630872BEF249BFA68F87D552719A6B, mem on start (mb), free: 182, total: 394, max: 672
2016-05-18 09:56:17,757 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B9630872BEF249BFA68F87D552719A6B, mem on close (mb), free: 182, total: 394, max: 672
2016-05-18 09:56:17,793 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.1.0
2016-05-18 09:56:17,793 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-05-18 09:56:17,800 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B23DEBC193F140CDA9B087FC01B92ECE, ordinal: 1
2016-05-18 09:56:17,800 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(pearson)[by:[{?}:ALL]]
2016-05-18 09:56:17,801 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][7278905907/pearson/]
2016-05-18 09:56:17,801 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B23DEBC193F140CDA9B087FC01B92ECE, mem on start (mb), free: 172, total: 394, max: 672
2016-05-18 09:56:17,825 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B23DEBC193F140CDA9B087FC01B92ECE, mem on close (mb), free: 170, total: 394, max: 672
2016-05-18 09:56:17,848 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pearson] starting step: (3/3) ...mposite/pearson/composite
2016-05-18 09:56:17,988 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pearson] submitted hadoop job: job_local1595713141_0006
2016-05-18 09:56:17,988 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pearson] tracking url: http://localhost:8080/
2016-05-18 09:56:17,994 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/7278905907_pearson_42CB7D317DB2427A850604FF6A2FAB1D/part-00000
2016-05-18 09:56:18,024 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.1.0
2016-05-18 09:56:18,025 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-05-18 09:56:18,036 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D62BCFCAADA8440A9D8BB4278C2107D2, ordinal: 0
2016-05-18 09:56:18,037 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][7278905907/pearson/]
2016-05-18 09:56:18,037 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(pearson)[by:[{2}:'n1', 'n2']]
2016-05-18 09:56:18,038 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D62BCFCAADA8440A9D8BB4278C2107D2, mem on start (mb), free: 175, total: 387, max: 672
2016-05-18 09:56:18,044 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D62BCFCAADA8440A9D8BB4278C2107D2, mem on close (mb), free: 175, total: 387, max: 672
2016-05-18 09:56:18,063 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.1.0
2016-05-18 09:56:18,063 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-05-18 09:56:18,072 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C179CD21852E4B7BB97B89B5D524B605, ordinal: 1
2016-05-18 09:56:18,072 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(pearson)[by:[{2}:'n1', 'n2']]
2016-05-18 09:56:18,073 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testPearsonDistanceComposite/pearson/composite"]
2016-05-18 09:56:18,073 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C179CD21852E4B7BB97B89B5D524B605, mem on start (mb), free: 165, total: 387, max: 672
2016-05-18 09:56:18,101 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C179CD21852E4B7BB97B89B5D524B605, mem on close (mb), free: 163, total: 387, max: 672
2016-05-18 09:56:18,122 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testPearsonDistanceComposite/pearson/composite/_temporary
2016-05-18 09:56:18,123 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pearson] completed in: 00:00.870
2016-05-18 09:56:18,178 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output//hadoop2-mr1/distanceusecaseplatform/testPearsonDistanceComposite/pearson/composite
2016-05-18 09:56:18,203 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 09:56:18,203 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 09:56:18,307 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.097
2016-05-18 09:56:18,309 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 6
2016-05-18 09:56:18,310 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 09:56:18,363 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] starting
2016-05-18 09:56:18,364 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/critics.txt"]
2016-05-18 09:56:18,364 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistance/euclidean/long"]
2016-05-18 09:56:18,364 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] parallel execution of steps is enabled: false
2016-05-18 09:56:18,365 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] executing total steps: 3
2016-05-18 09:56:18,365 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] allocating management threads: 1
2016-05-18 09:56:18,366 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] starting step: (1/3)
2016-05-18 09:56:18,481 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] submitted hadoop job: job_local484897570_0007
2016-05-18 09:56:18,481 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] tracking url: http://localhost:8080/
2016-05-18 09:56:18,487 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/critics.txt
2016-05-18 09:56:18,510 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.1.0
2016-05-18 09:56:18,511 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-05-18 09:56:18,522 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B8086AB39AFA4C048165E32A5739207E, ordinal: 0
2016-05-18 09:56:18,523 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/critics.txt"]
2016-05-18 09:56:18,523 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(euclidean)[by:[{1}:'movie'][numSelfJoins:1]]
2016-05-18 09:56:18,523 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B8086AB39AFA4C048165E32A5739207E, mem on start (mb), free: 181, total: 393, max: 672
2016-05-18 09:56:18,527 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B8086AB39AFA4C048165E32A5739207E, mem on close (mb), free: 181, total: 393, max: 672
2016-05-18 09:56:18,549 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.1.0
2016-05-18 09:56:18,549 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-05-18 09:56:18,561 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E5A3D09CC6B64B5CAF62FB27E1434085, ordinal: 1
2016-05-18 09:56:18,563 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(euclidean)[by:[{1}:'movie'][numSelfJoins:1]]
2016-05-18 09:56:18,563 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2']]"][3482794970/euclidean/]
2016-05-18 09:56:18,563 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E5A3D09CC6B64B5CAF62FB27E1434085, mem on start (mb), free: 174, total: 393, max: 672
2016-05-18 09:56:18,574 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 09:56:18,574 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 09:56:18,606 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E5A3D09CC6B64B5CAF62FB27E1434085, mem on close (mb), free: 171, total: 393, max: 672
2016-05-18 09:56:18,635 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] starting step: (2/3)
2016-05-18 09:56:18,758 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] submitted hadoop job: job_local1774279081_0008
2016-05-18 09:56:18,759 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] tracking url: http://localhost:8080/
2016-05-18 09:56:18,764 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/3482794970_euclidean_5B7ABD4BAE7F4FEABD84ADF40BFCD9D0/part-00000
2016-05-18 09:56:18,782 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.1.0
2016-05-18 09:56:18,782 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-05-18 09:56:18,788 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F4E098AA09C3435D9D55565A39148AF3, ordinal: 0
2016-05-18 09:56:18,788 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2']]"][3482794970/euclidean/]
2016-05-18 09:56:18,788 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{?}:ALL]]
2016-05-18 09:56:18,788 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F4E098AA09C3435D9D55565A39148AF3, mem on start (mb), free: 171, total: 383, max: 672
2016-05-18 09:56:18,797 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F4E098AA09C3435D9D55565A39148AF3, mem on close (mb), free: 171, total: 383, max: 672
2016-05-18 09:56:18,825 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.1.0
2016-05-18 09:56:18,825 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-05-18 09:56:18,833 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CE67D3143A29491098405645C0FDE528, ordinal: 1
2016-05-18 09:56:18,834 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{?}:ALL]]
2016-05-18 09:56:18,834 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2', 'score']]"][2279905497/euclidean/]
2016-05-18 09:56:18,834 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CE67D3143A29491098405645C0FDE528, mem on start (mb), free: 162, total: 383, max: 672
2016-05-18 09:56:18,869 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CE67D3143A29491098405645C0FDE528, mem on close (mb), free: 158, total: 383, max: 672
2016-05-18 09:56:18,897 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] starting step: (3/3) ...anDistance/euclidean/long
2016-05-18 09:56:19,011 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] submitted hadoop job: job_local428217629_0009
2016-05-18 09:56:19,011 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] tracking url: http://localhost:8080/
2016-05-18 09:56:19,016 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/2279905497_euclidean_0C62471D574B4D9F800DDA851C7918D2/part-00000
2016-05-18 09:56:19,034 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.1.0
2016-05-18 09:56:19,034 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-05-18 09:56:19,040 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B8A39935DCB247F09AC4B0C21AC22C9D, ordinal: 0
2016-05-18 09:56:19,041 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2', 'score']]"][2279905497/euclidean/]
2016-05-18 09:56:19,041 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{2}:'name1', 'name2']]
2016-05-18 09:56:19,041 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B8A39935DCB247F09AC4B0C21AC22C9D, mem on start (mb), free: 180, total: 392, max: 672
2016-05-18 09:56:19,048 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B8A39935DCB247F09AC4B0C21AC22C9D, mem on close (mb), free: 180, total: 392, max: 672
2016-05-18 09:56:19,075 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.1.0
2016-05-18 09:56:19,076 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-05-18 09:56:19,084 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: FC25C94AEBD24F4A8670E71BE87B3A1B, ordinal: 1
2016-05-18 09:56:19,085 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{2}:'name1', 'name2']]
2016-05-18 09:56:19,086 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistance/euclidean/long"]
2016-05-18 09:56:19,086 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FC25C94AEBD24F4A8670E71BE87B3A1B, mem on start (mb), free: 173, total: 392, max: 672
2016-05-18 09:56:19,101 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FC25C94AEBD24F4A8670E71BE87B3A1B, mem on close (mb), free: 170, total: 392, max: 672
2016-05-18 09:56:19,119 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistance/euclidean/long/_temporary
2016-05-18 09:56:19,120 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] completed in: 00:00.755
2016-05-18 09:56:19,168 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output//hadoop2-mr1/distanceusecaseplatform/testEuclideanDistance/euclidean/long
2016-05-18 09:56:19,190 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 09:56:19,190 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 09:56:19,267 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.072
2016-05-18 09:56:19,268 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 6
2016-05-18 09:56:19,268 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 09:56:19,319 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] starting
2016-05-18 09:56:19,319 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] source: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/critics.txt"]
2016-05-18 09:56:19,319 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceShort/euclidean/short"]
2016-05-18 09:56:19,320 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] parallel execution of steps is enabled: false
2016-05-18 09:56:19,320 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] executing total steps: 3
2016-05-18 09:56:19,320 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] allocating management threads: 1
2016-05-18 09:56:19,320 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] starting step: (1/3)
2016-05-18 09:56:19,425 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] submitted hadoop job: job_local1383972155_0010
2016-05-18 09:56:19,426 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] tracking url: http://localhost:8080/
2016-05-18 09:56:19,430 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/critics.txt
2016-05-18 09:56:19,448 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.1.0
2016-05-18 09:56:19,448 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-05-18 09:56:19,454 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AF261F27BEA54621B04668736963207E, ordinal: 0
2016-05-18 09:56:19,454 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line' | long, String]->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/critics.txt"]
2016-05-18 09:56:19,455 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(euclidean)[by:[{1}:'movie'][numSelfJoins:1]]
2016-05-18 09:56:19,455 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AF261F27BEA54621B04668736963207E, mem on start (mb), free: 179, total: 393, max: 672
2016-05-18 09:56:19,457 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AF261F27BEA54621B04668736963207E, mem on close (mb), free: 179, total: 393, max: 672
2016-05-18 09:56:19,470 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.1.0
2016-05-18 09:56:19,470 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-05-18 09:56:19,475 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: EB55BC6FE542400DB555F05A69966B2B, ordinal: 1
2016-05-18 09:56:19,476 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(euclidean)[by:[{1}:'movie'][numSelfJoins:1]]
2016-05-18 09:56:19,476 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2']]"][2668285189/euclidean/]
2016-05-18 09:56:19,476 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EB55BC6FE542400DB555F05A69966B2B, mem on start (mb), free: 172, total: 393, max: 672
2016-05-18 09:56:19,484 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 09:56:19,484 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 09:56:19,501 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: EB55BC6FE542400DB555F05A69966B2B, mem on close (mb), free: 170, total: 393, max: 672
2016-05-18 09:56:19,522 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] starting step: (2/3)
2016-05-18 09:56:19,639 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] submitted hadoop job: job_local822073731_0011
2016-05-18 09:56:19,640 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] tracking url: http://localhost:8080/
2016-05-18 09:56:19,644 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/2668285189_euclidean_FEA14E2BC2BC4D5FA805573069EE07F2/part-00000
2016-05-18 09:56:19,662 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.1.0
2016-05-18 09:56:19,662 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-05-18 09:56:19,668 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C072AB46EDD148E89264A0D613A39E0A, ordinal: 0
2016-05-18 09:56:19,668 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2']]"][2668285189/euclidean/]
2016-05-18 09:56:19,668 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{?}:ALL]]
2016-05-18 09:56:19,668 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C072AB46EDD148E89264A0D613A39E0A, mem on start (mb), free: 179, total: 393, max: 672
2016-05-18 09:56:19,676 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C072AB46EDD148E89264A0D613A39E0A, mem on close (mb), free: 179, total: 393, max: 672
2016-05-18 09:56:19,694 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.1.0
2016-05-18 09:56:19,694 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-05-18 09:56:19,700 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C623591E13C5427E92245A33898088B1, ordinal: 1
2016-05-18 09:56:19,701 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{?}:ALL]]
2016-05-18 09:56:19,701 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2', 'score']]"][4766289467/euclidean/]
2016-05-18 09:56:19,701 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C623591E13C5427E92245A33898088B1, mem on start (mb), free: 172, total: 393, max: 672
2016-05-18 09:56:19,724 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C623591E13C5427E92245A33898088B1, mem on close (mb), free: 169, total: 393, max: 672
2016-05-18 09:56:19,746 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] starting step: (3/3) ...anceShort/euclidean/short
2016-05-18 09:56:19,858 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] submitted hadoop job: job_local1071088354_0012
2016-05-18 09:56:19,858 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] tracking url: http://localhost:8080/
2016-05-18 09:56:19,863 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/4766289467_euclidean_0EDADCB859BC45EE845C3F09F23E9DEB/part-00000
2016-05-18 09:56:19,880 INFO hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.1.0
2016-05-18 09:56:19,881 INFO hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-05-18 09:56:19,886 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: EA9E79AAAB924DBB807521EFF907882D, ordinal: 0
2016-05-18 09:56:19,887 INFO hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2', 'score']]"][4766289467/euclidean/]
2016-05-18 09:56:19,887 INFO hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{2}:'name1', 'name2']]
2016-05-18 09:56:19,887 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EA9E79AAAB924DBB807521EFF907882D, mem on start (mb), free: 166, total: 380, max: 672
2016-05-18 09:56:19,894 INFO hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EA9E79AAAB924DBB807521EFF907882D, mem on close (mb), free: 166, total: 380, max: 672
2016-05-18 09:56:19,909 INFO hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.1.0
2016-05-18 09:56:19,909 INFO hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-05-18 09:56:19,916 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: C1FB5EAEED924F6491C94FE5169C2163, ordinal: 1
2016-05-18 09:56:19,917 INFO hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{2}:'name1', 'name2']]
2016-05-18 09:56:19,917 INFO hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceShort/euclidean/short"]
2016-05-18 09:56:19,917 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C1FB5EAEED924F6491C94FE5169C2163, mem on start (mb), free: 157, total: 380, max: 672
2016-05-18 09:56:19,931 INFO hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: C1FB5EAEED924F6491C94FE5169C2163, mem on close (mb), free: 155, total: 380, max: 672
2016-05-18 09:56:19,955 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceShort/euclidean/short/_temporary
2016-05-18 09:56:19,956 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [euclidean] completed in: 00:00.635
2016-05-18 09:56:20,004 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output//hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceShort/euclidean/short