Class cascading.DistanceUseCasePlatformTest

4

tests

0

failures

0

ignored

6.979s

duration

100%

successful

Tests

Test Duration Result
testEuclideanDistance 0.959s passed
testEuclideanDistanceComposite 4.073s passed
testEuclideanDistanceShort 0.846s passed
testPearsonDistanceComposite 1.101s passed

Standard output

2016-01-14 20:06:02,438 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 20:06:02,466 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.DistanceUseCasePlatformTest, with platform: hadoop2-mr1
2016-01-14 20:06:02,499 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(119)) - not using cluster
2016-01-14 20:06:03,100 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-01-14 20:06:03,281 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides: 
2016-01-14 20:06:03,417 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 20:06:03,420 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 20:06:03,531 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: E669A7F0D05044D3A52AC80278963D0A
2016-01-14 20:06:03,863 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.272
2016-01-14 20:06:03,868 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 6
2016-01-14 20:06:03,868 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 20:06:04,102 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 20:06:04,104 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting
2016-01-14 20:06:04,106 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/critics.txt"]
2016-01-14 20:06:04,107 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceComposite/euclidean/composite"]
2016-01-14 20:06:04,107 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  parallel execution of steps is enabled: false
2016-01-14 20:06:04,109 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  executing total steps: 3
2016-01-14 20:06:04,109 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  allocating management threads: 1
2016-01-14 20:06:04,110 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (1/3)
2016-01-14 20:06:04,700 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1419122951/.staging/job_local1419122951_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:04,713 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1419122951/.staging/job_local1419122951_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:04,903 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1419122951_0001/job_local1419122951_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:04,908 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1419122951_0001/job_local1419122951_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:04,915 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local1419122951_0001
2016-01-14 20:06:04,915 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2016-01-14 20:06:05,023 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/critics.txt
2016-01-14 20:06:05,189 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 20:06:05,189 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 20:06:05,208 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F65532EE1ED54215B6B901F606EC2E7F, ordinal: 0
2016-01-14 20:06:05,254 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/critics.txt"]
2016-01-14 20:06:05,254 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(euclidean)[by:[{1}:'l'][numSelfJoins:1]]
2016-01-14 20:06:05,255 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F65532EE1ED54215B6B901F606EC2E7F, mem on start (mb), free: 137, total: 281, max: 672
2016-01-14 20:06:05,267 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F65532EE1ED54215B6B901F606EC2E7F, mem on close (mb), free: 137, total: 281, max: 672
2016-01-14 20:06:05,380 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 20:06:05,380 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 20:06:05,400 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: ABD5E851304C48A5AB7D59F5C79DAE76, ordinal: 1
2016-01-14 20:06:05,403 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(euclidean)[by:[{1}:'l'][numSelfJoins:1]]
2016-01-14 20:06:05,403 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][7900767796/euclidean/]
2016-01-14 20:06:05,404 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ABD5E851304C48A5AB7D59F5C79DAE76, mem on start (mb), free: 125, total: 281, max: 672
2016-01-14 20:06:05,431 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 20:06:05,431 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 20:06:05,478 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: ABD5E851304C48A5AB7D59F5C79DAE76, mem on close (mb), free: 123, total: 281, max: 672
2016-01-14 20:06:05,518 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (2/3)
2016-01-14 20:06:05,626 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1482372653/.staging/job_local1482372653_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:05,628 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1482372653/.staging/job_local1482372653_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:05,710 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1482372653_0002/job_local1482372653_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:05,714 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1482372653_0002/job_local1482372653_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:05,715 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local1482372653_0002
2016-01-14 20:06:05,716 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2016-01-14 20:06:05,723 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/7900767796_euclidean_5FE573B5A49D4666B4A3F89779EB9923/part-00000
2016-01-14 20:06:05,836 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 20:06:05,837 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 20:06:05,849 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E1DA6003D9D14FB188843B7067B7292E, ordinal: 0
2016-01-14 20:06:05,850 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][7900767796/euclidean/]
2016-01-14 20:06:05,850 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{?}:ALL]]
2016-01-14 20:06:05,851 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E1DA6003D9D14FB188843B7067B7292E, mem on start (mb), free: 91, total: 382, max: 672
2016-01-14 20:06:05,876 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E1DA6003D9D14FB188843B7067B7292E, mem on close (mb), free: 91, total: 382, max: 672
2016-01-14 20:06:05,935 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 20:06:05,935 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 20:06:05,957 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B500633EC7BF41BD87B24721C8E6FB0B, ordinal: 1
2016-01-14 20:06:05,958 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{?}:ALL]]
2016-01-14 20:06:05,959 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][1284576704/euclidean/]
2016-01-14 20:06:05,959 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B500633EC7BF41BD87B24721C8E6FB0B, mem on start (mb), free: 86, total: 382, max: 672
2016-01-14 20:06:05,991 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B500633EC7BF41BD87B24721C8E6FB0B, mem on close (mb), free: 85, total: 382, max: 672
2016-01-14 20:06:06,016 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (3/3) ...osite/euclidean/composite
2016-01-14 20:06:06,158 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1203935827/.staging/job_local1203935827_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:06,161 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1203935827/.staging/job_local1203935827_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:06,255 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1203935827_0003/job_local1203935827_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:06,258 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1203935827_0003/job_local1203935827_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:06,259 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local1203935827_0003
2016-01-14 20:06:06,259 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2016-01-14 20:06:06,301 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/1284576704_euclidean_C624D804543047E29D98A3467A9EC757/part-00000
2016-01-14 20:06:06,340 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 20:06:06,341 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 20:06:06,363 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: CFFE0C69357B4E75B41DA24699505457, ordinal: 0
2016-01-14 20:06:06,364 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][1284576704/euclidean/]
2016-01-14 20:06:06,364 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{2}:'n1', 'n2']]
2016-01-14 20:06:06,364 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CFFE0C69357B4E75B41DA24699505457, mem on start (mb), free: 67, total: 382, max: 672
2016-01-14 20:06:06,376 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CFFE0C69357B4E75B41DA24699505457, mem on close (mb), free: 67, total: 382, max: 672
2016-01-14 20:06:06,407 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 20:06:06,407 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 20:06:06,419 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CDB946A731A94811B5FBF1DEC3991ECE, ordinal: 1
2016-01-14 20:06:06,420 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{2}:'n1', 'n2']]
2016-01-14 20:06:06,421 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceComposite/euclidean/composite"]
2016-01-14 20:06:06,421 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CDB946A731A94811B5FBF1DEC3991ECE, mem on start (mb), free: 62, total: 382, max: 672
2016-01-14 20:06:06,446 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CDB946A731A94811B5FBF1DEC3991ECE, mem on close (mb), free: 61, total: 382, max: 672
2016-01-14 20:06:06,485 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceComposite/euclidean/composite/_temporary
2016-01-14 20:06:06,486 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  completed in: 00:02.378
2016-01-14 20:06:06,568 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceComposite/euclidean/composite
2016-01-14 20:06:06,592 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 20:06:06,593 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 20:06:06,734 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.133
2016-01-14 20:06:06,736 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 6
2016-01-14 20:06:06,737 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 20:06:06,807 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] starting
2016-01-14 20:06:06,807 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/critics.txt"]
2016-01-14 20:06:06,807 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson]  sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testPearsonDistanceComposite/pearson/composite"]
2016-01-14 20:06:06,808 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson]  parallel execution of steps is enabled: false
2016-01-14 20:06:06,808 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson]  executing total steps: 3
2016-01-14 20:06:06,809 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson]  allocating management threads: 1
2016-01-14 20:06:06,810 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] starting step: (1/3)
2016-01-14 20:06:06,877 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity829115626/.staging/job_local829115626_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:06,878 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity829115626/.staging/job_local829115626_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:06,935 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local829115626_0004/job_local829115626_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:06,936 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local829115626_0004/job_local829115626_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:06,937 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] submitted hadoop job: job_local829115626_0004
2016-01-14 20:06:06,938 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] tracking url: http://localhost:8080/
2016-01-14 20:06:06,946 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/critics.txt
2016-01-14 20:06:06,986 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 20:06:06,986 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 20:06:06,997 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C19D072707454ECC84179BF449029174, ordinal: 0
2016-01-14 20:06:06,999 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/critics.txt"]
2016-01-14 20:06:06,999 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(pearson)[by:[{1}:'l'][numSelfJoins:1]]
2016-01-14 20:06:06,999 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C19D072707454ECC84179BF449029174, mem on start (mb), free: 129, total: 498, max: 672
2016-01-14 20:06:07,003 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C19D072707454ECC84179BF449029174, mem on close (mb), free: 129, total: 498, max: 672
2016-01-14 20:06:07,024 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 20:06:07,024 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 20:06:07,035 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F818C074468B4C588F33D15D32115E19, ordinal: 1
2016-01-14 20:06:07,037 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(pearson)[by:[{1}:'l'][numSelfJoins:1]]
2016-01-14 20:06:07,038 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][3768952305/pearson/]
2016-01-14 20:06:07,038 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F818C074468B4C588F33D15D32115E19, mem on start (mb), free: 120, total: 498, max: 672
2016-01-14 20:06:07,044 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 20:06:07,044 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 20:06:07,072 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F818C074468B4C588F33D15D32115E19, mem on close (mb), free: 118, total: 498, max: 672
2016-01-14 20:06:07,092 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] starting step: (2/3)
2016-01-14 20:06:07,178 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1822153473/.staging/job_local1822153473_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:07,181 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1822153473/.staging/job_local1822153473_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:07,247 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1822153473_0005/job_local1822153473_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:07,248 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1822153473_0005/job_local1822153473_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:07,249 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] submitted hadoop job: job_local1822153473_0005
2016-01-14 20:06:07,249 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] tracking url: http://localhost:8080/
2016-01-14 20:06:07,258 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/3768952305_pearson_3CD2551ADCD140B18B5D846692C0AA2E/part-00000
2016-01-14 20:06:07,291 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 20:06:07,291 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 20:06:07,300 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E77A8E3DFA8947498DF054F72A4E7917, ordinal: 0
2016-01-14 20:06:07,301 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][3768952305/pearson/]
2016-01-14 20:06:07,301 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(pearson)[by:[{?}:ALL]]
2016-01-14 20:06:07,301 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E77A8E3DFA8947498DF054F72A4E7917, mem on start (mb), free: 183, total: 497, max: 672
2016-01-14 20:06:07,313 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E77A8E3DFA8947498DF054F72A4E7917, mem on close (mb), free: 183, total: 497, max: 672
2016-01-14 20:06:07,338 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 20:06:07,338 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 20:06:07,346 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A5425E11062E4227882F7AC343F37170, ordinal: 1
2016-01-14 20:06:07,347 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(pearson)[by:[{?}:ALL]]
2016-01-14 20:06:07,347 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][3403975347/pearson/]
2016-01-14 20:06:07,347 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A5425E11062E4227882F7AC343F37170, mem on start (mb), free: 175, total: 497, max: 672
2016-01-14 20:06:07,370 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A5425E11062E4227882F7AC343F37170, mem on close (mb), free: 173, total: 497, max: 672
2016-01-14 20:06:07,389 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] starting step: (3/3) ...mposite/pearson/composite
2016-01-14 20:06:07,457 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1818406068/.staging/job_local1818406068_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:07,458 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1818406068/.staging/job_local1818406068_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:07,494 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1818406068_0006/job_local1818406068_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:07,495 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1818406068_0006/job_local1818406068_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:07,495 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] submitted hadoop job: job_local1818406068_0006
2016-01-14 20:06:07,496 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson] tracking url: http://localhost:8080/
2016-01-14 20:06:07,503 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/3403975347_pearson_E05802EAB6C24E92867C395830B4652B/part-00000
2016-01-14 20:06:07,529 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 20:06:07,529 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 20:06:07,538 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AAF7C0F0074D4B3EB4A47665B08CA092, ordinal: 0
2016-01-14 20:06:07,538 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['l', 'n1', 'v1', 'n2', 'v2']]"][3403975347/pearson/]
2016-01-14 20:06:07,538 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(pearson)[by:[{2}:'n1', 'n2']]
2016-01-14 20:06:07,539 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AAF7C0F0074D4B3EB4A47665B08CA092, mem on start (mb), free: 180, total: 493, max: 672
2016-01-14 20:06:07,545 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AAF7C0F0074D4B3EB4A47665B08CA092, mem on close (mb), free: 180, total: 493, max: 672
2016-01-14 20:06:07,563 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 20:06:07,563 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 20:06:07,571 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E9CA69AEDEF3434DBBE8DAFA1C2ECA5A, ordinal: 1
2016-01-14 20:06:07,572 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(pearson)[by:[{2}:'n1', 'n2']]
2016-01-14 20:06:07,572 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testPearsonDistanceComposite/pearson/composite"]
2016-01-14 20:06:07,572 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E9CA69AEDEF3434DBBE8DAFA1C2ECA5A, mem on start (mb), free: 173, total: 493, max: 672
2016-01-14 20:06:07,597 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E9CA69AEDEF3434DBBE8DAFA1C2ECA5A, mem on close (mb), free: 171, total: 493, max: 672
2016-01-14 20:06:07,617 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testPearsonDistanceComposite/pearson/composite/_temporary
2016-01-14 20:06:07,618 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pearson]  completed in: 00:00.808
2016-01-14 20:06:07,671 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/distanceusecaseplatform/testPearsonDistanceComposite/pearson/composite
2016-01-14 20:06:07,694 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 20:06:07,695 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 20:06:07,797 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.096
2016-01-14 20:06:07,800 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 6
2016-01-14 20:06:07,800 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 20:06:07,853 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting
2016-01-14 20:06:07,853 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/critics.txt"]
2016-01-14 20:06:07,854 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistance/euclidean/long"]
2016-01-14 20:06:07,854 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  parallel execution of steps is enabled: false
2016-01-14 20:06:07,855 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  executing total steps: 3
2016-01-14 20:06:07,855 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  allocating management threads: 1
2016-01-14 20:06:07,855 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (1/3)
2016-01-14 20:06:07,919 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity869814688/.staging/job_local869814688_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:07,920 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity869814688/.staging/job_local869814688_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:07,968 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local869814688_0007/job_local869814688_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:07,969 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local869814688_0007/job_local869814688_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:07,970 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local869814688_0007
2016-01-14 20:06:07,970 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2016-01-14 20:06:07,976 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/critics.txt
2016-01-14 20:06:08,013 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 20:06:08,014 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 20:06:08,025 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E6BECAA61E7D44CDA89E38CA81B84A55, ordinal: 0
2016-01-14 20:06:08,026 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/critics.txt"]
2016-01-14 20:06:08,027 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(euclidean)[by:[{1}:'movie'][numSelfJoins:1]]
2016-01-14 20:06:08,027 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E6BECAA61E7D44CDA89E38CA81B84A55, mem on start (mb), free: 172, total: 485, max: 672
2016-01-14 20:06:08,033 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E6BECAA61E7D44CDA89E38CA81B84A55, mem on close (mb), free: 172, total: 485, max: 672
2016-01-14 20:06:08,057 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 20:06:08,057 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 20:06:08,068 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: FCA7718F28A94EC986908AA7D0E194D1, ordinal: 1
2016-01-14 20:06:08,069 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(euclidean)[by:[{1}:'movie'][numSelfJoins:1]]
2016-01-14 20:06:08,069 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2']]"][1144367786/euclidean/]
2016-01-14 20:06:08,069 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FCA7718F28A94EC986908AA7D0E194D1, mem on start (mb), free: 164, total: 485, max: 672
2016-01-14 20:06:08,077 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 20:06:08,077 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 20:06:08,107 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: FCA7718F28A94EC986908AA7D0E194D1, mem on close (mb), free: 163, total: 485, max: 672
2016-01-14 20:06:08,136 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (2/3)
2016-01-14 20:06:08,219 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1691874517/.staging/job_local1691874517_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:08,220 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1691874517/.staging/job_local1691874517_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:08,255 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1691874517_0008/job_local1691874517_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:08,256 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1691874517_0008/job_local1691874517_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:08,257 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local1691874517_0008
2016-01-14 20:06:08,257 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2016-01-14 20:06:08,262 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/1144367786_euclidean_0F81D1CFE86142089A50FFFC1D229A96/part-00000
2016-01-14 20:06:08,282 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 20:06:08,282 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 20:06:08,289 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E2CA52B487DC47DB8138E04953AB8789, ordinal: 0
2016-01-14 20:06:08,289 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2']]"][1144367786/euclidean/]
2016-01-14 20:06:08,290 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{?}:ALL]]
2016-01-14 20:06:08,290 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E2CA52B487DC47DB8138E04953AB8789, mem on start (mb), free: 180, total: 493, max: 672
2016-01-14 20:06:08,300 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E2CA52B487DC47DB8138E04953AB8789, mem on close (mb), free: 180, total: 493, max: 672
2016-01-14 20:06:08,323 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 20:06:08,323 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 20:06:08,330 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: AD45B9F2812242E8982278651EFF0394, ordinal: 1
2016-01-14 20:06:08,331 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{?}:ALL]]
2016-01-14 20:06:08,331 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2', 'score']]"][1004901679/euclidean/]
2016-01-14 20:06:08,332 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AD45B9F2812242E8982278651EFF0394, mem on start (mb), free: 172, total: 493, max: 672
2016-01-14 20:06:08,362 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AD45B9F2812242E8982278651EFF0394, mem on close (mb), free: 168, total: 493, max: 672
2016-01-14 20:06:08,378 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (3/3) ...anDistance/euclidean/long
2016-01-14 20:06:08,443 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity191877506/.staging/job_local191877506_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:08,444 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity191877506/.staging/job_local191877506_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:08,478 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local191877506_0009/job_local191877506_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:08,479 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local191877506_0009/job_local191877506_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:08,480 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local191877506_0009
2016-01-14 20:06:08,480 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2016-01-14 20:06:08,486 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/1004901679_euclidean_8CD5262D7B994B07A79AB7D968962365/part-00000
2016-01-14 20:06:08,506 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 20:06:08,507 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 20:06:08,514 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: E23E23A5923E4DE5BADB70A1AD999E1E, ordinal: 0
2016-01-14 20:06:08,514 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2', 'score']]"][1004901679/euclidean/]
2016-01-14 20:06:08,514 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{2}:'name1', 'name2']]
2016-01-14 20:06:08,515 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E23E23A5923E4DE5BADB70A1AD999E1E, mem on start (mb), free: 181, total: 493, max: 672
2016-01-14 20:06:08,521 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: E23E23A5923E4DE5BADB70A1AD999E1E, mem on close (mb), free: 181, total: 493, max: 672
2016-01-14 20:06:08,539 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 20:06:08,539 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 20:06:08,547 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E9BDDBD462D3498DABA5F9C2EA10C0A9, ordinal: 1
2016-01-14 20:06:08,548 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{2}:'name1', 'name2']]
2016-01-14 20:06:08,548 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistance/euclidean/long"]
2016-01-14 20:06:08,548 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E9BDDBD462D3498DABA5F9C2EA10C0A9, mem on start (mb), free: 173, total: 493, max: 672
2016-01-14 20:06:08,562 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E9BDDBD462D3498DABA5F9C2EA10C0A9, mem on close (mb), free: 172, total: 493, max: 672
2016-01-14 20:06:08,583 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistance/euclidean/long/_temporary
2016-01-14 20:06:08,585 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  completed in: 00:00.728
2016-01-14 20:06:08,630 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/distanceusecaseplatform/testEuclideanDistance/euclidean/long
2016-01-14 20:06:08,648 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 20:06:08,649 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 20:06:08,728 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.075
2016-01-14 20:06:08,730 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 6
2016-01-14 20:06:08,730 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 20:06:08,784 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting
2016-01-14 20:06:08,785 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/critics.txt"]
2016-01-14 20:06:08,785 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceShort/euclidean/short"]
2016-01-14 20:06:08,785 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  parallel execution of steps is enabled: false
2016-01-14 20:06:08,785 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  executing total steps: 3
2016-01-14 20:06:08,785 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  allocating management threads: 1
2016-01-14 20:06:08,786 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (1/3)
2016-01-14 20:06:08,858 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity2103663619/.staging/job_local2103663619_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:08,859 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity2103663619/.staging/job_local2103663619_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:08,896 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2103663619_0010/job_local2103663619_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:08,897 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2103663619_0010/job_local2103663619_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:08,898 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local2103663619_0010
2016-01-14 20:06:08,898 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2016-01-14 20:06:08,904 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/critics.txt
2016-01-14 20:06:08,924 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 20:06:08,925 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 20:06:08,930 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: C5C1A31D7AAC4B49B4A3E1BED3017571, ordinal: 0
2016-01-14 20:06:08,931 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/critics.txt"]
2016-01-14 20:06:08,931 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: CoGroup(euclidean)[by:[{1}:'movie'][numSelfJoins:1]]
2016-01-14 20:06:08,931 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C5C1A31D7AAC4B49B4A3E1BED3017571, mem on start (mb), free: 180, total: 493, max: 672
2016-01-14 20:06:08,934 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: C5C1A31D7AAC4B49B4A3E1BED3017571, mem on close (mb), free: 180, total: 493, max: 672
2016-01-14 20:06:08,952 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 20:06:08,952 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 20:06:08,957 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: F7F853BE60D64A7EA0135DC3D2DDBF6F, ordinal: 1
2016-01-14 20:06:08,958 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: CoGroup(euclidean)[by:[{1}:'movie'][numSelfJoins:1]]
2016-01-14 20:06:08,958 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2']]"][1833556149/euclidean/]
2016-01-14 20:06:08,959 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F7F853BE60D64A7EA0135DC3D2DDBF6F, mem on start (mb), free: 174, total: 493, max: 672
2016-01-14 20:06:08,964 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 20:06:08,964 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-01-14 20:06:08,988 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: F7F853BE60D64A7EA0135DC3D2DDBF6F, mem on close (mb), free: 172, total: 493, max: 672
2016-01-14 20:06:09,013 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (2/3)
2016-01-14 20:06:09,094 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity955789335/.staging/job_local955789335_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:09,097 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity955789335/.staging/job_local955789335_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:09,132 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local955789335_0011/job_local955789335_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:09,133 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local955789335_0011/job_local955789335_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:09,133 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local955789335_0011
2016-01-14 20:06:09,134 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2016-01-14 20:06:09,138 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/1833556149_euclidean_F5AF7FBD165E47DDAEDFA920F854676B/part-00000
2016-01-14 20:06:09,157 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 20:06:09,157 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 20:06:09,163 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: AA0E19E308914CBDB37A5EAB4A4A7AF6, ordinal: 0
2016-01-14 20:06:09,164 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2']]"][1833556149/euclidean/]
2016-01-14 20:06:09,164 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{?}:ALL]]
2016-01-14 20:06:09,164 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AA0E19E308914CBDB37A5EAB4A4A7AF6, mem on start (mb), free: 180, total: 493, max: 672
2016-01-14 20:06:09,172 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: AA0E19E308914CBDB37A5EAB4A4A7AF6, mem on close (mb), free: 180, total: 493, max: 672
2016-01-14 20:06:09,193 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 20:06:09,193 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 20:06:09,200 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: AFCCC581DBCA49FA8705CC9FCEE1E58F, ordinal: 1
2016-01-14 20:06:09,201 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{?}:ALL]]
2016-01-14 20:06:09,201 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2', 'score']]"][7545305553/euclidean/]
2016-01-14 20:06:09,201 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AFCCC581DBCA49FA8705CC9FCEE1E58F, mem on start (mb), free: 174, total: 493, max: 672
2016-01-14 20:06:09,221 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: AFCCC581DBCA49FA8705CC9FCEE1E58F, mem on close (mb), free: 172, total: 493, max: 672
2016-01-14 20:06:09,244 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] starting step: (3/3) ...anceShort/euclidean/short
2016-01-14 20:06:09,307 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1657283764/.staging/job_local1657283764_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:09,308 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/tmp/cascading/staging/teamcity1657283764/.staging/job_local1657283764_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:09,341 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1657283764_0012/job_local1657283764_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 20:06:09,342 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1657283764_0012/job_local1657283764_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 20:06:09,343 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] submitted hadoop job: job_local1657283764_0012
2016-01-14 20:06:09,343 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean] tracking url: http://localhost:8080/
2016-01-14 20:06:09,349 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/7545305553_euclidean_0C8966D224D84158AB7629261E23E50C/part-00000
2016-01-14 20:06:09,369 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 20:06:09,369 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 20:06:09,375 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: EBADE7B520534B2F9DF38E93A1C70713, ordinal: 0
2016-01-14 20:06:09,375 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: TempHfs["SequenceFile[['movie', 'name1', 'rate1', 'name2', 'rate2', 'score']]"][7545305553/euclidean/]
2016-01-14 20:06:09,376 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(euclidean)[by:[{2}:'name1', 'name2']]
2016-01-14 20:06:09,376 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EBADE7B520534B2F9DF38E93A1C70713, mem on start (mb), free: 180, total: 493, max: 672
2016-01-14 20:06:09,380 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: EBADE7B520534B2F9DF38E93A1C70713, mem on close (mb), free: 180, total: 493, max: 672
2016-01-14 20:06:09,395 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 20:06:09,395 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 20:06:09,401 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: B41DEEBEA2394F0CAFB6048848B62039, ordinal: 1
2016-01-14 20:06:09,402 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(euclidean)[by:[{2}:'name1', 'name2']]
2016-01-14 20:06:09,403 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceShort/euclidean/short"]
2016-01-14 20:06:09,403 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B41DEEBEA2394F0CAFB6048848B62039, mem on start (mb), free: 174, total: 493, max: 672
2016-01-14 20:06:09,415 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: B41DEEBEA2394F0CAFB6048848B62039, mem on close (mb), free: 173, total: 493, max: 672
2016-01-14 20:06:09,432 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceShort/euclidean/short/_temporary
2016-01-14 20:06:09,432 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [euclidean]  completed in: 00:00.647
2016-01-14 20:06:09,476 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/distanceusecaseplatform/testEuclideanDistanceShort/euclidean/short