2015-02-10 12:00:00,835 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-02-10 12:00:00,891 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop
2015-02-10 12:00:00,891 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.flow.FlowStrategiesPlatformTest
2015-02-10 12:00:00,921 INFO hadoop.HadoopPlatform (HadoopPlatform.java:setUp(112)) - not using cluster
2015-02-10 12:00:01,319 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 12:00:01,320 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 12:00:01,333 INFO property.AppProps (AppProps.java:getAppID(169)) - using app.id: 629810E40616432DA0D46CA70A34C2D6
2015-02-10 12:00:01,495 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] at least one sink is marked for delete
2015-02-10 12:00:01,501 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2015-02-10 12:00:01,503 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] at least one sink is marked for delete
2015-02-10 12:00:01,503 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2015-02-10 12:00:01,564 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.6.3
2015-02-10 12:00:01,567 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting
2015-02-10 12:00:01,568 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/classes/test/data/apache.10.txt"]
2015-02-10 12:00:01,568 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/test/output/hadoop/flowstrategiesplatform/replace"]
2015-02-10 12:00:01,568 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] parallel execution is enabled: false
2015-02-10 12:00:01,570 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting jobs: 1
2015-02-10 12:00:01,570 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] allocating threads: 1
2015-02-10 12:00:01,572 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...trategiesplatform/replace
2015-02-10 12:00:01,619 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(52)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-02-10 12:00:01,670 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 12:00:01,889 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local_0001
2015-02-10 12:00:01,891 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2015-02-10 12:00:01,954 INFO util.ProcessTree (ProcessTree.java:isSetsidSupported(63)) - setsid exited with exit code 0
2015-02-10 12:00:01,963 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3ea86d12
2015-02-10 12:00:01,974 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/classes/test/data/apache.10.txt
2015-02-10 12:00:01,981 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2015-02-10 12:00:01,992 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 12:00:01,992 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 12:00:02,055 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/classes/test/data/apache.10.txt"]
2015-02-10 12:00:02,055 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/test/output/hadoop/flowstrategiesplatform/replace"]
2015-02-10 12:00:02,068 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
2015-02-10 12:00:02,071 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2015-02-10 12:00:02,072 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0001_m_000000_0 is allowed to commit now
2015-02-10 12:00:02,077 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0001_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/test/output/hadoop/flowstrategiesplatform/replace
2015-02-10 12:00:04,937 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/classes/test/data/apache.10.txt:0+1449
2015-02-10 12:00:04,938 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0001_m_000000_0' done.
2015-02-10 12:00:04,956 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/test/output/hadoop/flowstrategiesplatform/replace/_temporary
2015-02-10 12:00:04,957 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] at least one sink is marked for delete
2015-02-10 12:00:04,957 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2015-02-10 12:00:04,958 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] at least one sink is marked for delete
2015-02-10 12:00:04,958 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2015-02-10 12:00:04,991 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 12:00:05,017 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 12:00:05,019 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/test/output//hadoop/flowstrategiesplatform/replace
2015-02-10 12:00:05,048 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 12:00:05,049 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 12:00:05,072 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] at least one sink does not exist
2015-02-10 12:00:05,074 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] at least one sink does not exist
2015-02-10 12:00:05,076 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting
2015-02-10 12:00:05,077 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/classes/test/data/apache.10.txt"]
2015-02-10 12:00:05,077 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/test/output/hadoop/flowstrategiesplatform/keep"]
2015-02-10 12:00:05,077 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] parallel execution is enabled: false
2015-02-10 12:00:05,078 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting jobs: 1
2015-02-10 12:00:05,078 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] allocating threads: 1
2015-02-10 12:00:05,079 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...owstrategiesplatform/keep
2015-02-10 12:00:05,096 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 12:00:05,180 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local_0002
2015-02-10 12:00:05,180 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2015-02-10 12:00:05,187 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5893bca2
2015-02-10 12:00:05,189 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/classes/test/data/apache.10.txt
2015-02-10 12:00:05,190 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2015-02-10 12:00:05,197 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 12:00:05,197 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 12:00:05,210 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/classes/test/data/apache.10.txt"]
2015-02-10 12:00:05,210 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/test/output/hadoop/flowstrategiesplatform/keep"]
2015-02-10 12:00:05,213 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0002_m_000000_0 is done. And is in the process of commiting
2015-02-10 12:00:05,214 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2015-02-10 12:00:05,215 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0002_m_000000_0 is allowed to commit now
2015-02-10 12:00:05,220 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0002_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/test/output/hadoop/flowstrategiesplatform/keep
2015-02-10 12:00:08,187 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/classes/test/data/apache.10.txt:0+1449
2015-02-10 12:00:08,188 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0002_m_000000_0' done.
2015-02-10 12:00:08,199 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/test/output/hadoop/flowstrategiesplatform/keep/_temporary
2015-02-10 12:00:08,204 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink oldest modified date: Tue Feb 10 12:00:08 UTC 2015
2015-02-10 12:00:08,208 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] source modification date at: Tue Feb 10 10:05:33 UTC 2015
2015-02-10 12:00:08,211 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink oldest modified date: Tue Feb 10 12:00:08 UTC 2015
2015-02-10 12:00:08,231 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 12:00:08,253 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 12:00:08,255 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/test/output//hadoop/flowstrategiesplatform/keep
2015-02-10 12:00:08,283 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 12:00:08,284 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 12:00:08,326 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting
2015-02-10 12:00:08,327 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/classes/test/data/apache.10.txt"]
2015-02-10 12:00:08,327 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/test/output/hadoop/flowstrategiesplatform/simple"]
2015-02-10 12:00:08,327 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] parallel execution is enabled: false
2015-02-10 12:00:08,327 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting jobs: 1
2015-02-10 12:00:08,328 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] allocating threads: 1
2015-02-10 12:00:08,328 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...strategiesplatform/simple
2015-02-10 12:00:08,349 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 12:00:08,416 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local_0003
2015-02-10 12:00:08,416 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2015-02-10 12:00:08,422 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@63a1bc40
2015-02-10 12:00:08,424 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/classes/test/data/apache.10.txt
2015-02-10 12:00:08,426 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 12:00:08,435 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 12:00:08,575 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 12:00:08,576 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 12:00:08,596 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 12:00:08,596 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 12:00:08,617 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/classes/test/data/apache.10.txt"]
2015-02-10 12:00:08,618 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(test)[by:[{1}:'ip']]
2015-02-10 12:00:08,623 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 12:00:08,636 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 12:00:08,639 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0003_m_000000_0 is done. And is in the process of commiting
2015-02-10 12:00:11,422 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/classes/test/data/apache.10.txt:0+1449
2015-02-10 12:00:11,423 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0003_m_000000_0' done.
2015-02-10 12:00:11,457 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4b7361e2
2015-02-10 12:00:11,458 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2015-02-10 12:00:11,464 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 12:00:11,469 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 232 bytes
2015-02-10 12:00:11,469 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2015-02-10 12:00:11,471 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 12:00:11,471 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 12:00:11,490 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(test)[by:[{1}:'ip']]
2015-02-10 12:00:11,490 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/test/output/hadoop/flowstrategiesplatform/simple"]
2015-02-10 12:00:11,506 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0003_r_000000_0 is done. And is in the process of commiting
2015-02-10 12:00:11,507 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2015-02-10 12:00:11,508 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0003_r_000000_0 is allowed to commit now
2015-02-10 12:00:11,512 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0003_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/test/output/hadoop/flowstrategiesplatform/simple
2015-02-10 12:00:14,457 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2015-02-10 12:00:14,458 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0003_r_000000_0' done.
2015-02-10 12:00:14,470 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/test/output/hadoop/flowstrategiesplatform/simple/_temporary
2015-02-10 12:00:14,482 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 12:00:14,484 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-0.20.205.0/build/test/output//hadoop/flowstrategiesplatform/simple