Class cascading.tuple.hadoop.SpillableTupleHadoopTest

4

tests

0

failures

0

ignored

1.134s

duration

100%

successful

Tests

Test Duration Result
testSpillList 0.649s passed
testSpillListCompressed 0.220s passed
testSpillMap 0.195s passed
testSpillMapCompressed 0.070s passed

Standard output

2014-04-10 11:32:38,125 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2014-04-10 11:32:38,191 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2014-04-10 11:32:38,196 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2014-04-10 11:32:38,202 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2014-04-10 11:32:38,207 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2014-04-10 11:32:38,213 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2014-04-10 11:32:38,218 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2014-04-10 11:32:38,224 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2014-04-10 11:32:38,230 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2014-04-10 11:32:38,235 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2014-04-10 11:32:38,299 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2014-04-10 11:32:38,304 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2014-04-10 11:32:38,309 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2014-04-10 11:32:38,314 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2014-04-10 11:32:38,319 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2014-04-10 11:32:38,324 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2014-04-10 11:32:38,330 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2014-04-10 11:32:38,336 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2014-04-10 11:32:38,341 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2014-04-10 11:32:38,390 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2014-04-10 11:32:38,394 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2014-04-10 11:32:38,399 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2014-04-10 11:32:38,403 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2014-04-10 11:32:38,408 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2014-04-10 11:32:38,412 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2014-04-10 11:32:38,417 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2014-04-10 11:32:38,421 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2014-04-10 11:32:38,425 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2014-04-10 11:32:38,429 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 10
time = 647
2014-04-10 11:32:38,473 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-10 11:32:38,474 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-10 11:32:38,477 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-10 11:32:38,477 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-10 11:32:38,478 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2014-04-10 11:32:38,496 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-04-10 11:32:38,496 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,500 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2014-04-10 11:32:38,500 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,503 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2014-04-10 11:32:38,503 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,506 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2014-04-10 11:32:38,506 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,508 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2014-04-10 11:32:38,508 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,511 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 4
2014-04-10 11:32:38,511 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,514 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2014-04-10 11:32:38,514 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,517 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2014-04-10 11:32:38,517 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,520 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 5
2014-04-10 11:32:38,520 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,522 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2014-04-10 11:32:38,522 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,523 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-10 11:32:38,524 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-10 11:32:38,526 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-04-10 11:32:38,527 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,528 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-04-10 11:32:38,528 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,529 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-04-10 11:32:38,529 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,530 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-04-10 11:32:38,530 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,531 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-04-10 11:32:38,531 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,532 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-04-10 11:32:38,532 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,533 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-04-10 11:32:38,533 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,534 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-04-10 11:32:38,534 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,535 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-04-10 11:32:38,535 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,536 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-10 11:32:38,536 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
time = 195
2014-04-10 11:32:38,665 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-10 11:32:38,665 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-10 11:32:38,665 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-10 11:32:38,665 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-10 11:32:38,665 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2014-04-10 11:32:38,666 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,667 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2014-04-10 11:32:38,667 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,668 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2014-04-10 11:32:38,668 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,669 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2014-04-10 11:32:38,669 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,669 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2014-04-10 11:32:38,670 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,670 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 4
2014-04-10 11:32:38,671 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,671 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2014-04-10 11:32:38,671 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,672 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2014-04-10 11:32:38,672 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,673 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 5
2014-04-10 11:32:38,673 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,674 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2014-04-10 11:32:38,674 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,675 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-10 11:32:38,675 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-10 11:32:38,676 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-04-10 11:32:38,676 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,676 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-04-10 11:32:38,676 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,677 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-04-10 11:32:38,677 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,678 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-04-10 11:32:38,678 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,678 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-04-10 11:32:38,678 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,679 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-04-10 11:32:38,679 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,680 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-04-10 11:32:38,680 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,680 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-04-10 11:32:38,680 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,681 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-04-10 11:32:38,681 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,682 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-10 11:32:38,682 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
time = 70
2014-04-10 11:32:38,771 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2014-04-10 11:32:38,771 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,774 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,788 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,798 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2014-04-10 11:32:38,798 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,800 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2014-04-10 11:32:38,800 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,801 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2014-04-10 11:32:38,802 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,803 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2014-04-10 11:32:38,803 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,805 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2014-04-10 11:32:38,805 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,806 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2014-04-10 11:32:38,807 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,808 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2014-04-10 11:32:38,808 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,810 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2014-04-10 11:32:38,810 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,812 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2014-04-10 11:32:38,812 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,813 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,819 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,824 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,829 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,834 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,838 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,842 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,846 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,850 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,854 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,863 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2014-04-10 11:32:38,864 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,865 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2014-04-10 11:32:38,865 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,867 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2014-04-10 11:32:38,867 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,868 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2014-04-10 11:32:38,869 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,870 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2014-04-10 11:32:38,870 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,872 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2014-04-10 11:32:38,872 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,873 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2014-04-10 11:32:38,873 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,875 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2014-04-10 11:32:38,875 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,876 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2014-04-10 11:32:38,877 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,878 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,881 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,884 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,886 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,889 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,891 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,894 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,896 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,898 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,900 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,909 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2014-04-10 11:32:38,909 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,911 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2014-04-10 11:32:38,911 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,912 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2014-04-10 11:32:38,912 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,914 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2014-04-10 11:32:38,914 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,915 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2014-04-10 11:32:38,916 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,917 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2014-04-10 11:32:38,917 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,919 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2014-04-10 11:32:38,919 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,920 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2014-04-10 11:32:38,920 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,922 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2014-04-10 11:32:38,922 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,923 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 10
2014-04-10 11:32:38,923 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-04-10 11:32:38,925 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,927 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,929 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,931 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,933 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,935 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,937 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,939 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,941 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,943 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-04-10 11:32:38,946 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
time = 206