Class cascading.tuple.hadoop.SpillableTupleHadoopTest

4

tests

0

failures

3.001s

duration

100%

successful

Tests

Test Duration Result
testSpillList 1.955s passed
testSpillListCompressed 0.476s passed
testSpillMap 0.457s passed
testSpillMapCompressed 0.113s passed

Standard output

2015-02-10 18:34:45,934 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-02-10 18:34:46,101 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-02-10 18:34:46,126 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2015-02-10 18:34:46,150 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2015-02-10 18:34:46,175 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2015-02-10 18:34:46,201 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2015-02-10 18:34:46,225 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2015-02-10 18:34:46,250 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2015-02-10 18:34:46,274 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2015-02-10 18:34:46,299 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2015-02-10 18:34:46,498 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-02-10 18:34:46,522 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2015-02-10 18:34:46,545 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2015-02-10 18:34:46,567 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2015-02-10 18:34:46,590 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2015-02-10 18:34:46,613 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2015-02-10 18:34:46,637 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2015-02-10 18:34:46,660 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2015-02-10 18:34:46,682 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2015-02-10 18:34:46,858 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-02-10 18:34:46,879 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2015-02-10 18:34:46,900 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2015-02-10 18:34:46,922 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2015-02-10 18:34:46,944 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2015-02-10 18:34:46,965 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2015-02-10 18:34:46,987 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2015-02-10 18:34:47,010 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2015-02-10 18:34:47,030 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2015-02-10 18:34:47,050 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 10
time = 1953
2015-02-10 18:34:47,211 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 18:34:47,212 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 18:34:47,217 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 18:34:47,218 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 18:34:47,219 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2015-02-10 18:34:47,266 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-02-10 18:34:47,266 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,276 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2015-02-10 18:34:47,277 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,282 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2015-02-10 18:34:47,282 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,288 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2015-02-10 18:34:47,289 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,293 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2015-02-10 18:34:47,294 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,300 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 4
2015-02-10 18:34:47,300 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,305 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2015-02-10 18:34:47,306 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,313 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2015-02-10 18:34:47,314 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,321 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 5
2015-02-10 18:34:47,321 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,328 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2015-02-10 18:34:47,329 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,336 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 18:34:47,336 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 18:34:47,343 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-10 18:34:47,343 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,348 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-10 18:34:47,348 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,352 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-10 18:34:47,353 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,356 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-10 18:34:47,356 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,360 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-10 18:34:47,360 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,363 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-10 18:34:47,364 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,366 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-10 18:34:47,366 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,368 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-10 18:34:47,368 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,370 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-10 18:34:47,370 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,372 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 18:34:47,373 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
time = 457
2015-02-10 18:34:47,661 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 18:34:47,662 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 18:34:47,662 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 18:34:47,663 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 18:34:47,663 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2015-02-10 18:34:47,664 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,666 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2015-02-10 18:34:47,667 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,668 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2015-02-10 18:34:47,669 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,670 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2015-02-10 18:34:47,671 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,675 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2015-02-10 18:34:47,675 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,677 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 4
2015-02-10 18:34:47,677 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,679 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2015-02-10 18:34:47,679 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,681 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2015-02-10 18:34:47,682 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,683 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 5
2015-02-10 18:34:47,684 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,685 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2015-02-10 18:34:47,686 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,688 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 18:34:47,688 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 18:34:47,689 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-10 18:34:47,689 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,691 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-10 18:34:47,691 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,692 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-10 18:34:47,693 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,694 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-10 18:34:47,694 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,695 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-10 18:34:47,696 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,696 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-10 18:34:47,697 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,698 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-10 18:34:47,698 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,699 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-10 18:34:47,700 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,701 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-10 18:34:47,701 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,702 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 18:34:47,702 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
time = 113
2015-02-10 18:34:47,835 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-02-10 18:34:47,836 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,843 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:47,874 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:47,892 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-02-10 18:34:47,892 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,896 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2015-02-10 18:34:47,896 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,900 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2015-02-10 18:34:47,900 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,903 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2015-02-10 18:34:47,904 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,907 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2015-02-10 18:34:47,907 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,911 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2015-02-10 18:34:47,911 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,914 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2015-02-10 18:34:47,915 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,918 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2015-02-10 18:34:47,919 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,922 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2015-02-10 18:34:47,922 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:47,926 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:47,939 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:47,952 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:47,965 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:47,976 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:47,985 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:47,994 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,013 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,021 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,029 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,046 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-02-10 18:34:48,046 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:48,050 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2015-02-10 18:34:48,050 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:48,054 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2015-02-10 18:34:48,054 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:48,057 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2015-02-10 18:34:48,058 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:48,061 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2015-02-10 18:34:48,061 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:48,064 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2015-02-10 18:34:48,065 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:48,068 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2015-02-10 18:34:48,069 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:48,072 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2015-02-10 18:34:48,072 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:48,075 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2015-02-10 18:34:48,076 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:48,079 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,085 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,091 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,097 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,103 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,109 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,116 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,121 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,126 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,131 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,149 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-02-10 18:34:48,149 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:48,153 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2015-02-10 18:34:48,153 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:48,156 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2015-02-10 18:34:48,157 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:48,160 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2015-02-10 18:34:48,160 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:48,163 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2015-02-10 18:34:48,164 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:48,167 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2015-02-10 18:34:48,168 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:48,171 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2015-02-10 18:34:48,171 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:48,174 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2015-02-10 18:34:48,175 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:48,178 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2015-02-10 18:34:48,178 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:48,181 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 10
2015-02-10 18:34:48,182 INFO  compress.CodecPool (CodecPool.java:getCompressor(150)) - Got brand-new compressor [.gz]
2015-02-10 18:34:48,185 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,189 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,194 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,199 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,203 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,208 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,213 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,217 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,222 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,226 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
2015-02-10 18:34:48,230 INFO  compress.CodecPool (CodecPool.java:getDecompressor(178)) - Got brand-new decompressor [.gz]
time = 457