Class cascading.tuple.hadoop.SpillableTupleHadoopTest

4

tests

0

failures

0

ignored

1.950s

duration

100%

successful

Tests

Test Duration Result
testSpillList 1.084s passed
testSpillListCompressed 0.484s passed
testSpillMap 0.273s passed
testSpillMapCompressed 0.109s passed

Standard output

2015-02-12 16:39:16,914 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-02-12 16:39:17,044 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-02-12 16:39:17,055 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2015-02-12 16:39:17,065 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2015-02-12 16:39:17,073 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2015-02-12 16:39:17,084 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2015-02-12 16:39:17,093 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2015-02-12 16:39:17,102 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2015-02-12 16:39:17,114 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2015-02-12 16:39:17,124 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2015-02-12 16:39:17,233 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-02-12 16:39:17,241 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2015-02-12 16:39:17,250 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2015-02-12 16:39:17,260 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2015-02-12 16:39:17,273 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2015-02-12 16:39:17,285 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2015-02-12 16:39:17,301 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2015-02-12 16:39:17,313 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2015-02-12 16:39:17,332 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2015-02-12 16:39:17,452 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-02-12 16:39:17,458 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2015-02-12 16:39:17,466 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2015-02-12 16:39:17,471 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2015-02-12 16:39:17,480 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2015-02-12 16:39:17,485 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2015-02-12 16:39:17,495 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2015-02-12 16:39:17,501 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2015-02-12 16:39:17,507 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2015-02-12 16:39:17,512 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 10
time = 1082
2015-02-12 16:39:17,605 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-12 16:39:17,606 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-12 16:39:17,609 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-12 16:39:17,609 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-12 16:39:17,610 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2015-02-12 16:39:17,636 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-02-12 16:39:17,637 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,643 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2015-02-12 16:39:17,644 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,646 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2015-02-12 16:39:17,647 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,651 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2015-02-12 16:39:17,652 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,657 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2015-02-12 16:39:17,658 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,664 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 4
2015-02-12 16:39:17,665 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,668 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2015-02-12 16:39:17,669 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,673 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2015-02-12 16:39:17,674 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,677 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 5
2015-02-12 16:39:17,679 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,682 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2015-02-12 16:39:17,683 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,685 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-12 16:39:17,686 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-12 16:39:17,690 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-12 16:39:17,691 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,693 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-12 16:39:17,693 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,696 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-12 16:39:17,697 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,698 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-12 16:39:17,699 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,702 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-12 16:39:17,703 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,705 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-12 16:39:17,707 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,709 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-12 16:39:17,710 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,711 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-12 16:39:17,712 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,714 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-12 16:39:17,715 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,718 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-12 16:39:17,718 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
time = 272
2015-02-12 16:39:17,869 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-12 16:39:17,870 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-12 16:39:17,870 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-12 16:39:17,871 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-12 16:39:17,871 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2015-02-12 16:39:17,872 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,874 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2015-02-12 16:39:17,874 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,876 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2015-02-12 16:39:17,876 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,878 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2015-02-12 16:39:17,878 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,879 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2015-02-12 16:39:17,879 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,881 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 4
2015-02-12 16:39:17,881 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,883 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2015-02-12 16:39:17,883 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,884 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2015-02-12 16:39:17,885 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,886 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 5
2015-02-12 16:39:17,886 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,888 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2015-02-12 16:39:17,888 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,889 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-12 16:39:17,890 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-12 16:39:17,890 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-12 16:39:17,891 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,893 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-12 16:39:17,894 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,896 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-12 16:39:17,896 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,897 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-12 16:39:17,898 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,899 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-12 16:39:17,900 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,901 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-12 16:39:17,901 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,902 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-12 16:39:17,903 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,904 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-12 16:39:17,905 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,906 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-02-12 16:39:17,907 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:17,908 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-12 16:39:17,908 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
time = 109
2015-02-12 16:39:18,032 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-02-12 16:39:18,034 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,040 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,057 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,073 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-02-12 16:39:18,073 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,076 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2015-02-12 16:39:18,077 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,080 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2015-02-12 16:39:18,081 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,085 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2015-02-12 16:39:18,086 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,090 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2015-02-12 16:39:18,091 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,094 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2015-02-12 16:39:18,095 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,099 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2015-02-12 16:39:18,099 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,102 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2015-02-12 16:39:18,102 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,106 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2015-02-12 16:39:18,107 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,110 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,117 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,125 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,132 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,139 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,148 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,154 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,161 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,167 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,174 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,194 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-02-12 16:39:18,195 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,204 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2015-02-12 16:39:18,204 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,210 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2015-02-12 16:39:18,211 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,214 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2015-02-12 16:39:18,215 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,220 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2015-02-12 16:39:18,221 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,224 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2015-02-12 16:39:18,225 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,228 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2015-02-12 16:39:18,230 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,233 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2015-02-12 16:39:18,234 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,237 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2015-02-12 16:39:18,239 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,243 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,261 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,270 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,277 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,284 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,290 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,297 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,303 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,317 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,323 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,346 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-02-12 16:39:18,348 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,353 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2015-02-12 16:39:18,358 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,362 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2015-02-12 16:39:18,363 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,366 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2015-02-12 16:39:18,367 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,369 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2015-02-12 16:39:18,370 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,374 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2015-02-12 16:39:18,377 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,379 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2015-02-12 16:39:18,380 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,383 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2015-02-12 16:39:18,385 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,389 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2015-02-12 16:39:18,390 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,392 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 10
2015-02-12 16:39:18,393 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2015-02-12 16:39:18,397 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,401 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,406 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,410 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,414 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,430 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,434 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,438 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,443 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,447 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2015-02-12 16:39:18,451 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
time = 472