Class cascading.tuple.hadoop.SpillableTupleHadoopTest

4

tests

0

failures

2.966s

duration

100%

successful

Tests

Test Duration Result
testSpillList 1.865s passed
testSpillListCompressed 0.506s passed
testSpillMap 0.448s passed
testSpillMapCompressed 0.147s passed

Standard output

2014-08-22 22:45:19,320 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2014-08-22 22:45:19,500 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2014-08-22 22:45:19,522 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2014-08-22 22:45:19,543 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2014-08-22 22:45:19,565 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2014-08-22 22:45:19,586 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2014-08-22 22:45:19,607 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2014-08-22 22:45:19,629 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2014-08-22 22:45:19,650 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2014-08-22 22:45:19,671 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2014-08-22 22:45:19,860 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2014-08-22 22:45:19,881 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2014-08-22 22:45:19,901 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2014-08-22 22:45:19,921 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2014-08-22 22:45:19,941 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2014-08-22 22:45:19,961 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2014-08-22 22:45:19,984 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2014-08-22 22:45:20,004 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2014-08-22 22:45:20,023 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2014-08-22 22:45:20,171 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2014-08-22 22:45:20,189 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2014-08-22 22:45:20,206 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2014-08-22 22:45:20,224 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2014-08-22 22:45:20,241 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2014-08-22 22:45:20,258 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2014-08-22 22:45:20,275 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2014-08-22 22:45:20,292 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2014-08-22 22:45:20,309 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2014-08-22 22:45:20,326 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 10
time = 1863
2014-08-22 22:45:20,473 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-08-22 22:45:20,475 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2014-08-22 22:45:20,480 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-08-22 22:45:20,480 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2014-08-22 22:45:20,482 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2014-08-22 22:45:20,527 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-08-22 22:45:20,528 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,537 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2014-08-22 22:45:20,538 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,543 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2014-08-22 22:45:20,543 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,549 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2014-08-22 22:45:20,549 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,554 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2014-08-22 22:45:20,555 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,561 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 4
2014-08-22 22:45:20,561 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,566 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2014-08-22 22:45:20,567 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,574 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2014-08-22 22:45:20,575 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,582 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 5
2014-08-22 22:45:20,582 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,589 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2014-08-22 22:45:20,590 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,601 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-08-22 22:45:20,601 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2014-08-22 22:45:20,607 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-08-22 22:45:20,608 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,612 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-08-22 22:45:20,612 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,616 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-08-22 22:45:20,617 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,620 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-08-22 22:45:20,620 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,623 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-08-22 22:45:20,624 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,625 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-08-22 22:45:20,626 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,627 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-08-22 22:45:20,628 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,629 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-08-22 22:45:20,630 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,631 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-08-22 22:45:20,632 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,634 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-08-22 22:45:20,634 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
time = 447
2014-08-22 22:45:20,915 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-08-22 22:45:20,916 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2014-08-22 22:45:20,918 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-08-22 22:45:20,918 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2014-08-22 22:45:20,919 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2014-08-22 22:45:20,920 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,923 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2014-08-22 22:45:20,924 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,926 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2014-08-22 22:45:20,926 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,928 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2014-08-22 22:45:20,929 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,931 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2014-08-22 22:45:20,932 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,934 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 4
2014-08-22 22:45:20,935 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,937 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2014-08-22 22:45:20,938 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,940 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2014-08-22 22:45:20,940 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,942 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 5
2014-08-22 22:45:20,943 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,945 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2014-08-22 22:45:20,946 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,948 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-08-22 22:45:20,949 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2014-08-22 22:45:20,950 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-08-22 22:45:20,951 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,953 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-08-22 22:45:20,954 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,955 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-08-22 22:45:20,956 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,957 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-08-22 22:45:20,958 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,960 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-08-22 22:45:20,960 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,962 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-08-22 22:45:20,963 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,964 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-08-22 22:45:20,965 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,966 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-08-22 22:45:20,967 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,968 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2014-08-22 22:45:20,969 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:20,971 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-08-22 22:45:20,972 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
time = 145
2014-08-22 22:45:21,123 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2014-08-22 22:45:21,124 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,132 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,163 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,182 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2014-08-22 22:45:21,183 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,188 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2014-08-22 22:45:21,188 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,192 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2014-08-22 22:45:21,193 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,196 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2014-08-22 22:45:21,197 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,200 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2014-08-22 22:45:21,201 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,205 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2014-08-22 22:45:21,206 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,209 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2014-08-22 22:45:21,210 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,213 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2014-08-22 22:45:21,214 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,218 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2014-08-22 22:45:21,218 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,222 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,236 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,249 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,262 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,274 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,284 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,294 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,304 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,313 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,322 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,341 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2014-08-22 22:45:21,342 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,346 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2014-08-22 22:45:21,347 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,351 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2014-08-22 22:45:21,351 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,355 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2014-08-22 22:45:21,356 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,359 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2014-08-22 22:45:21,360 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,363 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2014-08-22 22:45:21,364 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,367 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2014-08-22 22:45:21,368 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,372 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2014-08-22 22:45:21,372 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,376 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2014-08-22 22:45:21,376 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,380 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,387 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,393 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,399 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,406 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,412 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,419 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,424 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,429 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,435 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,454 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2014-08-22 22:45:21,455 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,459 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2014-08-22 22:45:21,459 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,463 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2014-08-22 22:45:21,464 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,467 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2014-08-22 22:45:21,468 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,472 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2014-08-22 22:45:21,473 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,476 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2014-08-22 22:45:21,477 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,480 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2014-08-22 22:45:21,481 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,484 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2014-08-22 22:45:21,485 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,488 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2014-08-22 22:45:21,489 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,492 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 10
2014-08-22 22:45:21,493 INFO  compress.CodecPool (CodecPool.java:getCompressor(151)) - Got brand-new compressor [.gz]
2014-08-22 22:45:21,496 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,502 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,506 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,512 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,516 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,521 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,526 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,531 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,536 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,541 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
2014-08-22 22:45:21,545 INFO  compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz]
time = 485