Class cascading.tuple.hadoop.SpillableTupleHadoopTest

4

tests

0

failures

0

ignored

2.484s

duration

100%

successful

Tests

Test Duration Result
testSpillList 1.548s passed
testSpillListCompressed 0.433s passed
testSpillMap 0.407s passed
testSpillMapCompressed 0.096s passed

Standard output

2016-05-18 05:13:38,166 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2016-05-18 05:13:38,385 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2016-05-18 05:13:38,400 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2016-05-18 05:13:38,414 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2016-05-18 05:13:38,429 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2016-05-18 05:13:38,444 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2016-05-18 05:13:38,458 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2016-05-18 05:13:38,473 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2016-05-18 05:13:38,488 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2016-05-18 05:13:38,506 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2016-05-18 05:13:38,723 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2016-05-18 05:13:38,743 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2016-05-18 05:13:38,762 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2016-05-18 05:13:38,782 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2016-05-18 05:13:38,802 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2016-05-18 05:13:38,822 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2016-05-18 05:13:38,843 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2016-05-18 05:13:38,863 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2016-05-18 05:13:38,883 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2016-05-18 05:13:39,053 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2016-05-18 05:13:39,072 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2016-05-18 05:13:39,087 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2016-05-18 05:13:39,100 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2016-05-18 05:13:39,113 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2016-05-18 05:13:39,125 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2016-05-18 05:13:39,138 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2016-05-18 05:13:39,153 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2016-05-18 05:13:39,165 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2016-05-18 05:13:39,178 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 10
time = 1545
2016-05-18 05:13:39,321 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 05:13:39,323 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 05:13:39,330 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 05:13:39,331 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 05:13:39,333 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2016-05-18 05:13:39,380 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-05-18 05:13:39,391 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2016-05-18 05:13:39,395 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2016-05-18 05:13:39,401 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2016-05-18 05:13:39,407 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2016-05-18 05:13:39,413 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 4
2016-05-18 05:13:39,419 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2016-05-18 05:13:39,428 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2016-05-18 05:13:39,436 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 5
2016-05-18 05:13:39,445 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2016-05-18 05:13:39,451 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 05:13:39,451 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 05:13:39,456 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2016-05-18 05:13:39,458 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2016-05-18 05:13:39,460 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2016-05-18 05:13:39,461 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2016-05-18 05:13:39,463 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2016-05-18 05:13:39,465 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2016-05-18 05:13:39,466 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2016-05-18 05:13:39,467 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2016-05-18 05:13:39,469 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2016-05-18 05:13:39,471 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 05:13:39,472 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
time = 407
2016-05-18 05:13:39,694 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 05:13:39,695 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 05:13:39,696 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 05:13:39,696 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 05:13:39,696 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2016-05-18 05:13:39,699 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2016-05-18 05:13:39,701 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2016-05-18 05:13:39,703 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2016-05-18 05:13:39,705 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2016-05-18 05:13:39,707 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 4
2016-05-18 05:13:39,709 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2016-05-18 05:13:39,711 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2016-05-18 05:13:39,713 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 5
2016-05-18 05:13:39,714 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2016-05-18 05:13:39,717 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 05:13:39,718 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 05:13:39,719 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2016-05-18 05:13:39,720 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2016-05-18 05:13:39,722 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2016-05-18 05:13:39,723 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2016-05-18 05:13:39,724 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2016-05-18 05:13:39,725 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2016-05-18 05:13:39,727 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2016-05-18 05:13:39,728 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2016-05-18 05:13:39,729 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2016-05-18 05:13:39,731 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2016-05-18 05:13:39,732 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
time = 95
2016-05-18 05:13:39,830 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2016-05-18 05:13:39,906 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2016-05-18 05:13:39,910 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2016-05-18 05:13:39,914 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2016-05-18 05:13:39,917 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2016-05-18 05:13:39,921 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2016-05-18 05:13:39,925 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2016-05-18 05:13:39,928 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2016-05-18 05:13:39,932 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2016-05-18 05:13:39,936 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2016-05-18 05:13:40,037 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2016-05-18 05:13:40,041 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2016-05-18 05:13:40,044 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2016-05-18 05:13:40,048 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2016-05-18 05:13:40,051 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2016-05-18 05:13:40,055 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2016-05-18 05:13:40,058 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2016-05-18 05:13:40,061 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2016-05-18 05:13:40,065 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2016-05-18 05:13:40,133 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2016-05-18 05:13:40,137 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2016-05-18 05:13:40,140 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2016-05-18 05:13:40,143 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2016-05-18 05:13:40,146 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2016-05-18 05:13:40,149 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2016-05-18 05:13:40,153 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2016-05-18 05:13:40,156 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2016-05-18 05:13:40,159 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2016-05-18 05:13:40,162 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 10
time = 432