Class cascading.tuple.hadoop.SpillableTupleHadoopTest

all > cascading.tuple.hadoop > SpillableTupleHadoopTest

tests

failures

ignored

1.651s

duration

100%

successful

Tests
Standard output
Standard error

Tests

Test	Duration	Result
testSpillList	0.954s	passed
testSpillListCompressed	0.354s	passed
testSpillMap	0.259s	passed
testSpillMapCompressed	0.084s	passed

Standard output

2015-07-21 12:53:07,837 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-07-21 12:53:07,964 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-07-21 12:53:07,974 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2015-07-21 12:53:07,981 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2015-07-21 12:53:07,988 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2015-07-21 12:53:07,997 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2015-07-21 12:53:08,006 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2015-07-21 12:53:08,013 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2015-07-21 12:53:08,021 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2015-07-21 12:53:08,031 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2015-07-21 12:53:08,128 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-07-21 12:53:08,133 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2015-07-21 12:53:08,141 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2015-07-21 12:53:08,148 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2015-07-21 12:53:08,156 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2015-07-21 12:53:08,161 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2015-07-21 12:53:08,169 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2015-07-21 12:53:08,177 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2015-07-21 12:53:08,184 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2015-07-21 12:53:08,257 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-07-21 12:53:08,262 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2015-07-21 12:53:08,267 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2015-07-21 12:53:08,272 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2015-07-21 12:53:08,276 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2015-07-21 12:53:08,281 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2015-07-21 12:53:08,286 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2015-07-21 12:53:08,291 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2015-07-21 12:53:08,295 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2015-07-21 12:53:08,300 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 10
time = 952
2015-07-21 12:53:08,380 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 12:53:08,382 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 12:53:08,388 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 12:53:08,388 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 12:53:08,389 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2015-07-21 12:53:08,416 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-07-21 12:53:08,421 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2015-07-21 12:53:08,423 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2015-07-21 12:53:08,426 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2015-07-21 12:53:08,429 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2015-07-21 12:53:08,432 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 4
2015-07-21 12:53:08,435 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2015-07-21 12:53:08,439 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2015-07-21 12:53:08,441 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 5
2015-07-21 12:53:08,444 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2015-07-21 12:53:08,447 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 12:53:08,447 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 12:53:08,450 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-07-21 12:53:08,452 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-07-21 12:53:08,453 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-07-21 12:53:08,455 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-07-21 12:53:08,458 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-07-21 12:53:08,459 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-07-21 12:53:08,461 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-07-21 12:53:08,462 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-07-21 12:53:08,463 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-07-21 12:53:08,465 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 12:53:08,465 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
time = 258
2015-07-21 12:53:08,619 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 12:53:08,619 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 12:53:08,620 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 12:53:08,621 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 12:53:08,621 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2015-07-21 12:53:08,623 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2015-07-21 12:53:08,625 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2015-07-21 12:53:08,626 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 1
2015-07-21 12:53:08,628 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2015-07-21 12:53:08,630 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 4
2015-07-21 12:53:08,632 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2015-07-21 12:53:08,634 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 2
2015-07-21 12:53:08,635 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 5
2015-07-21 12:53:08,636 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 20 tuples in list to spill number 3
2015-07-21 12:53:08,639 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 12:53:08,639 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 12:53:08,640 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-07-21 12:53:08,641 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-07-21 12:53:08,642 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-07-21 12:53:08,643 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-07-21 12:53:08,645 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-07-21 12:53:08,646 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-07-21 12:53:08,647 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-07-21 12:53:08,648 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-07-21 12:53:08,649 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 10 tuples in list to spill number 1
2015-07-21 12:53:08,650 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(89)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-07-21 12:53:08,651 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(94)) - found codec: org.apache.hadoop.io.compress.GzipCodec
time = 84
2015-07-21 12:53:08,732 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-07-21 12:53:08,790 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-07-21 12:53:08,793 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2015-07-21 12:53:08,796 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2015-07-21 12:53:08,799 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2015-07-21 12:53:08,802 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2015-07-21 12:53:08,805 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2015-07-21 12:53:08,807 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2015-07-21 12:53:08,810 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2015-07-21 12:53:08,812 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2015-07-21 12:53:08,889 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-07-21 12:53:08,893 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2015-07-21 12:53:08,896 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2015-07-21 12:53:08,899 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2015-07-21 12:53:08,901 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2015-07-21 12:53:08,904 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2015-07-21 12:53:08,907 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2015-07-21 12:53:08,910 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2015-07-21 12:53:08,913 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2015-07-21 12:53:08,975 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 1
2015-07-21 12:53:08,977 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 2
2015-07-21 12:53:08,980 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 3
2015-07-21 12:53:08,983 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 4
2015-07-21 12:53:08,986 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 5
2015-07-21 12:53:08,989 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 6
2015-07-21 12:53:08,992 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 7
2015-07-21 12:53:08,995 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 8
2015-07-21 12:53:09,014 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 9
2015-07-21 12:53:09,017 INFO  collect.Spillable$SpillListener (Spillable.java:notifyWriteSpillBegin(48)) - spilling 50 tuples in list to spill number 10
time = 354

Standard error

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/hadoop/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/Users/castillo/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.5/6edffc576ce104ec769d954618764f39f0f0f10d/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]