#scoobi

[swedebeast]

... Huh.

[pghgraffiti]

[sargentorecipes]

a heat and sunny pasta on a chilly and dreary day: scoobi doo pasta shapes (did yo… a heat and sunny pasta on a chilly and dreary day: scoobi doo pasta shapes (do you know cavatappi/spiral macaroni is named scoobi doo?!) with cherry tomatoes, peas, burrata, and basil. i am in LOVE with burrata. recipe on the weblog! 🧀😋🧀😋🧀😋

[rubadubmedia]

[implicitly-notes]

scoobi 0.9.1

Maintenance version

Fixes

configureCompression only creates compressor once (fixes compression problems with Deflate and Snappy) by @jbeynon #352

scoobi is a productivity library for writing Hadoop jobs in Scala.

For more information visit: http://nicta.github.com/scoobi.

[implicitly-notes]

scoobi 0.9.0

Maintenance version

Improvements

use Scalaz 7.1.0 (by @charlesofarrell and @markhibberd)

Fix String cast to Level in LogFactory (by @charlesofarrell)

update to Scala 2.11 (by @charlesofarrell)

catching verification errors in seq sources

fuse of sequences sources when appending lots of DLists (to avoid possible serialization issues)

added a Short wire format #327 (by @raronson)

added a wire format for Thrift #344

added a WireFormat for \/

create the scoobi tmp jar in the scoobi temp dir

Fixes

EMR/S3 fixes (by Kevin X Chang) #344

don't move files which are already in the right place

update the job counters as soon as the job is finished and propagate to the ScoobiConfiguration

scoobi is a productivity library for writing Hadoop jobs in Scala.

For more information visit: http://nicta.github.com/scoobi.

[implicitly-notes]

scoobi 0.8.5

Maintenance version

Improvements

using wire formats to serialise DObjects

added a WireFormat for java.util.Map[A, B]

set the classpath diagnostics as debug info on the client by default

simplified the use of overwritable text file output format

added an overwritable text file sink

added the possibility to fully specify the temp directory with scoobi.workingdir and scoobi.tempdir

display only the sink id when pretty printing the graph

added methods to use an Emitter in the combine phase

added the possibility to use the task input output context in a parallelDo

added the possibility to access the configuration from a map operation

throw an exception if the compression codec is not available added a method to check the availability of a codec

added a "download" sink to collect downloaded files in map tasks

Fixes

fixed the passing of WireFormat when transforming a Combine node in a ParallelDo

fixed the numbering of steps

set the configuration if possible on the codec before getting its compressor

fix for checkpoints when one job fails In that case the _SUCCESS_JOB file for the other job is not changed into _SUCCESS but we should still use the checkpoint if there is one

scoobi is a productivity library for writing Hadoop jobs in Scala.

For more information visit: http://nicta.github.com/scoobi.