Algebird Versions Save

Similar to the 0.7.2 release, this is identical to the 0.8 release except that it has many Aggregators and Folds added.

See: https://github.com/twitter/algebird/blob/0.8.2/algebird-core/src/main/scala/com/twitter/algebird/Aggregator.scala#L55

There are now Aggregators for count, size, max, maxBy, min, minBy, forall, exists, sortedTake, sortedReverseTake, toSet, toList, uniqueCount and a few more.

Also, by an enrichment (for binary compatibility), you can .join two aggregators to aggregate a sequence (or a Scalding TypedPipe) without passing over it twice.

If you are not operating in parallel, the Fold type is just as useful. You can toFold and Aggregator, which can also be joined.

Aggregate away!

This is identical to the 0.7 release except that it has many Aggregators and Folds added.

See: https://github.com/twitter/algebird/blob/0.7.2/algebird-core/src/main/scala/com/twitter/algebird/Aggregator.scala#L55

There are now Aggregators for count, size, max, maxBy, min, minBy, forall, exists, sortedTake, sortedReverseTake, toSet, toList, uniqueCount and a few more.

Also, by an enrichment (for binary compatibility), you can .join two aggregators to aggregate a sequence (or a Scalding TypedPipe) without passing over it twice.

If you are not operating in parallel, the Fold type is just as useful. You can toFold and Aggregator, which can also be joined.

Aggregate away!

• Removes deprecated monoid: https://github.com/twitter/algebird/pull/342
• Use some value classes: https://github.com/twitter/algebird/pull/340
• WIP: Algebird 210 211: https://github.com/twitter/algebird/pull/337
• Use Builder in Seq/List Monoids: https://github.com/twitter/algebird/pull/338
• Add a commment to close 334: https://github.com/twitter/algebird/pull/339
• Make trait public that should never have been private: https://github.com/twitter/algebird/pull/335
• Fix some issues with Successible/Predessible: https://github.com/twitter/algebird/pull/332
• Add Applicative and Functor as superclasses of Monad: https://github.com/twitter/algebird/pull/330
• Updated Maven section to updated version 0.7.0: https://github.com/twitter/algebird/pull/329

• simplification for spacesaver. before buckets were kept in an option str...: https://github.com/twitter/algebird/pull/308
• Dynamic Summer, may use heuristics to decide not to keep a tuple in a buffer for aggregation.: https://github.com/twitter/algebird/pull/314
• Was a missing call to the update if we had flushed. Now we just do it as...: https://github.com/twitter/algebird/pull/324
• Bump to 2.10.4 in travis: https://github.com/twitter/algebird/pull/323
• Feature/auto formatter ran: https://github.com/twitter/algebird/pull/321
• Little commit fixing up some spacing per our norms:: https://github.com/twitter/algebird/pull/319
• provider methods for java: https://github.com/twitter/algebird/pull/317
• Serializable adaptive matrix: https://github.com/twitter/algebird/pull/318
• Clean up comments: https://github.com/twitter/algebird/pull/315
• make distribution immutable now that it contains mutable counters: https://github.com/twitter/algebird/pull/313
• a monoid that keeps track of the monoid usage: https://github.com/twitter/algebird/pull/311

• make constructors for SpaceSaver subclasses public so that deserializers..: https://github.com/twitter/algebird/pull/289
• Restoring optimized SketchMapMonoid#sumOption: https://github.com/twitter/algebird/pull/293
• Newer caliper hll benchmark: https://github.com/twitter/algebird/pull/297
• hll optimization: https://github.com/twitter/algebird/pull/299
• Optimize the storage backend used in sketch map: https://github.com/twitter/algebird/pull/301
• migrate async summers from Summingbird: https://github.com/twitter/algebird/pull/296
• add sumOption to EventuallySemiGroup: https://github.com/twitter/algebird/pull/306
• Heavyhitters no longer attempts lazy storage in SketchMap: https://github.com/twitter/algebird/pull/305
• Async Maps performance improvements: https://github.com/twitter/algebird/pull/302
• Make the AsyncListSum be immutable again: https://github.com/twitter/algebird/pull/309

• Remove handling that doesn't seem needed/wanted for longs: https://github.com/twitter/algebird/pull/287
• Add average() for DecayedValue: https://github.com/twitter/algebird/pull/286
• SketchMapParams can support being constructed with both width/depth and eps/delta: https://github.com/twitter/algebird/pull/285
• undo the undo of the interval fixes: https://github.com/twitter/algebird/pull/283
• Fix priority queue bug found by scalacheck: https://github.com/twitter/algebird/pull/280
• Adds type parameters to Intersection for more precision: https://github.com/twitter/algebird/pull/279
• Make resolver consistent with scalding: https://github.com/twitter/algebird/pull/276
• remove Math use in test: https://github.com/twitter/algebird/pull/275
• Remove extends function from algebird: https://github.com/twitter/algebird/pull/274
• remove unnecessary implicit requirement: https://github.com/twitter/algebird/pull/272
• Fix SketchMapMonoid zero: https://github.com/twitter/algebird/pull/269
• Make SketchMapMonoid params public: https://github.com/twitter/algebird/pull/265
• Add Predecessible and methods to Interval: https://github.com/twitter/algebird/pull/262
• Implement StreamSummary data structure for finding frequent/top-k items: https://github.com/twitter/algebird/pull/259

• Make SketchMap1 the only SketchMap implementation: https://github.com/twitter/algebird/pull/256
• Use semigroup in StateWithError: https://github.com/twitter/algebird/pull/255
• Don't iterate through everything in unit monoid: https://github.com/twitter/algebird/pull/253
• Factor as much logic as possible into SketchmapMonoid1: https://github.com/twitter/algebird/pull/251
• Moving Trampoline flatMap implementation into trait: https://github.com/twitter/algebird/pull/249
• Integrate Caliper: https://github.com/twitter/algebird/pull/248
• Adds append method to MonoidAggregator and RingAggregator: https://github.com/twitter/algebird/pull/246
• Make the map monoid more performant for mutable maps: https://github.com/twitter/algebird/pull/245
• Make BFHash take on non negative values only: https://github.com/twitter/algebird/pull/243
• Fixed DecayedValue: https://github.com/twitter/algebird/pull/238
• Updated scaladoc to 0.3.0: https://github.com/twitter/algebird/pull/237
• Add Incrementable and tests: https://github.com/twitter/algebird/pull/234
• Updates sbt runner: https://github.com/twitter/algebird/pull/232
• Upgrade sbt, specs, add a build.properties, and bump travis's target: https://github.com/twitter/algebird/pull/231

• Make a field transient in BloomFilter serialization: https://github.com/twitter/algebird/pull/209
• Add the TunnelMonoid to Util (like async function monoid): https://github.com/twitter/algebird/pull/213
• Make DecayedValueMonoid a class: https://github.com/twitter/algebird/pull/223
• SketchMap performance improvements: https://github.com/twitter/algebird/pull/227
• Add the Option group: https://github.com/twitter/algebird/pull/230
• Add Successible Typeclass for countable things: https://github.com/twitter/algebird/pull/234
• sumOption support on generated tuple Semigroups: https://github.com/twitter/algebird/pull/242

Thanks to @jcoveney , @andrewnguyen , @jackcwang1 , @tsdeng and @gmike especially.

• Optimize lots of the Monoids/Semigroups when summing many items: see Semigroup.sumOption https://github.com/twitter/algebird/pull/206
• Add many Aggregators for more convenient aggregation: https://github.com/twitter/algebird/pull/194
• Aggregators compose: https://github.com/twitter/algebird/pull/188
• Added scala.collection.Map (not just immutable.Map) algebras: https://github.com/twitter/algebird/pull/199
• Added Boolean monoids (Or and And): https://github.com/twitter/algebird/pull/198

This release closes up the following issues:

• Adds algebird-bijection module: https://github.com/twitter/algebird/pull/181
• Build cleanups: https://github.com/twitter/algebird/pull/180
• MapAlgebra.sparseEquiv: https://github.com/twitter/algebird/pull/182
• Remove isNonZero from Semigroup, add to Monoid: https://github.com/twitter/algebird/pull/183
• add MapAlgebra.mergeLookup: https://github.com/twitter/algebird/pull/185

The new release's API documentation can be found here:

http://twitter.github.io/algebird/#package

Thanks to all of our wonderful contributors!