Summingbird Versions Save

• Depend on proper Tormenta version (fix semver hiccup)

• We don't want to hit runningState.fail twice: https://github.com/twitter/summingbird/pull/425
• also tail producer support: https://github.com/twitter/summingbird/pull/423
• fix merge planner bug: https://github.com/twitter/summingbird/pull/417
• shard fm: https://github.com/twitter/summingbird/pull/416
• Add sinking to stores: https://github.com/twitter/summingbird/pull/408
• Add NormalScaldingStore which contains only (K, V) pairs: https://github.com/twitter/summingbird/pull/407

• Bump the chill version - makes storm provided: https://github.com/twitter/summingbird/pull/406
• sort by batch if monoid is commutative: https://github.com/twitter/summingbird/pull/411
• Fix README to properly run Storm locally: https://github.com/twitter/summingbird/pull/412
• Feature/async summer store: https://github.com/twitter/summingbird/pull/400

• Add serializers for BatchID, Timestamp: https://github.com/twitter/summingbird/pull/350
• ADd a means to set defaults outside the planner: https://github.com/twitter/summingbird/pull/351
• fix bugs hdfs: https://github.com/twitter/summingbird/pull/353
• add default option setting: https://github.com/twitter/summingbird/pull/356
• Add options tests: https://github.com/twitter/summingbird/pull/335
• Add some hadoop defaults to the builder API: https://github.com/twitter/summingbird/pull/359
• Cleanup the Storm API a bit: https://github.com/twitter/summingbird/pull/360
• Put all Collector actions in one execute: https://github.com/twitter/summingbird/pull/365
• Producer API executors for storm and scalding: https://github.com/twitter/summingbird/pull/367
• standardize get or else scalding: https://github.com/twitter/summingbird/pull/363
• Fixes ticks: https://github.com/twitter/summingbird/pull/368
• spout metrics: https://github.com/twitter/summingbird/pull/344
• Add the summingbird prefix to the graphs: https://github.com/twitter/summingbird/pull/370
• add localOrShuffle: https://github.com/twitter/summingbird/pull/371
• Make the StormMetric Covariant: https://github.com/twitter/summingbird/pull/373
• Fix depreciation to be from sink: https://github.com/twitter/summingbird/pull/375
• add options to cfg: https://github.com/twitter/summingbird/pull/376
• Null out Tuple.values for GC: https://github.com/twitter/summingbird/pull/374
• Add timestamps to hadoop configs: https://github.com/twitter/summingbird/pull/377/files
• add Options.toString: https://github.com/twitter/summingbird/pull/378
• Fix out of sync versions to keep: https://github.com/twitter/summingbird/pull/379
• Feature fix ffm: https://github.com/twitter/summingbird/pull/381
• Add an await timeout: https://github.com/twitter/summingbird/pull/380
• Add local or shuffle option: https://github.com/twitter/summingbird/pull/384
• Add dequeueAll to Queue: https://github.com/twitter/summingbird/pull/386
• Add in log4j and slf4j to the example: https://github.com/twitter/summingbird/pull/392
• Fixes naming in bolts for options to work right after plan: https://github.com/twitter/summingbird/pull/391
• Add error checking to the cache size: https://github.com/twitter/summingbird/pull/393
• Add more storm tests, add some new test graphs: https://github.com/twitter/summingbird/pull/394
• Proxy the select correctly on initialbatch: https://github.com/twitter/summingbird/pull/389
• Refactors the bolts from storm to be independent workers in online: https://github.com/twitter/summingbird/pull/395
• Pluggable caches in FinalFlatMap: https://github.com/twitter/summingbird/pull/396
• Uses multimerge: https://github.com/twitter/summingbird/pull/399
• ack on entry option: https://github.com/twitter/summingbird/pull/398

• Fix issue with externalizer: https://github.com/twitter/summingbird/pull/316
• Initial implementation of checkpoint state: https://github.com/twitter/summingbird/pull/315
• Move to sbt 0.13: https://github.com/twitter/summingbird/pull/322
• Move Dependants common code to graph: https://github.com/twitter/summingbird/pull/321
• CheckpointState -> HDFSState: https://github.com/twitter/summingbird/pull/318
• Change depthFirstOf to use List instead of Vector: https://github.com/twitter/summingbird/pull/323
• Add an optional parameter to set default parallelism for a storm source: https://github.com/twitter/summingbird/pull/319
• Add a method to prepare for optimizing FlatMapKeys: https://github.com/twitter/summingbird/pull/305
• fix the increased output issue: https://github.com/twitter/summingbird/pull/327
• Optimize iterator sums: https://github.com/twitter/summingbird/pull/326
• Make sure to register BatchID and Timespan: https://github.com/twitter/summingbird/pull/324
• Sum by key test: https://github.com/twitter/summingbird/pull/330
• Add slf4j logging to scalding: https://github.com/twitter/summingbird/pull/331
• Move the versioned store to scalding package: https://github.com/twitter/summingbird/pull/332
• storm logging: https://github.com/twitter/summingbird/pull/333
• Adds/extends some storm option tests: https://github.com/twitter/summingbird/pull/334
• Make VersionedState fail-safe: https://github.com/twitter/summingbird/pull/337
• Throw on Storm Submission w/ no online store: https://github.com/twitter/summingbird/pull/338
• General graph support online: https://github.com/twitter/summingbird/pull/340
• Summingbird config: https://github.com/twitter/summingbird/pull/339

We were dropping the old data after the sum... Woops. Beefed up the tests and fixed the issue.

• Add convenience methods to Producer: https://github.com/twitter/summingbird/pull/307
• Massively optimize Scalding merge/sumByKey: https://github.com/twitter/summingbird/pull/303
• Improve the WaitingState state machine: https://github.com/twitter/summingbird/pull/302
• Move code for common realtime planners (storm + akka): https://github.com/twitter/summingbird/pull/299
• Fix an issue with source minify in scalding: https://github.com/twitter/summingbird/pull/298
• Improve scalding tests: https://github.com/twitter/summingbird/pull/296
• Improve storm tests: https://github.com/twitter/summingbird/pull/292
• Use an AnyVal-like class rather than java.util.Date: https://github.com/twitter/summingbird/pull/295
• improve Batcher documentation: https://github.com/twitter/summingbird/pull/293

• Use pipes instead of parentheses when naming online physical nodes: https://github.com/twitter/summingbird/pull/273
• Add Alsos in Producer2, OptProd2: https://github.com/twitter/summingbird/pull/275
• Multiple disjoint summers: https://github.com/twitter/summingbird/pull/274
• Make Tail sealed: https://github.com/twitter/summingbird/pull/276
• Scalding Laws not to use scalacheck: https://github.com/twitter/summingbird/pull/278
• Pull Online planner common code into core: https://github.com/twitter/summingbird/pull/281
• Use externalizer instead of meatlocker: https://github.com/twitter/summingbird/pull/282
• Standardize SourceBuilder Naming: https://github.com/twitter/summingbird/pull/285
• Add TailProducer, for graph ending point: https://github.com/twitter/summingbird/pull/286
• MemoryLaws not use scalacheck: https://github.com/twitter/summingbird/pull/287
• Added flatMapKeys to all platforms: https://github.com/twitter/summingbird/pull/288
• Added flatMapKeys to Builder API: https://github.com/twitter/summingbird/pull/290
• Add better type safety to Storm Spouts: https://github.com/twitter/summingbird/pull/289
• Add a streaming left join: https://github.com/twitter/summingbird/pull/291

• Add support for map only jobs in producer api https://github.com/twitter/summingbird/pull/269
• Fixes naming of nodes, options are picked up correctly https://github.com/twitter/summingbird/pull/267
• Fix missing elements in case statements for applying online graph to storm https://github.com/twitter/summingbird/pull/272

• Bump the version numbers of the dependencies https://github.com/twitter/summingbird/pull/260
• Upgrade to Tormenta 0.5.2, Scalding 0.9.0, Bijection 0.5.3 betas: https://github.com/twitter/summingbird/pull/191
• Feature/storm new planner: https://github.com/twitter/summingbird/pull/250
• Feature/move dag to core: https://github.com/twitter/summingbird/pull/255