Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.
|logo|
|Build Status|
Streamparse lets you run Python code against real-time streams of data via Apache Storm. With streamparse you can create Storm bolts and spouts in Python without having to write a single line of Java. It also provides handy CLI utilities for managing Storm clusters and projects.
The Storm/streamparse combo can be viewed as a more robust alternative to Python worker-and-queue systems, as might be built atop frameworks like Celery and RQ. It offers a way to do "real-time map/reduce style computation" against live streams of data. It can also be a powerful way to scale long-running, highly parallel Python processes in production.
|Demo|
HEAD <http://streamparse.readthedocs.org/en/master/>
_Stable <http://streamparse.readthedocs.org/en/stable/>
_Follow the project's progress, get involved, submit ideas and ask for help via
our Google Group, [email protected] <https://groups.google.com/forum/#!forum/streamparse>
__.
Alphabetical, by last name:
@dsblanch <https://twitter.com/dsblanch>
__)@kbourgoin <https://twitter.com/kbourgoin>
__)@hellais <https://github.com/hellais>
__)@rey12rey <https://twitter.com/rey12rey>
__)@hodgesds <https://github.com/hodgesds>
__)@mineo <https://github.com/mineo>
__)@tdhopper <https://twitter.com/tdhopper>
__)@thedrow <https://github.com/thedrow>
__)@Aiyesha <https://github.com/Aiyesha>
__)@amontalenti <https://twitter.com/amontalenti>
__)@roadhead <https://twitter.com/roadhead>
__)@vshlapakov <https://github.com/vshlapakov>
__)@msukmanowsky <https://twitter.com/msukmanowsky>
__)@codywilbourn <https://github.com/codywilbourn>
__)@omus <https://github.com/omus>
__)See the releases <https://github.com/Parsely/streamparse/releases>
__ page on
GitHub.
See the Roadmap <https://github.com/Parsely/streamparse/wiki/Roadmap>
__.
.. |logo| image:: https://raw.githubusercontent.com/Parsely/streamparse/master/doc/source/images/streamparse-logo.png .. |Build Status| image:: https://travis-ci.org/Parsely/streamparse.svg?branch=master :target: https://travis-ci.org/Parsely/streamparse .. |Demo| image:: https://raw.githubusercontent.com/Parsely/streamparse/master/doc/source/images/quickstart.gif