Streamparse Versions Save

Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.

v4.1.2

2 years ago

Features

  • Raise an exception when run_cmd does not return an exit code of 0. (PR #492)

v4.1.1

2 years ago

Features

  • Switch to using Fabric39 for Python 3.9.X compatibility (PR #490)
  • Upgrade setuptools during virtual environment creation for Python 3.9.X compatibility (PR #489)

v4.0.0

3 years ago

⚠️ Backward Incompatible Changes ⚠️

  • streamparse now only supports Python 3.6+

Features

  • Switched depending on thriftpy to thriftpy2, because thriftpy is no longer maintained (PR #481)

v3.16.0

5 years ago

Features

  • Faster virtualenv creation when passing multiple requirements files to sparse submit (PR #459)
  • Add sudo_user option to config.json that can be used for specifying a different user that is used for virtualenv creation/deletion instead of always using the SSH login user. (PR #455)

Fixes

  • Fix typo that would cause update_virtualenv to when no CLI options were passed (PR #459)

⚠️ In the upcoming streamparse 4.0 release, support for Python 2 will be dropped. ⚠️

v3.15.1

5 years ago

Fixes

  • Make update_virtualenv create virtualenvs as sudo user, and not just when trying to delete them (0250cfa)
  • Prevent pip 19.0 from being installed because it breaks --no-cache-dir installs (db26183)
  • Prevent virtualenv from downloading pip versions other than what we have pinned (0573bc8)
  • Make redis examples work with sparse run again (b61c85d)
  • Fix issues where repr(Topology) was always None (fd5b4b6)

Misc.

  • Simplify Travis setup (#454)

v3.15.0

5 years ago

Features

  • Allow submitting topologies as inactive/deactivated (PR #448)
  • Stop pinning pip to 9.x when running update_virtualenv (PR #444)

Fixes

  • Added missing options argument to bootstrap project (PR #436)
  • Import fixes in redis example (PR #451)
  • Fix issues with virtualenv-related option resolution, which made options only in config.json not get used. (PR #453)

Misc.

  • Reformatted code with black

v3.14.0

5 years ago

Features

  • Allow install_venv and use_venv options to be overridden via CLI, topology config, etc. (PR #421)
  • Stop pinning pip to 9.x when running update_virtualenv (PR #444)

Fixes

  • Pass config_file to get_config in submit.py (PR #419)

v3.13.1

6 years ago

This fixes an issue with the --overwrite_virtualenv option introduced in 3.13.0 when some of the files in the virtualenv are not removable due to insufficient permissions. You can now specify the user to user for removing them with --user. We also delete using sudo by default now. (PR #417)

v3.13.0

6 years ago

This tiny release just adds the --overwrite_virtualenv flag to sparse submit and sparse update_virtualenv for the cases where you want to recreate a virtualenv without having to manually delete it from all the worker nodes. (PR #416)

v3.12.0

6 years ago

This release mostly improves and fixes some CLI option handling.

Features

  • Added --config option to all commands to pass custom config.json path. (PR #409, Issue #343)
  • Added --options option to sparse update_virtualenv, so it can properly handle customized worker lists. (PR #409)
  • Switched from using prettytable to texttable, which has better line wrapping support for wide tables. (PR #413)
  • Updated version of storm.thrift used internally to the one from Storm 1.1.1, which made the sparse list tables more informative. We also now verify that Storm believe the topology name you are submitting is a valid name. (PR #414)

Fixes

  • Added proper option resolution for sparse update_virtualenv (PR #409)
  • Fixed a couple typos in our handling of using custom Java objects for groupings. (PR #405)