Smart Open Versions Save

Utils for streaming large files (S3, HDFS, gzip, bz2...)

2.2.1

3 years ago

2.2.1, 1 Oct 2020

  • Include S3 dependencies by default, because removing them in the 2.2.0 minor release was a mistake. It broke existing code in a minor release.
  • Instead, S3 dependencies will not be installed by default in the next major smart_open release, 3.0.0. So if you don't want to install S3 dependencies, to keep your smart_open installation lean, install 3.0.0 instead.

2.2.0

3 years ago

2.2.0, 25 Sep 2020

This release modifies the behavior of setup.py with respect to dependencies. Previously, boto3 and other AWS-related packages were installed by default. Now, in order to install them, you need to run either:

pip install smart_open[aws]

to install the AWS dependencies only, or

pip install smart_open[all]

to install all dependencies, including AWS, GCS, etc.

Summary of changes:

  • Correctly pass newline parameter to built-in open function (PR #478, @burkovae)
  • Remove boto as a dependency (PR #523, @isobit)
  • Performance improvement: avoid redundant GetObject API queries in s3.Reader (PR #495, @jcushman)
  • Support installing smart_open without AWS dependencies (PR #534, @justindujardin)
  • Take object version into account in to_boto3 method (PR #539, @interpolatio)

Deprecations

Functionality on the left hand side will be removed in future releases. Use the functions on the right hand side instead.

  • smart_open.s3_iter_bucketsmart_open.s3.iter_bucket

2.1.1

3 years ago

2.1.1, 27 Aug 2020

  • Bypass unnecessary GCS storage.buckets.get permission (PR #516, @gelioz)
  • Allow SFTP connection with SSH key (PR #522, @rostskadat)

2.1.0

3 years ago

2.1.0, 1 July 2020

2.0.0

4 years ago

2.0.0, 27 April 2020, "Python 3"

  • This version supports Python 3 only (3.5+).
    • If you still need Python 2, install the smart_open==1.10.1 legacy release instead.
  • Prevent smart_open from writing to logs on import (PR #476, @mpenkov)
  • Modify setup.py to explicitly support only Py3.5 and above (PR #471, @Amertz08)
  • Include all the test_data in setup.py (PR #473, @sikuan)

1.10.1

4 years ago

1.10.1, 26 Apr 2020

This is the last version to support Python 2.7. Versions 1.11 and above will support Python 3 only.

  • Temporarily disable Google Cloud Storage transport mechanism for this release. If you want to use GCS, please use version 1.11 and above.

1.11.1

4 years ago

1.11.1, 8 Apr 2020

  • Add missing boto dependency (Issue #468)

1.11.0, 8 Apr 2020

Starting with this release, you will have to run:

pip install smart_open[gcs] to use the GCS transport.

In the future, all extra dependencies will be optional. If you want to continue installing all of them, use:

    pip install smart_open[all]

See the README.rst for details.

1.11.0

4 years ago

1.11.0, 8 Apr 2020

1.10.0

4 years ago

1.9.0

4 years ago

1.9.0