Utils for streaming large files (S3, HDFS, gzip, bz2...)
This release modifies the behavior of setup.py with respect to dependencies.
Previously, boto3
and other AWS-related packages were installed by default.
Now, in order to install them, you need to run either:
pip install smart_open[aws]
to install the AWS dependencies only, or
pip install smart_open[all]
to install all dependencies, including AWS, GCS, etc.
Summary of changes:
newline
parameter to built-in open
function (PR #478, @burkovae)to_boto3
method (PR #539, @interpolatio)Functionality on the left hand side will be removed in future releases. Use the functions on the right hand side instead.
smart_open.s3_iter_bucket
→ smart_open.s3.iter_bucket
newline
parameter to built-in open
function (PR #478, @burkovae)This is the last version to support Python 2.7. Versions 1.11 and above will support Python 3 only.
pathlib.Path.open
(PR #436, @menshikh-iv)Starting with this release, you will have to run:
pip install smart_open[gcs] to use the GCS transport.
In the future, all extra dependencies will be optional. If you want to continue installing all of them, use:
pip install smart_open[all]
See the README.rst for details.
pathlib.Path.open
(PR #436, @menshikh-iv)