Open Data Cube analyses continental scale Earth Observation data through time
Key improvements this release:
datacube dataset add
.Full list of changes:
datacube dataset
cli commands print error message if missing argument (#1437)datacube dataset search
, dc.load
, and dc.find_datasets
(#1439, #1443)archive_less_mature
option to datacube dataset add
and datacube dataset update
(#1451)With contributions from @SpacemanPaul, @Ariana-B, @omad, and @MartinPontius
Special thanks to @Kirill888 for his assistance with resolving #1448 and thanks to all supporting organisations, especially Geoscience Australia.
The previous two releases had a serious bug in the new Transaction API that resulted in parallel writes to the database being highly likely to fail. This release is mostly to provide a fix for this issue.
type
attribute to geom_type
, to align with Shapely 2.0 (#1402)Includes contributions from @SpacemanPaul, @emmaai, @Ariana-B, @omad, and first-time contributor @charalamm.
Special thanks to @alexgleith for reporting the Transaction API bug and working with us to test the fix.
Administrative release to address two technical issues in release 1.8.10:
setup.py
(pip), conda-environment.yml
(conda) and constrains.in
(Docker).Full list of changes:
MultiIndex
and coord/dims
introduced since xarray>2022.3.0
(#1397)Includes contributions from @SpacemanPaul, @pindge, @Ariana-B, @emmaai and @omad.
Bug fixes, enhancements, and updates to work with newer versions of upstream libraries.
grid_spec
to list_products
(#1357)conda
and remove flake8
from action (#1361)group_by
for dataset.load
(#1364)Includes contributions from: @pindge, @omad, @Ariana-B, @sanjeev0210 and @SpacemanPaul
Most notable changes:
patch_url
argument to dc.load()
and dc.load_data()
(introduced in v1.8.8) is now also supported for Dask loading.Full list of changes:
patch_url
argument to dc.load()
and dc.load_data()
to Dask loading. (#1323)sphinx.ext.autoselectionlabel
extension to readthedoc conf to support :ref:
command (#1325)pyspellcheck
for .rst
documentation files and fix typos (#1327)rst
documentation lint github action and apply best practices (#1328)set-output
(#1333)search_fields
to required for metadata type schema and update doc (#1339)nodata
in readthedoc for products page (#1347)eo-datasets
to extensions & related software doc page (#1349)whats_news.rst
(#1353)Includes contributions from @SpacemanPaul, @omad, @pindge, @snowman2.
With thanks and appreciation to all contributors, users and supporting organisations, expecially Geoscience Australia.
Ofiicial release (Same as 1.8.8-rc1)
Most notable new features are:
with dc.index.transaction() as trans:
# Archive old datasets and add new ones in single transaction
dc.index.datasets.archive([old_ds1.id, old_ds2.id])
dc.index.datasets.add(ds1)
dc.index.datasets.add(ds2)
# If execution gets to here, the transaction is committed.
# If an exception was raised by any of the above methods, the transaction is rolled back.
patch_url
argument to dc.load
and dc.load_data
allowing signing of URIs as required by some commercial data providers (e.g. Microsoft Planetary Computer).Also includes an update of the main test docker build to Ubuntu 22.04 and Python 3.10, and significant progress on the new postgis index driver.
Please note that the postgis index driver is still flagged as "experimental" and is missing several key features.
The release is almost identical to 1.8.8rc1. Full list of changes since 1.8.7:
whats_new.rst
for release (#1320)Includes contributions from @SpacemanPaul @tijmenr @pindge and @omad
Thanks to the ODC Steering Council and Geoscience Australia for their ongoing support of ODC development.
RC release to facilitate development in downstream packages using the new transaction API.
Most notable new feature is the new database transaction API, as discussed in ODC-EP07 Database Transaction API. API Example:
with dc.index.transaction() as trans:
# Archive old datasets and add new ones in single transaction
dc.index.datasets.archive([old_ds1.id, old_ds2.id])
dc.index.datasets.add(ds1)
dc.index.datasets.add(ds2)
# If execution gets to here, the transaction is committed.
# If an exception was raised by any of the above methods, the transaction is rolled back.
Also includes an update of the main test docker build to Ubuntu 22.04 and Python 3.10, and significant progress on the new postgis index driver.
Please note that the postgis index driver is still flagged as "experimental" and is missing several key features.
Full list of changes since 1.8.7:
dataset id
check to dataset doc resolve to prevent uuid
returning error when id
used in None
(#1287)help message
for all dataset
, product
and metadata
subcommands when required arg is not passed in (#1292)error code 1
to all incomplete dataset
, product
and metadata
subcommands (#1293)exit_on_empty_file
message to product
and dataset
subcommands instead of returning no output when file is empty (#1294)patch_url
argument to dc.load()
and dc.load_data()
to provide a way to sign dataset URIs, as
is required to access some commercial archives (e.g. Microsoft Planetary Computer). API is based on the odc-stac
implementation. Only works for direct loading. More work required for deferred (i.e. Dask) loading. (#1317)rasterio.path
. (#1255)DATACUBE_DB_URL
parsing to understand syntax like: postgresql:///datacube?host=/var/run/postgresql
(#1256)postgres
index driver as postgis
, and flag as experimental. (#1248)odc-geo
. (#1242)datacube.index
to datacube.index.postgres
.
datacube.index.Index
is now an alias for the abstract base class index interface definition
rather than postgres driver-specific implementation of that interface. (#1231)datacube/geobase
to osgeo/gdal
. (#1233)skip_broken_datasets
is correctly propagated in virtual products (#1259)Rename
, Select
and ToFloat
built-in transforms in virtual products (#1263)Includes contributions from @whatnick, @alexgleith, @maawoo, @jeremyh, @iamtekson, @alfredoahds, @SpacemanPaul, @kirill888, @robbitbt, @tebadi, @uchchwhash, and @mpaget.
Acknowledgements to the Open Datacube Steering Council and all supporting organisations, including Geoscience Australia, Digital Earth Africa, CSIRO, Frontier SI and Aerometrex.
dataset purge
command for hard deletion of archived datasets #1199numpy.bool
deprecation warnings #1184