Dea Notebooks Versions Save

Repository for Digital Earth Australia Jupyter Notebooks: tools and workflows for geospatial analysis with Open Data Cube and Xarray

0.3.2

1 month ago

What's Changed

Add missing dependency by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1190
Adding PyPi link to DEA Tools introduction and rewording intro by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1192
Edited the repo's README by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1193
Changed one link by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1196
Fixing broken images on Knowledge Hub Noteboks Readme by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1197
Update USAGE.rst, Adding Citation (Issue #1178) by @ncimino1 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1181
Update all Knowledge Hub 'docs' links to new 'knowledge' links by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1201
Renamed all 'Github' to 'GitHub' by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1203
Sphinx autosummary minor update by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1202
Add updated xr_interpolate func and tests by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1205
Updated references to the old repo name 'dea-docs' to the new name by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1204
Updates to DEA Waterbodies notebooks and tools for v3.0 by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1199
DEA Waterbodies notebook for v3, closes issue #1200 by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1207
add citation to usage.rst by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1208
Change xr_interpolate extent Error to Warning by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1210
Update R^2 method in eval_metrics by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1211

New Contributors

@ncimino1 made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1181

Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.3.1...0.3.2

0.3.1

2 months ago

What's Changed

A minor update to dea-tools including updates to tide modelling and parallel processing functions.

New feature: load_reproject function for loading external COG GeoTIFFs and reprojecting them to match a specific resolution or GeoBox.

Pull pixel_tide resampling into function for easier re-use by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1149
Update pixel_tides to work on non-Dask inputs by @erialC-P in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1155
Add threads flag to parallel apply by @alexgleith in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1171
Update several notebooks to use cleaner odc-geo code, including new load_reproject function by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1186

New Contributors

@matt-fry-ga made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1154

Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.3.0...0.3.1

0.3.0

6 months ago

What's changed

Overall updates

Major update to repository directory structure (new Interactive_apps directory, Frequently_used_code renamed to How_to_guides, DEA_datasets renamed to DEA_products)
All repository content updated to the latest DEA Collection 3 Landsat and Sentinel-2 data
Added extensive testing throughout repo (of both dea_tools and notebook content)

New Python package updates

New xr_pansharpen function supporting multiple options for pansharping Landsat imagery, including Brovey, ESRI, simple mean, PCA and HSV pansharpening (#994)
Major refactor of tide modelling functions (model_tides, pixel_tides) to add support for multiple tide models and parallel processing (#1077, #1112, #1142, #1084)
Updated load_ard to support Sentinel-2 data and the s2cloudless cloud mask (#984, #1000)
Update subpixel_contours to allow custom time formats (#1065)
Updated dea_tools.spatial functions to use spatial tools from odc-geo (#978, #1039)
New function to calculate points on a line (#1014)
New helper functions folium_map and ipyleaflet_map that enables easy placing of an xarray.Dataset on a webmap (#1145)
New folium_dual_map function to allow easily comparing datasets side-by-side (#1145)

New Jupyter notebooks and features

New introductory Wetlands Insight Tool notebook (#1102)
New introductory DEA Mangroves notebook (#1131)
New introductory DEA Surface Reflectance (Sentinel-2, Collection 3) notebook
New Sunglint masking with Sentinel-2 notebook (#1122)
New Pansharpening Landsat with xr_pansharpen notebook (#994)
New Combining data from DEA and Microsoft Planetary Computer notebook (#1097)
New Visualising coastal turbidity notebook (#1073)
New Determining seasonal extent of waterbodies with Sentinel-2 notebook (#1054)
New Monitoring water quality notebook (#1146)
New Near real-time burnt area mapping using DEA notebook (#1049)
Added a search bar and marker to interactive widgets (#1096)
Updated DEA Landsat Surface Reflectance notebook to include an example of cloud buffering with load_ard (#1094)
Updated Generating satellite imagery animations notebook to add a combined Sentinel-2 and Landsat option (#1043)
Extracted coastal transect app from DEA Coastlines notebook and moved it to a new Interactive_apps notebook (#1032)

Examples

New Contributors

@geoscience-aman made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/956
@andressutton made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/991
@LaurenSchenk1 made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1025
@treefern made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1026
@mdasi00 made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1029
@Joram95 made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1073
@Ariana-B made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1081

PyPI

https://pypi.org/project/dea-tools/0.3.0/

Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.2.7...0.3.0

0.2.8

7 months ago

What's Changed

major update to the load_ard function to allow the function to support the new Sentinel-2 Collection 3 products https://github.com/GeoscienceAustralia/dea-notebooks/pull/984
wetlands.py wetlands module added to run DEA Wetlands Insight Tool notebook https://github.com/GeoscienceAustralia/dea-notebooks/pull/1102
Update and simplify xr_rasterize, xr_vectorise and subpixel_contours by using odc-geo https://github.com/GeoscienceAustralia/dea-notebooks/pull/978
Add missing dependencies to setup.py, remove no longer used segmentation.py https://github.com/GeoscienceAustralia/dea-notebooks/pull/1003

PyPI

https://pypi.org/project/dea-tools/0.2.8/

Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.2.7...0.2.8

0.2.7

1 year ago

What's Changed

Fix missing function import in pixel_tides by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/940

PyPI

https://pypi.org/project/dea-tools/0.2.7/

Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.2.6...0.2.7

0.2.6

1 year ago

New features

`Real_world_examples/Generating_satellite_animations.ipynb`

An interactive "app" notebook for exporting time series satellite imagery animations by drawing a box on a map and selecting a custom time period.

https://user-images.githubusercontent.com/17680388/183581425-bd015371-8ec6-49d0-a035-1f64f98c7da2.mp4

`dea_tools.coastal`

dea_tools.coastal.model_tides: A replacement for the existing tidal_tag func that uses the open-source FES2014 tidal model.
dea_tools.coastal.pixel_tides: A more advanced tidal model function that models tides across the 2D extent of a satellite imagery dataset, then interpolates that data into each pixel of the dataset. Used in DEA Coastlines to create seamless tidal composites and shorelines (with no discontinuities along study area boundaries).

`dea_tools.datahandling`

dea_tools.datahandling.parallel_apply: A function for applying a custom function in parallel along a specific dimension in an xarray (e.g. for each timestep), using multiprocessing from the concurrent.futures package

`dea_tools.spatial`

dea_tools.spatial.hillshade: A function for generating hillshades on DEM data, using custom sun angles and azimuths.
dea_tools.spatial.sun_angles: A function for extracting average sun angles and azimuths from DEA Collection 3 metadata for each timestep in a satellite dataset. Can be used to identify pixels that are likely to be affected by terrain shadow in surface reflectance data.

What's Changed (full changelog)

Fix failed Dask worker pod launch due to invalid username characters by @jmettes in https://github.com/GeoscienceAustralia/dea-notebooks/pull/928
New generating animations interactive notebook by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/927
Waterbodies fix by @vnewey in https://github.com/GeoscienceAustralia/dea-notebooks/pull/932
Move datacube import lower in STAC notebook to reduce confusion by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/933
remove unused import of write_geotiff by @ErinKenna in https://github.com/GeoscienceAustralia/dea-notebooks/pull/930
Add missing rasterstats and geopy dependency by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/934
Add funcs from DEA Coastlines and DEA Intertidal to DEA Tools by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/936
fix to Surface Area Duration NB by @vnewey in https://github.com/GeoscienceAustralia/dea-notebooks/pull/937

New Contributors

@jmettes made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/928
@vnewey made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/932
@ErinKenna made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/930

PyPI

https://pypi.org/project/dea-tools/

0.2.5

1 year ago

What's Changed

Add ability to plot a colour bar on level 4 animation by @Kooie-cate in https://github.com/GeoscienceAustralia/dea-notebooks/pull/915
Update notebooks to use C3 derivatives by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/917
Optimise test github action by @pindge in https://github.com/GeoscienceAustralia/dea-notebooks/pull/920
Unpin index image for docker-compose by @pindge in https://github.com/GeoscienceAustralia/dea-notebooks/pull/921
Remove ignore from basic analysis notebook tests by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/922
Support for FES2014 tide model via CNES aviso-fes. by @rtaib in https://github.com/GeoscienceAustralia/dea-notebooks/pull/919
Pin pip to allow build Action to work by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/924

New Contributors

@pindge made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/920
@rtaib made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/919

Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.2.4...0.2.5

0.2.4

2 years ago

What's Changed

Updates to ML notebooks/scripts, load_ard, and phenology

Update Polygon_drill.ipynb by @CEKrause in https://github.com/GeoscienceAustralia/dea-notebooks/pull/897
DEA Land Cover notebook suite by @bellemae in https://github.com/GeoscienceAustralia/dea-notebooks/pull/898
Update animation notebook to use MP4s by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/903
Add Fractional Cover reprocessing notebook and results by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/905
Add DEA training to repo by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/906
Update README.rst by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/907
Ah, add my conf paper by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/908
Remove spatial cross validation from Scalable ML by @cbur24 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/909
Update phenology notebook and script by @cbur24 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/910
Add morphological filtering to load_ard by @cbur24 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/912
Conference contribution GeoPython by @sebfoe in https://github.com/GeoscienceAustralia/dea-notebooks/pull/914

Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.2.3...0.2.4

0.2.3

2 years ago

What's Changed

Updated image export notebook to an interactive app that requires no coding by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/894

Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.2.2...0.2.3

0.2.2

2 years ago

What's Changed

Add new func for plotting fmask data with automatic colours by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/886
Update to document new Coastlines paper and use recently added Dask and Geopandas functionality by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/887
Updated courses and training by @Bethany-M in https://github.com/GeoscienceAustralia/dea-notebooks/pull/889
Add coastlines paper to repo usage by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/890
Add new interactive DEA Coastlines app and move all widgets to dea_tools.app submodule by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/892

New Contributors

@Bethany-M made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/889

Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.2.1...0.2.2