Flowminder FlowKit Versions Save

FlowKit: Flowminder CDR analytics toolkit

1.25.0

1 month ago

Fixed

  • FlowETL get_qa_checks no longer attempts to create duplicate tasks for QA checks defined in the DAG folder. #6494

Removed

  • Removed flowpyter-task from the FlowETL Docker image. For a Docker image with flowpyter-task included, see flowminder/flowbot.

1.24.0

2 months ago

Added

  • Test and synthetic data generators now perform QA checks on the generated data. #6467
  • Added new /qa endpoint to FlowAPI and FlowClient, which supports getting the results of QA checks run by FlowETL #2704
  • Added new available_qa_checks property to flowmachine Connection objects #2704
  • Added new get_qa_checks method to flowmachine Connection objects #2704

Fixed

  • Test QA check IDs are now of the same format as those produced by FlowETL. #6472
  • FlowAuth now runs migrations correctly on startup. #6480

What's Changed

Full Changelog: https://github.com/Flowminder/FlowKit/compare/1.23.0...1.24.0

1.23.0

2 months ago

Changed

  • MostFrequentLocation now breaks ties based on the last used location, instead of by arbitrary Postgres sort order. #6268
  • Users no longer have write access to the public schema in FlowDB following a change introduced in PostgreSQL 15
  • FlowDB is now built on PostgreSQL 16, debian bullseye

    Warning

    You may need to update your docker version to use newer releases of FlowDB. You will also need to create a fresh database and reimport data if you are upgrading from a previous FlowDB release.

What's Changed

Full Changelog: https://github.com/Flowminder/FlowKit/compare/1.22.0...1.23.0

1.22.0

3 months ago

Added

  • FlowETL sensor NRowsPresentSensor which checks for a specified minimum number of rows.

Changed

  • ForeignStagingTableOperator will now error if the underlying file cannot be read or the command returns an error. #5763
  • Flowmachine now requires SQLAlchemy >= 2.0.0 #6066

What's Changed

Full Changelog: https://github.com/Flowminder/FlowKit/compare/1.21.1...1.22.0

1.21.1

4 months ago

Changed

  • Upgraded Python dependencies

What's Changed

Full Changelog: https://github.com/Flowminder/FlowKit/compare/1.21.0...1.21.1

1.21.0

4 months ago

Added

  • Added new FlowDB tables infrastructure.cell_info and infrastructure.cells_table_versions to keep track of changes to the cell info over time (note: the new tables have not yet replaced infrastructure.cells as the source of cell information for FlowKit queries). #6184

What's Changed

Full Changelog: https://github.com/Flowminder/FlowKit/compare/1.20.0...1.21.0

1.20.0

6 months ago

Changed

  • Updated flowpyter-task to 1.1.0

Removed

  • Removed AutoFlow. #6394

What's Changed

Full Changelog: https://github.com/Flowminder/FlowKit/compare/1.19.1...1.20.0

1.19.1

7 months ago

Added

  • flowpyter-task now included in the flowetl image

What's Changed

Full Changelog: https://github.com/Flowminder/FlowKit/compare/1.19.0...1.19.1

1.19.0

7 months ago

Added

  • FlowETL now updates a new table events.location_ids each time a new day of CDR data is ingested, to record the first and last date that each location ID appears in the data. #5376
  • New FlowETL QA check "count_locatable_events", which counts the number of added rows with location ID corresponding to a cell with a known location. #5289
  • flowkit_jwt_generator is now published as a wheel via pypi

What's Changed

Full Changelog: https://github.com/Flowminder/FlowKit/compare/1.18.4...1.19.0

1.18.4

1 year ago

Changed

  • docker-compose has been replaced with docker compose in the makefile; this might break builds on machines that haven't updated their docker in a while.

Fixed

  • SQLAlchemy version installed in the FlowMachine docker image is now compatible with the flowmachine library. #6052