AgnostiqHQ Covalent Versions Save

Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.

v0.222.0-rc.0

1 year ago

[0.222.0-rc.0] - 2023-04-27

v0.220.0

1 year ago

[0.220.0] - 2023-04-28

Authors

Added

  • Tutorial for hybrid neural network using Covalent, AWSBatch, and Qiskit Runtime.
  • Environment variable that users can set to specify the location where Covalent can find their defined executors.
  • Task group id in Electrons.
  • Reconstruct postprocessing method.
  • Postprocessing as electrons.
  • Postprocessing class in postprocessing.py module for all the different postprocessing helper methods and algorithms.
  • disable_run option added to enable "saving-only" option on covalent server and not executing the workflow
  • register_triggers, stop_triggers functions added to LocalDispatcher class
  • triggers parameter to the lattice metadata
  • BaseTrigger, DirTrigger, TimeTrigger classes added available to be assigned to any lattice enabling the triggers feature
  • TriggerLoader class added enabling loading of any kind of triggers including user defined ones without requiring installation
  • CLI options to start covalent server in triggers only, and no triggers mode
  • is_pending option added during redispatch to resume execution of a previously "saved-only", i.e pending workflow
  • API routes added for Triggers server
  • Added feature to support cancelling workflow dispatches
  • Updating/adding new tests to improve code coverage
  • API endpoint for redispatching.
  • Unit and functional tests for redispatching.
  • TransportGraphOps class for diffing operations on transport graphs.
  • Added make derived dispatch method.
  • Apply electron updates method to _TransportGraph.
  • Workflow re-dispatching functionality.
  • Added dispatcher_addr argument to ct.get_result similar to ct.dispatch so that it doesn't always fallback to using the default configured address
  • Front-end pending unit tests for the GUI.
  • Adding support for PostgresQL DB backend
  • Added check for COVALENT_DATABASE_URL, if exists connect sqlalchemy engine using that
  • Adding COVALENT_DATABASE_USER and COVALENT_DATABASE_PASSWORD environment variables
  • Adding COVALENT_DATABASE_HOSTNAME and COVALENT_DATABASE_PORT environment variables for easy configuration
  • Added TaskRuntimeError exception for executor plugin implementations to signal to Covalent that a task raised an unhandled exception while running in the executor backend.
  • Added environment variable for a remote database backend
  • Added support for mysql and postgresql
  • Support for transferring the contents of folders to and from S3 buckets using the file transfer module.
  • RTD for User Interface
  • Minor GUI fixes
  • Ability to use terminal on the GUI.

Changed

  • Postprocessing logic.
  • Sublattice logic. Sublattices are now treated as electrons. Once the transport graph has been built, the status get changed to DISPATCHING at which point it is executed as another workflow.
  • Modified ct.get_result to allow for status only requests
  • Enhanced the Dockerfile to include builds from various sources and a differentiation between SDK and Server builds
  • Location of function to load result from the database now moved to load module in covalent_dispatcher/_db folde.
  • Changed decode-uri-component package version on webapp yarn-lock file.
  • Changed json5 package version on webapp yarn-lock file.
  • Reverted nightly frequency back to once a day
  • Updated requirements.txt to include pyscopg2
  • Refactored execution.py into loosely coupled modular pieces
  • Updated directory like default environment variable paths to avoid creating redundant nested directories when self-hosting
  • Docs for Covalent's Slurm plugin updated with explanation for optional srun parameters.
  • Electron errors are segregated by type; task runtime errors are stored in stderr while the error attribute of a node is reserved for exceptions raised by Covalent itself.
  • When tasks fail in a workflow, the Lattice ErrorCard in the UI summarizes the failed tasks.
  • Width of lattice name column on dispatch list GUI.
  • Optimzing larger graphs for better performance.
  • Running migrations automatically if none have run in the past (fresh installs, after purging)
  • Single line call to join instead of a for loop
  • Updated black, mirrors-prettier, and detect-secrets in pre-commit hooks
  • Made root_dispatch_id nullable to circumvent migration issues with sqlite in certain platforms

Removed

  • Postprocessing from runners.
  • References to specific IBMQ hub/group/project in tutorial 5
  • Slurm executor reference from qaoa tutorial since it's not compatible with conda env at the moment.

Fixed

  • Doubling of nodes that are added to the transport graph.
  • Ensure postprocessing node end time is added as the workflow end time.
  • Functional tests
  • Custom executor how to guide, and its loading mechanism in covalent server.
  • Broken postprocessing unit test.
  • UI crashing if time values are null
  • No longer adding "http://" every time a dispatcher address is provided in local dispatcher class in order to use the provided address exactly
  • Redispatch bug involving copying reusable nodes from old transport graph to new transport graph.
  • Pennylane tutorial notebook.
  • Redispatch bug.
  • Braket pip installation instructions.
  • Removing the entrypoint for SDK-only install
  • Updating client requirements to match server versions
  • Load plugins only when COVALENT_PLUGIN_LOAD environment variable has been set to a Truthy value.
  • MNIST tutorial now shows non-Null outputs and the classifier training log image has been updated.
  • Minor changes to tutorials: autoencoder, quantum and classical svm, ensemble classification, iris classification with Pennylane, quantum chemistry, DNN tutorial, qaoa, spacetime tutorial etc.
  • The range of networkx versions in requirements.txt weren't compatible with each other, thus it is pinned to 2.8.6 now
  • SDK-only sdist and installation should now work as expected, not packaging the server
  • Fixed naming of collection nodes (was breaking postprocessing)
  • Restored compatibility with stable release of AWS executors
  • Optimization of logs on the GUI for large log file sizes.
  • Fixed UI pagination not working for more than 11 pages
  • Runtime field counting down for select running dispatches
  • Removed merge conflict symbols in changelog
  • Build graph now sets all unset lattice constraints from defaults
  • Fixed all failing functional tests
  • Fixed local executor tests on MacOS by adding ProcessPoolExecutor
  • Respecting specified AWS profile & region in remote executed S3 file transfers, defaulting to env vars of execution backend
  • Electrons will inherit the lattice executors.
  • Sublattices inherit the parent lattice executor.
  • When several electrons are running concurrently, their stdout and stderr are stored in the correct graph nodes.
  • Electron errors now appear in the Electron ErrorCard when one clicks on a failed task in the UI.
  • When an electron raises an exception during execution, the local and dask executors now try to recover any output that was already written.
  • Fixed functional tests.
  • Added requirements-client.txt to MANIFEST file
  • Respecting specified AWS profile & region in remote executed S3 file transfers, defaulting to env vars of execution backend
  • Fixed local executor tests on MacOS (second attempt)
  • The initialize_results_dir method attempts to use an environment variable instead of the results directory in the payload
  • Modified certain sqlalchemy commands for postgres compatibility
  • Removed references to results_dir in the payload
  • Folder transfer unit test.
  • Folder transfer download bug
  • Result objects now print correctly when nodes fail
  • Enabling logging by default
  • Removed debugging output
  • Clarify cli output when covalent db migrate needs to be run
  • Rendering newlines in ErrorCard on the UI for displaying error stacktraces
  • VERSION incrementing logic in changelog
  • Fixed v11 migration to use render as batch to make DROP operations compatible with sqlite
  • covalent restart honors the sdk.no_cluster setting
  • Re-applying default executor fix post config file reunification
  • Exceptions when instantiating executors are handled
  • Covalent start now waits for the server to settle before returning

Tests

  • Updated and added tests to account for all of the above triggers related changes
  • Updated _get_result_from_dispatcher test to verify whether using a link directly works or not

Docs

  • Adding Google Batch executor plugin RTD
  • Updated How-to documents.
  • Port of Pennylane's Univariate QVR tutorial using Covalent to this repo.
  • Adding troubleshooting guide to RTD's
  • Added a note to First Experiment offering initial intro to executors.
  • Adding cancellation RTD text files
  • Added documentation for "Triggers" and a separate section for similar "Features"
  • Tutorial guidelines
  • Redispatch API section.
  • Add how to for redispatch.
  • Mention redispatch in the concepts section.
  • Update AWS Lambda executor RTD with steps to extend the base executor image for installing custom packages
  • Updated self-deployment (server deployment).
  • Added IBMQ tutorial
  • Published Self-Deployment Guide
  • Revised UI reference. Added Settings page documentation.
  • Added broken UI links in README
  • Updated compatibility matrix
  • Adding Deployment section for self-hosting guide
  • Rewrote Concepts section in docs
  • Split Concepts into API, server, and UI sections
  • Added new examples and graphics for Concepts
  • Added DNN tutorial
  • Updated AWS Plugins install instructions
  • Updated AWS Plugins documentation (minor fixes)
  • Rewrote intro material in README.
  • Changed "Citation" in the README.
  • Renamed "Release Notes" to "What's New?" in the README. Updated What's New with a description of the newest GUI functionality.
  • Added "Quick Start" guide.
  • Updated and reorganized doc landing page.
  • Rewrote "Getting Started" page.
  • Broke out "Installing from Source" instructions to separate page.
  • Corrected some API class names in headers.
  • Added an executors-and-UI graphic.
  • Adding Deployment section for self-hosting guide
  • Rewrote intro material in README.
  • Changed "Citation" in the README.
  • Renamed "Release Notes" to "What's New?" in the README. Updated What's New with a description of the newest GUI functionality.
  • Updated AWS Lambda executor docs to address conflict with using public ecr registries
  • Fixed missing RTD content under API section for covalent, cli, leptons, deps, data transfer
  • Updated RTD with details about the new AWS lambda executor interface

Operations

  • Updating nightly frequency (temp)
  • Lowering number of jest workers as an attempt to fix flaky UI functional tests
  • Added exception for nightly to pass if conda release fails
  • Updated pre-commit hook versions
  • Updated codecov upload steps in tests workflow to fail if upload to codecov fails
  • Added job in nightly to trigger base executor image builds after a Covalent pre-release
  • Fixed stable-changelog action removed .catch added .on('error')
  • Removed AWS base executor deployment from release.yml
  • Removed experimental tests from nightly test matrix (will be brought back but in different workflow)
  • Updated release workflow to continue if release tag already exists
  • Reverted nightly schedule back to daily at 4:00am
  • Added Alejandro to PAUL_BLART group to allow trigerring of releases
  • Updated hotfix logic to run on a merge to a release branch
  • CodeQL workflow uses a test matrix to scan all repos in the Covalent ecosystem
  • Updated all CI Slack alerts to all go to the #covalent-ci channel
  • Removed PAUL_BLART check on build sdist step in release.yml
  • Consolidated pre & stable build into one step in release.yml
  • Fixing the validate distribution step given changes in -rc0 suffix to version
  • updated hotfix logic to run on a merge to a release branch
  • Fixing js github actions dist by re-building from develop
  • Fixing syntax in describe action & compiled action manually

v0.221.1-rc.0

1 year ago

[0.221.1-rc.0] - 2023-04-26

v0.221.0-rc.0

1 year ago

[0.221.0-rc.0] - 2023-04-17

v0.220.0-rc.0

1 year ago

[0.220.0-rc.0] - 2023-04-14

v0.219.0-rc.0

1 year ago

[0.219.0-rc.0] - 2023-03-01

v0.218.0-rc.0

1 year ago

[0.218.0-rc.0] - 2023-02-21

v0.217.0-rc.0

1 year ago

[0.217.0-rc.0] - 2023-02-12

v0.216.0-rc.0

1 year ago

[0.216.0-rc.0] - 2023-02-05

v0.215.0-rc.0

1 year ago

[0.215.0-rc.0] - 2023-02-01