Mlf Core Versions Save

Changes

🚀 Features

• upgrade dependencies (#490) @Zethson

🐛 Bug Fixes

• TF fix (#489) @Zethson

:package: Dependencies

• [DEPENDABOT]: Bump packaging from 21.2 to 21.3 (#480) @dependabot
• [DEPENDABOT]: Bump actions/setup-python from 2.2.2 to 2.3.0 (#479) @dependabot
• [DEPENDABOT]: Bump sphinx from 4.2.0 to 4.3.0 (#475) @dependabot
• [DEPENDABOT]: Bump types-requests from 2.25.11 to 2.25.12 (#474) @dependabot
• [DEPENDABOT]: Bump jinja2 from 3.0.2 to 3.0.3 (#473) @dependabot
• [DEPENDABOT]: Bump sphinx-click from 3.0.1 to 3.0.2 (#472) @dependabot
• [DEPENDABOT]: Bump coverage from 6.0.2 to 6.1.1 (#471) @dependabot
• [DEPENDABOT]: Bump packaging from 21.0 to 21.2 (#470) @dependabot
• [DEPENDABOT]: Bump autopep8 from 1.5.7 to 1.6.0 (#469) @dependabot
• [DEPENDABOT]: Bump darglint from 1.8.0 to 1.8.1 (#468) @dependabot
• [DEPENDABOT]: Bump mlflow from 1.20.2 to 1.21.0 (#467) @dependabot
• [DEPENDABOT]: Bump types-requests from 2.25.10 to 2.25.11 (#466) @dependabot
• [DEPENDABOT]: Bump cffi from 1.14.6 to 1.15.0 (#464) @dependabot
• [DEPENDABOT]: Bump pyyaml from 5.4.1 to 6.0 (#465) @dependabot
• [DEPENDABOT]: Bump types-requests from 2.25.9 to 2.25.10 (#463) @dependabot
• [DEPENDABOT]: Bump coverage from 6.0.1 to 6.0.2 (#461) @dependabot
• [DEPENDABOT]: Bump flake8 from 3.9.2 to 4.0.1 (#462) @dependabot
• [DEPENDABOT]: Bump typeguard from 2.12.1 to 2.13.0 (#460) @dependabot
• [DEPENDABOT]: Bump click from 8.0.1 to 8.0.3 (#459) @dependabot
• [DEPENDABOT]: Bump coverage from 6.0 to 6.0.1 (#458) @dependabot
• [DEPENDABOT]: Bump xdoctest from 0.15.9 to 0.15.10 (#457) @dependabot
• [DEPENDABOT]: Bump jinja2 from 3.0.1 to 3.0.2 (#456) @dependabot
• [DEPENDABOT]: Bump coverage from 5.5 to 6.0 (#455) @dependabot
• [DEPENDABOT]: Bump typeguard from 2.13.0 to 2.13.2 (#482) @dependabot
• [DEPENDABOT]: Bump actions/cache from 2.1.6 to 2.1.7 (#483) @dependabot
• [DEPENDABOT]: Bump coverage from 6.1.1 to 6.2 (#484) @dependabot
• [DEPENDABOT]: Bump types-requests from 2.25.12 to 2.26.1 (#486) @dependabot

1. cli-python to 2.x
2. Many version bumps for the templates

1.11.2 (2021-04-23)

Added

Fixed

• libcudnn8 was not found for the Tensorflow container. Hence, we separated the Dockerfiles and added it to the container.

Dependencies

Deprecated

1.11.1 (2021-04-16)

Added

Fixed

• XGBoost cudatoolkit channel

Dependencies

Deprecated

1.11.0 (2021-03-30)

Added

Fixed

• [MLFLOW-PYTORCH] MNIST data loading (#298)
• Improved console output info in case the repos sync secret could not be set automatically and added it to FAQ docs
• [ALL-TEMPLATES] Input data md5 logging

Dependencies

Deprecated

• Removed mlflow-xgboost_dask. It was never deterministic to begin with. If you are interested in using mlf-core and XGBoost with multiple GPUs please refer to the old releases.

1.10.0 (2021-03-11)

Added

• Tutorial accessible at: mlf-core.com/tutorial (#159)
• [ALL TEMPLATES] Removed AUTHORS.rst and moved content into docs/authors.rst (#267)
• [ALL TEMPLATES] Added boto3 to environment to allow for S3 accessibility (#278)
• [ALL TEMPLATES] Workflows, that were triggered when pusing/pr to default master branch do now accept main as default branch

Fixed

• Bandit complaining about insecure md5
• mlf-core pytorch template creation and updated its dependencies versions accordingly (#298)
• Pytorch template hparam logging with tensorboard now working
• blacklisted files for sync defined by the user are now correctly picked up
• blacklisted sync files, that are newly introduced by a PR are now included in the sync PR, they were introduced but not in the following ones

Dependencies

Deprecated

1.9.1 (2021-02-16)

Added

Fixed

• [ALL TEMPLATES] lint badge in README.rst

Dependencies

Deprecated

1.9.0 (2021-02-16)

Added

• Possibility to log input files in all template with the MLFCore object.
• [ALL TEMPLATES] Using new mlf-core/base:1.2.0 container, which is based on CUDA 11.2.1 and cudnn 8.1
• [PYTORCH] Upgraded Pytorch to 1.7.1
• [PYTORCH] Added set_deterministic
• [ALL TEMPLATES] Using new mlflow autolog
• [ALL TEMPLATES] Changed mlflow autolog for loss to every 1 iteration

Fixed

• mlf-core fix-artifact-paths does now operate as expected.
• [ALL TEMPLATES] fixed a path error that causes the general template linter to fail searching for subprocess.call(['conda', 'env', 'export', '--name', '<<project_name>>'], stdout=conda_env_filehandler) and mlflow.log_artifact(f'{{reports_output_dir}}/<<project_name>>_conda_environment.yml', artifact_path='reports') in the project's mlf_core.py file

Dependencies

Deprecated

1.8.0 (2021-02-01)

Added

• fixed sync command: blacklisted files now fully working
• updated sync code to the latest version and added logging
• added a output-directory parameter option to create command, allowing users to specifify the directory, where the project should be created
• added a user information before the user is prompted to create a GitHub repo with mlf-core
• added flake8 linting for each create template workflow
• GitHub workflow badges in README now link to the corresponding workflow
• [ALL TEMPLATES] added vscode files to .gitignore for templates
• [ALL TEMPLATES] now feature a mlf-core lint workflow with colored linting result output
• [ALL TEMPLATES] renamed train_cpu workflows to use project_slug (was project_slug_no_hyphen)
• [MLFLOW TEMPLATES] refactored the common files for all mlflow templates into a common files directory
• config default values are now preconfigured values (if any)
• added logging to all commands mlf-core offers
• refactored sync, bump-version and create code (added type hints, fixed some variable scoping)
• [ALL TEMPLATES] replaced click with argparse
• [ALL TEMPLATES] renamed some parameters to harmonize between templates
• [PyTorch Template] New template with autologging via pytorch-lightning and mlflow 1.13.1

Fixed

• fixed publish_docs WF for all templates working on main or master branch

• fixed gh_pages setup for default branch main

• fixed a bug causing the check upgrade version function to fail if local version is a SNAPSHOT version

Dependencies

Deprecated