What's Changed

Updated Package Requirements, Setup Scripts and CI/CD Pipeline Workflows.

Bug Fixes

• Fixed issue in portal where error page is display upon report generation (#270)
• Fixed redis client reconnection issue (#266)
• Fixed image corruption plugin (#255)

Features for Improved Application Security

• Enhanced password security for db (#271)
• Enhanced file upload validation (#268)

Package Updates

• Apigw Packages (#270)
• Python Packages (#256)

Full Changelog: https://github.com/IMDA-BTG/aiverify/compare/v0.10.1...v0.10.2

What's Changed

Bug fixes for the API Connector and implemented new application security features.

Bug Fixes:

• Fixed bug where SHAP and robustness test fails when model is connected via API.
• Fixed bug where test task updated hook does not execute while generating report.
• Updated node setup for Dockerfile, which was previously causing a 60s wait on build.

Features for improved application security:

• Removal of default usernames and passwords for Mongodb setup. Users are now required to define these credentials during setup.
• Upgraded npm packages (#231)
• Improved sanitization of file uploads (#231)
• Improved error messages and disabled stack trace to reduce information exposure (#242)
• Disabled autocompletion of sensitive fields (#231)
• CORS whitelist (#245) (#240)
• Updated the portal graphql client so that all browser requests use the portal rewrites for graphql client requests and subscriptions (#232)
• Other minor code cleanups to remove absolute file paths and default URLs (#243)

Full Changelog: https://github.com/IMDA-BTG/aiverify/compare/v0.10.0...v0.10.1

Installation Instructions

Build and run from Dockerfile Build and run from Source Code

What's Changed

New API Connector Feature!

We're excited to introduce a powerful enhancement to AI Verify – the API Connector feature! Now, instead of uploading your AI Model file onto AI Verify, you can seamlessly configure an API Connection to your model server.

Learn more about the modes of accessing AI models here

Key Advantages:

• Bypass Size Limitations: Say goodbye to the constraints imposed by browser upload size limits.
• Test previously unsupported AI frameworks: The API Connector empowers you to work with models of any framework, such as PyTorch. Learn more about compatibility of model uploads here.
• Connection Settings for Batch Requests: Optimise your test runs by configuring connection timeouts, connection retries, max connections, rate limit and rate limit timeouts.

** Important Note: This feature currently supports tabular data only.

Getting Started:

To take advantage of this feature, refer to our How-To Guide. This guide provides step-by-step instructions on setting up the API Connector for seamless integration with your model server.

We are excited to have you try it out and hear what you think about this feature! Discussion Board

Full Changelog: https://github.com/IMDA-BTG/aiverify/compare/v0.9.4...v0.10.0

Installation Instructions

Build and run from Dockerfile Build and run from Source Code

What's Changed

Updated the Testing Framework to include Organisational Considerations and other minor bug fixes.

• Updated the Testing Framework to include Organisational Considerations when deciding AI deployment. (Updates to aiveriy.stock.reports and aiverify.stock.process-checklist plugins)
• Beyond assessment of individual AI systems, organisations need to consider issues such as the use of AI (versus non-AI options), norms and expectations as well as resources to manage the use of AI. We have added 6 process checks under Organisational Considerations.
• Fixed an issue where report title is not substituted with project name in report generated (#77)
• Fixed save message to only appear upon successful save of a project (#186)
• Other minor documentation, unit test, UI updates

Full Changelog: https://github.com/IMDA-BTG/aiverify/compare/v0.9.3...v0.9.4

Installation Instructions

Build and run from Dockerfile Build and run from Source Code

What's Changed

Added Support for Fairness Testing For Image and Major Bug Fixes

• Fairness Testing for Image (Classification) Documentation here and here
• Fixed an issue where generate report operation executes before model and datasets (https://github.com/IMDA-BTG/aiverify/issues/153)
• Fixed an issue where validation fails for single-column CSV files (https://github.com/IMDA-BTG/aiverify/issues/165)
• Fixed an issue where Dataset and Model will not be available for upload after deselecting and reselecting the same file (https://github.com/IMDA-BTG/aiverify/issues/161)
• Fixed an issue where widget description overlapped with the dependencies status if the widget description is too long (https://github.com/IMDA-BTG/aiverify/issues/136)
• Fixed an issue where report generation is stuck when running XGBoost
• Fixed an issue where permissions issue in Docker causes Image Testing to fail (https://github.com/IMDA-BTG/aiverify/issues/173)

Full Changelog: https://github.com/IMDA-BTG/aiverify/compare/v0.9.2...v0.9.3

Installation Instructions

Build and run from Dockerfile Build and run from Source Code

What's Changed

Major Bug fixes & Python 3.11 support

• Setup scripts will now run Python 3.11
• Fixed bug where some test runs are stuck (#135)
• Fixed error in process checklist numbering in report (#124)
• Vulnerability fixes

Installation Instructions

Build and run from Dockerfile Build and run from Source Code

What's Changed

Dynamic height widgets & dev updates

New Features:

• Dynamic Height functionality for widgets
• Updated stock plugins and report templates
• New radarchart and treemap packages for shared lib

Dev/code:

• Flake8 & prettier configs
• Code linting
• New unit tests
• Vulnerability fixes

The First AI Verify Release

release v0.9.0