Sayn Versions Save

Fixed

• Avoid double execution of tests on run command
• Don't execute tests when task failed

Changed

• Snowflake: temporary objects are created as temp where possible (ie: stages, incremental tables,...)
• Added flag to run command (--with-tests) that combines the execution of both tests and tasks
• Added new flag to run and test commands (--fail-fast) that terminates the execution upon an error on any task or test

Fixed

• Allow changing the target database for tests
• Fixes load_data code when checking if the table exists
• Fixes issue with Redshift region setting for IAM connections

Changed

• Update driver versions for Redshift, Snowflake and BigQuery

Fixed

• Issue with incremental sql models on first load not creating the table

Fixed

• Colon (:) in SQL is not interpreted as bind parameters
• Update Redshift dependencies
• Fixes to Redshift load_data when using an S3 bucket
• Fixes typo in BigQuery move table step

Changed

• Add support for 3rd level (eg: projects in BigQuery or databases in Snowflake) when referencing database objects with src and out
• Add support for python 3.11
• Switch Redshift driver to use AWS' redshift-connector
• Improve support for Redshift IAM authentications

Fixed

• Allow data types other than strings in allowed_values data test
• Fixes to ddl parsing for view materialisations

Changed

• Drop support for Python 3.7
• Upgrades numpy version
• Improved messaging upon load_data errors
• Removed Jinja caching to allow more code reusability

Fixed

• CLI command status code changed to error when tasks fail
• Fixed error in src or out to allow for missing schema

Fixed

• Fixes serialisation to json preventing copy tasks to work on BigQuery
• Fixes character encoding issue on windows

Changed

• sql tasks replace autosql with new materialisation "script"
• Allows custom tests to be defined from project.yaml as a group with the type: test
• Root for custom tests changed to the sql folder, rather than sql/tests

Fixed

• UUID support for copy to BigQuery
• Adds support for missing task properties to config macro and python task decorator
• Fixes to introspection with missing connections
• Upstream prod and from_prod are recognised with sayn test

Changed

• Allows connections for decorator based python tasks to be missing from settings when the task is not in the current execution
• Allows adding tags from decorator based python tasks
• Adds src and out to jinja environment in python tasks