Dbt Data Reliability Versions Save

Data anomalies monitoring as dbt tests and dbt artifacts uploader.

0.8.1

11 months ago

What's Changed

Added insertion time to a table. by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/349
add pg_catalog to redshift macros so they work with late binding views by @kochalex in https://github.com/elementary-data/dbt-data-reliability/pull/371
Ele 966 add exposure data by @NoyaArie in https://github.com/elementary-data/dbt-data-reliability/pull/379
Added a log to recommend dbt core upgrade. by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/381
default for macro complete_buckets_cte by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/380
fallback for load relation by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/377
Ele 983 generate job url and job run url by @NoyaArie in https://github.com/elementary-data/dbt-data-reliability/pull/367
Made databricks avoid running info schema models even if user enabled: true by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/375

New Contributors

@kochalex made their first contribution in https://github.com/elementary-data/dbt-data-reliability/pull/371

Full Changelog: https://github.com/elementary-data/dbt-data-reliability/compare/0.8.0...0.8.1

0.8.0

1 year ago

What's Changed

add materialization to run results table by @arilmav in https://github.com/elementary-data/dbt-data-reliability/pull/355
ELE-917 delete the temp tables on atomic upload by @IDoneShaveIt in https://github.com/elementary-data/dbt-data-reliability/pull/361
Pro 134 allowing test configuration on different levels (project/model/test) by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/350
Ele 826 orchestration integration by @NoyaArie in https://github.com/elementary-data/dbt-data-reliability/pull/363
ELE-987 remove dbt package integration tests from our GH actions by @IDoneShaveIt in https://github.com/elementary-data/dbt-data-reliability/pull/364

New Contributors

@arilmav made their first contribution in https://github.com/elementary-data/dbt-data-reliability/pull/355

Full Changelog: https://github.com/elementary-data/dbt-data-reliability/compare/0.7.8...0.8.0

0.7.8

1 year ago

What's Changed

Fixes to dbt_columns slowing down dbt docs by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/354
[ELE-896] Quoting bug in dimensions_anomalies by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/356
integration test: fix for dbt 1.5.0 by @haritamar in https://github.com/elementary-data/dbt-data-reliability/pull/359

Full Changelog: https://github.com/elementary-data/dbt-data-reliability/compare/0.7.7...0.7.8

0.7.7

1 year ago

What's Changed

Added target to failure message when elementary tables are not found by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/341
[ELE-735] Add an exception when anomaly detection test is configured on ephemeral model by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/338
Bug fix in dimension_anomalies with no timestamp (community) by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/344
Ele 658 create view dbt columns by @NoyaArie in https://github.com/elementary-data/dbt-data-reliability/pull/343
ELE-810 support dbt run results compiled sql with % on redshift by @IDoneShaveIt in https://github.com/elementary-data/dbt-data-reliability/pull/345
delete_and_insert macro deletes NULLs. by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/347
Not rely on adapter's make_temp_relation's implementation. by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/348
Ele 700 add default values to time bucket by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/346
Created 'edr_make_session_temp_relation'. by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/353

New Contributors

@NoyaArie made their first contribution in https://github.com/elementary-data/dbt-data-reliability/pull/343

Full Changelog: https://github.com/elementary-data/dbt-data-reliability/compare/0.7.6...0.7.7

0.7.6

1 year ago

What's Changed

fix dbt sources owner format by @IDoneShaveIt in https://github.com/elementary-data/dbt-data-reliability/pull/215
Using a different method to define deprecated columns. by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/330
Changed the order of insertion between 'elementary_test_results' and 'test_result_rows'. by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/333
[ELE-704] Column anomalies query with no timestamp ignores where_expression by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/334
Add cached empty test results row instead of running the query a… by @RoiTabach in https://github.com/elementary-data/dbt-data-reliability/pull/331
Removed unused macro that made Spark fail by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/336
Fixing anomaly tests on regular tables (non incremental) return all anomalies regardless of backfill days by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/335

Full Changelog: https://github.com/elementary-data/dbt-data-reliability/compare/0.7.5...0.7.6

0.7.5

1 year ago

What's Changed

Fixed unsupported time buckets in BQ (week, month) by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/295
dump_table returns an empty list if table is missing. by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/303
Macro 'dump_table' supports excluding deprecatedly-marked columns. by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/304
Fix integration tests by @haritamar in https://github.com/elementary-data/dbt-data-reliability/pull/311
Added logs to learn about dbt package performance. by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/312
Sorting lists without meaningful order in artifacts. by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/316
Ele 347 add new mode of day of week to our by @RoiTabach in https://github.com/elementary-data/dbt-data-reliability/pull/310
Raise an exception if user configures a timestamp column that doesn't exist by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/305
Revert "Raise an exception if user configures a timestamp column that doesn't exist" by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/320
Add "direction" param to anomalies tests by @noaKurman in https://github.com/elementary-data/dbt-data-reliability/pull/315
Validate only test that should error return error by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/318
Remove custom name from elementary tests by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/307
Buckets fixes new by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/322
Only uploading the diff in artifacts. by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/317
Changed an if condition for clarity. by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/326
Buckets unit test fix for BQ by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/327
Added a feature flag for the artifacts uploading mechanism. by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/328

New Contributors

@noaKurman made their first contribution in https://github.com/elementary-data/dbt-data-reliability/pull/315

Full Changelog: https://github.com/elementary-data/dbt-data-reliability/compare/0.7.4...0.7.5

0.7.4

1 year ago

What's Changed

add lower to avoid string matching error by @sadahry in https://github.com/elementary-data/dbt-data-reliability/pull/290
Changed test table of schema_changes_from_baseline to not be temp by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/288
Changed default query max for BQ by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/287
Added comment for BQ generate profile by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/289
Fix calling macro from package (broke upload source freshness) by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/293
Fix - Decimal type databricks not recognized as numeric by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/294
Generate cli profile cmd quoting by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/297
Bugfix: Artifacts cache is ignored when empty. by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/298
support custom test name by @Maayan-s in https://github.com/elementary-data/dbt-data-reliability/pull/299

New Contributors

@sadahry made their first contribution in https://github.com/elementary-data/dbt-data-reliability/pull/290

Full Changelog: https://github.com/elementary-data/dbt-data-reliability/compare/0.7.3...0.7.4

0.7.3

1 year ago

What's Changed

Removing monitors that don't match the column's type. by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/285

Full Changelog: https://github.com/elementary-data/dbt-data-reliability/compare/0.7.2...0.7.3

0.7.2

1 year ago

What's Changed

Fixed a breaking change in dbt 1.5.0. by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/272
Ele 331 implement sync db task by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/263
Created a state model. by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/274
ELE-352 - update integration tests to support new dbt runner by @IDoneShaveIt in https://github.com/elementary-data/dbt-data-reliability/pull/275
add sum column anomaly check by @tc-chrisbui in https://github.com/elementary-data/dbt-data-reliability/pull/235
Column monitor sum by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/277
Add column monitor sum by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/278
Asserting that each record in dbt_run_results appears in dbt_invocations. by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/279
Feature/python test where expression by @Deathfireofdoom in https://github.com/elementary-data/dbt-data-reliability/pull/273
Avoid using dict as a default parameter. by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/281
Ele 447 bugfix dimension anomalies without a by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/280
release/0.7.2 by @github-actions in https://github.com/elementary-data/dbt-data-reliability/pull/282

New Contributors

@tc-chrisbui made their first contribution in https://github.com/elementary-data/dbt-data-reliability/pull/235
@Deathfireofdoom made their first contribution in https://github.com/elementary-data/dbt-data-reliability/pull/273

Full Changelog: https://github.com/elementary-data/dbt-data-reliability/compare/0.7.1...0.7.2

0.7.1

1 year ago

What's Changed

Add missing ref at test_results_rows by @elongl in https://github.com/elementary-data/dbt-data-reliability/pull/269
integration tests: shorten paths by @haritamar in https://github.com/elementary-data/dbt-data-reliability/pull/270

Full Changelog: https://github.com/elementary-data/dbt-data-reliability/compare/0.7.0...0.7.1