Data Diff Versions Save

Compare tables within or across databases

v0.11.1

2 months ago

What's Changed

clarify that SQL Server support is limited by @leoebfolsom in https://github.com/datafold/data-diff/pull/864
formatting update to readme by @leoebfolsom in https://github.com/datafold/data-diff/pull/865
Loosen the restrictions of dependencies versions: >= instead of ^ and = by @nolar in https://github.com/datafold/data-diff/pull/867

Full Changelog: https://github.com/datafold/data-diff/compare/v0.11.0...v0.11.1

v0.11.0

2 months ago

What's Changed

Fix github action that doesn't work with forked branches by @sungchun12 in https://github.com/datafold/data-diff/pull/815
Ignore columns at runtime on request (e.g. with too many diffs in them) by @nolar in https://github.com/datafold/data-diff/pull/822
[to#811]Fix special characters in PG url and Mysql connection reconnect by @idling11 in https://github.com/datafold/data-diff/pull/812
yield list vs. indiv tuples by @dlawin in https://github.com/datafold/data-diff/pull/805
Retrieve collations from the schema (and refactor the column info structures) by @nolar in https://github.com/datafold/data-diff/pull/814
Make InfoTree classes overrideable by @nolar in https://github.com/datafold/data-diff/pull/824
Cast to unlimited varchars in MS SQL (especially UUDS) by @nolar in https://github.com/datafold/data-diff/pull/825
Do not detect MD5s as UUIDs, and preserve UUID casing for UUID PKs by @nolar in https://github.com/datafold/data-diff/pull/813
Fix precision fetching for DataBricks by @nolar in https://github.com/datafold/data-diff/pull/826
Tolerate column type mismatches in non-strict mode by @nolar in https://github.com/datafold/data-diff/pull/829
Update ruff formatter to work differently between forks and native branches by @sungchun12 in https://github.com/datafold/data-diff/pull/821
keep precision, scale info for databricks decimal by @dlawin in https://github.com/datafold/data-diff/pull/830
Fix redshift schema ingest by @teraamp in https://github.com/datafold/data-diff/pull/835
fix typo -> ignored_columns2=self.ignored_columns2 by @dlawin in https://github.com/datafold/data-diff/pull/832
Fix databricks schema handling by @teraamp in https://github.com/datafold/data-diff/pull/836
Fix precision recognition by @vvkh in https://github.com/datafold/data-diff/pull/823
Group rows by all columns of composite PKs by @nolar in https://github.com/datafold/data-diff/pull/838
Update README to be ergonomic and excite new users by @sungchun12 in https://github.com/datafold/data-diff/pull/816
Type annotate some things ("no-brainers") by @nolar in https://github.com/datafold/data-diff/pull/827
remove local computer piece by @sungchun12 in https://github.com/datafold/data-diff/pull/843
Ability to install all database adapters. by @sar009 in https://github.com/datafold/data-diff/pull/842
Microsoft SQL Server Support Docs by @sungchun12 in https://github.com/datafold/data-diff/pull/845
Send event json errors by @dlawin in https://github.com/datafold/data-diff/pull/847
LAB-271 Redshift Spectrum type mapping by @teraamp in https://github.com/datafold/data-diff/pull/848
Detect duplicate rows on each side by @nolar in https://github.com/datafold/data-diff/pull/850
Improve error reporting for PK type mismatch by @vvkh in https://github.com/datafold/data-diff/pull/851
Fix mssql, databricks date types by @dlawin in https://github.com/datafold/data-diff/pull/853
Fix date and time formatting by @teraamp in https://github.com/datafold/data-diff/pull/854
closing connection once data diff is executed by @sar009 in https://github.com/datafold/data-diff/pull/785
Minor readme edits by @elliotgunn in https://github.com/datafold/data-diff/pull/855
Fix motherduck bug (#858) by @sungchun12 in https://github.com/datafold/data-diff/pull/861
Evolve dbt data diff output by @sungchun12 in https://github.com/datafold/data-diff/pull/857

New Contributors

@idling11 made their first contribution in https://github.com/datafold/data-diff/pull/812
@teraamp made their first contribution in https://github.com/datafold/data-diff/pull/835
@elliotgunn made their first contribution in https://github.com/datafold/data-diff/pull/855

Full Changelog: https://github.com/datafold/data-diff/compare/v0.10.1...v0.11.0

v0.10.1

4 months ago

What's Changed

add vhol callout by @sungchun12 in https://github.com/datafold/data-diff/pull/808
Better Action Next Step when using CLI by @sungchun12 in https://github.com/datafold/data-diff/pull/809

Full Changelog: https://github.com/datafold/data-diff/compare/v0.10.0...v0.10.1

v0.10.0

4 months ago

What's Changed

Make local dbt data diffs concurrent by @sungchun12 in https://github.com/datafold/data-diff/pull/776
Accept either key file path or file itself in Snowflake by @vvkh in https://github.com/datafold/data-diff/pull/792
mssql normalize_uuid by @dlawin in https://github.com/datafold/data-diff/pull/793
Revert "mssql normalize_uuid" and fix the overall problem by @dlawin in https://github.com/datafold/data-diff/pull/794
Remove Unneeded Logging by @sungchun12 in https://github.com/datafold/data-diff/pull/798
Tolerate empty samples & allow custom database schemas by @nolar in https://github.com/datafold/data-diff/pull/802
redshift: also try to get schema from svv_columns by @dlawin in https://github.com/datafold/data-diff/pull/803
Track data-diff usage in MotherDuck by @sungchun12 in https://github.com/datafold/data-diff/pull/800
fix unreachable code branches by @dlawin in https://github.com/datafold/data-diff/pull/791

Full Changelog: https://github.com/datafold/data-diff/compare/v0.9.17...v0.10.0

v0.10.0rc0

4 months ago

What's Changed

Make local dbt data diffs concurrent by @sungchun12 in https://github.com/datafold/data-diff/pull/776
Accept either key file path or file itself in Snowflake by @vvkh in https://github.com/datafold/data-diff/pull/792
mssql normalize_uuid by @dlawin in https://github.com/datafold/data-diff/pull/793
Revert "mssql normalize_uuid" and fix the overall problem by @dlawin in https://github.com/datafold/data-diff/pull/794

Full Changelog: https://github.com/datafold/data-diff/compare/v0.9.17...v0.10.0rc0

v0.9.17

5 months ago

What's Changed

Chiel fix link readme by @cfernhout in https://github.com/datafold/data-diff/pull/783
Handle full timestamp ranges for redshift, postgres by @dlawin in https://github.com/datafold/data-diff/pull/787
databricks does not require "database" by @dlawin in https://github.com/datafold/data-diff/pull/788

Full Changelog: https://github.com/datafold/data-diff/compare/v0.9.16...v0.9.17

v0.9.16

5 months ago

What's Changed

revert databricks information_schema by @dlawin in https://github.com/datafold/data-diff/pull/782

Full Changelog: https://github.com/datafold/data-diff/compare/v0.9.15...v0.9.16

v0.9.15

5 months ago

What's Changed

Normalize schema info in databricks and redshift by @dlawin in https://github.com/datafold/data-diff/pull/781

Full Changelog: https://github.com/datafold/data-diff/compare/v0.9.14...v0.9.15

v0.9.14

5 months ago

What's Changed

add TIMESTAMP_NTZ for databricks by @dlawin in https://github.com/datafold/data-diff/pull/780

Full Changelog: https://github.com/datafold/data-diff/compare/v0.9.13...v0.9.14

v0.9.13

5 months ago

What's Changed

feat: support TOP operator by @pik94 in https://github.com/datafold/data-diff/pull/756
Add pre-commit automation for faster, safer development by @sungchun12 in https://github.com/datafold/data-diff/pull/771
Prevent type overflow by @pik94 in https://github.com/datafold/data-diff/pull/757

Full Changelog: https://github.com/datafold/data-diff/compare/v0.9.12...v0.9.13