Datachecks Versions Save

Open Source Data Quality Monitoring.

v0.2.5

5 months ago

What's Changed

New Features:

feat: add custom SQL metric by @subhankarb in https://github.com/waterdipai/datachecks/pull/157
feat: dashboard design changes by @driptanil in https://github.com/waterdipai/datachecks/pull/158
feat: add metric storage framework by @datageek00 in https://github.com/waterdipai/datachecks/pull/142
feat: add an example for a quick start by @datageek00 in https://github.com/waterdipai/datachecks/pull/160
feat: add support for configuration directory with multiple configuration files by @datageek00 in https://github.com/waterdipai/datachecks/pull/161

Bug Fix

fix(ui): frontend dependency issues by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/144
fix: schema defaults to public if schema is not present by @Anu-Ra-g in https://github.com/waterdipai/datachecks/pull/153
fix(yaml): duplicate datasource names by @Anu-Ra-g in https://github.com/waterdipai/datachecks/pull/147
fix(filters): filter option application fixed by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/155
fix: duplicate metric names by @Anu-Ra-g in https://github.com/waterdipai/datachecks/pull/152

Others

docs: Update README.md by @subhankarb in https://github.com/waterdipai/datachecks/pull/133
build(deps): bump pyarrow from 13.0.0 to 14.0.1 by @dependabot in https://github.com/waterdipai/datachecks/pull/138
build(deps): bump cryptography from 41.0.4 to 41.0.6 by @dependabot in https://github.com/waterdipai/datachecks/pull/149
refactor(dashboard): Update dashboard contracts by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/156
dependency(nivo): updated d3-color dependency by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/165
refactor: example configurations suffixed with data sources type by @Ryuk-me in https://github.com/waterdipai/datachecks/pull/164
dependency(ui): removed unnecessary dependencies by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/166
upgrade to v0.2.5 by @datageek00 in https://github.com/waterdipai/datachecks/pull/168

New Contributors

@Anu-Ra-g made their first contribution in https://github.com/waterdipai/datachecks/pull/147
@driptanil made their first contribution in https://github.com/waterdipai/datachecks/pull/158
@Ryuk-me made their first contribution in https://github.com/waterdipai/datachecks/pull/164

Full Changelog: https://github.com/waterdipai/datachecks/compare/v0.2.4...v0.2.5

v0.2.4

7 months ago

What's Changed

docs: update validation docs by @subhankarb in https://github.com/waterdipai/datachecks/pull/125
docs: fix docs failure by @datageek00 in https://github.com/waterdipai/datachecks/pull/127
fix(dashboard): type decimal is not json serializable in html report generation by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/129
build(deps): bump urllib3 from 1.26.17 to 1.26.18 by @dependabot in https://github.com/waterdipai/datachecks/pull/130
build(deps): bump @babel/traverse from 7.23.0 to 7.23.2 in /ui by @dependabot in https://github.com/waterdipai/datachecks/pull/131

Full Changelog: https://github.com/waterdipai/datachecks/compare/v0.2.3...v0.2.4

v0.2.3

7 months ago

What's Changed

Features

feat(metrics): implemented sum metric + tests by @niyasrad in https://github.com/waterdipai/datachecks/pull/109
feat(datasource): aws redshift datasource by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/122
feat(metrics): implemented standard deviation + tests by @niyasrad in https://github.com/waterdipai/datachecks/pull/108
feat(validation): metric validation framework by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/107
feat: add initial dashboard framework by @datageek00 in https://github.com/waterdipai/datachecks/pull/116

Bug Fix

fix(dashboard): html report slack icon should route to slack by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/121

Build Fix

build(deps): bump cryptography from 41.0.3 to 41.0.4 by @dependabot in https://github.com/waterdipai/datachecks/pull/103
build(deps): bump urllib3 from 1.26.16 to 1.26.17 by @dependabot in https://github.com/waterdipai/datachecks/pull/114
build(deps): bump webpack from 5.53.0 to 5.76.0 in /ui by @dependabot in https://github.com/waterdipai/datachecks/pull/117

Documentation

docs: update readme.md file by @datageek00 in https://github.com/waterdipai/datachecks/pull/120

Full Changelog: https://github.com/waterdipai/datachecks/compare/v0.2.2...v0.2.3

v0.2.2

8 months ago

What's Changed

Features

feat(metric): implemented null count calculation by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/72
feat(metrics): implemented distinct count with tests by @niyasrad in https://github.com/waterdipai/datachecks/pull/67
feat(metric): implemented null percentage calculation by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/76
feat: add bigquery data source by @datageek00 in https://github.com/waterdipai/datachecks/pull/79
feat: add databricks data source by @datageek00 in https://github.com/waterdipai/datachecks/pull/82
feat: add elasticsearch data source by @datageek00 in https://github.com/waterdipai/datachecks/pull/83
feat(metrics): added empty-string-count and tests by @niyasrad in https://github.com/waterdipai/datachecks/pull/78
feat: add mysql data source by @datageek00 in https://github.com/waterdipai/datachecks/pull/84
feat(metrics): implemented empty-string-percentage metric and tests by @niyasrad in https://github.com/waterdipai/datachecks/pull/85

Bug Fix

fix(metric): the metric configuration filters does not apply by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/93
fix(import): modules to import isn't being identifiable by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/95
fix(metrics): round function in average and variance metric by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/97
fix(metric): field_name not being accepted in open-search and elastic-search in freshness metric by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/96
fix(datasource): included qualified_table_name to all table calls by @niyasrad in https://github.com/waterdipai/datachecks/pull/87

Documentation Improvement

docs: fix the issue link by @fabriciodadosbr in https://github.com/waterdipai/datachecks/pull/88
docs: add slack channel to readme by @datageek00 in https://github.com/waterdipai/datachecks/pull/94
docs: update metric configurations by @datageek00 in https://github.com/waterdipai/datachecks/pull/98
docs: added tracking for docs by @subhankarb in https://github.com/waterdipai/datachecks/pull/99
docs: update website-docs by @PULAK0717 in https://github.com/waterdipai/datachecks/pull/73

New Contributors

@PULAK0717 made their first contribution in https://github.com/waterdipai/datachecks/pull/73
@fabriciodadosbr made their first contribution in https://github.com/waterdipai/datachecks/pull/88

Full Changelog: https://github.com/waterdipai/datachecks/compare/v0.2.1...v0.2.2

v0.2.1

9 months ago

What's Changed

fix: added better error handle for inpect run by @datageek00 in https://github.com/waterdipai/datachecks/pull/47
feat: add CLI output for metrics by @datageek00 in https://github.com/waterdipai/datachecks/pull/58
docs: add getting started page by @datageek00 in https://github.com/waterdipai/datachecks/pull/60
feat(metric): numeric metric variance calculation by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/56
fix: add postgres schema name in create engine by @datageek00 in https://github.com/waterdipai/datachecks/pull/62
docs: update configuration documentation by @datageek00 in https://github.com/waterdipai/datachecks/pull/63
docs: Update usage_analytics by @datageek00 in https://github.com/waterdipai/datachecks/pull/64
feat(metric): implement combined metric by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/65
feat(metric): implemented duplicate count calculation by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/66
feat: update cli table output by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/70

Full Changelog: https://github.com/waterdipai/datachecks/compare/v0.2.0...v0.2.1

v0.2.0

9 months ago

What's Changed

Feature

Automatic field profiling for SQL and Search Index data source. The automatic profiler will discover all the tables, indices, and fields for a given dataset. And will generate metrics for all the numeric and text fields
Added numeric distribution metric for the average value.
Added numeric distribution metric for minimum value.

New Contributors

@niyasrad made their first contribution in https://github.com/waterdipai/datachecks/pull/25
@WeryZebra-Yue made their first contribution in https://github.com/waterdipai/datachecks/pull/39

Full Changelog: https://github.com/waterdipai/datachecks/compare/v0.1.2...v0.2.0

v0.1.2

10 months ago

What's Changed

Add support for the freshness metric
Add support for opensearch data source

New Contributors

@subhankarb made their first contribution in https://github.com/waterdipai/datachecks/pull/1
@dependabot made their first contribution in https://github.com/waterdipai/datachecks/pull/8
@datageek00 made their first contribution in https://github.com/waterdipai/datachecks/pull/10

Full Changelog: https://github.com/waterdipai/datachecks/commits/v0.1.2