Pandera Versions Save

A light-weight, flexible, and expressive statistical data testing library

v0.19.0b3

2 weeks ago

What's Changed

fix pyspark import error by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1591

Full Changelog: https://github.com/unionai-oss/pandera/compare/v0.19.0b2...v0.19.0b3

v0.19.0b2

2 weeks ago

What's Changed

do not format if test is not necessary by @mattB1989 in https://github.com/unionai-oss/pandera/pull/1530
Register default backends when restoring state by @alkment in https://github.com/unionai-oss/pandera/pull/1550
Bump actions/setup-python from 4 to 5 by @dependabot in https://github.com/unionai-oss/pandera/pull/1452
fix: prevent environment pollution when importing pyspark by @sam-goodwin in https://github.com/unionai-oss/pandera/pull/1552
use rst to speed up api docs generation by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1557
Add _GenericAlias.call patch by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1561
support typeguard < 3 for better compatability by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1563
Add parse function to DataFrameModel in https://github.com/unionai-oss/pandera/pull/1181
localize GenericAlias patch to DataFrameBase subclasses by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1571
Bump idna from 3.4 to 3.7 by @dependabot in https://github.com/unionai-oss/pandera/pull/1569
docs: fix typo in env var name by @alekseik1 in https://github.com/unionai-oss/pandera/pull/1562
polars: fix element-wise checks, register backends by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1572
remove pytest ignore on modin, dask. pyspark tests with pandas >= 2 by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1573
make sure check name is propagated to error report by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1574
update ci to run pyspark, modin, dask with pandas >= v2 by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1575
use sphinx-design instead of sphinx-panels by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1581
Update bug_report.md by @philiporlando in https://github.com/unionai-oss/pandera/pull/1585
bugfix: polars column core checks now return check output by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1586
make pandera.typing.Series[TYPE] error in polars DataFrameModel more readable by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1588
implement timezone agnostic polars_engine.DateTime type by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1589

New Contributors

@alkment made their first contribution in https://github.com/unionai-oss/pandera/pull/1550
@sam-goodwin made their first contribution in https://github.com/unionai-oss/pandera/pull/1552
@alekseik1 made their first contribution in https://github.com/unionai-oss/pandera/pull/1562
@philiporlando made their first contribution in https://github.com/unionai-oss/pandera/pull/1585

Full Changelog: https://github.com/unionai-oss/pandera/compare/v0.19.0b1...v0.19.0b2

v0.19.0b1

1 month ago

What's Changed

Support polars DataFrames, LazyFrames by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1373
bugfix: optional columns in polars schema should no longer raise errors when not present by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1532
check_nullable does not uselessly compute isna() anymore in pandas backend by @smarie in https://github.com/unionai-oss/pandera/pull/1538
Polars LazyFrames are validated at the schema-level by default by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1534
Enable from_format_kwargs for dict format by @ektar in https://github.com/unionai-oss/pandera/pull/1539
Convert docs to myst by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1542
fix README(tab to space) by @np-yoe in https://github.com/unionai-oss/pandera/pull/1544
pandas DataFrameModel accepts python generic types by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1547
Backend registration happens at schema initialization by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1548

New Contributors

@smarie made their first contribution in https://github.com/unionai-oss/pandera/pull/1538
@ektar made their first contribution in https://github.com/unionai-oss/pandera/pull/1539
@np-yoe made their first contribution in https://github.com/unionai-oss/pandera/pull/1544

Full Changelog: https://github.com/unionai-oss/pandera/compare/v0.18.3...v0.19.0b1

v0.19.0b0

1 month ago

What's Changed

Support polars DataFrames, LazyFrames by @cosmicBboy, @AndriiG13, and @FilipAisot in https://github.com/unionai-oss/pandera/pull/1373

Full Changelog: https://github.com/unionai-oss/pandera/compare/v0.18.3...v0.19.0b0

v0.18.3

1 month ago

What's Changed

bugfix: add index validation to SeriesSchema by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1524

Full Changelog: https://github.com/unionai-oss/pandera/compare/v0.18.2...v0.18.3

v0.18.2

1 month ago

v0.18.1

1 month ago

✨ Highlights ✨

Granular control of pandas validation https://github.com/unionai-oss/pandera/pull/1490

There is now support for granular control of schema-level or data-level validations. This can be done via the PANDERA_VALIDATION_DEPTH environment variable. Schema-level (or metadata) validation includes things like column name checks and column data types, while data-level validation involves checks that operate on actual data values.

export PANDERA_VALIDATION_DEPTH= SCHEMA_AND_DATA  # check schema- and data-level checks (default)
export PANDERA_VALIDATION_DEPTH=SCHEMA_ONLY  # only do schema-level checks
export PANDERA_VALIDATION_DEPTH=DATA_ONLY  # only do data-level checks

Efficient Hypothesis strategies https://github.com/unionai-oss/pandera/pull/1503

Pandas data synthesis strategies now uses comparison operator functions for more efficient data synthesis. It also updates the minimum hypothesis version to 6.92.7.

What's Changed

Fix copy-pasted docstring in PySpark accessor test by @deepyaman in https://github.com/unionai-oss/pandera/pull/1448
Mypy precommit by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1468
@check_types now properly passes in *args **kwargs and checks their types by @ecthompson99 in https://github.com/unionai-oss/pandera/pull/1336
Bump starlette from 0.27.0 to 0.36.2 in /dev by @dependabot in https://github.com/unionai-oss/pandera/pull/1484
Bump fastapi from 0.103.0 to 0.109.1 by @dependabot in https://github.com/unionai-oss/pandera/pull/1482
Bump actions/cache from 3 to 4 by @dependabot in https://github.com/unionai-oss/pandera/pull/1478
Bump codecov/codecov-action from 3 to 4 by @dependabot in https://github.com/unionai-oss/pandera/pull/1477
Bump jinja2 from 3.1.2 to 3.1.3 by @dependabot in https://github.com/unionai-oss/pandera/pull/1459
fix: pin multimethod dep version (#1485) by @schatimo in https://github.com/unionai-oss/pandera/pull/1486
Fix issue where str dtype in a multiindex dataframe schema results in invalid example by @gsugar87 in https://github.com/unionai-oss/pandera/pull/1050
Bump python-multipart from 0.0.6 to 0.0.7 by @dependabot in https://github.com/unionai-oss/pandera/pull/1496
Bump python-multipart from 0.0.6 to 0.0.7 in /dev by @dependabot in https://github.com/unionai-oss/pandera/pull/1495
Bump python-multipart from 0.0.6 to 0.0.7 in /ci by @dependabot in https://github.com/unionai-oss/pandera/pull/1494
Bump jinja2 from 3.1.2 to 3.1.3 in /ci by @dependabot in https://github.com/unionai-oss/pandera/pull/1457
Bump starlette from 0.27.0 to 0.36.2 in /dev by @dependabot in https://github.com/unionai-oss/pandera/pull/1489
Bugfix/1463 Pandas 2.2.0 FutureWarning resolution by using assignment instead of … by @derinwalters in https://github.com/unionai-oss/pandera/pull/1464
Bump jinja2 from 3.1.2 to 3.1.3 in /dev by @dependabot in https://github.com/unionai-oss/pandera/pull/1458
add pandas 2.2.0 to tests, use uv for pip compile by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1502
Efficient Hypothesis strategies by @Zac-HD in https://github.com/unionai-oss/pandera/pull/1503
remove headers in requirements files by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1512
Granular validations on pandas dfs by @kykyi in https://github.com/unionai-oss/pandera/pull/1490

New Contributors

@deepyaman made their first contribution in https://github.com/unionai-oss/pandera/pull/1448
@ecthompson99 made their first contribution in https://github.com/unionai-oss/pandera/pull/1336
@schatimo made their first contribution in https://github.com/unionai-oss/pandera/pull/1486
@gsugar87 made their first contribution in https://github.com/unionai-oss/pandera/pull/1050
@Zac-HD made their first contribution in https://github.com/unionai-oss/pandera/pull/1503

Full Changelog: https://github.com/unionai-oss/pandera/compare/v0.18.0...v0.18.1

v0.18.0

4 months ago

✨ Highlight ✨

Pandera now supports the configuration environment variable PANDERA_VALIDATION_ENABLED. export PANDERA_VALIDATION_ENABLED=False now globally deactivates validation.

What's Changed

Bump urllib3 from 2.0.4 to 2.0.7 by @dependabot in https://github.com/unionai-oss/pandera/pull/1383
Bump urllib3 from 2.0.5 to 2.0.7 in /dev by @dependabot in https://github.com/unionai-oss/pandera/pull/1382
Bump urllib3 from 2.0.4 to 2.0.7 in /ci by @dependabot in https://github.com/unionai-oss/pandera/pull/1381
Bugfix/1278 add_missing_columns assorted bugfixes by @derinwalters in https://github.com/unionai-oss/pandera/pull/1372
Fix lack of support for new TimestampNTZType in Spark 3.4 datatypes by @filipeo2-mck in https://github.com/unionai-oss/pandera/pull/1385
Current pip-compile usage does not have --no-emit-index-url by @filipeo2-mck in https://github.com/unionai-oss/pandera/pull/1390
Avoid throwing exception on Union types by @mjgp2 in https://github.com/unionai-oss/pandera/pull/1378
Fix optional fields in PySpark SQL by @filipeo2-mck in https://github.com/unionai-oss/pandera/pull/1387
Add support for unique validation in PySpark by @filipeo2-mck in https://github.com/unionai-oss/pandera/pull/1396
Enhancement to support GeoDataFrame, Geometry coercion, and CRS (Feature/1108) by @derinwalters in https://github.com/unionai-oss/pandera/pull/1392
fix issue for optional fields by @coobas in https://github.com/unionai-oss/pandera/pull/1258
Fix validating pyspark dataframes with regex columns by @lexanth in https://github.com/unionai-oss/pandera/pull/1397
Bump pyarrow from 13.0.0 to 14.0.1 by @dependabot in https://github.com/unionai-oss/pandera/pull/1417
Bump pyarrow from 13.0.0 to 14.0.1 in /dev by @dependabot in https://github.com/unionai-oss/pandera/pull/1416
Bump pyarrow from 13.0.0 to 14.0.1 in /ci by @dependabot in https://github.com/unionai-oss/pandera/pull/1415
[BUGFIX] [PYSPARK] Avoid running nullable checks if nullable=True by @filipeo2-mck in https://github.com/unionai-oss/pandera/pull/1403
Add Date type to pandera.all by @diederikperdok in https://github.com/unionai-oss/pandera/pull/1419
Fix disabling validation for PySpark DataFrame Schemas by @maxispeicher in https://github.com/unionai-oss/pandera/pull/1407
Bump actions/checkout from 3 to 4 by @dependabot in https://github.com/unionai-oss/pandera/pull/1361
[PySpark] Improve validation performance by enabling cache()/unpersist() toggles by @filipeo2-mck in https://github.com/unionai-oss/pandera/pull/1414
Bump urllib3 from 2.0.5 to 2.0.7 by @dependabot in https://github.com/unionai-oss/pandera/pull/1420
Generate localized timestamps in multiindex examples by @rob-sil in https://github.com/unionai-oss/pandera/pull/1426
feature: support string column validation for pandas 2.1.3 by @karlma821 in https://github.com/unionai-oss/pandera/pull/1425
Add support for PANDERA_VALIDATION_ENABLED for pandas and Configuration docs by @noklam in https://github.com/unionai-oss/pandera/pull/1354
update total download badge and fix contributing instructions by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1436
update cache dataframe config args, fix tests by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1437
Bump jupyter-server from 2.7.3 to 2.11.2 in /dev by @dependabot in https://github.com/unionai-oss/pandera/pull/1440
Bump cryptography from 41.0.4 to 41.0.6 by @dependabot in https://github.com/unionai-oss/pandera/pull/1435
Bump jupyter-server from 2.7.2 to 2.11.2 by @dependabot in https://github.com/unionai-oss/pandera/pull/1441

New Contributors

@filipeo2-mck made their first contribution in https://github.com/unionai-oss/pandera/pull/1385
@mjgp2 made their first contribution in https://github.com/unionai-oss/pandera/pull/1378
@coobas made their first contribution in https://github.com/unionai-oss/pandera/pull/1258
@lexanth made their first contribution in https://github.com/unionai-oss/pandera/pull/1397
@diederikperdok made their first contribution in https://github.com/unionai-oss/pandera/pull/1419
@maxispeicher made their first contribution in https://github.com/unionai-oss/pandera/pull/1407
@rob-sil made their first contribution in https://github.com/unionai-oss/pandera/pull/1426
@karlma821 made their first contribution in https://github.com/unionai-oss/pandera/pull/1425
@noklam made their first contribution in https://github.com/unionai-oss/pandera/pull/1354

Full Changelog: https://github.com/unionai-oss/pandera/compare/v0.17.2...v0.18.0

v0.18.0b0

4 months ago

v0.17.2

7 months ago

What's Changed

improve pydantic model efficiency by @cosmicBboy in https://github.com/unionai-oss/pandera/pull/1358

Full Changelog: https://github.com/unionai-oss/pandera/compare/v0.17.1...v0.17.2