ParquetSharp Versions Save

ParquetSharp is a .NET library for reading and writing Apache Parquet files.

15.0.2

3 weeks ago

This version of ParquetSharp upgrades the underlying Arrow C++ Parquet library to version 15.0.2.

New features

Add support for reading and writing the .NET Half type by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/418
Expose page checksum verification reader and writer properties by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/419
Support the TimeOnly and DateOnly types added in .NET 6 by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/424
Add the key management tools API for encryption by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/426
Support buffered writing with the Arrow API by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/428
Allow getting a ParquetFileReader and the SchemaManifest from an Arrow.FileReader by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/430

Bug fixes

Make sure that RandomAccessFile is not freed prematurely by @marcin-krystianc in https://github.com/G-Research/ParquetSharp/pull/436

Miscellaneous

Upgrade C++ Arrow to 15.0.0 by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/417
Upgrade Arrow C++ version to 15.0.2 by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/431

Full Changelog: https://github.com/G-Research/ParquetSharp/compare/14.0.2...15.0.2

15.0.2-beta2

1 month ago

What's Changed

Make sure that RandomAccessFile is not freed prematurely by @marcin-krystianc in https://github.com/G-Research/ParquetSharp/pull/436

Full Changelog: https://github.com/G-Research/ParquetSharp/compare/15.0.2-beta1...15.0.2-beta2

15.0.2-beta1

1 month ago

What's Changed

Upgrade Arrow C++ version to 15.0.2 by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/431
Allow getting a ParquetFileReader and the SchemaManifest from an Arrow.FileReader by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/430

Full Changelog: https://github.com/G-Research/ParquetSharp/compare/15.0.0-beta3...15.0.2-beta1

15.0.0-beta3

2 months ago

What's Changed

Support buffered writing with the Arrow API by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/428

Full Changelog: https://github.com/G-Research/ParquetSharp/compare/15.0.0-beta2...15.0.0-beta3

15.0.0-beta2

2 months ago

What's Changed

Document workarounds for writing TimeSpan values by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/422
Support the TimeOnly and DateOnly types added in .NET 6 by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/424
Add the key management tools API for encryption by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/426

Full Changelog: https://github.com/G-Research/ParquetSharp/compare/15.0.0-beta1...15.0.0-beta2

15.0.0-beta1

3 months ago

This version of ParquetSharp upgrades the underlying Arrow C++ Parquet library to version 15.0.0.

What's Changed

Upgrade C++ Arrow to 15.0.0 by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/417
Add support for reading and writing the .NET Half type by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/418
Expose page checksum verification reader and writer properties by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/419

Full Changelog: https://github.com/G-Research/ParquetSharp/compare/14.0.2...15.0.0-beta1

14.0.2

3 months ago

This version of ParquetSharp is identical to 14.0.2-beta1, which has been promoted to stable.

This version of ParquetSharp upgrades the underlying Arrow C++ Parquet library to version 14.0.2.

New features

Add Skip at the LogicalColumnReader level by @mfkl in https://github.com/G-Research/ParquetSharp/pull/388
Add support for custom conversion logic with the row-oriented API by @jescalada in https://github.com/G-Research/ParquetSharp/pull/393

Bug fixes

Fix segfault writing to no longer valid column writer by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/401

Miscellaneous

Upgrade Arrow C++ to 14.0.1 by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/402
Upgrade Arrow C++ to 14.0.2 by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/407
Small bit of simplification by @philjdf in https://github.com/G-Research/ParquetSharp/pull/397
CI: enable CodeQL runs by @ljubon in https://github.com/G-Research/ParquetSharp/pull/392
Copy vcpkg.json before cloning vcpkg in devcontainer Dockerfile by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/408
add caching to save time on CodeQL analysis by @ljubon in https://github.com/G-Research/ParquetSharp/pull/410
Lint: Update rules for formating code by @ljubon in https://github.com/G-Research/ParquetSharp/pull/414

Full Changelog: https://github.com/G-Research/ParquetSharp/compare/13.0.0...14.0.2

14.0.2-beta1

3 months ago

This version of ParquetSharp upgrades the underlying Arrow C++ Parquet library to version 14.0.2.

New features

Add Skip at the LogicalColumnReader level by @mfkl in https://github.com/G-Research/ParquetSharp/pull/388
Add support for custom conversion logic with the row-oriented API by @jescalada in https://github.com/G-Research/ParquetSharp/pull/393

Bug fixes

Fix segfault writing to no longer valid column writer by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/401

Miscellaneous

Upgrade Arrow C++ to 14.0.1 by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/402
Upgrade Arrow C++ to 14.0.2 by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/407
Small bit of simplification by @philjdf in https://github.com/G-Research/ParquetSharp/pull/397
CI: enable CodeQL runs by @ljubon in https://github.com/G-Research/ParquetSharp/pull/392
Copy vcpkg.json before cloning vcpkg in devcontainer Dockerfile by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/408
add caching to save time on CodeQL analysis by @ljubon in https://github.com/G-Research/ParquetSharp/pull/410

Full Changelog: https://github.com/G-Research/ParquetSharp/compare/13.0.0...14.0.2-beta1

13.0.0

5 months ago

This version of ParquetSharp is identical to 13.0.0-beta1, which has been promoted to stable.

This version of ParquetSharp upgrades the underlying Arrow C++ Parquet library to version 13.0.0, and adds the ability to interoperate with the Arrow C# library, supporting reading Parquet data as Arrow record batches and writing Arrow data to Parquet. See the working with Arrow data documentation for further details.

Full list of changes

fix ci warnings by @ljubon in https://github.com/G-Research/ParquetSharp/pull/363
Integrate self-hoster runners by @pavlovic-ivan in https://github.com/G-Research/ParquetSharp/pull/364
Finalize net7.0 migration by @jgiannuzzi in https://github.com/G-Research/ParquetSharp/pull/365
Fix "All required checks done" CI job to never be skipped by @jgiannuzzi in https://github.com/G-Research/ParquetSharp/pull/366
Create "All required checks succeeded" check run when "All required checks done" CI job is actually successful by @jgiannuzzi in https://github.com/G-Research/ParquetSharp/pull/367
Create MAINTAINERS.md by @demarillacizere in https://github.com/G-Research/ParquetSharp/pull/359
Upgrade to Arrow 13.0.0 by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/368
Add prebuilt devcontainer by @jgiannuzzi in https://github.com/G-Research/ParquetSharp/pull/369
Split up LogicalBatchReader/Writer into separate files by @philjdf in https://github.com/G-Research/ParquetSharp/pull/371
Support reading and writing data with the Arrow format by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/354
Upgrade the NUnit test adapter by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/372
Document workarounds for using the dev container with podman and SELinux by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/373
add ISSUE_TEMPLATE: Bug Report Form by @naskio in https://github.com/G-Research/ParquetSharp/pull/370
add ISSUE_TEMPLATE: feature request by @naskio in https://github.com/G-Research/ParquetSharp/pull/374
TestWriterDoubleDispose: remove outdated comment by @mfkl in https://github.com/G-Research/ParquetSharp/pull/378
README Enhancements by @jescalada in https://github.com/G-Research/ParquetSharp/pull/379
exceptions: explicitly catch and throw OutOfMemoryException by @mfkl in https://github.com/G-Research/ParquetSharp/pull/380
Run tests on Apple Silicon by @jgiannuzzi in https://github.com/G-Research/ParquetSharp/pull/382
Documentation Enhancements by @jescalada in https://github.com/G-Research/ParquetSharp/pull/383
Write vcpkg arrow port ABI info in CI by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/384
Enhance PowerShell documentation by @jescalada in https://github.com/G-Research/ParquetSharp/pull/386
test: update Microsoft.NET.Test.Sdk by @mfkl in https://github.com/G-Research/ParquetSharp/pull/389

New Contributors

@demarillacizere made their first contribution in https://github.com/G-Research/ParquetSharp/pull/359
@naskio made their first contribution in https://github.com/G-Research/ParquetSharp/pull/370
@jescalada made their first contribution in https://github.com/G-Research/ParquetSharp/pull/379

Full Changelog: https://github.com/G-Research/ParquetSharp/compare/12.0.1...13.0.0

13.0.0-beta1

6 months ago

Full list of changes

fix ci warnings by @ljubon in https://github.com/G-Research/ParquetSharp/pull/363
Integrate self-hoster runners by @pavlovic-ivan in https://github.com/G-Research/ParquetSharp/pull/364
Finalize net7.0 migration by @jgiannuzzi in https://github.com/G-Research/ParquetSharp/pull/365
Fix "All required checks done" CI job to never be skipped by @jgiannuzzi in https://github.com/G-Research/ParquetSharp/pull/366
Create "All required checks succeeded" check run when "All required checks done" CI job is actually successful by @jgiannuzzi in https://github.com/G-Research/ParquetSharp/pull/367
Create MAINTAINERS.md by @demarillacizere in https://github.com/G-Research/ParquetSharp/pull/359
Upgrade to Arrow 13.0.0 by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/368
Add prebuilt devcontainer by @jgiannuzzi in https://github.com/G-Research/ParquetSharp/pull/369
Split up LogicalBatchReader/Writer into separate files by @philjdf in https://github.com/G-Research/ParquetSharp/pull/371
Support reading and writing data with the Arrow format by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/354
Upgrade the NUnit test adapter by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/372
Document workarounds for using the dev container with podman and SELinux by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/373
add ISSUE_TEMPLATE: Bug Report Form by @naskio in https://github.com/G-Research/ParquetSharp/pull/370
add ISSUE_TEMPLATE: feature request by @naskio in https://github.com/G-Research/ParquetSharp/pull/374
TestWriterDoubleDispose: remove outdated comment by @mfkl in https://github.com/G-Research/ParquetSharp/pull/378
README Enhancements by @jescalada in https://github.com/G-Research/ParquetSharp/pull/379
exceptions: explicitly catch and throw OutOfMemoryException by @mfkl in https://github.com/G-Research/ParquetSharp/pull/380
Run tests on Apple Silicon by @jgiannuzzi in https://github.com/G-Research/ParquetSharp/pull/382
Documentation Enhancements by @jescalada in https://github.com/G-Research/ParquetSharp/pull/383
Write vcpkg arrow port ABI info in CI by @adamreeve in https://github.com/G-Research/ParquetSharp/pull/384
Enhance PowerShell documentation by @jescalada in https://github.com/G-Research/ParquetSharp/pull/386
test: update Microsoft.NET.Test.Sdk by @mfkl in https://github.com/G-Research/ParquetSharp/pull/389

New Contributors

@demarillacizere made their first contribution in https://github.com/G-Research/ParquetSharp/pull/359
@naskio made their first contribution in https://github.com/G-Research/ParquetSharp/pull/370
@jescalada made their first contribution in https://github.com/G-Research/ParquetSharp/pull/379

Full Changelog: https://github.com/G-Research/ParquetSharp/compare/12.0.1...13.0.0-beta1