Aws Data Wrangler Versions Save

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

3.7.3

3 weeks ago

Bug fixes 🐛

  • Iceberg schema evolution fails for map, array and struct types by @LeonLuttenberger in #2755
  • trickle down s3_output in athena.to_iceberg by @jaidisido in #2767
  • respect order of columns in to_iceberg by @jaidisido in #2768
  • add PyArrow fixed_size_binary dtype support by @jaidisido in #2775
  • Opensearch serverless vector search collections - remove default _id by @kukushking in #2784
  • missing keys in list_to_arrow_table by @kukushking in #2778
  • prevent athena.to_iceberg overwrite to delete table in order to preserve Iceberg transactions history by @erwan-simon in #2776

Documentation 📚

  • simplify README, remove AWS Glue for Ray references by @jaidisido in #2750
  • fix YAML formatting in Ray Remote tutorial by @LeonLuttenberger in #2770

Security Dependency Updates 🛡️

  • bump idna from 3.6 to 3.7 by @dependabot in #2772
  • bump aiohttp from 3.9.3 to 3.9.4 by @dependabot in #2777

New Contributors 👋

  • @erwan-simon made their first contribution in #2776

Full Changelog: https://github.com/aws/aws-sdk-pandas/compare/3.7.2...3.7.3

3.7.2

1 month ago

Features/Enhancements 🚀

  • Add support for DeltaLake's DynamoDB lock mechanism by @LeonLuttenberger in #2705

Bug fixes 🐛

  • wr.athena.to_iceberg - Insert query has mismatched column types #2678 by @GalvFionic in #2715
  • allow s3_output in athena.to_iceberg by @jaidisido in #2727
  • replace deprecated np.split_array by @jaidisido in #2735
  • Athena to_iceberg fails with non-lowercase column names by @LeonLuttenberger in #2736
  • Support Ray 2.10 by @kukushking in #2741

New Contributors

  • @GalvFionic made their first contribution in #2715

Full Changelog: https://github.com/aws/aws-sdk-pandas/compare/3.7.1...3.7.2

3.7.1

2 months ago

Bug fixes 🐛

Documentation 📚

Full Changelog: https://github.com/aws/aws-sdk-pandas/compare/3.7.0...3.7.1

3.7.0

2 months ago

Breaking changes 💥

Lake Formation Governed tables are being phased out and we are dropping support (#2692).

Features/Enhancements 🚀

Bug fixes 🐛

New Contributors

Full Changelog: https://github.com/aws/aws-sdk-pandas/compare/3.6.0...3.7.0

3.6.0

3 months ago

Features/Enhancements 🚀

  • Enable Iceberg row deletion & add mode parameter to to_iceberg by @LeonLuttenberger in #2632
  • Add support for pyarrow type large_string by @joakibo in #2663
  • Add max_results to athena.list_query_executions by @LeonLuttenberger in #2665

Bug fixes 🐛

  • Pyarrow 15 imports & remove unused code by @kukushking in #2649

New Contributors

Full Changelog: https://github.com/aws/aws-sdk-pandas/compare/3.5.2...3.6.0

3.5.2

3 months ago

Bug fixes 🐛

Documentation 📚

Other 🤖

New Contributors

  • @raaidarshad made their first contribution in #2636

Full Changelog: https://github.com/aws/aws-sdk-pandas/compare/3.5.1...3.5.2

3.5.1

4 months ago

Bug fixes 🐛

  • Deserialization error when reading from DynamoDB using KeyConditionExpression by @LeonLuttenberger in #2607
  • Reading of chunked parquet when columns parameter is specified by @rchromik in #2599

Documentation 📚

  • Add show_create_table to Athena API page by @MikeSchriefer in #2610

Other 🤖

  • chore: Replace bump2version with bump-my-version by @LeonLuttenberger in #2608
  • chore(deps-dev): bump jinja2 from 3.1.2 to 3.1.3 by @dependabot in #2609
  • chore(deps): bump grpcio from 1.51.3 to 1.53.0 by @dependabot in #2612

New Contributors

  • @MikeSchriefer made their first contribution in #2610
  • @rchromik made their first contribution in #2599

Full Changelog: https://github.com/aws/aws-sdk-pandas/compare/3.5.0...3.5.1

3.5.0

4 months ago

Breaking changes 💥

Due to CVEs, Ray is capped to patched version 2.9.x. As a result, the latest version of the library cannot be used on the Glue for Ray runtime. We have raised the CVEs issue to the Glue team

Features/Enhancements 🚀

Bug fixes 🐛

Documentation 📚

Other 🤖

New Contributors

Full Changelog: https://github.com/aws/aws-sdk-pandas/compare/3.4.2...3.5.0

3.4.2

6 months ago

Features/Enhancements 🚀

Full Changelog: https://github.com/aws/aws-sdk-pandas/compare/3.4.1...3.4.2

3.4.1

6 months ago

Features/Enhancements 🚀

Bug fixes 🐛

Documentation 📚

New Contributors

Full Changelog: https://github.com/aws/aws-sdk-pandas/compare/3.4.0...3.4.1