Debezium Server Iceberg Versions Save

Replicates database CDC events to Apache Iceberg Tables

latest

2 weeks ago

Release latest

0.4.0.Final

2 weeks ago

Release 0.4.0.Final

What's Changed

Fix multiple log4j logger bindings by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/289
Fix __source_ts_ms values with 0 conversion and enable mongodb test by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/292
Remove maven stage repository by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/293
Test upsert with tables without PK by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/295
Bump softprops/action-gh-release from 1 to 2 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/301
Add example setup using docker-compose by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/302
Add iceberg-hive-metastore jar to distribution by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/308
Update docker-compose example by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/309
Bump io.smallrye:jandex-maven-plugin from 3.1.6 to 3.1.7 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/300
Bump version.testcontainers from 1.19.6 to 1.19.7 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/299
Bump org.apache.maven.plugins:maven-surefire-plugin from 3.2.2 to 3.2.5 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/297
Bump org.awaitility:awaitility from 4.2.0 to 4.2.1 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/296
Bump dev-drprasad/delete-tag-and-release from 1.0 to 1.1 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/310
Bump org.apache.maven.plugins:maven-assembly-plugin from 3.6.0 to 3.7.1 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/311
Update debezium version to 2.5.4.Final by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/315
Upgrade iceberg to 1.5.2 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/316

Full Changelog: https://github.com/memiiso/debezium-server-iceberg/compare/0.3.0.Final...0.4.0.Final

0.3.0.Final

2 months ago

Release 0.3.0.Final

Breaking Changes

Iceberg upgraded from 1.3.1 to 1.4.3 For Iceberg changes please see https://iceberg.apache.org/releases/

Quarkus upgraded from 3.3.2 to 3.5.3 For Quarkus changes please see https://quarkus.io/blog/tag/release/

What's Changed

Improve exception messages and fix committing to IcebergSchemaHistory by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/234
Upgrade iceberg to 1.4.0 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/237
Correct schema history parameter in application.properties.example file by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/238
Upgrade debezium version to 2.4.x by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/235
Bump org.apache.maven.plugins:maven-assembly-plugin from 3.4.2 to 3.6.0 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/225
Bump org.apache.maven.plugins:maven-failsafe-plugin from 3.0.0-M7 to 3.1.2 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/245
Bump docker/build-push-action from 4 to 5 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/242
Bump docker/login-action from 2 to 3 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/241
Bump actions/checkout from 2 to 4 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/240
Bump com.squareup.okhttp3:okhttp from 4.10.0 to 4.11.0 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/243
Bump version.hadoop from 3.3.2 to 3.3.6 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/244
Upgrade iceberg to 1.4.1 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/247
Bump actions/setup-java from 3 to 4 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/253
Bump version.testcontainers from 1.19.0 to 1.19.1 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/250
Bump com.google.cloud:google-cloud-nio from 0.124.19 to 0.127.7 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/254
Bump org.apache.maven.plugins:maven-surefire-plugin from 3.0.0-M7 to 3.2.2 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/255
Improve documentation by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/258
Upgrade iceberg dependency 1.4.1 to 1.4.3 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/260
Upgrade quarkus 3.3.2 to 3.5.3 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/261

New Contributors

@robinsinghstudios made their first contribution in https://github.com/memiiso/debezium-server-iceberg/pull/272

Full Changelog: https://github.com/memiiso/debezium-server-iceberg/compare/0.3.0.Beta...0.3.0.Final

0.4.0.Beta

2 months ago

This release includes dependency upgrades and improvements with dependency versions.

Breaking Changes

Removed iceberg-spark-runtime-* dependency from the release in #114

Debezium version upgraded from 2.2.1 to 2.5.2 For Debezium 2.2 Breaking Changes please see release notes For Debezium 2.3 Breaking Changes please see release notes For Debezium 2.4 Breaking Changes please see release notes For Debezium 2.5 Breaking Changes please see release notes

Iceberg upgraded from 1.3.x to 1.5.0 For Iceberg changes please see https://iceberg.apache.org/releases/

Quarkus upgraded from 3.3.2 to 3.6.9 For Quarkus changes please see https://quarkus.io/blog/tag/release/

What's Changed

Improve exception messages and fix committing to IcebergSchemaHistory by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/234
Upgrade iceberg to 1.4.0 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/237
Correct schema history parameter in application.properties.example file by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/238
Upgrade debezium version to 2.4.x by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/235
Bump org.apache.maven.plugins:maven-assembly-plugin from 3.4.2 to 3.6.0 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/225
Bump org.apache.maven.plugins:maven-failsafe-plugin from 3.0.0-M7 to 3.1.2 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/245
Bump docker/build-push-action from 4 to 5 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/242
Bump docker/login-action from 2 to 3 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/241
Bump actions/checkout from 2 to 4 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/240
Bump com.squareup.okhttp3:okhttp from 4.10.0 to 4.11.0 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/243
Bump version.hadoop from 3.3.2 to 3.3.6 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/244
Upgrade iceberg to 1.4.1 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/247
Bump actions/setup-java from 3 to 4 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/253
Bump version.testcontainers from 1.19.0 to 1.19.1 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/250
Bump com.google.cloud:google-cloud-nio from 0.124.19 to 0.127.7 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/254
Bump org.apache.maven.plugins:maven-surefire-plugin from 3.0.0-M7 to 3.2.2 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/255
Improve documentation by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/258
Upgrade iceberg dependency 1.4.1 to 1.4.3 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/260
Upgrade quarkus 3.3.2 to 3.5.3 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/261
Upgrade debezium to 2.5.0.Final by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/262
documentation typo fix by @robinsinghstudios in https://github.com/memiiso/debezium-server-iceberg/pull/272
Bump org.postgresql:postgresql from 42.6.0 to 42.7.2 in /debezium-server-iceberg-sink by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/270
Bump github/codeql-action from 2 to 3 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/268
Bump com.fasterxml.jackson:jackson-bom from 2.13.5 to 2.16.1 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/267
Bump version.awssdk from 2.19.4 to 2.22.9 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/265
Bump io.minio:minio from 8.5.1 to 8.5.7 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/264
Bump version.groovy from 3.0.17 to 3.0.20 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/263
Upgrade dependencies, Upgrade iceberg to 1.5.0 and debezium to 2.5.2.Final by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/273
Use jackson version same as iceberg 2.14.2 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/274
Add example config for Hive metastore catalog by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/275
Align package dependencies to iceberg and revert iceberg back to 1.4.3 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/276
Revert iceberg version to 1.4.3, It is changed to 1.4.2 by mistake by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/279
Bump version.groovy from 3.0.20 to 3.0.21 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/280
Bump org.apache.maven.plugins:maven-failsafe-plugin from 3.1.2 to 3.2.5 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/284
Bump version.testcontainers from 1.19.3 to 1.19.6 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/281
Upgrade quarkus from 3.5.3 to 3.6.9 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/285
Upgrade iceberg to 1.5.0 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/278
Use iceberg-spark only for tests by @racevedoo in https://github.com/memiiso/debezium-server-iceberg/pull/114
Switch to iceberg cloud bundle dependecies by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/288

New Contributors

@robinsinghstudios made their first contribution in https://github.com/memiiso/debezium-server-iceberg/pull/272

Full Changelog: https://github.com/memiiso/debezium-server-iceberg/compare/0.3.0.Beta...0.4.0.Beta

0.3.0.Beta

8 months ago

This release includes major features and changes

Notable changes

Support for all nested data types added in #232 #233
New iceberg offset and database history classes added in #174 #175

Notable PRs

Convert __source_ts_ms and __ts_ms to TimestampType.withZone type in #108
Add ofset storage class in #174
Add iceberg schema history storage in #175
Remove aws-java-sdk-bundle from release in #204
Add hive-metastore and Iceberg cloud dependencies to release in #198
Add support to map data type in #232 #233

Breaking Changes

aws-java-sdk-bundle dependency removed from the release in #204
__source_ts_ms and __ts_ms fields are converted to TimestampType.withZone type in #108

Debezium version upgraded from 1.9.5.Final to 2.2.1.Final For Debezium 1.9 Breaking Changes please see release notes For Debezium 2.0 Breaking Changes please see release notes For Debezium 2.1 Breaking Changes please see release notes For Debezium 2.2 Breaking Changes please see release notes

Iceberg upgraded from 0.14.0 to 1.3.1 For Iceberg changes please see https://iceberg.apache.org/releases/

Quarkus upgraded from 2.11.3.Final to 3.3.2 For Quarkus changes please see https://quarkus.io/blog/tag/release/

What's Changed

Upgrade iceberg to 0.14.1 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/110
Convert __source_ts_ms and __ts_ms to TimestampType.withZone type by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/108
Use upstream DebeziumMetrics by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/111
Upgrade quarkus to 2.13.2.Final by @racevedoo in https://github.com/memiiso/debezium-server-iceberg/pull/115
Configure dependabot to update versions automatically by @racevedoo in https://github.com/memiiso/debezium-server-iceberg/pull/116
Remove usages of ObjectNode.put(String, JsonNode) as it is deprecated by @racevedoo in https://github.com/memiiso/debezium-server-iceberg/pull/113
Bump mysql-connector-java from 8.0.28 to 8.0.30 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/125
Bump version.groovy from 3.0.12 to 3.0.13 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/124
Bump docker/login-action from 1 to 2 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/123
Bump minio from 8.4.3 to 8.4.5 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/122
Bump actions/checkout from 2 to 3 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/121
Bump dev-drprasad/delete-tag-and-release from 0.1.3 to 0.2.0 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/119
Bump docker/build-push-action from 2 to 3 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/118
Bump version.hadoop from 3.3.3 to 3.3.4 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/120
Bump version.spark from 3.2.2 to 3.3.0 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/117
Upgrade iceberg-spark to use spark 3.3 by @racevedoo in https://github.com/memiiso/debezium-server-iceberg/pull/127
Bump maven-failsafe-plugin from 3.0.0-M6 to 3.0.0-M7 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/132
Bump version.testcontainers from 1.17.3 to 1.17.5 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/131
Bump version.awssdk from 2.17.256 to 2.17.293 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/130
Bump jackson-bom from 2.13.3 to 2.13.4.20221013 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/128
Upgrade iceberg to 1.0.0 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/112
Bump google-cloud-storage from 2.11.3 to 2.13.1 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/135
Bump version.spark from 3.3.0 to 3.3.1 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/137
Bump version.quarkus from 2.13.2.Final to 2.13.3.Final by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/136
Bump okhttp from 4.9.2 to 4.10.0 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/141
Bump version.awssdk from 2.17.293 to 2.18.7 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/140
Bump maven-assembly-plugin from 3.3.0 to 3.4.2 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/138
Bump maven-surefire-plugin from 3.0.0-M6 to 3.0.0-M7 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/139
Bump gcs-connector from hadoop3-2.2.7 to hadoop3-2.2.8 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/142
Bump google-cloud-nio from 0.124.14 to 0.124.19 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/144
Bump version.quarkus from 2.13.3.Final to 2.14.0.Final by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/143
Bump google-cloud-storage from 2.13.1 to 2.14.0 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/146
Bump version.debezium from 1.9.6.Final to 1.9.7.Final by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/145
Avoid logging secrets in jvm arguments by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/148
Bump gcsio from 2.2.7 to 2.2.9 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/152
Bump postgresql from 42.4.2 to 42.4.3 in /debezium-server-iceberg-sink by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/153
Bump google-cloud-storage from 2.14.0 to 2.15.1 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/156
Update iceberg to 1.1.0 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/158
Bump jandex-maven-plugin from 1.0.8 to 1.2.3 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/150
Bump google-cloud-storage from 2.15.1 to 2.16.0 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/161
Improve github release workflows by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/167
Improve deduplicateBatch logic by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/168
Bump postgresql from 42.4.3 to 42.5.2 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/171
Bump docker/build-push-action from 3 to 4 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/169
Bump minio from 8.4.5 to 8.5.1 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/170
Add ofset storage class by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/174
Improve test dependencies and code by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/177
Upgrade quarkus by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/178
Add iceberg schema history storage by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/175
Bump version.testcontainers from 1.17.5 to 1.17.6 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/179
Upgrade iceberg to 1.2.0 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/182
Document IcebergOffsetBackingStore, IcebergSchemaHistory storage classes by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/183
Bump dev-drprasad/delete-tag-and-release from 0.2.0 to 0.2.1 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/184
Bump version.awssdk from 2.18.7 to 2.19.4 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/162
Upgrade debezium to 2.x by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/176
Use Append commit when there is no delete files by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/188
Minor cleanup and code improvements by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/190
Fix IcebergSchemaHistory and IcebergOffsetBackingStore by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/194
Bump google-cloud-storage from 2.16.0 to 2.22.1 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/193
Upgrade debezium to 2.2.x and Quarkus to 3.x by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/189
Use new storage calesses for tests by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/195
Bump version.groovy from 3.0.13 to 3.0.17 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/185
Improve Offset and Database History Storage classes by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/199
Improve tests and Add JDBC catalog with S3FileIO example config by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/203
Remove aws-java-sdk-bundle from release by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/204
Add hive-metastore and Iceberg cloud dependencies to release by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/198
Make debezium.sink.iceberg.table-prefix config optional by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/212
Add deduplicateBatch test by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/213
fix issue 217 by @Rishav-Git in https://github.com/memiiso/debezium-server-iceberg/pull/218
Bump okio from 3.2.0 to 3.4.0 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/216
Update release.yml, upgrade delete-tag-and-release to v1.0 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/220
Bump gcsio from 2.2.9 to 2.2.16 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/214
Bump postgresql from 42.5.2 to 42.6.0 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/209
Bump version.testcontainers from 1.17.6 to 1.19.0 by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/223
Remove outdated/unused config by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/230
Add support to map data type by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/232
Add support for map type part2 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/233
Upgrade iceberg to 1.3.1 and quarkus to 3.3.2 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/224

New Contributors

@Rishav-Git made their first contribution in https://github.com/memiiso/debezium-server-iceberg/pull/218

Full Changelog: https://github.com/memiiso/debezium-server-iceberg/compare/0.2.0.Final...0.3.0.Beta

0.2.0.Final

1 year ago

Release 0.2.0.Final

What's Changed

update dependency versions by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/80
Bump postgresql from 42.3.1 to 42.3.2 in /debezium-server-iceberg-sink by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/81
Bump postgresql from 42.3.2 to 42.3.3 in /debezium-server-iceberg-sink by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/82
Update Iceberg version by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/83
Upgraded debezium to 1.9.2.Final, quarkus to 2.8.2.Final and iceberg to 0.13.1 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/84
Minor, add draw.io diagram by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/85
Use regexp to enable flexible destination mapping by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/86
Add Debezium Python runner/class by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/87
Upgrade iceberg to 0.13.2 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/88
Support UUID Type by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/89
Add mangodb test by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/65
Bump postgresql from 42.3.3 to 42.4.1 in /debezium-server-iceberg-sink by @dependabot in https://github.com/memiiso/debezium-server-iceberg/pull/93
Update documentation by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/94
Upgrade java build version to 11 and upgrade maven dependencies by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/92
Minor add code comment by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/95
Move Python runner to python module by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/99
Minor code cleanup and Doc fix by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/100
Add consumer artifact to release by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/101
Add python example to doc by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/102
Package google cloud storage client libs by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/103
Use restrictToAnnotatedClass=true for quarkus tests by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/104
Upgrade dependencies by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/105
Upgrade dependencies by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/106
Improve test resources by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/107
Improve tests by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/109

New Contributors

@dependabot made their first contribution in https://github.com/memiiso/debezium-server-iceberg/pull/81

Full Changelog: https://github.com/memiiso/debezium-server-iceberg/compare/0.2.0.Beta...0.2.0.Final

0.2.0.Beta

2 years ago

New features since 0.1.0.Alpha

Enable automatic field addition to support schema evolution #74
Support writing partitioned iceberg tables #71
Add support for array data type #63
Improving documentation #61
Update distribution to include oracle and db2 connectors #60
add Dockerfile and release image to github container registry #53
Support all iceberg file formats parquet,orc,avro #46
Support nested data types #41
Add batch size wait to optimize batch size by monitoring debezium queue size #16

Full Release History

What's Changed

Adding mysql test by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/12
remove hadoop-aws from distribution by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/14
Upgrade iceberg Version to 0.12 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/17
Add batch size wait to optimize batch size by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/16
Adapt iceberg 12 changes by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/18
Minor improvements by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/19
improve documentation by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/15
Add delete test by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/21
Minor improvements (#20) by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/23
chore: update debezium-server version to 1.7.0.Final by @racevedoo in https://github.com/memiiso/debezium-server-iceberg/pull/25
Upgrade quarkus version by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/26
Update aws dependencies by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/29
Simplify naming of master-latest release by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/30
refactor: move get or create table behavior to IcebergTableOperations by @racevedoo in https://github.com/memiiso/debezium-server-iceberg/pull/31
split table operations append and upsert to separate classes by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/33
Apply code recommendations by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/34
Organize Code by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/37
refactor: avoid throwing InterruptedException directly by @racevedoo in https://github.com/memiiso/debezium-server-iceberg/pull/38
Periodically log number of event consumed by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/40
Support nested data types by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/41
refactor(IcebergTableOperatorUpsert): use DeleteWriteBuilder.forTable instead of setting table params manually by @racevedoo in https://github.com/memiiso/debezium-server-iceberg/pull/44
Unit test schema changes by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/43
add new test to see effects of Data Type Changes by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/47
Make file type parametric by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/46
Remove DebeziumToIcebergTable move logic to IcebergUtil by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/48
Improve documentation and document schema change behaviour by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/51
docker: add Dockerfile by @racevedoo in https://github.com/memiiso/debezium-server-iceberg/pull/53
Release docker image to github container registry by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/55
Rename distribution package by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/57
fix: use correct path inside dockerfile by @racevedoo in https://github.com/memiiso/debezium-server-iceberg/pull/58
Update dist include oracle and db2 connectors by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/60
Add support for array data type by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/63
Improve array type handling by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/64
enhance documentation by @chulucninh09 in https://github.com/memiiso/debezium-server-iceberg/pull/61
Add IcebergChangeEvent class Part 1 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/66
Add IcebergChangeEvent class Part 2 by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/67
Upgrade debezium version by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/69
Upgrade debezium and dependencies by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/70
Support Partitioned tables by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/71
Minor improvements by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/73
improve IcebergChangeEvent and iceberg schema generation by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/75
Improve testing helper classes by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/76
[Feature] Enable field addition by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/74
Release 0.2.0.Beta by @ismailsimsek in https://github.com/memiiso/debezium-server-iceberg/pull/78

New Contributors

@racevedoo made their first contribution in https://github.com/memiiso/debezium-server-iceberg/pull/25
@chulucninh09 made their first contribution in https://github.com/memiiso/debezium-server-iceberg/pull/61

Full Changelog: https://github.com/memiiso/debezium-server-iceberg/compare/0.1.0.Alpha...0.2.0.Beta

0.1.0.Alpha

3 years ago

Release 0.1.0.Alpha

New Features:

Iceberg append, upsert modes
Dynamic batch size control