Kafka Connect File Pulse Versions Save

🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka

2.15.0-early-access

1 month ago

Changelog

v2.14.1

1 month ago

Changelog

🪛 Improvement and 🐞 Bug fixes

  • c7f8ad0 chore: update release workflow (Florian Hussonnois)
  • 705bc24 chore: update release workflow (Florian Hussonnois)
  • f52b3ed chore: update release workflow (Florian Hussonnois)
  • 2c16195 chore: bump dependencies (Florian Hussonnois)
  • 616be3e chore: bump dependencies (Florian Hussonnois)

⬆️ Dependencies

  • 0b0fc73 build(deps): bump maven.surefire.plugin.version from 3.1.2 to 3.2.5 (dependabot[bot])
  • 79c37dd build(deps): bump com.github.spotbugs:spotbugs-maven-plugin (dependabot[bot])
  • 9244d51 build(deps): bump org.mockito:mockito-core from 5.5.0 to 5.11.0 (dependabot[bot])
  • 14233d7 build(deps): bump org.apache.maven.plugins:maven-assembly-plugin (dependabot[bot])

Contributors

We'd like to thank the following people for their contributions: '- Florian Hussonnois (@fhussonnois)', '- dependabot[bot] (@dependabot[bot])', '- github-actions[bot] (@github-actions[bot])'

v2.14.0

1 month ago

Changelog

🚀 New Features

  • 89729eb feat(plugin): add parquet file reader (jAVA)

🪛 Improvement and 🐞 Bug fixes

  • 9960290 chore: jacoco to 0.8.9 (Florian Hussonnois)
  • a9de29d chore: bump docker image to cp-kafka-connect-base:7.6.0 (Florian Hussonnois)
  • dae1f7c chore: migrate to SPDX-License-Identifier (Florian Hussonnois)
  • 3a12e7e chore: fix checkstyle (Florian Hussonnois)
  • fae3d56 chore: update docker-compose files (Florian Hussonnois)
  • 1aee27a fix(filters): fix fields by index logic (TheWorkshopCom)
  • 636e73c docs(gh-page): update (Florian Hussonnois)
  • 7493f8e docs: update (Florian Hussonnois)

⬆️ Dependencies

  • 9d4f243 build(deps): bump com.github.spotbugs:spotbugs from 4.7.3 to 4.8.3 (dependabot[bot])
  • 498a3c1 build(deps): bump junit.version from 5.10.1 to 5.10.2 (dependabot[bot])
  • e894318 build(deps): bump org.apache.commons:commons-compress (dependabot[bot])
  • d62f43f build(deps): bump com.fasterxml.jackson.core:jackson-core (dependabot[bot])
  • 2404bb0 build(deps): bump com.azure:azure-identity from 1.10.1 to 1.11.4 (dependabot[bot])
  • dbe079c build(deps): bump org.apache.kafka.version from 3.5.1 to 3.6.1 (dependabot[bot])
  • cc260f6 build(deps): bump com.aliyun.oss:aliyun-sdk-oss from 3.17.1 to 3.17.4 (dependabot[bot])
  • 2a20b81 build(deps): bump org.jreleaser:jreleaser-maven-plugin (dependabot[bot])
  • 13fac18 build(deps): bump org.jacoco:jacoco-maven-plugin from 0.8.10 to 0.8.11 (dependabot[bot])
  • 7101f4a build(deps): bump junit.version from 5.10.0 to 5.10.1 (dependabot[bot])
  • 7ce8ff9 build(deps): bump org.apache.maven.plugins:maven-checkstyle-plugin (dependabot[bot])
  • 5543afa build(deps): bump actions/cache from 3 to 4 (dependabot[bot])
  • 81ef2ba build(deps): bump org.apache.commons:commons-compress (dependabot[bot])
  • cfebb36 build(deps): bump testcontainer.version from 1.19.0 to 1.19.1 (dependabot[bot])
  • 45f34ec build(deps): bump com.github.spotbugs:spotbugs-maven-plugin (dependabot[bot])
  • 9ccc2cb build(deps): bump commons-io:commons-io from 2.13.0 to 2.15.0 (dependabot[bot])
  • e7116c1 build(deps): bump org.apache.maven.plugins:maven-javadoc-plugin (dependabot[bot])
  • f6c5336 build(deps): bump aws.version from 1.12.553 to 1.12.555 (dependabot[bot])
  • b6daea4 build(deps): bump slf4j.version from 2.0.7 to 2.0.9 (dependabot[bot])
  • 9d2ad70 build(deps): bump org.apache.avro:avro from 1.11.2 to 1.11.3 (dependabot[bot])
  • 35e97ff build(deps): bump com.azure:azure-storage-blob from 12.21.1 to 12.24.0 (dependabot[bot])
  • dc47ee9 build(deps): bump com.aliyun.oss:aliyun-sdk-oss from 3.16.3 to 3.17.1 (dependabot[bot])
  • fcb4050 build(deps): bump com.diffplug.spotless:spotless-maven-plugin (dependabot[bot])
  • 957fb2f build(deps): bump aws.version from 1.12.552 to 1.12.553 (dependabot[bot])
  • a462522 build(deps): bump org.apache.avro:avro from 1.11.1 to 1.11.2 (dependabot[bot])
  • 5bb6f0b build(deps): bump aws.version from 1.12.550 to 1.12.552 (dependabot[bot])
  • 57d721e build(deps): bump com.google.cloud:libraries-bom from 26.12.0 to 26.23.0 (dependabot[bot])
  • 325e166 build(deps): bump aws.version from 1.12.548 to 1.12.550 (dependabot[bot])
  • e00af4e build(deps): bump com.azure:azure-identity from 1.9.1 to 1.10.1 (dependabot[bot])
  • c02d08d build(deps): bump junit.version from 5.9.3 to 5.10.0 (dependabot[bot])
  • 2332941 build(deps): bump testcontainer.version from 1.18.3 to 1.19.0 (dependabot[bot])
  • 41ebbd4 build(deps): bump docker/build-push-action from 4 to 5 (dependabot[bot])
  • fe1d02f build(deps): bump crazy-max/ghaction-import-gpg from 5 to 6 (dependabot[bot])
  • fdadc0b build(deps): bump docker/login-action from 2 to 3 (dependabot[bot])
  • 38dc3d1 build(deps): bump docker/setup-buildx-action from 1 to 3 (dependabot[bot])
  • 5d15d70 build(deps): bump org.apache.maven.plugins:maven-checkstyle-plugin (dependabot[bot])
  • 30f73f9 build(deps): bump org.codehaus.mojo:build-helper-maven-plugin (dependabot[bot])
  • e4810d1 build(deps): bump org.apache.commons:commons-compress (dependabot[bot])
  • 33c753d build(deps): bump antlr4.version from 4.12.0 to 4.13.1 (dependabot[bot])

Contributors

We'd like to thank the following people for their contributions: '- Florian Hussonnois (@fhussonnois)', '- TheWorkshopCom', '- dependabot[bot] (@dependabot[bot])', '- github-actions[bot] (@github-actions[bot])', '- jAVA'

2.14.0-early-access

1 month ago

Changelog

v2.13.0

8 months ago

Changelog

🚀 New Features

  • 3d31dbe feat(filters): add built-in NamingConventionFilter (TheWorkshopCom)
  • 0531d63 feat(filters): add documentation for built-in MoveAllFieldsFilter, ExtractValueFilter, ExcludeFieldsMatchingPatternFilter (TheWorkshopCom)
  • 0355ca6 feat(filters): add built-in MoveAllFieldsFilter (TheWorkshopCom)
  • 7fec3c1 feat(filters): add built-in ExtractValueFilter (TheWorkshopCom)
  • e854995 feat(filters): add built-in ExcludeFieldsMatchingPatternFilter (TheWorkshopCom)
  • 6752c23 feat(filters): add built-in ExcludeFieldsMatchingPatternsFilter (TheWorkshopCom)
  • d5375b7 feat(filters): updating documentation date (TheWorkshopCom)
  • 79333f6 feat(filters): removing dependency to assertj (TheWorkshopCom)
  • d78219a feat(plugin): add built-in DateInFilenameFileListFilter (TheWorkshopCom)
  • d8e8df8 feat(plugin): add SFTP Filesystem (TheWorkshopCom)
  • e91cbd9 feat(plugin): add tasks.file.status.storage.topic.creation.enable props (Florian Hussonnois)

🪛 Improvement and 🐞 Bug fixes

  • be13d5d bump confluent image version (Florian Hussonnois)
  • 32f9770 chore: fix apache-license header (Florian Hussonnois)
  • baa79dc fix CSV example (pka23)
  • 35e85ea add test case for AliyunOSSURI (sunxiaojian)
  • dec3ba6 Support for reading files from Aliyun OSS #386 (sunxiaojian)
  • ce329c0 perf(plugin): optimize aws s3 file listing (Bartosz Jaroszewski)
  • e2bf74f fix(plugin): fix NPE in DefaultFileSystemMonitor (#465) (Florian Hussonnois)
  • df7c71f fix(filters): fix wrong index for DelimitedRowIndex (Agustin Gonzalez)
  • aa53cc2 bump project version for next iteration (Florian Hussonnois)

⬆️ Dependencies

  • 243248f build(deps): bump actions/checkout from 3 to 4 (dependabot[bot])
  • fa07d97 build(deps): bump aws.version from 1.12.502 to 1.12.548 (dependabot[bot])
  • 6fd8b11 build(deps): bump org.jacoco:jacoco-maven-plugin from 0.8.9 to 0.8.10 (dependabot[bot])
  • 5b526b8 build(deps): bump com.opencsv:opencsv from 5.7.1 to 5.8 (dependabot[bot])
  • 03105fd build(deps): bump com.azure:azure-storage-blob from 12.21.1 to 12.23.1 (dependabot[bot])
  • 3fa31d6 build(deps): bump software.amazon.msk:aws-msk-iam-auth (dependabot[bot])
  • 9b65463 build(deps): bump org.mockito:mockito-core from 5.3.1 to 5.5.0 (dependabot[bot])
  • 163e626 build(deps): bump org.apache.maven.plugins:maven-assembly-plugin (dependabot[bot])
  • 683ca75 build(deps): bump org.apache.maven.plugins:maven-source-plugin (dependabot[bot])
  • f275a54 build(deps): bump com.github.spotbugs:spotbugs-maven-plugin (dependabot[bot])
  • 8aa5849 build(deps): bump org.apache.kafka.version from 3.4.0 to 3.5.1 (dependabot[bot])
  • 75304f9 build(deps): bump testcontainer.version from 1.18.0 to 1.18.3 (dependabot[bot])
  • f506e42 build(deps): bump maven.surefire.plugin.version from 3.0.0 to 3.1.2 (dependabot[bot])
  • ec0f27e build(deps): bump junit.version from 5.9.2 to 5.9.3 (dependabot[bot])
  • d2b2c62 build(deps): bump aws.version from 1.12.483 to 1.12.502 (dependabot[bot])
  • 6929c39 build(deps): bump Saxon-HE from 12.1 to 12.3 (dependabot[bot])
  • c92a7a3 build(deps): bump json from 20230227 to 20230618 (dependabot[bot])
  • 0acf316 build(deps): bump spotless-maven-plugin from 2.36.0 to 2.37.0 (dependabot[bot])
  • 68b0b98 build(deps): bump aws.version from 1.12.447 to 1.12.483 (dependabot[bot])
  • 3238d83 build(deps): bump commons-io from 2.11.0 to 2.13.0 (dependabot[bot])
  • fccfff6 build(deps): fix build (Florian Hussonnois)
  • 36ab512 build(deps): bump aws.version from 1.12.445 to 1.12.447 (dependabot[bot])
  • ccb9e0a build(deps): bump mockito-core from 5.2.0 to 5.3.1 (dependabot[bot])
  • bfa2573 build(deps): bump jackson-databind from 2.14.2 to 2.15.2 (dependabot[bot])
  • e6cd947 build(deps): bump azure-identity from 1.8.1 to 1.9.1 (dependabot[bot])
  • e843cff build(deps): bump aws.version from 1.12.444 to 1.12.445 (dependabot[bot])
  • 555f964 build(deps): bump aws.version from 1.12.443 to 1.12.444 (dependabot[bot])
  • 4288bd0 build(deps): bump spotbugs-maven-plugin from 4.7.3.3 to 4.7.3.4 (dependabot[bot])
  • 9f578f7 build(deps): bump spotless-maven-plugin from 2.35.0 to 2.36.0 (dependabot[bot])
  • 1887176 build(deps): bump aws.version from 1.12.442 to 1.12.443 (dependabot[bot])
  • ca320ca build(deps): bump testcontainer.version from 1.17.6 to 1.18.0 (dependabot[bot])
  • b4ae964 build(deps): bump libraries-bom from 26.11.0 to 26.12.0 (dependabot[bot])
  • df8fa35 build(deps): bump spotless-maven-plugin from 2.33.0 to 2.35.0 (dependabot[bot])
  • 700aa83 build(deps): bump aws.version from 1.12.428 to 1.12.442 (dependabot[bot])
  • fba4f57 build(deps): bump actions/cache from 1 to 3 (dependabot[bot])

Contributors

We'd like to thank the following people for their contributions:

v2.12.0

1 year ago

Features

Improvements & Bugfixes

  • fix(plugin): fix KafkaFileObjectStateBackingStoreConfig by @fhussonnois

Docs

Sub-Tasks

Docker Images

$ docker pull streamthoughts/kafka-connect-file-pulse:2.12.0

For verifying distirbution zip file

$ curl -L -o streamthoughts-kafka-connect-file-pulse-2.12.0.zip https://github.com/streamthoughts/kafka-connect-file-pulse/releases/download/v2.12.0/streamthoughts-kafka-connect-file-pulse-2.12.0.zip
$ curl -L -o streamthoughts-kafka-connect-file-pulse-2.12.0.zip.asc https://github.com/streamthoughts/kafka-connect-file-pulse/releases/download/v2.12.0/streamthoughts-kafka-connect-file-pulse-2.12.0.zip.asc
$ gpg --keyserver keyserver.ubuntu.com --recv-keys D12696955654914F
$ gpg --verify streamthoughts-kafka-connect-file-pulse-2.12.0.zip.asc streamthoughts-kafka-connect-file-pulse-2.12.0

Full Changelog: https://github.com/streamthoughts/kafka-connect-file-pulse/compare/v2.11.0...v2.12.0

v2.11.0

1 year ago

Features

Improvements & Bugfixes

Docs

Sub-Tasks

Docker Images

$ docker pull streamthoughts/kafka-connect-file-pulse:2.11.0

For verifying distirbution zip file

$ curl -L -o streamthoughts-kafka-connect-file-pulse-2.11.0.zip https://github.com/streamthoughts/kafka-connect-file-pulse/releases/download/v2.11.0/streamthoughts-kafka-connect-file-pulse-2.11.0.zip
$ curl -L -o streamthoughts-kafka-connect-file-pulse-2.11.0.zip.asc https://github.com/streamthoughts/kafka-connect-file-pulse/releases/download/v2.11.0/streamthoughts-kafka-connect-file-pulse-2.11.0.zip.asc
$ gpg --keyserver keyserver.ubuntu.com --recv-keys D12696955654914F
$ gpg --verify streamthoughts-kafka-connect-file-pulse-2.11.0.zip.asc streamthoughts-kafka-connect-file-pulse-2.11.0

Full Changelog: https://github.com/streamthoughts/kafka-connect-file-pulse/compare/v2.10.0...v2.11.0

v2.10.0

1 year ago

Features

Improvements & Bugfixes

Docs

Sub-Tasks

Docker Images

$ docker pull streamthoughts/kafka-connect-file-pulse:2.10.0

For verifying distirbution zip file

$ curl -L -o streamthoughts-kafka-connect-file-pulse-2.10.0.zip https://github.com/streamthoughts/kafka-connect-file-pulse/releases/download/v2.10.0/streamthoughts-kafka-connect-file-pulse-2.10.0.zip
$ curl -L -o streamthoughts-kafka-connect-file-pulse-2.10.0.zip.asc https://github.com/streamthoughts/kafka-connect-file-pulse/releases/download/v2.10.0/streamthoughts-kafka-connect-file-pulse-2.10.0.zip.asc
$ gpg --keyserver keyserver.ubuntu.com --recv-keys D12696955654914F
$ gpg --verify streamthoughts-kafka-connect-file-pulse-2.10.0.zip.asc streamthoughts-kafka-connect-file-pulse-2.10

New Contributors

Full Changelog: https://github.com/streamthoughts/kafka-connect-file-pulse/compare/v2.9.0...v2.10.0

v2.9.0

1 year ago

Features

Improvements & Bugfixes

Docs

Sub-Tasks

New Contributors

Docker Images

$ docker pull streamthoughts/kafka-connect-file-pulse:2.9.0

For verifying distirbution zip file

$ curl -L -o streamthoughts-kafka-connect-file-pulse-2.9.0.zip https://github.com/streamthoughts/kafka-connect-file-pulse/releases/download/v2.9.0/streamthoughts-kafka-connect-file-pulse-2.9.0.zip
$ curl -L -o streamthoughts-kafka-connect-file-pulse-2.9.0.zip.asc https://github.com/streamthoughts/kafka-connect-file-pulse/releases/download/v2.9.0/streamthoughts-kafka-connect-file-pulse-2.9.0.zip.asc
$ gpg --keyserver keyserver.ubuntu.com --recv-keys D12696955654914F
$ gpg --verify streamthoughts-kafka-connect-file-pulse-2.9.0.zip.asc streamthoughts-kafka-connect-file-pulse-2.9.0.zip

Full Changelog: https://github.com/streamthoughts/kafka-connect-file-pulse/compare/v2.8.0...v2.9.0

v2.8.0

1 year ago

Features

Improvements & Bugfixes

Docs

Sub-Tasks

Docker Images

$ docker pull streamthoughts/kafka-connect-file-pulse:2.8.0

For verifying distirbution zip file

$ curl -L -o streamthoughts-kafka-connect-file-pulse-2.8.0.zip https://github.com/streamthoughts/kafka-connect-file-pulse/releases/download/v2.8.0/streamthoughts-kafka-connect-file-pulse-2.8.0.zip
$ curl -L -o streamthoughts-kafka-connect-file-pulse-2.8.0.zip.asc https://github.com/streamthoughts/kafka-connect-file-pulse/releases/download/v2.8.0/streamthoughts-kafka-connect-file-pulse-2.8.0.zip.asc
$ gpg --keyserver keyserver.ubuntu.com --recv-keys D12696955654914F
$ gpg --verify streamthoughts-kafka-connect-file-pulse-2.8.0.zip.asc streamthoughts-kafka-connect-file-pulse-2.8.0.zip

Full Changelog: https://github.com/streamthoughts/kafka-connect-file-pulse/compare/v2.7.0...v2.8.0