Kafka Minion Versions Save

Changelog

• 2e792e6da6b930418d2c46c1ac03dfbe5025ae46: update franz-go to latest version (@weeco)
• 569fa8251f8e197439ef544af619f4cfef3b4480: update go v1.22 (@weeco)
• a50eaf70af78008755bec6408a5e6a6bbf2306a1: make init phase more robust if cluster is offline (@weeco)
• 2bc1ad7d8cf1c78089027b01f8f8027f706af89f: lower log level for expired/lost messages (@weeco)
• 2d34cf1f32b56c8f612b0846b69d3a44feb0776d: use TryProduce instead of blocking Produce if buffer is full (@weeco)
• 1f1fe713fd59800d43a96d27cdabde670d5f894a: fix disabling consumergroup or topic collection (@weeco)

Docker Image

Use the following command to pull this release's Docker image:

docker pull redpandadata/kminion:v2.2.8

Changelog

• 406d1980e53e658404f95611746a3d7fe3385fc6: Update image tag in Readme (@weeco)
• 4fa1a11820326b53cc140132dbcc617c4105e987: Add support for SASL/OAUTHBEARER (#230) (@bachmanity1)
• 9ff13ad0d414145b5638bfbebcd54d1c46f7cb9c: update docker pull image with latest (@andrewhsu)
• 5bcd78fe28965265924dcc247c97427e4c8afbd1: Merge pull request #228 from andrewhsu/docker-pull (@andrewhsu)
• 4c40fee3e54854f03b87390912e562fccb08e9c6: removes snyk cli scan - this project will now use scm integration (#241) (@wreet)
• 5a57069ea85d9dbb91f3819211f7ec49467fb82d: chore: remove kics workflow (#242) (@weeco)
• 88dae5c9e0ec3c7afb691913564a85ab02647679: updating golang and various libs to fix security vulns (#249) (@rmb938)

Docker Image

Use the following command to pull this release's Docker image:

docker pull redpandadata/kminion:v2.2.7

Changelog

• d15078f33b50b9851092209ee7097b2dca9caded: helm: Package chart v0.11.3 (@sbocinec)
• fc3d500d2da229b8401795b93c7e1e30dd0d4b1c: build: fix .gitignore to not ignore kminion helm chart (@sbocinec)
• 83fafe378c1810321ec410808839d1a17a9b2c1a: Update README.md (@vikumar-ciena)
• f3ce983306e58050dd55f4fdfbc50388342ad9b6: Make kminion helm chart compatible with K8s >= 1.25 (@panyuenlau)
• 18986e8455248a277f884badff973c0042b41bfb: chore: release chart v0.12.0 (@weeco)
• 752ba52e8649210c4f361d57a6b7b225edd4ebf3: helm: allowPrivilegeEscalation=false (@simon0191)
• 2f841e31aff86138def1b1e3716324ade8efe56c: Merge pull request #218 from redpanda-data/ss/no-proviledged-access (@simon0191)
• cde80c2c90e33f0a98b3e3af83d9c8d970fe8bf3: Bump appVersion (@gavinheavyside)
• b492a8c2f75b78ca80e377c3f85cb69514881395: Merge pull request #226 from redpanda-data/gavinheavyside/bump-alpine-base-image (@gavinheavyside)
• ffd448787022b41c6264875fad9fe15734c1d587: Revert "Bump appVersion" (@gavinheavyside)
• a4b98548106bb819a3301ce5f6b4291c15ef906d: Use latest tag at time of writing in README (@gavinheavyside)
• 0c90d4301ed4600d1aaf3345b6f16587d2f282fc: Merge pull request #227 from redpanda-data/revert-226-gavinheavyside/bump-alpine-base-image (@gavinheavyside)

Docker Image

Use the following command to pull this release's Docker image:

docker pull redpandadata/kminion:v2.2.6

Changelog

• a7d4bd895f76756c6667fdf93a1cbcd525b833c4: build: use the same alpine OS version in Dockerfile (@sbocinec)
• 3391840172a9db688f1d524156eafed9e9c076c0: build: run OS pkg update on image build (@sbocinec)
• 291a8ee2e163425549b6d970b0c652d50e351e5e: Merge pull request #211 from redpanda-data/st/docker-image-sync-up (@sbocinec)

Docker Image

Use the following command to pull this release's Docker image:

docker pull redpandadata/kminion:v2.2.5

Changelog

• d24d713031637216e4628571e0b0c5dfbb0a8297: Update all dependencies (#194) (@weeco)
• d7c838e028ed821c050897f4ab41399007b14deb: fix: support ingress for clusters >= 1.22 (#195) (@TheMeier)
• 764017c08fc6faa680f6c4e734cec1594a3ceec5: Release new chart version (#197) (@weeco)
• 295efc25721950a8b2b62ad06cbf3499c4d9c9bd: fix: set apiVersion for PodDisruptionBudget depending on capabilities (#198) (@TheMeier)
• a80e8074586d3c80261d7d5f39be3526303b4f98: publish kminion-0.11.1 (@joejulian)
• 22c95d6f84ed8989f0696cca90b3a26a42eaf901: Merge pull request #199 from redpanda-data/publish_latest (@joejulian)
• bebfda8ba4737cdd86237fe05cdd849df17f7bfd: Add user to docker image to avoid running as root (@simon0191)
• 1b7366c3f54def475d056cc6962cfd3ad954f0a8: Merge pull request #202 from redpanda-data/ss/sec-add-user-to-docker-image (@simon0191)
• 2810e7d0d9e04a1e44c4ce3a7a75b048f6f5adc6: Update default docker repository (#201) (@weeco)
• eb48b5d9ff17f25c7a43691e82f12a9f9452bc9d: helm: Package chart v0.11.2 (#204) (@weeco)
• f0a6e370a762f6c06fae31164741145395fea200: build: update docker repo in release notes (@weeco)
• 4b7bfc82dc7e6b0141d7c4a4b85728a260d48480: build: update go version to v1.20 (@weeco)
• 3c7e7ccf4a7ef4904dffe9076c374e30505680fd: build: disable CGO when building (@weeco)
• e65214271d4feded37b7304720f160d8168c40cf: chore: update dependencies (@weeco)

Docker Image

Use the following command to pull this release's Docker image:

docker pull redpandadata/kminion:v2.2.4

Changelog

• 85993abe250a98c11b1d732ba3e41abc7c8da6ea: Add graceful shutdown to HTTP server (@hhromic)
• 91d89fb16e6d64264509f18d239920a0af4a6abb: update franz-go to v1.10.4 (@)
• e6ed3be75386ab20fac7b6ef9c6df5d06d413bcb: Merge pull request #180 from redpanda-data/update-franz-go (@weeco)
• 7db0042c7e5b23cf43c07d4c967e171b9ead2c67: Simplify signal handling logic (@hhromic)
• 5d28b6d47d6ce9cd5666185b8f6ece5279a916e7: Merge pull request #178 from hhromic/http-graceful-shutdown (@weeco)
• ba7d561e605a4ad1f84d6898a95911d4e90fe0b3: add extraPorts for extraContainers (@cruwe)
• 1be4f8fec77a4b23898323913e61e28fd2d8874d: Merge pull request #176 from cruwe/add-extraPorts-for-extraContainers (@weeco)
• 10ca7ea65e92807fa0229f940acadac38f3a53f3: adds snyk scanning (@wreet)
• c515483b40c0ae9da63a811da4ad695551d7ab0d: Merge pull request #183 from redpanda-data/snyk-scanning (@weeco)
• cf800d62bdae4c89e8380a993a9ff32edffa7caa: adds cron for snyk scans (#184) (@wreet)
• 66777ffd1813fecec6b3bec43bfb23cd3f56f1db: build: also push docker image to redpandadata (#186) (@andrewhsu)
• 7367a4a36c6830dfb9de8a214fe0890bd997c97c: updates kics (#192) (@wreet)
• 89c22763cbc65b623e9e40fcd700535bed88deb5: fix: unmarshal ca, privateKey, cert as string instead of byte slice (#193) (@TheMeier)

Docker Image

Use the following command to pull this release's Docker image:

docker pull vectorized/kminion:v2.2.3

Changelog

• 85993abe250a98c11b1d732ba3e41abc7c8da6ea: Add graceful shutdown to HTTP server (@hhromic)
• 91d89fb16e6d64264509f18d239920a0af4a6abb: update franz-go to v1.10.4 (@)
• e6ed3be75386ab20fac7b6ef9c6df5d06d413bcb: Merge pull request #180 from redpanda-data/update-franz-go (@weeco)
• 7db0042c7e5b23cf43c07d4c967e171b9ead2c67: Simplify signal handling logic (@hhromic)
• 5d28b6d47d6ce9cd5666185b8f6ece5279a916e7: Merge pull request #178 from hhromic/http-graceful-shutdown (@weeco)
• ba7d561e605a4ad1f84d6898a95911d4e90fe0b3: add extraPorts for extraContainers (@cruwe)
• 1be4f8fec77a4b23898323913e61e28fd2d8874d: Merge pull request #176 from cruwe/add-extraPorts-for-extraContainers (@weeco)
• 10ca7ea65e92807fa0229f940acadac38f3a53f3: adds snyk scanning (@wreet)
• c515483b40c0ae9da63a811da4ad695551d7ab0d: Merge pull request #183 from redpanda-data/snyk-scanning (@weeco)
• cf800d62bdae4c89e8380a993a9ff32edffa7caa: adds cron for snyk scans (#184) (@wreet)
• 66777ffd1813fecec6b3bec43bfb23cd3f56f1db: build: also push docker image to redpandadata (#186) (@andrewhsu)
• 7367a4a36c6830dfb9de8a214fe0890bd997c97c: updates kics (#192) (@wreet)
• 89c22763cbc65b623e9e40fcd700535bed88deb5: fix: unmarshal ca, privateKey, cert as string instead of byte slice (#193) (@TheMeier)

Docker Image

Use the following command to pull this release's Docker image:

docker pull vectorized/kminion:v2.2.2

Changelog

• 2f5e2cd566446b37352b26a35293ee906146f491: Update Helm chart with v2.2.0 image tag (@BitProcessor)
• 352c8dd9b15126e3bcb5bfff6b8cc077f8d94e3f: Merge pull request #134 from BitProcessor/master (@weeco)
• 3e705571af9bcd699be93e8c5008aa4577093463: [Auto Commit] Package helm chart (@weeco)
• ddac75ec7fa461458895bef32da043b8254376ac: Fix the prom annotations sample (are not labels) (@BitProcessor)
• bb3014edd19cc5117652f77f9229b2f215687998: Fix the prom annotations sample (are not labels) (@BitProcessor)
• 8ff3a2d7f2726dc9f676b8db864f59cff0f9ab41: Revert "Fix the prom annotations sample (are not labels)" (@BitProcessor)
• 05a03ed6175352f8e4a9e99d32589bb7bc163dc2: Merge pull request #135 from BitProcessor/master (@weeco)
• cab459581736711ed7db2582469ca9954e7110f3: Upgrade franz-go to v1.4.1 (@alexander-falca)
• 2a62a9d24ca6579cc5dcf30c4f56215430162fd4: Merge pull request #140 from alexander-falca/franz-go-upgrade (@weeco)
• a4cbed24eda706c689a29971920cd04062158bd8: Increase membersWithEmptyAssignment when MemberAssignment is empty (@Sh1ftry)
• 4fbec9af01b97d5b746187494bb2ee50f508a34d: Merge pull request #142 from Sh1ftry/empty-members-assignment (@weeco)
• a066b272a92678f3919682a8daf377819de330f2: config: add possibility to specify tls as bytes (@alenkacz)
• ea8dbba00a04cbfbf3808d9882fdab14a658efbb: Merge pull request #147 from alenkacz/av/ca-cert-key (@weeco)
• ee700c22928adbe71bff5c784c1e8d77f19df57e: Update CodeQL to latest versions (@weeco)
• 802bdab44166694458d78212a0a77ab18bd00657: Update Docker base image to Go v1.18 (@weeco)
• f848ea9a20c2d2da0fc22ea8b5c60075bcb78575: do not use logger.Fatal when testing connection (@alenkacz)
• d068e97ce5094870d1bdc8483a7e794e5c15cab6: Use build flags for version and meta information instead of env variables (@weeco)
• b71e21fa8f836780739f66590ad800530aa2b573: Use single GH actions workflow to build Docker image and update used actions to the latest versions (@weeco)
• 52a26f9c4d22b1062fe52af395713ce1d427a62c: Update GoReleaser config and build for multi arch binaries (@weeco)
• 2f6ccdf5313bfb8486b1293d4bfa6a85c8eafd66: Merge pull request #148 from alenkacz/av/no-logger-fatal (@weeco)
• f00573c563e48b88f359c89b71c123f84ebbb4aa: Use docker registry vectorized (@weeco)
• 72fe3edca1e08c85d4c9ad8d65cdb0e9634fb9a7: do not log as info from testConnection func (@alenkacz)
• 3712fd3dc6f36606e29b5ae2ed34841a1e5d787d: Merge pull request #149 from alenkacz/av/no-info-log (@weeco)
• e8181ad02436fd5193a45b4dab29af9b58718cc2: Run GoReleaser only on new tags (@weeco)
• c68ad1064e7d760b15aa940d34e955f73b3aa4fc: Create binaries on release for arm64 and amd64 (@weeco)
• 46a33d56ae02d7ee2ffe4663ff993032c758cdfd: Update all dependencies and require Go 1.18 (@weeco)
• 125519c30567a324b253908d5858a9edabc61cac: Add multi-platform docker builds (@weeco)
• f97e56e47e1355af51f284bf6dcf1041e9c3a3b4: Install qemu action for multi-platform builds (@weeco)
• 9d178573bc2ccbb099504c000f9e2a4bebd5964a: Remove logging on info level from kafka service (@alenkacz)
• 18bc1ad9e19c8dd254f3a8d47eab7cfe8864ee02: Merge pull request #150 from alenkacz/av/log-info-remove (@weeco)
• f81b6c9e97ac1045d121257308ed6983323ed0c2: remove unused import (@alenkacz)
• 5425c6203c957ad1688bb60d5e8eb9bb2bdaaa63: Merge pull request #151 from alenkacz/av/unused-import (@weeco)
• a69839c1a7067c4de562c2c5190bb51606101831: Replace Discord link with Slack link (@weeco)
• c3d9ae699ee48afccafe79fca72fc8240fcb60bd: Add support to set Deployment annotations (@amuraru)
• 3eb190ad42d3d0c1bc23eb6c489944cfb3339441: Merge pull request #158 from amuraru/pr (@weeco)
• 630b419df9a4a81dcc67f650576767e3b52ef3a6: Release v0.9.0 (@weeco)
• 5a5c78855a24489021061e328e11e7162b16e0ae: [Auto Commit] Package helm chart (@weeco)
• 7ac093a936e0df3e5daa8749b333822007b848b6: feat: allow retry on init failure (@Scandiravian)
• 020e30e97df189f590ae19d9e43d6589cb356745: Merge pull request #166 from Scandiravian/allow-no-crash-on-initial-connect-failure (@weeco)
• 6362e856ee3fda77017e5a4fbb63015762b5b211: Add support for more features in helm chart (@antvick)
• cb9763e193894a9d294ab9990f0ba23db8b23259: Bump helm chart release version (@antvick)
• 845f8fa60ca7268fa47a81da320db3611f716c54: Fix emptyDir volume (@antvick)
• f1ea127c0de873e426db07b061344bfe394f4dee: Add support for any extra volume type not just emptyDir (@antvick)
• a2f14019dd37a7b1d2ed73a91f4197b09012179e: Update example values.yaml (@antvick)
• 37424c1a4169c59bfbb199e0dc6d940c7a81c81d: Add deployment labels (@antvick)
• 9918d411842ccb7448e09940ee1da7dbcdc8d3da: Revert customlabels variable (@antvick)
• 58684d4ad41154aae065fc0b89d5d57bb740d3d7: Revert deployment annotations change (@antvick)
• 60d41ec6c604fa3a1482dae262360ad30e3c2435: add ignore exit fail for results (@)
• 4ededa96a811aa972618453e1d4e743411f4f180: add kics scanning (@)
• 71512bae3636aa24318adb1ece951b9ab0ff4d9d: fix action-specfic issues (@)
• 0ef4ca2b5ed81164e9eda0bb4008303d73d79d50: Merge pull request #171 from redpanda-data/iac-scanning (@wreet)
• 71b0ac23008f0fb448c9aa78454f73f6b80dc716: Revert move empty line in custom labels (@antvick)
• ebf004b1c28cfb87b01b1dfc3fc862ae91bdad24: Optional readiness probe (@antvick)
• 3806868d70751333fb0f2378d5da3146892329d8: Merge pull request #170 from nutmegdevelopment/task/extra-deployment-containers (@weeco)
• 2ddba523fe2f22b49070457f000af180e43a5511: Update all dependencies including runtime image (Alpine) (@weeco)
• 190dcfb28e098a609509a467a58a4ffff6562764: Merge pull request #172 from redpanda-data/update-dependencies (@weeco)
• 2e66a4d68294204276f772493d340a5e9b75d86c: Fix Go releaser config (@weeco)
• 3025881fedd24492b410ded6815ee134c7bfc9c4: Merge pull request #173 from redpanda-data/fix-goreleaser-cfg (@weeco)
• 1cb8f11ff71b96cdebb2d586d2d17998f6a86f99: build: Fix condition for semver docker tag (@weeco)
• cdd8e59e3beae8301ac398773bc98860329d0277: Merge pull request #175 from redpanda-data/fix-docker-tag-condition-in-build-pipeline (@weeco)

Docker Image

Use the following command to pull this release's Docker image:

docker pull vectorized/kminion:v2.2.1

Changelog

• d0d9e9d Make E2E service accept a prometheus registerer
• 2b50411 use right nil type to fix partition reassignments
• 236d68c Validate number of specified brokers
• 49300f0 Order imports
• 63d501b Handle other protocolTypes than consumer properly
• 461321b Lower produce request timeout to 3s
• 5fdb775 Eagerly initialize failed metrics
• ffa4211 Fix race condition in message tracker
• a082b4e Fix typo in enum variable name
• 059131a [Auto Commit] Package helm chart
• 5adc178 Release v0.8.2
• 8e169a7 Fix indenting
• 0236e2e [Auto Commit] Package helm chart
• 114cdb8 Release v0.8.1
• 7ccca22 Fix broken format
• f94e25b [Auto Commit] Package helm chart
• d6a8030 Bump chart version
• 41127e4 Add readiness probe for newer KMinion versions
• fcd8c0c Only add consume config for appropriate scrapeMode
• c1e922e Move comment into switch cases
• fb5f4d4 Remove line break to improve readability
• 62b1b51 Fix error handling for topic metadata response
• 9960755 Merge pull request #129 from Scandiravian/handle_UnknownTopicOrPartition_error
• 776cc2d Use typed error
• c0f7ac6 Create topic instead of panic, when error is UnknownTopicOrPartition
• 9162d2f Consider errors in metadata response for topic check
• 26b2314 Merge pull request #128 from alenkacz/av/send-msg-immediately
• 7c2e82e Send first e2e init message immediately
• 21e8a6b Update to franz-go v1.2.2
• d2b9046 Merge pull request #127 from alenkacz/av/helm-install
• 357f8e5 Drop --name in helm install readme
• 64d41d5 Merge pull request #124 from amuraru/pod-target-labels
• d3016f8 Propage kminion pod custom labels as metrics labels
• 8a393eb [Auto Commit] Package helm chart
• 2ed9d5a Release version 0.7.0
• e0d6dc5 Merge pull request #122 from stoader/metric_relabeling
• a09adb0 Default value for serviceMonitor.relabelings
• 0223754 Support metric relabeling
• f5c6af4 [Auto Commit] Package helm chart
• 877e893 Release chart version 0.6.0
• 1dd4368 Merge pull request #119 from mrandreyeff/add_daemonset
• 1dd0306 Merge pull request #105 from amuraru/issue-103
• ed79c19 update according to changes in values
• 4518838 change daemonset values structure
• 3f84442 Merge pull request #120 from rashid4lyf/feature/add_scrape_timeout_interval
• 89ea1c6 Merge remote-tracking branch 'origin/master' into feature/add_scrape_timeout_interval
• 430d647 update values to 10s and 15s
• af4fb49 Merge pull request #118 from mrandreyeff/add_targetLabels
• 00eb355 Extract consumer group member_count as a separate metric
• 7cbbc7d fix indent
• 66e3435 support for dynamic scrapeTimeout and interval
• caba0ad add daemonset template
• 5536165 add serviceMonitor.targetLabels
• dff9857 Merge pull request #106 from amuraru/issue-104
• 4e87969 Implemented review comments
• 320627b Export number of members and assigned partitions for each topic in a consumer group
• 30f84f5 Fixes #111
• 1e3a1d5 Introduce a state property that tracks whether a msg has been produced successfully or not
• 7b6bd7e Fix partition reassignment and creation
• a3558e0 Change default for commitSla to 5s
• c4e5e82 Move to new cache lib
• 02dbc3e Update franz-go to v0.10.2
• f10fa9e Remove unused template literal
• 01ff757 Use oneliner to access the Kafka message keys
• 6901e62 Do not try to create or modify the topic if management is disabled
• d38052f Fix offset commit metrics
• ba20914 Use named loggers everywhere
• 1545c20 Add clarifying log message during consumer init
• f6ab00e Add timeout for consumer initialization
• 6f76df2 Fix consumer initialization process for empty topics
• 020c680 Make all message metrics vectors with partition id as label
• 08dff9b Don't manage topics if not enabled
• 7e882f2 Wait for a fully initialized consumer before starting the producer
• 326337f Consume from newest offset
• f6b7b3f Add messages to messagetracker before getting produce response
• 3d59e90 Update franz-go to v0.9.1
• d452033 Add partitionID in labels
• 5e11446 Fix bug where we marked successfully received messages as lost
• 634347d Rename metrics variable names
• ded85bf Update to latest franz-go version
• 4285a76 Add timeout for producing records
• d0348bd Add timeout for producing records
• e699e83 Add counter for lost messages
• 244567c Move end to end message struct into it's own file
• a2daa17 Refactor produce methods so that it is no longer sequential
• 778e87c Remove TODO in regards to a metric tracking the failed produces
• 1c46b56 Add metrics for produced messages
• c0b7922 [Auto Commit] Package helm chart
• 2d3d03f Release version 0.5.0
• 01843a9 Add PodDisruptionBudget resource
• 7381f6b Merge pull request #98 from amuraru/hlm
• ec2c5de Tidy go mod
• 52bb5f2 Merge pull request #109 from amuraru/update-deps
• eddb2b8 Use consistent naming convention for log fields
• d6048fd Update franz-go library to 0.9.0
• aeb3b12 [helm-chart] Append customLabels to all resources if defined
• a234a98 Document ensureCompatibility method
• 5a7a20a Merge pull request #101 from amuraru/cached-groups
• f96bc3a Introduce /ready endpoint that can be used in a readiness or startup probe
• b6b6b4c Use cached consumer groups when listing offsets via Admin API
• 63cba76 Merge pull request #97 from amuraru/moretopicconfigs
• 032d501 Update minion/config_topic_config.go
• a8a95ac Update minion/config_topic_config.go
• 4cbfe01 Update minion/config_topic_config.go
• 77249c3 Allow to export configurable set of topic configuration keys
• 1a777bf Refactor some end-to-end functionality
• 8157df5 Update to franz-go v0.8.0
• 1ffd02b Print aggregated error summary
• 3c7cfad Add partitions per broker default of 1
• 01bedfc Fix reference config and change some e2e defaults
• ec31cfd Merge branch 'master' of https://github.com/cloudhut/kminion
• ce0423c update reference config
• b435183 update reference config
• 20bd38d Clarify what validateManagementTopic() does
• 8d8c683 Use key from generated kmsg instead of comparing key name
• 423e1c0 Merge branch 'endtoend'
• 17ec4dd Update franz-go to v0.8.0
• 0c33e52 Merge pull request #95 from Trackunit/feature/document-scrapemode
• be3686c Also mention the increase in CPU usage when using scrapemode=offsetsTopic
• 4305998 Document the difference between scrapemodes
• 4948761 Fix formatting of e2e monitoring metrics
• 5982e2c Fix some typos and reword a few things
• ea47f26 Merge branch 'master' of https://github.com/cloudhut/kminion
• 23a4d9a Update franz-go to v0.7.9
• 10ed356 add e2e feature documentation, updated readme with link
• ec428c0 fix issues when with logging string pointers
• 390cf6f multiple changes: - remove rebalancingProtocol config, since there will never be any rebalancing in kminions consumer groups (since every kminion instance has exactly one, unique, consumer group that it uses) - change type of 'requiredAcks' from int to string (now takes 'all' or 'leader') - lots of functions have been refactored to use "early return" and/or split into logical steps so there aren't any huge functions - 'createEndToEndRecord' doesn't return an error anymore and instead panics. if serialization fails, there must be an issue that prevents kminion from running anyway - actually set 'ProduceRequestTimeout' to 'ackSla' config property - topic.go: complete rewrite: properly validate partition count, partition assignments, replication factor; considering potentially changing broker/partition count and replicationFactor; also now error checking for all potential errors in kafka responses (including nested errors, that are for example local to only one partition)
• e262749 Merge pull request #90 from JoschaLaubach/fix-link-in-charts-docs
• 405dbc5 docs: Fix link in Helm chart readme
• 192bf30 message tracker, better comments, use time.Now() everywhere (no point in dealing with millis)
• 3754be9 custom partitioner to send messages to predetermined partitions
• 716f3e3 rename metric 'messages_commited_total' to 'commits_total' (since we're not comitting messages, but our "read offsets" per partition)
• 0546a23 use hooks to track which broker sent a response to our offset commit
• 6f7eb6d use new error reporting pattern in Produce after franz-go update, report broker_id instead of address in metrics
• 9db7976 update packages, update to latest franz-go version, fix breaking changes
• c2df9de rename "image-on-push" to "image-on-push-to-master", and create a new workflow that only builds images for pushes to any other (non-master) branch and tagging the image as "branchName-gitSha"
• e1a8788 put deleting old consumer groups into its own file (group_tracker.go)
• e36eb71 each kminion instance uses its own consumer group for end-to-end now so the instances don't "steal" messages from each other
• d5a116c remove bytesSent/Received metrics from end to end
• b4a08c5 more refactoring, seperate client hooks for each package
• 1349666 move end-to-end into its own package called e2e
• cc9a4e9 - remove SLA gauge metrics, they can be inferred from the 'inifinite' bucket in the latency histograms - methods to handle metric events (onAck, onRoundtrip, onOffsetCommit); will also soon be used to extract e2e into its own package - add _total and _seconds suffixes to metrics for best practices
• a1ca198 update e2e topic config
• 9813ad2 remove old methods; extract 'processMessage' for a small cleanup
• c8e360a many changes: - new metrics (in 3 groups): low level, SLA indicators, latency histograms - don't put metrics results in a cache, instead directly increment/observe/set on promauto objects - only generate minionID once, don't create a new one for every message - actually check minionID to filter messages from other kminion instances - check timestamp to discard old messages and establish roundtrip latency - keep track of last received message timestamp, so we can detect/skip cases where we receive older messages for whatever reason - don't call storage.markRecordConsumed since that's only for offset_consumer
• 4ae6088 log which partitions are lagging
• b8c324d update franz-go to v0.6.14
• be77e13 gitignore __debug_bin
• 9bc99a0 typo in ReconciliationInterval
• 9c14fca Merge pull request #86 from rjmasikome/master
• 2cb857b Config adjustment
• 7276c6e [Auto Commit] Package helm chart
• f362bea Release v0.4.0
• 2ed9e87 Merge pull request #85 from amuraru/ns
• 4f4804b Add namespace metadata to all k8s resource definitions
• 4aa5344 Message Loss Rate and config validations
• 72a3df7 More robust checking on end to end topic, config validation, manual consumer commit, better label and help on metrics, and key on produce
• c0b0695 Better commit latency metrics
• 12bc74d EnToEnd Consumer Availability
• 1069e39 Validate topic and commit metrics
• a3befc7 EnToEnd Producer Availability
• 3bac213 EndToEnd Latencies
• f1f9ff5 Adding skeleton for endtoend feature

Changelog

cc3d571 Update franz-go to latest version f6fafd3 Merge pull request #81 from amuraru/coordinator-id 43854e0 Don't use var for initializations 0a2a86b Add coordinator id to group info 50470fb Remove wrapper around sharded request response 48fd15d Add consumer group coordinator label to consumer_group_info metric 4f4b8c5 Align reference config with actually available config structs 6fd3af1 [Auto Commit] Package helm chart 5aa70be Release 0.3.1 49df52b Patch service monitor 88d760e Only trigger on push to Chart.yaml b2cac79 [Auto Commit] Package helm chart 14992b9 Release 0.3.0 4321f33 [Auto Commit] Package helm chart 9568fa5 Merge pull request #76 from rjmasikome/master ef366bf Add annotations to service on helm chart deefcf8 [Auto Commit] Package helm chart 185e619 Release chart v0.2.2 358b66f [Auto Commit] Package helm chart f764728 Merge pull request #75 from amuraru/patch 7152855 Fix helm default values 75daf70 Use dashes as separator for the date