Kt Versions Save

short one to address #125

all

• updates go version #125
• update shopify sarama to v1.31.0
• support auth sasl-plain #118 big thanks to @ducnt114

it's been a while, thank you for your patience 🙏

all

• adds authentication. big thanks to @rwaweber's PR #86 to get this started! cf issues #70
• adds TLS 1-way authentication, big thanks to @dangogh cf #110
• current versions: go 1.14, sarama 1.26.1 and system test against Kafka 2.4.0.
• drops old vendoring in favor of go modules, big thanks to @jackyzhen and @ebati
• exit code 0 when help is requested #81
• adds system testing again kafka via docker
• adds license #80
• use sarama's version parsing - big thanks to @ebati #85
• improves env var documentation - big thanks to @empeje #87

consume:

• improves offset parsing implementation - big thanks to @rogpeppe #105
• adds ability to resume #78

topic:

• adds ability to print topic config - big thanks to bo0rsh201 #102

produce:

• adds timestamp to produced messages #95
• passes the partitioner argument along #71
• adds note about the partitioner #74
• adds -compression to produce command to set codec - big thanks to @ooesili #73

admin:

• supports timeout - big thanks to @tyranron #94
• supports creating and deleting topics #82

group:

• adds regex based topic filtering - big thanks to @michaelritsema #72
• sorts the output for deterministic ordering - big thanks to @jackhopner #79

Quick one:

• consume #67: fix null / empty slice handling - thanks @vmaurin
• all: sync supported versions with sarama

all:

• #52 ⚠️ adds pretty printing to all output by default, if stdout is a TTY. When stdout is redirected, lines are output is printed one unit per line to facilitate piping into other commands. e.g. kt consume -topic test | kt produce -topic test2 still works. To prevent pretty printing anyway, you can pass -pretty=false to any command.
• #55 consistent interrupt behavior across commands. only the produce command cleans up after itself on SIGINT or SIGKILL.
• #57 updates Shopify/sarama to v1.12.0
• #63 defaults to v0.10.0.0 - fixes client.GetOffset incompatibilities
• #64 fixes build issue on windows - thanks @mkokho !

consume:

• #59 fixes nil pointer dereference and reads from consumer's err chan

group:

• #48 allows resetting all partitions - thanks @disq !
• #56 improved help message on supported versions, also cf #63
• #62 improved group offset and lag results
• allows resetting offsets to 0.
• resolves newest / oldest offset before resetting to fix a specific offset.
• resolve partitions only once per topic.
• saves roundtrip to brokers to find all brokers.

topic:

• #53 includes ISR info - thanks @pd !

group:

• #47 fixes concurrent write issue
• speeds up initial group fetching by asking all brokers in parallel
• closes offset manager properly to ensure -reset request is sent.

group:

• renamed offset command to group ⚠️
• #43 ability to list all consumer groups
• #44 adds group lag - thanks @njhartwell!
• ability to filter group by regex via -filter flag
• speeds up group info fetching by parallelizing
• monkey patches sarama to allow resetting offset to values less that current offset.

consume:

• #38 adds ability to encode binary data in base64 and hex
• #41 fixes potential memory leak
• #45 adds support for optional timestamp field - thanks @marianogappa!

produce:

• #39 adds ability to decode binary data from base64 and hex
• adds -buffersize flag to control buffer size for reading lines from stdin. Fixes issue where large input lines would be ignored silently.

all:

• #42 adds support for windows user names - thanks @mponton!
• update to sarama v1.11.0

offset:

• #36 adds new command! kudos to @henzenvandijk, thanks! 😸
• prints offsets for partitions and a consumer group
• allows setting the offset for a given consumer group

produce:

• #35 adds -partition to set partition when using -literal - kudos to @mkokho, thanks! 😸
• #34 don't close broker that is not connected - kudos to @mkokho, thanks! 😸

topic & consume:

• fixes issue that command would catch and ignore interrupt signals
• fixes race condition that could result in lost output

all:

• some refactoring love across the board (no more global config, more consistent naming, ...)
• more consistent failure messages to stderr
• update to sarama v1.10.1

• all #28: Upgraded sarama version to v1.10.0.
• all #29: Added -version flag to specify Kafka protocol version to use. Defaults to v0.10.0.0.
• all #30: Ensure we set the client ID when talking to Kafka cluster. Currently set to kt-{command}-{whoami}, e.g. kt-consume-fgeller
• all: Releases built with Go 1.7 ❤️ for smaller binaries!

• produce #27: Fixes issues where sometimes the last set of messages in a batch wasn't submitted.
• produce #26: Adds -literal option to prevent interpretation of stdin line and instead use it literally as the value and null for the key.

produce #25: Adds option to use default partitioner. Currently only the hashCode partitioner is available. By default no partitioner is used. This means that either the partition is specified or it defaults to 0.

⚠️ produce: If the stdin line cannot be deserialized into a JSON object, its string value is used as the value and the key will be nil/null and the partition 0.