Message Format Compatibility during/after Kafka upgrade

2025-04-16 Thread Atul Sharma
Hi Team, Regarding the Kafka cluster upgrade from VersionA to VersionB, I have a query about message format compatibility. Let's assume we have a topic "topicA" containing messages written with the message log format version "v1-a". After the Kafka cluster migration is complete and the broker's

Re: Idempotent producer and handling OutOfOrderSequenceException

2025-04-16 Thread Matthias J. Sax
The behavior I'm looking for is that if thread 1 sends message x=1, and thread 2 sees message x=1 come through Kafka, thread 2 can't then write message x=2 and have that be clobbered because thread 1's producer is retrying the send since it didn't receive the ack in time. This is not how it work

Custom Kafka Connect REST Extension for Token Authentication

2025-04-16 Thread Jamie
Hi All,  I'm trying to implement a custom REST extension for Kafka Connect that allows a token to be used for authentication.  When I have a single instance of Kafka connect running in distributed mode (i.e. 1 worker) this works as expected. However, when I add another instance (another worker)

[VOTE] 3.9.1 RC0

2025-04-16 Thread TengYao Chi
Hello Kafka users, developers, and client-developers, This is the first candidate for the release of Apache Kafka 3.9.1. This is a bug-fix release with several fixes, and most importantly, it adds Java 23 support for 3.9 Release notes for the 3.9.1 release: https://dist.apache.org/repos/dist/dev