Multi Cluster Failover Kafka Client

Hi, I am designing a Geo Red Kafka cluster with MirrorMaker. My use case is an active/passive cluster where the follower is kept up-to-date by MirrorMaker. Now, I want that my consumers and producers should switch to the follower cluster when none of the brokers in the primary cluster are reachab

[ANNOUNCE] Apache Kafka 3.0.1

The Apache Kafka community is pleased to announce the release for Apache Kafka 3.0.1 Apache Kafka 3.0.1 is a bugfix release and 29 issues have been fixed since 3.0.0. All of the changes in this release can be found in the release notes: https://www.apache.org/dist/kafka/3.0.1/RELEASE_NOTES.html

Re: [kafka-clients] [ANNOUNCE] Apache Kafka 3.0.1

Thanks Mickael for driving this release! Best, Bruno On 14.03.22 11:42, Mickael Maison wrote: The Apache Kafka community is pleased to announce the release for Apache Kafka 3.0.1 Apache Kafka 3.0.1 is a bugfix release and 29 issues have been fixed since 3.0.0. All of the changes in this relea

Error creating PREFIXED ACL's

Hi Since weeks we have on one of our environments the following error by creating PREFIXED ACL’s. Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=xyz1, patternType=PREFIXED)`: (principal=User:xyz, host=*, operation=READ, permissionType=ALLOW) (principal=Use

Re: [kafka-clients] [ANNOUNCE] Apache Kafka 3.0.1

Yes, thank you, Mickael! -John On Mon, 2022-03-14 at 12:19 +0100, Bruno Cadonna wrote: > Thanks Mickael for driving this release! > > Best, > Bruno > > On 14.03.22 11:42, Mickael Maison wrote: > > The Apache Kafka community is pleased to announce the release for > > Apache Kafka 3.0.1 > > > > A

Re: [kafka-clients] [ANNOUNCE] Apache Kafka 3.0.1

Thank you Mickael! On Mon, Mar 14, 2022 at 6:47 PM John Roesler wrote: > Yes, thank you, Mickael! > -John > > On Mon, 2022-03-14 at 12:19 +0100, Bruno Cadonna wrote: > > Thanks Mickael for driving this release! > > > > Best, > > Bruno > > > > On 14.03.22 11:42, Mickael Maison wrote: > > > The Ap

Compression - producer vs topic?

Hi. I looked around for advice about Kafka compression. I've seen mixed and conflicting advice. Is there any sorta "if X, do Y" type of documentation around Kafka compression? Any advice? Any good posts to read that talk about this trade off? *Detailed comments* I tried looking for producer v

Re: Compression - producer vs topic?

Hi Dan, Decompression generally only happens in the broker if the topic has a particular compression algorithm set, and the producer is using a different one - then the broker will decompress records from the producer, then recompress it using the topic's configured algorithm. (The LogCleaner will

Re: Compression - producer vs topic?

Thanks, Liam! I have a mixture of Kafka record size. 10% are large (>100kbs) and 90% of the records are smaller than 1kb. I'm working on a streaming analytics solution that streams impressions, user actions and serving info and combines them together. End-to-end latency is more important than s

Re: Few partitions stuck in under replication

Some more information split brain issue is happening with the controller. when brokers (including the active controller) lose connection with zookeeper, for few seconds 2 brokers are the active controller. following is the log of broker 1 and broker 0. At the time when connection to zookeeper was l

Re: Error creating PREFIXED ACL's

Hi Daniel, Did you see any error from the server log or zookeeper log while getting the `InvalidRequestException: Failed to create ACL` response? Thank you. Luke On Mon, Mar 14, 2022 at 9:13 PM wrote: > Hi > > Since weeks we have on one of our environments the following error by > creating PRE