Re: Understanding Kafka Streams max.task.idle.ms

2022-08-30 Thread Derek Mok
Hi Alexandre, thanks for your reply. I updated my example to produce a message to the compacted topic ("table") at a lower timestamp, but I'm still not getting the expected result unfortunately. The scenario is now: 1. Message published to A ("input") with timestamp t_0 2. Three seconds of wall cl

Trouble with Kafka ACLs upon startup

2022-08-30 Thread Rabey, Matthew
Hello, I’m currently working on setting up a Kafka cluster that utilizes mTLS for client communication and plaintext for inter-broker communication. I’m running into issues that prevent me from creating topics and ACLs from the Broker after it has started up. I have had success so far setting

Benchmarking Kafka KRaft mode with many partitions

2022-08-30 Thread Paul Brebner
Hi all, I'm giving a talk at ApacheCon in early October (in the Performance Engineering track) on Kafka Zookeer vs. KRaft modes. I've already got some "interesting" results but wondering if anyone can help with the following please: 1) What benchmarking has been done on KRaft clusters, particular