Emulating a cosumer with maximum consumption rate and its synchronization with the producer work.

2021-05-31 Thread Mazen Ezzeddine
Dear all, I am trying to run a Kafka experiment on Kubernetes where I would like to control the number of messages sent/produced to the broker per unit time/interval, and the number of messages being consumed by the consumer per unit time/interval. Controlling the number of messages sent/prod

Zookeeper failure handling in Kafka

2021-05-31 Thread Neeraj Vaidya
Hi All, If I have a 5 node zookeeper ensemble backing my 5 node Kafka cluster and if more than 2 of the zookeeper nodes shutdown, Kafka producer clients are still able to write to Kafka without any issues. Is this normal behaviour ? I always thought that zookeeper quorum should be available for