Hi, We have a Kafka server deployment shared between multiple teams and i have created a topic with multiple partitions on it for pushing some JSON data.
We have multiple such Kafka producers running from different machines which produce/push data to a Kafka topic. A lot of times i see the following exception in the logs : "*Event queue is full of unsent messages, could not send event"* Any idea how to solve this ? We can not synchronise the volume or timing of different Kafka producers across machines and between multiple processes. There is a limit on maximum number of concurrent processes (kafka producer) that can run on a mchine but it is only going to increase with time as we scale. What is the right way to solve this problem ? Thanks, Saurabh
