Re: kafka producer exception due to TimeoutException:

2025-02-26 Thread Kirk True
Hi Giri, The first question I would ask is: what happens when you run the producer with the default configuration? Producer timeouts are usually caused by client misconfiguration, network issues, broker load/topology changes, or a combination of those. Try to remove as many configuration overr

Re: kafka producer exception due to TimeoutException:

2025-02-25 Thread Greg Harris
Hi Giri, Thanks for your additional context. Good to see you're running experiments! > How to achieve workload among a different number of producers..could you > suggest java code for this. This is an api calling from dB stored procedure > and they can call any number of times this api with mess

Re: kafka producer exception due to TimeoutException:

2025-02-25 Thread giri mungi
Hi Greg, Thanks for your insights! I tried increasing the timeouts to: request.timeout.ms = 6 delivery.timeout.ms = 90 However, the issue persists. Some messages are still failing intermittently with a timeout, while others are successfully delivered. props.put(ProducerConfig.ACKS_CONFIG

Re: kafka producer exception due to TimeoutException:

2025-02-25 Thread Greg Harris
Hi Giri, Since nobody with more experience has answered yet, let me give you my amateur understanding of this error. The TimeoutException will appear whenever the load generation (code calling the Producer) runs faster than all downstream components (Producer, Network, Brokers, etc) can handle. R

kafka producer exception due to TimeoutException:

2025-02-21 Thread giri mungi
Hi all iam encountering a TimeoutException while publishing messages to Kafka during load testing of our Kafka producer. The error message indicates that records are expiring before they can be sent successfully: org.apache.kafka.common.errors.TimeoutException: Expiring 115 record(s) for ORG_LT