Re: Optimize KafkaProducer Performance

2024-11-25 Thread Haruki Okada
Hi, Generally, max production throughput will be calculated as follows: - max_requests_per_sec = 1000 / request_latency_ms * 5 (max.in.flight.requests) - max_throughput = max_requests_per_sec * messages-per-request So I suggest identifying which is the bottleneck first, req-latency or too-small-

Optimize KafkaProducer Performance

2024-11-25 Thread giri mungi
Hi Team, I am currently pushing 50,000 records to a Kafka producer, but the process is taking approximately 5 minutes to complete. Could you please assist me in optimizing the Kafka producer configurations to reduce the processing time? Any recommendations or best practices would be greatly appre