Re: Producer Application Utilizing Multiple Threads

2023-04-25 Thread info
On 2023-04-24 11:19, Margaret Figura wrote: Hi Arvid, Just as another user of Kafka, I suspect the claim has to do with the producer's ability to perform batching and compression across produced data, so it should be more efficient in some cases, especially with smaller volumes of data and large

Re: Producer Application Utilizing Multiple Threads

2023-04-25 Thread info
On 2023-04-24 11:48, Santhosh Kumar wrote: Hi Arvind Yes, there is data to support the claim that sharing a single producer instance across threads in Apache Kafka is generally faster than having multiple instances. The reason for this is that a single producer instance can take advantage of b

Re: Producer Application Utilizing Multiple Threads

2023-04-24 Thread Santhosh Kumar
Hi Arvind Yes, there is data to support the claim that sharing a single producer instance across threads in Apache Kafka is generally faster than having multiple instances. The reason for this is that a single producer instance can take advantage of batch processing, which allows it to send multi

RE: Producer Application Utilizing Multiple Threads

2023-04-24 Thread Margaret Figura
Hi Arvid, Just as another user of Kafka, I suspect the claim has to do with the producer's ability to perform batching and compression across produced data, so it should be more efficient in some cases, especially with smaller volumes of data and larger linger.ms settings. However, like you, I