Re: Doubt on max.request.size

2016-10-14 Thread David Garcia
WRT performance, yes, changing message size will affect the performance of producers and consumers. Please study the following to understand the relationship between message size and performance (graphs at the bottom visualize the relationship nicely): https://engineering.linkedin.com/kafka/ben

Re: Doubt on max.request.size

2016-10-14 Thread David Garcia
Hello Daniccan. I apologize for the dumb question, but did you also check “message.max.bytes” on the broker? Default is about 1meg (112 bytes) for kafka 0.10.0. if you need to publish larger messages, you will need to adjust that on the brokers and then restart them. -David On 10/14/16,

Doubt on max.request.size

2016-10-14 Thread Daniccan VP
Hi, Kindly request to help with a doubt regarding the "max.request.size" configuration that we use in the Kafka Producer. I get the following exceptions sometimes in my project. org.apache.kafka.common.errors.RecordTooLargeException: The request included a message larger than the max message s