Ah, sorry, I missed the version number in your title. I think this tool saw some rearrangement in 0.9.0 and I was looking at the latest version. Unfortunately it doesn't look like the old kafka.tools.ProducerPerformance that is used in kafka-producer-perf-test.sh in 0.8.2.1 supports passing in additional properties.
-Ewen On Fri, Jan 8, 2016 at 9:10 AM, Andrej Vladimirovich <udodizdu...@gmail.com> wrote: > Ewen, > > I tried that before like this: > > ./kafka-producer-perf-test.sh --broker-list test:9092 --topics test8-3 > --messages 2000000 --new-producer --message-size 2000000 > --show-detailed-stats max.request.size=10000000 > > and it does not work. It comletly ignore this option. > > And --producer-props is not a valid option for kafka-producer-perf-test.sh. > Maybe it is not the right syntax? But I tried a lot of different ways and > have yet to find the right one. > > Thanks! > > Andrew > > On Fri, Jan 8, 2016 at 10:54 AM, Ewen Cheslack-Postava <e...@confluent.io> > wrote: > > > Andrew, > > > > kafka-producer-perf-test.sh is just a wrapper around > > orga.apache.kafka.clients.tools.ProducerPerformance and all command line > > options should be forwarded. Can you just pass a --producer-props to set > > max.request.size to a larger value? > > > > -Ewen > > > > On Fri, Jan 8, 2016 at 7:51 AM, Andrej Vladimirovich < > > udodizdu...@gmail.com> > > wrote: > > > > > Hi! > > > > > > I am testing Kafka's performance with large messages and would like to > > > specify maximum request size when I run kafka-producer-perf-test.sh: > > > > > > ./kafka-producer-perf-test.sh --broker-list "test1:9092" --topics > test8-3 > > > --messages 1000000 --new-producer --msage-size 1100000 > > > --show-detailed-stats > > > > > > I always get this message if I specify somethine larger than 1MB: > > > > > > ERROR Error when sending message to topic test8-3 with key: 1 bytes, > > value: > > > 1100000 bytes with error: The message is 1100027 bytes when serialized > > > which is larger than the maximum request size you have configured with > > the > > > max.request.size configuration. > > > (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback) > > > > > > I know I can specify maximum request size with kafka-run-class.sh > > > org.apache.kafka.clients.tools.ProducerPerformance but I would like to > > use > > > kafka-producer-perf-test.sh if possible. > > > > > > Thanks! > > > > > > Andrew > > > > > > > > > > > -- > > Thanks, > > Ewen > > > -- Thanks, Ewen
