I was testing kafka 0.10 with and without compression, when I actived compression I got a message that max bytes exceeded with same batch size.
the command was this with compression kafka-producer-perf-test --topic test-rep-one4 --num-records 100000 --record-size 35000 --throughput -1 --producer-props bootstrap.servers=**** security.protocol=SSL ssl.truststore.location=/home/felipe.santos/client.truststore.jks ssl.truststore.password=changeit ssl.keystore.location=/home/felipe.santos/client.keystore.jks ssl.keystore.password=changeit ssl.key.password=changeit acks=1 batch.size=900000 max.request.size=200000000 compression.type=snappy no compression kafka-producer-perf-test --topic test-rep-one4 --num-records 100000 --record-size 35000 --throughput -1 --producer-props bootstrap.servers=**** security.protocol=SSL ssl.truststore.location=/home/felipe.santos/client.truststore.jks ssl.truststore.password=changeit ssl.keystore.location=/home/felipe.santos/client.keystore.jks ssl.keystore.password=changeit ssl.key.password=changeit acks=1 batch.size=900000 max.request.size=200000000 Why? To me when I actived compression the message should be smaller Thanks -- Felipe Santos
