Hi David,
Have you tried increasing the number of containers? Our benchmarks show
about 1M messages per sec processed on one machine. You should be able to
scale linearly by increasing number of containers. All relevant
Kafka producer properties like batch size, compression and linger can be
passe
Is there a way to control the number of producers? Our Samza job writes a
lot of data to the downstream Kafka topic. I was wondering if there is a
way to optimize concurrency by creating more async producers.
Thanks,
David
