Hi Ben,
Thanks for quick reply. As you mentioned, we are seeing the write throughput
per broker being capped at 250 MB/s.
We tried multiple scenarios as below
1) Msg size 1 KB, 3 publishers, 3 brokers, with 3 parritions and RF = 2
In this, as mentioned in earlier emai, with replication on Tot
Hi Arti,
>From your description, it sounds like your per-partition throughput is
extremely high (380 MB/s across three partitions is ~125 MB/s per
partition). A more typical high-end range would be 5-10 MB/s per partition.
Each follower gets mapped to a single replica fetcher thread on the
followe
Hi,
We have been evaluating Managed Streaming for Kafka (MSK) on AWS for a use-case
that requires high-speed data ingestion of the order of millions of messages
(each ~1 KB size) per second. We ran into some issues when testing this case.
Context:
To start with, we have set up single topic wit
