ection.
Regards,
Soumyajit Sahu
a proof-of-concept build at
https://github.com/Microsoft/Cluster-Partition-Rebalancer-For-Kafka
That might require some changes before being run, as it has some hard-coded
methods to fetch my broker and zookeeper list during run-time from my
custom file.
Thanks,
Soumyajit Sahu
We are running Kafka on AWS EC2 instances (m5.2xlarge) with mounted EBS st1
volume (one on each machine).
Occasionally, we have noticed that the write ops/second goes through the
roof and we get throttled by AWS while the data throughput wouldn't have
changed much. As far as our observation goes, i
gt; -Suman
>
> On Tue, Apr 7, 2020 at 11:59 AM Soumyajit Sahu
> wrote:
>
> > We are running Kafka on AWS EC2 instances (m5.2xlarge) with mounted EBS
> st1
> > volume (one on each machine).
> > Occasionally, we have noticed that the write ops/second goes through
lagging.
> >
> > BR
> >
> > On Tue, Apr 7, 2020 at 10:06 AM Soumyajit Sahu >
> > wrote:
> >
> > > Our typical IOPS stays at ~10K write ops/min, but it goes to 37K write
> > > ops/min (which is where AWS throttles).
> > > The spike in write
