You can also look into the producer time metrics and see if the time goes
up before the spike of the request rate. If the time does go up, you can
look at the breakdown of the time. Any latency due to local I/O will be
included in the local time.
Thanks,
Jun
On Tue, Nov 11, 2014 at 10:50 AM, Wes
There are some fixes in 0.8.2-beta for periodic latency spikes if you are
using acks=-1 in the producer.
-Jay
On Tue, Nov 11, 2014 at 10:50 AM, Wes Chow wrote:
>
> We're seeing periodic spikes in req/sec rates across our nodes. Our
> cluster is 10 nodes, and the topic has a replication factor o
Hi Wes,
are you monitoring librdkafka statistics as well?
If so, are there any correlating spikes in the per-broker and per-partition
statistics?
Such as:
- brokers..rtt.avg <--- broker round-trip-time (latency)
- brokers..waitresp_cnt <-- requests in flight
- topics..partitions..msgq_cnt <
