Hi, Do you track these metrics with JMX and can you see if there are any differences between your brokers?
- Number of client requests (fetch, consume, and follower) per second per broker - Message in rate per second per broker Is your 80mB/sec rate the outgoing traffic for the entire server and not just the Kafka process? Is it possible there's another program on that server that's transferring more data? - Harper On Fri, Feb 7, 2020 at 1:38 PM Dylan Martin <dmar...@istreamplanet.com> wrote: > Hi all! > > I have a cluster of about 20 brokers and one of them is transmitting about > 4 times as much data as the others (80mB/sec vs 20mB/sec). It has the > roughly the same number of topics & partitions and it's the leader for the > same number as all the other brokers. The kafka-manager web tool doesn't > say it's doing a particuarly large amount of work. Datadog & iftop both > agree that it's sending out 4 times as much traffic as any of the others. > It's very consistent, in that it's been this way for weeks. > > Any advice on how to track down what's going on? > > Thanks! > -Dylan > > > > The information contained in this email message, and any attachment > thereto, is confidential and may not be disclosed without the sender's > express permission. If you are not the intended recipient or an employee or > agent responsible for delivering this message to the intended recipient, > you are hereby notified that you have received this message in error and > that any review, dissemination, distribution or copying of this message, or > any attachment thereto, in whole or in part, is strictly prohibited. If you > have received this message in error, please immediately notify the sender > by telephone, fax or email and delete the message and all of its > attachments. Thank you. >
