Krishna created KAFKA-3967: ------------------------------ Summary: Excessive Network IO between Kafka brokers Key: KAFKA-3967 URL: https://issues.apache.org/jira/browse/KAFKA-3967 Project: Kafka Issue Type: Bug Affects Versions: 0.8.2.2 Reporter: Krishna
Excessive Network IO between Kafka brokers running on AWS in different AZ's as compared to actual message volume. We are producing 2-5 MB /Sec message volume however kafka seems to me moving 20 gb /hr on network. The data volume has around 12 GB of message log on each nodes. Is this a natural behavior ?. I believe only the new messages will get replicated on non-leader nodes however here it seems that entire log is re-synced -- This message was sent by Atlassian JIRA (v6.3.4#6332)