Hello community, We use Kafka extensively at our organisation. Our SLAs are strict and require:- — throughputs north of 1000TPS and — 60ms latency per transaction
We run:- — 6 brokers and 6 zookeepers — brokers and zookeepers are hosted on ec2 instances with sufficient iops, throughput and network bandwidth to meet our requirements We were under the impression that using log levels (on brokers) such as INFO or DEBUG would produce too many server logs and have an adverse impact on performance. Can someone with experience please confirm that log levels won’t have an adverse effect on latency and throughput of these clusters or vice-versa, given that we come up with a strategy to clean out these logs on broker servers after a defined unit of time ? Does generation of system logs have potential to impact disk or compute iops and slow us down ? Thanks!
