Re: Consumer has high network bandwidth when consuming no messages

2023-04-17 Thread Alexandre Dupriez
Hi, Lee, Would you be able to see which Kafka API is generating the traffic? This is provided by the MBean kafka.network:type=RequestMetrics,name=RequestsPerSec,request=*,version=([0-9]+) [1]. Thanks, Alexandre [1] https://kafka.apache.org/documentation/#monitoring Le dim. 16 avr. 2023 à 18:22,

Re: Consumer has high network bandwidth when consuming no messages

2023-04-16 Thread Lee Carroll
Hi Kirk, Points 1 and 2: yes we have both logging and metrics. I'll collate Point 3 concurrency refers to the spring boot kafka concurrent container. 2 threads will be made available to the consumer group to consume 30 partitions making up a single topic. point 4: consumer- Kafka Consumer Configur

Re: Consumer has high network bandwidth when consuming no messages

2023-04-13 Thread Kirk True
Hi Lee, Some questions: 1. Can you enable metrics for your consumer(s)? See [1] and [2] for links on consumer-level and fetch-level metrics, respectively. 2. Can you enable more detailed logging? 3. What do you mean specifically by “concurrency of 2?” 4. Can you verify the name of the fetch.wait