Kafka consumer Fetcher several Ignoring fetched records logs

Hello all, We're noticing several logs on our consumer apps similar to the following : 2019-09-06 17:56:36,933 DEBUG org.apache.kafka.clients.consumer.internals.Fetcher - Ignoring fetched records for mytopic-7 at offset 45704161910 since the current position is 45704162370 Any idea on what

__consumer_offsets compaction settings / metadata performance

Hi all, Currently with default settings min.cleanable.dirty.ratio/log.cleaner.min.cleanable.ratio (0.5) __consumer_offsets partition size grows up to 80Mb and this seems to slow down metadata related operations (notably commits / join group). What are the normal/expected partition avg size for

Re: Kafka consumer Fetcher several Ignoring fetched records logs

18:18, Hrishikesh Mishra wrote: > Can you check whether its happening because logs are getting purge very > fast. > > On Sat, 7 Sep 2019 at 12:18 AM, Aminouvic wrote: > > > Hello all, > > > > We're noticing several logs on our consumer apps similar to the