Re: automatic offset reset question

Hello, Can you check the offsets.retention.minutes paramether >From the documentation ( https://kafka.apache.org/documentation/#upgrade_200_notable) : - KIP-186 increases the default offset retention time from 1 day to 7 days. This makes it l

automatic offset reset question

Hi, I have a stream process that from time to time starts re-ingesting old data which affects the whole pipeline. What I think is happening is the consumer group gets reset to the earliest, but since: * the consumer group name is always the same * Replica set is 3 * auto.offset.reset is 'none

Re: Latency requirements for Kafka connect workers

Hey Ashish, If I understand it correctly, the workers are actually using connect groups via Kafka to coordinate (I believe via the configured status.storage.topic and the Kafka consumer group.id). See here: https://docs.confluent.io/5.5.0/connect/userguide.html#connect-userguide-distributed-config

Latency requirements for Kafka connect workers

Hi Team, As per my understanding, the distributed Kafka connect workers communicate with each other over the rest interface. Is there any specific latency requirements i.e. there should be a maximum latency of 'x' ms to allow effective functioning of the Kafka connect distributed worker cluster.