Liju created KAFKA-4918: --------------------------- Summary: Continuous fetch requests for offset storage topic in kafka connect Key: KAFKA-4918 URL: https://issues.apache.org/jira/browse/KAFKA-4918 Project: Kafka Issue Type: Improvement Components: KafkaConnect Affects Versions: 0.10.2.0, 0.10.1.1, 0.10.1.0 Environment: unix, osx Reporter: Liju
The kafka consumer in the KafkaOffsetBackingStore polls continuously with timeout hardcoded as 0 ms , this leads to high fetch request load to kafka server , and specifically for the sink connectors ( eg. kafka-connect-hdfs) which doesn't uses the offset storage topic for offset tracking , this becomes redundant and it continuously sends fetch request as there is no data in this topic -- This message was sent by Atlassian JIRA (v6.3.15#6346)