Josh Goodrich created KAFKA-4085: ------------------------------------ Summary: Create Consumer fetch(..) implementation that returns any events available at time of request Key: KAFKA-4085 URL: https://issues.apache.org/jira/browse/KAFKA-4085 Project: Kafka Issue Type: Improvement Components: clients Reporter: Josh Goodrich
The current implementation of the KafkaConsumer.poll(long timeout) does not always return events, even if new events are available on the cluster. I believe this is due to the Consumer not yet syncing all of it's metadata (topics, partitions, offsets, etc . . .) and reaching the timeout before even getting to see if there are events that match it's request. The Consumer should have a fetch(..) method that guarantees to return events if there are available events in Kafka that meet it's configured criteria. The current poll(..) has unpredictable results depending on how quickly the Consumer can synch with the Broker. -- This message was sent by Atlassian JIRA (v6.3.4#6332)