Hello, I have a basic question.
Lets say a kafka consumer is subscribed to to a topic "test". When the producer publishes logs/records into that topic, does the consumer explicitly need to poll at regular intervals to find out if a new message is available and pull the new message or a notification will be sent to the consumer that a new message is available on the topic subscribed and then it can call a consume API. Is it possible to do a select on the connection with the broker rather than poll. My kafka cluster will be over WAN and the consumers will be all over geographically. Polling seems to be too costly. I am planning on using librdkafka. I will greatly appreciate any help in this regards, Regards Siddhartha
