I am trying to understand the semantics of the timeout specified in the poll method in http://kafka.apache.org/083/javadoc/index.html?org/apache/kafka/clients/consumer/KafkaConsumer.html. Is this timeout a measure of how long the fetch request will be parked on the broker waiting for a reply or is this more like the timeout in selector.select(long timeout) i.e. the method will return with whatever data is there after waiting a maximum of timeout. Exposing the selector timeout will be very helpful for us because we want to put a tight bound on how long we are ready to wait on the poll call. When this API is available we plan to use a single thread to get data from kafka, process them as well as run periodic jobs. For the periodic jobs to run we need a guarantee on how much time the poll call can take at most.
Thanks! On Fri, Mar 20, 2015 at 6:59 AM, Rajiv Kurian <ra...@signalfuse.com> wrote: > Thanks! > > > On Thursday, March 19, 2015, Jay Kreps <jay.kr...@gmail.com> wrote: > >> Err, here: >> >> http://kafka.apache.org/083/javadoc/index.html?org/apache/kafka/clients/consumer/KafkaConsumer.html >> >> -Jay >> >> On Thu, Mar 19, 2015 at 9:40 PM, Jay Kreps <jay.kr...@gmail.com> wrote: >> >> > The current work in progress is documented here: >> > >> > >> > On Thu, Mar 19, 2015 at 7:18 PM, Rajiv Kurian <ra...@signalfuse.com> >> > wrote: >> > >> >> Is there a link to the proposed new consumer non-blocking API? >> >> >> >> Thanks, >> >> Rajiv >> >> >> > >> > >> >
