Re: Question Regarding Offset Behavior When Calling Poll()

2020-10-07 Thread Zhen Zhang
Thank you. Regards, Zhen Zhang Software Engineer [image: Twilio] MOBILE (949) 771-6073 EMAIL zzh...@twilio.com On Wed, Oct 7, 2020 at 11:35 PM Matthias J. Sax wrote: > I guess it's a question of the client implementation and you cannot > inf

Re: Question Regarding Offset Behavior When Calling Poll()

2020-10-07 Thread Matthias J. Sax
I guess it's a question of the client implementation and you cannot infer the behavior from the Java client. I would _assume_ that the offset is _not_ advanced. But the behavior is not define by Kafka itself, but it's up the the client implementation itself. Thus, only the client's docs or communi

Re: Question Regarding Offset Behavior When Calling Poll()

2020-09-25 Thread Zhen Zhang
Hi, Sorry for the late reply, let me clarify on this. I am developing using Golang so I used a library based on librdkafka, and there's one function, ReadMesage(), which is a wrapper on top of the poll() function, except that it will only poll one message(record) at a time and return either one o

Re: Question Regarding Offset Behavior When Calling Poll()

2020-09-23 Thread Matthias J. Sax
I guess it depends where the exception comes from? Can you clarify? -Matthias On 9/23/20 12:53 AM, Zhen Zhang wrote: > Hi there, > > I am new to Kafka and I would like to get some clarifications for a newbie > question, > > Let's say if I have set up my consumer's "enable.auto.commit" to false,

Question Regarding Offset Behavior When Calling Poll()

2020-09-23 Thread Zhen Zhang
Hi there, I am new to Kafka and I would like to get some clarifications for a newbie question, Let's say if I have set up my consumer's "enable.auto.commit" to false, and then poll the records one at a time. So when calling poll(), starting from offset 0, if any exception is thrown, should I expe