Re: Too many commits

2019-04-25 Thread Dimitry Lvovsky
That's the problem I think. The gist of it is ( without going back on my part and looking at the details of the docs) Kafka isn't getting a poll from your consumer in time and thinks it's dead (crashed or hung)...then you try to commit something that is no longer valid. The solution is pausing the

Re: Too many commits

2019-04-25 Thread yuvraj singh
Yeah it's taking time , that's why I am doing manually commits to achieve at least once semantics . Thanks Yubraj Singh On Thu, Apr 25, 2019, 12:49 PM Dimitry Lvovsky wrote: > Are your processes taking a long time between commits — does consuming each > message take a long while? > > On Thu, A

Re: Too many commits

2019-04-25 Thread Dimitry Lvovsky
Are your processes taking a long time between commits — does consuming each message take a long while? On Thu, Apr 25, 2019 at 08:50 yuvraj singh <19yuvrajsing...@gmail.com> wrote: > Hi all , > > In my application i am committing every offset to kafka one by one and my > max poll size is 30 . I a

Too many commits

2019-04-24 Thread yuvraj singh
Hi all , In my application i am committing every offset to kafka one by one and my max poll size is 30 . I am facing lot of commit failures so is it because of above reasons ? Thanks Yubraj Singh [image: Mailtrack]