while youre at it another metric that we have found to be useful is % time spent in user code vs time spent in poll() (so time between poll calls / time inside poll calls) - the higher the % value the more indicative of user code being the cause of performance bottlenecks.
On Fri, Sep 13, 2019 at 9:14 AM Kevin Lu <lu.ke...@berkeley.edu> wrote: > > Hi All, > > Happy Friday! Bumping this. Any thoughts? > > Thanks. > > Regards, > Kevin > > On Thu, Sep 5, 2019 at 9:35 AM Kevin Lu <lu.ke...@berkeley.edu> wrote: > > > Hi All, > > > > I'd like to propose a new consumer metric that measures the time between > > calls to poll() for use in issues related to hitting max.poll.interval.ms > > due to long processing time. > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-517%3A+Add+consumer+metric+indicating+time+between+poll+calls > > > > Please give it a read and let me know what you think. > > > > Thanks! > > > > Regards, > > Kevin > >
