Is there a correlation between the lagging partitions and the consumer assigned to them?
> On Jun 26, 2019, at 4:25 PM, Garvit Sharma <eng.gar...@gmail.com> wrote: > > Can anyone please help me with this. > > On Wed, Jun 26, 2019 at 8:56 PM Garvit Sharma <eng.gar...@gmail.com> wrote: > >> Hey Steve, >> >> I have checked, count of messages on all the partitions are same. >> >> I am still exploring an approach using which the root cause could be >> determined. >> >> Thanks, >> >> On Wed, Jun 26, 2019 at 8:07 PM Garvit Sharma <eng.gar...@gmail.com> >> wrote: >> >>> I am not sure about that. Is there a way to analyse that ? >>> >>> On Wed, Jun 26, 2019 at 7:35 PM Steve Howard <steve.how...@confluent.io> >>> wrote: >>> >>>> Hi Garvit, >>>> >>>> Are the slow partitions "hot", i.e., receiving a lot more messages than >>>> others? >>>> >>>> Thanks, >>>> >>>> Steve >>>> >>>> On Wed, Jun 26, 2019, 9:56 AM Garvit Sharma <eng.gar...@gmail.com wrote: >>>> >>>>> Just to add more details, these consumers are processing the Kafka >>>> events >>>>> and writing to DB(fast write guaranteed). >>>>> >>>>> On Wed, Jun 26, 2019 at 7:23 PM Garvit Sharma <eng.gar...@gmail.com> >>>>> wrote: >>>>> >>>>>> Hi All, >>>>>> >>>>>> I can see huge consumer lag in a few partitions of Kafka topic. I >>>> need to >>>>>> know the root cause of this issue. >>>>>> >>>>>> Please let me know, how to proceed. >>>>>> >>>>>> Below is sample consumer lag data : >>>>>> >>>>>> [image: image.png] >>>>>> >>>>>> Thanks, >>>>>> >>>>>> >>>>> >>>> >>>