Hi Ted, I'm using kafka_2.11-0.10.2.0 version, I figure out that the issue from the wildfly node because of each consumed messages are passed by the Tomcat node and it sends the details to the wildfly node.
When the wildfly node process the details again it will consume the next offset messages. So it causes the issue On Fri, May 11, 2018 at 9:07 PM, Ted Yu <yuzhih...@gmail.com> wrote: > bq. load on the node is increasing tremendously > > Can you do some profiling to see where the bottleneck was ? > You can pastebin some stack traces. > > Which Kafka release do you use ? > > Thanks > > On Fri, May 11, 2018 at 6:41 AM, Karthick Kumar <kku...@apptivo.co.in> > wrote: > > > Hi, > > > > I'm using tomcat nodes for Kafka producer and consumer, Recently I faced > > some issues with it. > > Normally the producer and consumer counts matched in the tomcat nodes. > > After some time the produced data is consumed with delay, I'm not sure > > where to check. > > > > The data which was delayed is dumped over the consumer when it is > started. > > At this time, the load on the node is increasing tremendously. > > > > > > So any data that was newly produced at this time is getting lost (it is > > available on the producer but not on the consumer). > > > > -- > > With Regards, > > Karthick.K > > > -- With Regards, Karthick.K
