Re: Kafka consumer slowly consume the data

2018-05-14 Thread Karthick Kumar
Hi Ted, I'm using kafka_2.11-0.10.2.0 version, I figure out that the issue from the wildfly node because of each consumed messages are passed by the Tomcat node and it sends the details to the wildfly node. When the wildfly node process the details again it will consume the next offset messages.

Re: Kafka consumer slowly consume the data

2018-05-11 Thread Ted Yu
bq. load on the node is increasing tremendously Can you do some profiling to see where the bottleneck was ? You can pastebin some stack traces. Which Kafka release do you use ? Thanks On Fri, May 11, 2018 at 6:41 AM, Karthick Kumar wrote: > Hi, > > I'm using tomcat nodes for Kafka producer an

Re: Kafka consumer slowly consume the data

2018-05-11 Thread Karthick Kumar
Hi, I'm using tomcat nodes for Kafka producer and consumer, Recently I faced some issues with it. Normally the producer and consumer counts matched in the tomcat nodes. After some time the produced data is consumed with delay, I'm not sure where to check. The data which was delayed is dumped over