Is it possible that your app is thrashing (i.e. FullGC’ing too much and not
processing messages)?
-David
On 7/19/16, 9:16 AM, "Abhinav Solan" <abhinav.so...@gmail.com> wrote:
Hi Everyone, can anyone help me on this
Thanks,
Abhinav
On Mon, Jul 18, 2016, 6:19 PM Abhinav Solan <abhinav.so...@gmail.com> wrote:
> Hi Everyone,
>
> Here are my settings
> Using Kafka 0.9.0.1, 1 instance (as we are testing things on a staging
> environment)
> Subscribing to 4 topics from a single Consumer application with 4 threads
>
> Now the server keeps on working fine for a while, then after about 3-4 hrs
> or so, it stops consuming at all.
> I started my own Consumer Instance and one Kafka Console Consumer, I can
> see messages coming in the console consumer but not in my Consumer
instance.
>
> There are some messages which are coming through but not all messages,
> then after a while I restarted the Consumer instance, then again nothing
> coming through .. then I restarted the Kafka Server and then I could see
> all the messages coming through.
>
> Has anyone seen this kind of problem ?
> Is it because I am running only single broker ?
>
> Here are the properties I am setting for the Consumer -
> fetch.min.bytes=1
> max.partition.fetch.bytes=8192
> heartbeat.interval.ms=10000
>
> I have written up my Consumer using
> http://docs.confluent.io/2.0.1/clients/consumer.html
>
> Thanks,
> Abhinav
>
>
