Hello community, any hints on this, then?
Thank you, Andrea
On Thu, Aug 23, 2018, 16:15 Andrea Spina wrote:
> Hi Andrew,
> Thank you for your answer. Sadly I'm not allowed to add this module to my
> technologies by now.
>
> 2018-08-23 16:00 GMT+02:00 Andrew Otto :
>
>> Hiya, this doesn’t help a
understand, thanks for all the help
On Mon, Aug 27, 2018 at 2:16 PM Guozhang Wang wrote:
> Hello Nan,
>
> What you described seems to be a broker-side latency spike, not a client
> (either producer, or consumer, or streams)-side latency spike. There's a
> number of possible reasons for such spik
Someone, please help me. Only 1 or 2 out of 7 consumer groups keep
rebalancing every 5-10mins. One topic is constantly receiving 10-20
msg/sec. The other one receives a bulk load after many hours of inactivity.
CGs for both these topics are different. So, I see no observable pattern
here.
On Wed,
Shantanu,
Sounds like your consumers are processing too many records between poll()s.
Notice that max.poll.records is 50. If your consumer is taking up to 200ms
to process each record, then you'd see up to 10 seconds between poll()s.
If a consumer doesn't call poll() frequently enough, Kafka will
Hello!
I haven’t had a lot of luck looking around on the internet, and I suspect the
answer I want doesn’t exist.
Let’s say I have replication factor 3 and min.insync.replicas=1 (the default).
That means that I can get into a situation where if two brokers fall behind,
then we no longer have re
Any one use kafka 0.9.0.1 with zookeeper 3.4.10 (instead of zookeeper-3.4.6
jar file, in the libs folder, replace with zookeeper-3.4.10.jar)? Is there
any issue with this combination?
Thanks,
Fang
Hi,
I am from Intuit. We want to use Kafka as message bus where Single Producer
produces message and 1 Million Consumer listens it.
Requirement –
1. Single producer and 1 Million Consumer and one particular Topic with
message.
2. When Pushed Message thru producer, should be received by
Hi Ryanne,
Thanks for your response. I had even tried with 5 records and session
timeout as big as 10 minutes. Logs still showed that consumer group
rebalanced many times.
Also there is another mystery, some CGs take upto 10 minutes to subscribe
to topic and start consumption. Why might that be ha
