Hi Sameer,
>From your shared logs it seems the number of "threads" is actually larger
than the number of topic partitions (note each machine seem to have lots of
threads). More specifically, I have only saw max. of 6 partitions for any
topics, e.g.:
LIC3-43-lic3-deb-ci2-43-repartition-0
LIC3-43-l
Hi Eno,
Yes, I was concerned that machine2 ispite of being free is not utilized at
all.
Partitions would be 60 and streams would have 63 threads. So, I understand
now why threads were not started on machine2.
For others, 1 partition would be consumed by 1 thread. So, thus the
mismatch.
Thanks,
Hi Sameer,
Could you elaborate on your question? Are you concerned that machine2 does not
have any tasks in the beginning?
Could you share your streams configuration? In particular how many threads does
each stream instance have? Also how many topics and partitions do you have?
Thanks,
Eno
Hi,
Came across a rebalancing issue in using KafkaStreams. I have two machines,
Machine1 and Machine2, machine1 is consuming all partitions and machine2 is
completely free and not processing any partitions. If I shutdown machine1,
then machine2 will take over and would start consuming all partitio
