Hi Navneeth,
I need some clarifications to be able to help you.
First of all it would be useful to know if your topology is stateful,
i.e., if it has to maintain state. Since you have two topics with 72
partitions but only 72 tasks (or partitions groups to assign) that need
to be distributed
This is how the assignment looks like after full restart. N represents node
and the second column is the number of partitions assigned. There are just
two input topics with equal partitions in the topology. I was expecting
each node to have 6 partitions assigned.
N1 7
N2 5
N3 7
N4 5
N5 7
N6 5
N7 7
We are using kafka version 2.6.1 on broker and 2.6.2 for streams.
Thanks
On Wed, Jun 2, 2021 at 7:18 PM Navneeth Krishnan
wrote:
> Hi All,
>
> We recently migrated from flink to kafka streams in production and we are
> facing a major issue. Any quick help would really be appreciated.
>
> There
Hi All,
We recently migrated from flink to kafka streams in production and we are
facing a major issue. Any quick help would really be appreciated.
There are 72 input data topic partitions and 72 control stream topic
partitions. There is a minimum of 12 nodes with 6 streams threads on each
instan
