Re: Reading all messages from a Kafka topic for a state

Hi Matthias, Thanks for the info. I tried what you suggested. However I couldn't restore the state by reading the entire topic from beginning to end (assuming it's not stored on a local disk) without changing the application.id property to another value which will force it to re-read the topic.

Re: Sub Tasks being processed only after restart

Hi Nitay, What version of Kafka are you running? If you could also give the topology you're using that would be great. Do you have a sense of if the lag is happening on all partitions or just a few? Also if you're using rocksDB there are some rocksDB metrics in newer versions of Kafka that could b

Reg: Impact in topic-partition proportion

Hi, How to choose a topic design for an event type? one topic per even-type with 1000 partitions - 5 topics per event-type, each with 200 partitions - 10 topics per event-type, each with 100 partitions - 20 topics per event-type, each with 50 partitions - 50 topics per event-type, eac