About the order of messages when a single consumer is consuming messages from multiple partitions

2022-01-05 Thread Roger Kasinsky
Hi, I have a topic divided into 4 partitions. I have a consumer that needs to consume all messages from the topic (all messages from all 4 partitions). So to do that I have this consumer sitting by itself in its own consumer group. I'm not committing any offsets, because I want to read all message

Re: About the order of messages when a single consumer is consuming messages from multiple partitions

2022-01-05 Thread Luke Chen
Hi Roger, > Can anything be said about the order of the messages consumed by my consumer? Kafka guarantees that any consumer of a given topic-partition will always read that partition's events in exactly the same order as they were written. So, if you create 4 consumers in a group, to consume fro

Re: About the order of messages when a single consumer is consuming messages from multiple partitions

2022-01-05 Thread sunil chaudhari
hi, Why dont you provide new name to consumer group each time you restart your consumer? This new consumer group will not conflict with the earlier one and it will be treated as new consumer thread next time to get all messages again. Regards, Sunil. On Wed, 5 Jan 2022 at 10:45 PM, Roger Kasinsk