Kafka architecture

2024-01-07 Thread Winstein Martins
Hello everyone, I have two questions about Kafka's operation. 1. Can I modify events after they are written to Kafka, or are they immutable? 2. Do consumers always receive messages in the order they were sent by Kafka? Thank you in advance!

Re: Kafka architecture

2024-01-07 Thread Andrew Grant
Hey Winstein, 1. You can’t modify events after they are written. They are immutable. 2. Consumers always see messages in order. Note this guarantee is per partition. That is, the consumer is guaranteed to read messages in order for a given partition. There isn’t a guarantee across partitions.

Re: Kafka architecture

2024-01-07 Thread sunil chaudhari
Hi, point 1…. If you want to mutate the messsage you have this option. 1. Start a Ksql server 2. read from parent_topic, mutate and create child_topic where mutated message will be published 3. your consumer will read child_topic to consume and processe the message. regards, Sunil. child_to