Re: Kafka architecture

2024-01-07 Thread sunil chaudhari
Hi, point 1…. If you want to mutate the messsage you have this option. 1. Start a Ksql server 2. read from parent_topic, mutate and create child_topic where mutated message will be published 3. your consumer will read child_topic to consume and processe the message. regards, Sunil. child_to

Re: Kafka architecture

2024-01-07 Thread Andrew Grant
Hey Winstein, 1. You can’t modify events after they are written. They are immutable. 2. Consumers always see messages in order. Note this guarantee is per partition. That is, the consumer is guaranteed to read messages in order for a given partition. There isn’t a guarantee across partitions.

Kafka architecture

2024-01-07 Thread Winstein Martins
Hello everyone, I have two questions about Kafka's operation. 1. Can I modify events after they are written to Kafka, or are they immutable? 2. Do consumers always receive messages in the order they were sent by Kafka? Thank you in advance!

Re: Kafka Architecture diagram

2015-02-05 Thread Joe Stein
Ankur, There is more from papers and presentations you can check out too https://cwiki.apache.org/confluence/display/KAFKA/Kafka+papers+and+presentations if you haven't already. - Joestein On Thu, Feb 5, 2015 at 12:57 PM, Conikee wrote: > Michael Noll's blog posting might serve your purpose as

Re: Kafka Architecture diagram

2015-02-05 Thread Conikee
Michael Noll's blog posting might serve your purpose as well http://www.michael-noll.com/blog/2013/03/13/running-a-multi-broker-apache-kafka-cluster-on-a-single-node/ Sent from my iPhone > On Feb 5, 2015, at 9:52 AM, Gwen Shapira wrote: > > The Kafka documentation has several good diagrams. D

Re: Kafka Architecture diagram

2015-02-05 Thread Gwen Shapira
The Kafka documentation has several good diagrams. Did you check it out? http://kafka.apache.org/documentation.html On Thu, Feb 5, 2015 at 6:31 AM, Ankur Jain wrote: > Hi Team, > > I am looking out high and low level architecture diagram of Kafka with > Zookeeper, but haven't got any good one ,

Kafka Architecture diagram

2015-02-05 Thread Ankur Jain
Hi Team, I am looking out high and low level architecture diagram of Kafka with Zookeeper, but haven't got any good one , showing concepts like replication, high availability etc. Please do let me know if there is any... Thank you Ankur