Re: Patterns for generating ordered streams

2023-05-30 Thread Italo Nesi
Hi Edward, if you use partition number and/or partition offset you are potentially building up a technical debt and tightly coupling the pipeline. What if you want to change the numbers of partitions in the future? Also there is what you mentioned about moving to another Kafka cluster where you hav

Re: Patterns for generating ordered streams

2023-05-29 Thread Brebner, Paul
generating ordered streams NetApp Security WARNING: This is an external email. Do not click links or open attachments unless you recognize the sender and know the content is safe. Hi there, Kafka is new to us, so we don't have operational experience from it. I'm building a system tha

Re: Patterns for generating ordered streams

2023-05-29 Thread Brebner, Paul
://www.linkedin.com/pulse/complete-guide-apache-kafka-developers-everything-i-know-paul-brebner/ Regards, Paul From: Edvard Fagerholm Date: Tuesday, 30 May 2023 at 6:55 am To: users@kafka.apache.org Subject: Patterns for generating ordered streams NetApp Security WARNING: This is an external email

Patterns for generating ordered streams

2023-05-29 Thread Edvard Fagerholm
Hi there, Kafka is new to us, so we don't have operational experience from it. I'm building a system that would be broadcasting events to groups of clients. Kafka consumers handle the broadcasting. In other words, kafka topic --- consumers --- clients We need to maintain the order of the events