One approach you can take is to set an upper bound number of partitions a
priori. Imagine your key was the username. If you had 2 partitions in your
topic and 4 users writing messages, then Kafka would split these messages
between two partitions of the topic (assuming the usernames are unique).
Fo
Just key your messages by user ID and they'll be processed in sequence.
Every message with the same key will go to the same partition, regardless
of how many partitions there are.
Ryanne
On Tue, Jan 8, 2019, 8:57 AM marimuthu eee Hi Ryanne Dolan,
>
> My requirement is to process notification mes
Hi Ryanne Dolan,
My requirement is to process notification messages in parallel.So i have an
idea to pick kafka as a messaging system.But i need dynamic partitioning*
to handle individual user notification messages in serial manner*.Is it
possible to create dynamic partition creation for a particu
Can you explain why you think you need dynamic partitioning? Maybe we can
help you design without it.
Ryanne
On Tue, Jan 8, 2019, 4:04 AM marimuthu eee Hi,
>
> My requirement is to process notification messages in parallel.So i have an
> idea to pick kafka as a messaging system.But i need dynami
Hello Marimuthu,
Partitions are created at the moment the topic is created, however, you can
also add more new partitions to a topic once have been created. There is
not a possibility to create partitions dynamically (out-of-the-box) into a
topic unless you create your own business logic and/or sc
That command will change how many partitions the topic has.
What you are looking for I think is
https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools#Replicationtools-6.ReassignPartitionsTool
which allows you to change what partitions are running on which replicas
and which replicas
