Re: Best practices Partition Key

2018-01-25 Thread Maria Pilar
Yes, I´m capturing different events from the same entity/resource (create, update and delete) for that reason I´ve choosen that options however my question is if i can improve my solution if I want to use kafka as datastore including the partition key of cassandra for each entity as partition key o

Re: Best practices Partition Key

2018-01-25 Thread Dmitry Minkovsky
> I know that could be a best practice use the partition key of Cassandra (e.g Customer ID) as a partition key in kafka Yeah, the Kafka Producer will hash that key with murmur so all entities coming out of cassandra with the same partition key will end up on the same kafka partition. Then you can

Re: Best practices Partition Key

2018-01-25 Thread Dmitry Minkovsky
> one entity - one topic, because I need to ensure the properly ordering in the events. This is a great in insight. I discovered that keeping entity-related things on one topic is much easier than splitting entity-related things onto multiple topics. If you have one topic, replaying that topic is

Best practices Partition Key

2018-01-25 Thread Maria Pilar
Hi everyone, I´m trying to understand the best practice to define the partition key. I have defined some topics that they are related with entities in cassandra data model, the relationship is one-to-one, one entity - one topic, because I need to ensure the properly ordering in the events. I have