Hello, I'm processing events from several users but one user should not affect the other user processing throughput.
My initial idea was: one single topic partitioned by the userId. So if I have 5000 users and 1000 topics, each partition will receive messages from 5 users. For 100 workers, each worker will take care of 10 partitions and thus each worker will take care of 50 users. But then 1 user that sends a burst of messages will affect the other 49 users. Without using 1 partition per user, which would bring a lot of workers (and idle workers!), does anyone have any suggestion on how to evenly process these messages? Thank you. Regards, Francisco
