Re: Kafka Beginners planning problem.

2016-07-05 Thread Hyounmin Wang
Hi David Thank you for your comments. My concern about that idea is that with only one topic, it will slow a lot of things down. I am assuming there are at least 6~7 physical consumers so I can safely assume to have more topics. ( Separate topic by operation perhaps?) Also according to your appro

RE: Kafka Beginners planning problem.

2016-07-05 Thread David Newberger
Hi, I think the recommended approach to this would be to have a single topic and partition it by userId. This will give you locality and order by user. If you think about it this would give you a better ordering guarantee than if you had one topic per users. It's also a lot more efficient. If y