Re: application scenerio and suggested kafka setup

2013-01-27 Thread Guy Doulberg
Hi Ahmed, I can share with you my experience, I have built a system similar to yours. 1. If all your messages are the same, I think you should use the default partitioner, so the messages will spread evenly across all the brokers/partition combinations, unless you have a better function to s

Re: application scenerio and suggested kafka setup

2013-01-27 Thread Jun Rao
Partition is useful for increasing the degree of parallelism of consumers and to a certain degree, producers too. You can have multiple consumer groups consuming the same topic/partition. Thanks, Jun On Sun, Jan 27, 2013 at 1:06 PM, S Ahmed wrote: > Say I create web application/service where c