Re: Amount of partitions

2015-09-07 Thread Jörg Wagner
Thank you very much for both replies. @Tao Thanks, I am aware of and have read that article. I am asking because my experience is completely different :/. Everytime we go beyond 400 partitions the cluster really starts breaking apart. @Todd Thank you, very informative. Or Details: 3 Brokers:

Re: Amount of partitions

2015-09-07 Thread Jörg Wagner
Sorry, the messages are keyed. On 07.09.2015 10:08, Jörg Wagner wrote: Thank you very much for both replies. @Tao Thanks, I am aware of and have read that article. I am asking because my experience is completely different :/. Everytime we go beyond 400 partitions the cluster really starts bre

Re: Message Id in Kafka Keyed Message

2015-09-07 Thread Muqtafi Akhmad
I just figured out that it is ok to assign random value as message key after reading kafka protocol guide ( https://cwiki.apache.org/confluence/display/KAFKA/A+Guide+To+The+Kafka+Protocol ) Thank you, On Mon, Sep 7, 2015 at 10:26 AM, Muqtafi Akhmad wrote: > hello all, > > I've read KeyedMessage