Re: command line clients and request balancing.

2014-05-02 Thread Jun Rao
The reason for this change is described in https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-Whyisdatanotevenlydistributedamongpartitionswhenapartitioningkeyisnotspecified ? In 0.8.2, we will be releasing the new producer which will have the even distribution out of the box, but allow the

Re: command line clients and request balancing.

2014-05-02 Thread Edward Capriolo
Why was this change made? Does this mean that all applicationa i have will need to be converted to use the partitioned send? This hurts the out of the box experience. Can the console producer simply split on first space and use that as the key? On Thursday, May 1, 2014, Guozhang Wang wrote: > Hi

Re: command line clients and request balancing.

2014-05-01 Thread Guozhang Wang
Hi Edward, What is the current version you are using? Starting in 0.8.1 the default partitioner of the producer would no longer be round-robin at a per-message level but would stick to one partition for a period (the metadata refresh period, which is 10 min by default) and then round-robin to anot

command line clients and request balancing.

2014-05-01 Thread Edward Capriolo
After installing Kafka I did the following createTopic --partitions 10 -replication 1 --name mytopic I started producer using bin/kafka-producer-shell I opened two consumers in the same group using bin/kafka-consumer-shell In older versions this test used to result in the messages being sent by