Re: Kafka DefaultPartitioner is not behaved as expected.

2015-03-05 Thread Zijing Guo
Thanks a lot, really appreciate you guys help!!! On Thursday, March 5, 2015 9:17 PM, tao xiao wrote: The reason you need to use "a".getBytes is because the default serializer.class is kafka.serializer.DefaultEncoder which takes byte[] as input. The way the array returns hash code is n

Re: Kafka DefaultPartitioner is not behaved as expected.

2015-03-05 Thread tao xiao
The reason you need to use "a".getBytes is because the default serializer.class is kafka.serializer.DefaultEncoder which takes byte[] as input. The way the array returns hash code is not based on equality of the elements hence every time a new byte array is created which is the case in your sample

Re: Kafka DefaultPartitioner is not behaved as expected.

2015-03-05 Thread Zijing Guo
And also there something that I think worth mentioning,when I call  prod.send(KeyedMessage("foo", "a", "test message")), the data can't be delivered to the brokers, the only way to make it work is through:prod.send(KeyedMessage("foo", "a".getBytes, "test message".getBytes)). When I convert the d

Re: Kafka DefaultPartitioner is not behaved as expected.

2015-03-05 Thread Zijing Guo
Hi Guozhang,I'm using kafka 0.8.2.0  Thanks On Thursday, March 5, 2015 12:57 PM, Guozhang Wang wrote: Zijing, Which version of Kafka client are you using? On Thu, Mar 5, 2015 at 8:50 AM, Zijing Guo wrote: > Hi community,I have a 2 nodes test cluster with 2 zk instance and 2 broke

Re: Kafka DefaultPartitioner is not behaved as expected.

2015-03-05 Thread Guozhang Wang
Just got the previous emails. Mayuresh is right, it seems your keys are not "a". On Thu, Mar 5, 2015 at 9:57 AM, Guozhang Wang wrote: > Zijing, > > Which version of Kafka client are you using? > > On Thu, Mar 5, 2015 at 8:50 AM, Zijing Guo > wrote: > >> Hi community,I have a 2 nodes test clust

Re: Kafka DefaultPartitioner is not behaved as expected.

2015-03-05 Thread Guozhang Wang
Zijing, Which version of Kafka client are you using? On Thu, Mar 5, 2015 at 8:50 AM, Zijing Guo wrote: > Hi community,I have a 2 nodes test cluster with 2 zk instance and 2 broker > instance running and I'm experimenting kafka producer in a cluster > environment. So I create a topic "foo" with

Re: Kafka DefaultPartitioner is not behaved as expected.

2015-03-05 Thread Zijing Guo
Hi, Thanks for your response. That's just my typo, I was meant to say  KeyedMessage("foo","a", "test message" + e). On Thursday, March 5, 2015 12:49 PM, Mayuresh Gharat wrote: I suppose the keyedMessage constructor is KeyedMessage(topic, key, message), so in your case key is "test me

Re: Kafka DefaultPartitioner is not behaved as expected.

2015-03-05 Thread Mayuresh Gharat
I suppose the keyedMessage constructor is KeyedMessage(topic, key, message), so in your case key is "test message" + e. Thanks, Mayuresh On Thu, Mar 5, 2015 at 9:25 AM, Zijing Guo wrote: > And I'm using kafka version 0.8.2.0 > > On Thursday, March 5, 2015 11:51 AM, Zijing Guo > wrote: >

Re: Kafka DefaultPartitioner is not behaved as expected.

2015-03-05 Thread Zijing Guo
And I'm using kafka version 0.8.2.0 On Thursday, March 5, 2015 11:51 AM, Zijing Guo wrote: Hi community,I have a 2 nodes test cluster with 2 zk instance and 2 broker instance running and I'm experimenting kafka producer in a cluster environment. So I create a topic "foo" with 2 par

Kafka DefaultPartitioner is not behaved as expected.

2015-03-05 Thread Zijing Guo
Hi community,I have a 2 nodes test cluster with 2 zk instance and 2 broker instance running and I'm experimenting kafka producer in a cluster environment. So I create a topic "foo" with 2 partitions and replication 1.I create a async Producer without defining partition.class (so the partitioner