Re: parittioner runtime error with kafka 0.8

2013-01-18 Thread Jay Kreps
Hmmm, so I would like to turn this into a bug for us, since at the very least the error is confusing, but I am not quite sure what was going on. At least one issue is the error doesn't make it clear whether this is for the key serializer or value serializer and could be cleaned up. Let me try to re

Re: parittioner runtime error with kafka 0.8

2013-01-18 Thread Jane Wang
finally, I made the partitioner working after changing the partition key to be string. and add the key.serializer.class to the config props. thanks for the help. On Thu, Jan 17, 2013 at 7:57 PM, Jane Wang wrote: > I also tried with the constructor > ExpertSearchCollectionPartitioner(VerifiableP

Re: parittioner runtime error with kafka 0.8

2013-01-17 Thread Jane Wang
I also tried with the constructor ExpertSearchCollectionPartitioner(VerifiableProperties props) { } Still the same error. I also tried the constructor without any parameter and with parameter Long. None of them worked. On Thu, Jan 17, 2013 at 7:08 PM, Jay Kreps wrote: > Hi Jane, > > This e

Re: parittioner runtime error with kafka 0.8

2013-01-17 Thread Jay Kreps
Hi Jane, This error is java.lang.NoSuchMethodException: com.twitter.expertsearch.indexing.jit.ExpertSearchCollectionPartitio ner.(kafka.utils.VerifiableProperties) It means that you need to have a constructor which takes a single argument, VerifiableProperties. This is a way to pass any configura

parittioner runtime error with kafka 0.8

2013-01-17 Thread Jane Wang
I defined a customized partitioner: class ExpertSearchCollectionPartitioner implements Partitioner { @Override public int partition(Long key, int numPartitions) { System.out.print("partition: " + key + ", " + numPartitions + ", "+ (key.hashCode() % numPartitions) + "\n"); retur