Re: urgent request for kafka 0.8

2013-01-28 Thread Jane Wang
Please ignore the previous email. I have found the library version and got the jar files. Thanks, Jane On Mon, Jan 28, 2013 at 11:30 AM, Jane Wang wrote: > I just updated my kafka 0.8 this morning. > > After that I am not able to run kafka any more. > > The error msg I got

urgent request for kafka 0.8

2013-01-28 Thread Jane Wang
I just updated my kafka 0.8 this morning. After that I am not able to run kafka any more. The error msg I got is for producer: 13/01/28 11:23:57 ERROR async.DefaultEventHandler: Failed to send messages java.lang.NoClassDefFoundError: org/xerial/snappy/SnappyOutputStream at kafka.message.ByteBuff

Re: parittioner runtime error with kafka 0.8

2013-01-18 Thread Jane Wang
finally, I made the partitioner working after changing the partition key to be string. and add the key.serializer.class to the config props. thanks for the help. On Thu, Jan 17, 2013 at 7:57 PM, Jane Wang wrote: > I also tried with the constructor > ExpertSearchCollectionParti

Re: parittioner runtime error with kafka 0.8

2013-01-17 Thread Jane Wang
y to pass any configuration from the > producer properties to your partitioner instance. > > Sorry there is no real documentation for this as it is new to 0.8 and we > haven't finished the 0.8 documentation. > > -Jay > > On Thu, Jan 17, 2013 at 5:29 PM,

parittioner runtime error with kafka 0.8

2013-01-17 Thread Jane Wang
I defined a customized partitioner: class ExpertSearchCollectionPartitioner implements Partitioner { @Override public int partition(Long key, int numPartitions) { System.out.print("partition: " + key + ", " + numPartitions + ", "+ (key.hashCode() % numPartitions) + "\n"); retur

Re: weird partitioner behavior

2013-01-14 Thread Jane Wang
? Thanks, Jane On Fri, Jan 11, 2013 at 9:06 PM, Jun Rao wrote: > The very first message triggers the creation of the topic. Once the topic > is created, the producer can know the # of partitions. > > Thanks, > > Jun > > On Fri, Jan 11, 2013 at 5:20 PM, Jane Wang wrote

Re: retrieving and deleting about topics

2013-01-14 Thread Jane Wang
I tried to grep getMetadata from kafka 0.8. However, I failed to find it. does the api belong to a particular of kafka 0.8? Does this getMetadata an api belong to consumer? On Fri, Jan 11, 2013 at 9:04 PM, Jun Rao wrote: > getMetadata

kafka 0.8 vs. scala 2.9.2

2013-01-14 Thread Jane Wang
I need to use some of the newly added functions of kafka 0.8. However, in our system, we support scala 2.9.2. I build my code together kafka 0.8 and scala 2.9.2 and I got alot of runtime issues, one of them is: Exception in thread "main" java.lang.NoClassDefFoundError: scala/Tuple2$mcLL$sp at kafka

periodically delete topics in version 0.8?

2013-01-14 Thread Jane Wang
in kafka 0.8, is it possible for a consumer to send a request to the broker to delete some topics? If yes, is it possible to provide some sample code snippet to do it? I would highly appreciate it. Thanks in advance!

weird partitioner behavior

2013-01-11 Thread Jane Wang
I am using kafka 0.7. and I write a simple customized partitioner: public static class ExpertSearchCollectionPartitioner implementsPartitioner { @Override public synchronized int partition(Long key, int numPartitions) { System.out.print("partition: " + key.hashCode() + ", " +

retrieving and deleting about topics

2013-01-11 Thread Jane Wang
I am new to kafka and would appreciate any suggestions:)= In kafka 0.7, is it possible for the consumer to obtain all the topics so far written by the broker? If not possible, is there any later version makes this possible? thanks alot!