Re: Get all the partion details from zookeeper for a topic

You can instantiate ZkClient with the ZkStringSerializer in Kafka - zkClient = new ZkClient(params.zkConnect, 3, 3, ZKStringSerializer) For code examples on how to read the various paths, you can take a look at kafka.utils.ZkUtils.scala Thanks, Neha On Wed, Mar 6, 2013 at 11:43 AM

Re: Get all the partion details from zookeeper for a topic

Thanks Neha for your response. Now I am calling it like: List partitions = zkclient.readData("/brokers/topics/test-topic/1"); //topic = test topic and broker id is 1 *1. * Now _connection.readData(path, stat, watch); is returning a byte[] of [49]. But derializable(data) is throwing ZkMarshal

Re: Get all the partion details from zookeeper for a topic

I didn't check before I typed. I was referring to readData(). Thanks, Neha On Tue, Mar 5, 2013 at 11:04 PM, sourabh chaki wrote: > Hi Neha, > I am using zkclient version 0.1. I dont see any method "getData" in > zkclient. Please let me know which version should I use. > > Thanks > Sourabh > > >

Re: Get all the partion details from zookeeper for a topic

Hi Neha, I am using zkclient version 0.1. I dont see any method "getData" in zkclient. Please let me know which version should I use. Thanks Sourabh On Tue, Mar 5, 2013 at 10:01 PM, Neha Narkhede wrote: > The problem is that you need to invoke getData, not getChildren on this > path - /brokers/

Re: Get all the partion details from zookeeper for a topic

The problem is that you need to invoke getData, not getChildren on this path - /brokers/topics/test-topic/1. That will return the # of partitions on this broker, which is 1. Thanks, Neha On Tue, Mar 5, 2013 at 6:48 AM, sourabh chaki wrote: > Hi Neha, > > Thanks for your reply. > > ZkClient zk =

Re: Get all the partion details from zookeeper for a topic

Hi Neha, Thanks for your reply. ZkClient zk = new ZkClient(serverstring ); List partitions = zk.getChildren("/brokers/topics/test-topic/1"); // my topic = test-topic, broker id = 1 This broker is associated with partition 0. So I am expecting output should be [0] but I am getting empty response

Re: Get all the partion details from zookeeper for a topic

Sourabh, In 0.7, you can use zkclient or the zookeeper client library to query the following zookeeper path to get a number of partitions for a topic - get /brokers/topics/[topic]/[broker-id] This will give you # of partitions/broker, you can then add up this value across all brokers. Thanks, N

Re: Get all the partion details from zookeeper for a topic

Hi All, I am using zookeeper based connector to get data from Kafka Server. Is there any way to get all the partitions from zookeeper for a given topic? I need do do that through java code. Please help!!! Thanks.