The way offset management works with kafka is : It stores offsets for a particular (groupId, Topic, partitionId) in a particular partition of __consumer_offset topic.
1) By default the value is 50. You can change it by setting this property : "*offsets.topic.num.partitions*" in your config. 2) No we don't have an API. But there is a ticket for those improvements : KAFKA-1013 <https://issues.apache.org/jira/browse/KAFKA-1013>. There is already a patch for this. We can add this to that. Would mind leaving a comment there? Thanks, Mayuresh On Fri, Mar 13, 2015 at 5:13 AM, Madhukar Bharti <bhartimadhu...@gmail.com> wrote: > Hi, > > I am using Kafka 0.8.2.1. I have two topics with 10 partitions each. > Noticed that one more topic exist named as "__consumer_offset" with 50 > partitions. My questions are: > > 1. Why this topic is created with 50 partition? > 2. How to get consumer group names for a topic? Is there any document or > API to get all consumer group from Kafka offset storage manager like > zookeeper we have /consumer which lists all consumers. > > > Thanks in advance. > > Regards, > Madhukar > -- -Regards, Mayuresh R. Gharat (862) 250-7125
