How to batch fetch/commit offset in Kafka 0.10 API

2017-07-05 Thread Martin Peng
Hi, Does anyone know how to batch fetch/commit the Kafka topic offsets using the new Kafka 0.10 API? When we were using Kafka 0.81, we used BlockingChannel to send OffsetCommitRequest and OffsetFetchRequest to do it in batch from Zk. However in 0.10, everything is built for single consumer based.

How to fetch offset for all the partitions of one topic through single KafkaClient function call (0.10.x)?

2017-07-06 Thread Martin Peng
Hi, I am using Kafka client 0.10.2. Is there a way to fetch latest committed offset for all the partitions in one function call? I am call the KafkaConsumer.commited() to get this for single partition, is there a simple way to batch fetch offsets for all the partitions in single topic in one shot