Re: Offset backup and restore in Kafka v0.8.2

2015-01-08 Thread Mayuresh Gharat
There is a patch for KAFKA-1013 that has a tool for importing and exporting offsets to and from kafka. Using that tool you can write topic/partion/offset to a file and import it back to kafka. Thanks, Mayuresh On Thu, Jan 8, 2015 at 1:21 PM, Kyle Banker wrote: > We currently checkpoint partiti

Offset backup and restore in Kafka v0.8.2

2015-01-08 Thread Kyle Banker
We currently checkpoint partition offsets from ZK into an external database, and we have a process for restoring those offsets to ZK in case we ever need to replay data from Kafka. Since offsets are now stored on the broker, the ConsumerOffsetChecker no longer works. Is there a new way (tool) to d