Hi Everyone,

I need to migrate my organization's Kafka cluster along with the underlying
Zookeeper ensemble (cluster) from one set of racks to another within our
data center. I am pretty sure I have the steps correct, but I need to
confirm just to ensure I am not missing anything.

Here's what I think I need to do in the following order:

1. Configure new Zookeeper ensemble
2. Configure brokers for new Kafka cluster, with zookeeper.connect list of
new Zookeeper ensemble nodes
3. Startup new Zookeeper ensemble
4. Startup new Kafka cluster
5. Shutdown data feeds to old Kafka cluster and reconfigure for new cluster
6. Migrate topics from old Kafka brokers to new brokers via
kafka-reassign-partitions.sh script and the instructions here:
http://kafka.apache.org/082/documentation.html#basic_ops_cluster_expansion
7. Export consumer offsets from old Zookeeper ensemble and import into new
Zookeeper ensemble
8. Shutdown old Kafka cluster
9. Restart data feeds into new Kafka cluster

The Kafka documentation is great and I've tested out the topic reassignment
and consumer offset import and export, but, again, just want to ensure I am
not missing anything.

Thanks

--John

Reply via email to