Hi,

I can think of two failover strategies. I am not sure which one is the right 
way to go.

First method. set up kafka server A on cluster 1 and set up another server B on 
cluster 2.
The two clusters are in different data centers. Use customized mirrormaker to 
sync between
the two servers. Use one server in production and use the other one as 
contingency. If
server A is down, server B will be used (this can be transparent to 
publishers/consumers).
There may be a lag between the two servers before server A is down . But after 
A is back,
the customized mirrormaker can sync the two. And eventually B will have all the 
data A had
before the failure.

Second method. Set up one kafka server using cluster 1 and cluster 2. When 
creating a topic ,
always use two replications. For each partition, assign one replication to a 
broker in cluster 1
and assign the other replication to a broker in cluster 2. So kafka will handle 
the syncing and failover
for the two clusters. Is that a right (expected) way to use kafka?


Regards,

Libo

Reply via email to