Re: Replication across Multiple Datacenters

2013-06-24 Thread Joel Koshy
I don't think replication is ideal for creating single clusters spanning DCs for at least a couple reasons: the replica assignment strategy is currently not rack or DC-aware although that can be addressed by manually creating topics. Also, network glitches and latencies which are more likely in a c

Replication across Multiple Datacenters

2013-06-23 Thread Mark Farnan
Howdy, Is the replication factor system in Kafka 0.8 suitable for creating single clusters which span across data centers ? (up to 3) I am looking for a system where I don't loose messages, and can effectively 'fail over' to a different datacenter for processing if/when the primary goes down