Re: interesting paper on log replication

2013-04-16 Thread Jun Rao
On the last point, in general, Kafka logs are identical among replicas. The only case that they may not be identical is when an unclean leader election happens, i.e., a leader has to be elected from a replica not in in-sync replica set). Unclean leader election should be rare since this requires mu

Re: interesting paper on log replication

2013-04-16 Thread Neha Narkhede
More notable differences from Kafka as far as log replication protocol is concerned - - Raft considers log entries as committed as soon as it is acknowledged by a majority of the servers in a cluster. Compare this to Kafka where we have the notion of "in-sync followers" that are required to ack ev

Re: interesting paper on log replication

2013-04-14 Thread Jun Rao
Thanks for the link. This paper provides an alternative, but similar implementation to that in Zookeeper. The key difference seems to be that the former supports membership reconfiguration. Kafka replication is simpler because it separates the leader election part from log replication. Such separa

interesting paper on log replication

2013-04-09 Thread Jay Kreps
Very similar in design to kafka replication https://ramcloud.stanford.edu/wiki/download/attachments/11370504/raft.pdf -Jay