Re: how brokers sync with each other

2013-07-01 Thread Joel Koshy
lto:jjkosh...@gmail.com] > Sent: Friday, June 28, 2013 9:04 PM > To: users@kafka.apache.org > Subject: Re: how brokers sync with each other > > I'm assuming this is somewhat related to your previous question on cross-DC > replication. This is not an ideal set up as mentioned

RE: how brokers sync with each other

2013-06-29 Thread Yu, Libo
nt: Friday, June 28, 2013 9:04 PM To: users@kafka.apache.org Subject: Re: how brokers sync with each other I'm assuming this is somewhat related to your previous question on cross-DC replication. This is not an ideal set up as mentioned there. If the replica lags then it will fall out of the &

Re: how brokers sync with each other

2013-06-28 Thread Jun Rao
Since broker A persists all messages on disk, the buffer is the on-disk file (with recent data cached in file system buffer). Thanks, Jun On Fri, Jun 28, 2013 at 5:41 PM, Yu, Libo wrote: > Hi, > > Assume A and B are two brokers in a kafka server. And there is long network > Latency between A

Re: how brokers sync with each other

2013-06-28 Thread Joel Koshy
I'm assuming this is somewhat related to your previous question on cross-DC replication. This is not an ideal set up as mentioned there. If the replica lags then it will fall out of the "in-sync-replica" set. You could tune parameters that effectively allow a high (but bounded over time) lag betwee

how brokers sync with each other

2013-06-28 Thread Yu, Libo
Hi, Assume A and B are two brokers in a kafka server. And there is long network Latency between A and B. For a partition with two replications, one replication Is assigned to A and the other is assigned to B. Number of acknowledge is set to one. Assume the partition is handled by broker A. After