Re: producer purgatory

2023-03-08 Thread David Ballano Fernandez
e the followers > writes to their local log are slower? Seems like that would sense if those > writes are going over the network. This could explain why the leader ends > up having to wait longer to hear back from the followers before sending the > produce response, which in turn co

Re: producer purgatory

2023-03-04 Thread Andrew Grant
leader ends up having to wait longer to hear back from the followers before sending the produce response, which in turn could explain why the producer purgatory is bigger. See the section "Commit time: Replicating the record from leader to followers" in https://www.confluent.io/blog/confi

Re: producer purgatory

2023-02-27 Thread David Ballano Fernandez
ter. messages per second matches exactly the > number of requests. > but on the ceph cluster messages do not match total produce requests per > second. > > and the only thing I can find is that the Producer purgatory in ceph kafka > cluster has more request queued up than th

producer purgatory

2023-02-27 Thread David Ballano Fernandez
nd is that the Producer purgatory in ceph kafka cluster has more request queued up than the local disk. Also RemoteTime-ms for producers is high, which could explain why there are more requests on the purgatory. To me , I think this means that the Producer is waiting to hear from all the acks. whic