Re: [External] Kafka broker architecture overview

You can try taking a look at https://jaceklaskowski.gitbooks.io/apache-kafka/ , not sure if it is the same level you want but I've used it for some reference before. On Thu, Jun 18, 2020 at 6:39 AM Alexander Sibiryakov < sibirya...@scrapinghub.com> wrote: > Hello, > > could anyone please point me

Re: [External] Topics naming convention

If the schema is no longer compatible I think it makes sense to create a new topic. Offsets wise you can just have the consumer finish consuming from the old topic/schema (i.e. migrate all producers to use the new schema format first) and then migrate consumers to use the new schema format (and th

Re: [DISCUSS] KIP-501 Avoid out-of-sync or offline partitions when follower fetch requests not processed in time

Hi, Just wanted to bump this discussion, since it happened to us again at Yelp 😂 It's particularly nasty since it can happen right before a disk failure, so right as the leader for the partition becomes the only ISR, the leader becomes unrecoverable right after, forcing us to do an unclean lea