Re: Failover Subscription - consumer assignment logic discussion

Hi Penghui and Girish, Thanks for your discussions and technical guidance! I've optimized the docs in https://github.com/apache/pulsar-site/pull/633, could you PTAL? Anyone else who wants to take a look and comment, feel free! Thanks! Yu On Tue, Jul 4, 2023 at 8:31 AM PengHui Li wrote: > > I

Re: Failover Subscription - consumer assignment logic discussion

> I was also thinking that from a user perspective, one would think that a lower priority consumer is meant for backup in case one active consumer goes down - which also doesn't work like that. Yes, it makes sense. We will try to think more about that to find a solution to make Failover subscripti

Re: Failover Subscription - consumer assignment logic discussion

Hello PengHui, On Mon, Jul 3, 2023 at 8:39 PM PengHui Li wrote: > > Got it, for the Failover subscription, the new consumer caused the active > consumer > shift. I think we can make some improvements to this part to make sure the > new active > consumer will only get messages after the previous

Re: Failover Subscription - consumer assignment logic discussion

Hi Girish, Yes, we will improve the document to make it really reflect actual behavior. > - Unlike KEY_SHARED, there is no logic to start sending data to newly assigned consumers *only after *the previous one acks to a certain checkpoint. - This in turn leads to chances of out of

Re: Failover Subscription - consumer assignment logic discussion

Hello PengHui, Thank you for the reply. Adding comments inline below with a few concerns. On Mon, Jul 3, 2023 at 4:38 PM PengHui Li wrote: > Hi Girish, > > Thanks for raising the discussion. > > I can confirm that your understanding is correct, and the document > is confusing. If there are four

Re: Failover Subscription - consumer assignment logic discussion

Hi Girish, Thanks for raising the discussion. I can confirm that your understanding is correct, and the document is confusing. If there are four consumers connected to a partitioned topic with two partitions, each partition will have four connected consumers but only one active consumer. The docu

Re: Failover Subscription - consumer assignment logic discussion

Bumping this up. Would really like to discuss this in the community. Regards On Wed, Jun 28, 2023 at 11:49 PM Girish Sharma wrote: > Hi everyone, I am trying to understand the failover subscription logic a > bit more in detail. Specifically, the doc >

Failover Subscription - consumer assignment logic discussion

Hi everyone, I am trying to understand the failover subscription logic a bit more in detail. Specifically, the doc mention this part for partitioned topic: * If the number of partitions in a partitioned topic is less than the num