Re: Ability to decrease partition count in pulsar

2024-07-22 Thread Girish Sharma
Hi Tao, We are planning to get a PIP out in this quarter. Regards On Mon, Jul 22, 2024 at 1:35 PM Tao Jiuming wrote: > Hi, > > How's the proposal going? > > On 2024/01/19 06:28:14 Girish Sharma wrote: > > Hello everyone, > > > > A a true cloud native platform, which supports scale up and scale d

Re: Ability to decrease partition count in pulsar

2024-07-22 Thread Tao Jiuming
Hi, How's the proposal going? On 2024/01/19 06:28:14 Girish Sharma wrote: > Hello everyone, > > A a true cloud native platform, which supports scale up and scale down, I > feel like there is a need to be able to reduce partition count in pulsar to > truly achieve a scale down after events like s

Re: Ability to decrease partition count in pulsar

2024-02-20 Thread Girish Sharma
Hello Asaf, thank you for taking a look at this. I will have a formal PIP sometime by March end. Trying to close on the Rate limiting PIPs first. On Sun, Feb 18, 2024 at 3:47 PM Asaf Mesika wrote: > Hey Girish, > > First, I say that I *love* this proposal and, in general, those types of > propo

Re: Ability to decrease partition count in pulsar

2024-02-18 Thread Asaf Mesika
Hey Girish, First, I say that I *love* this proposal and, in general, those types of proposals. This is what strides Pulsar towards being an even more next-generation messaging system. I read and have a few questions and brainstorming ideas popping into my mind: 1. The current design basically s

Re: Ability to decrease partition count in pulsar

2024-01-24 Thread Girish Sharma
Hello Lari, thanks for the comments. replies inline. On Wed, Jan 24, 2024 at 7:36 PM Lari Hotari wrote: > Hi Girish, > > Very useful proposal. > > Would it be possible to enable comments on the Google Doc? It's pretty > hard to comment on the doc since copying is also disabled. > > I've enabled

Re: Ability to decrease partition count in pulsar

2024-01-24 Thread Lari Hotari
Hi Girish, Very useful proposal. Would it be possible to enable comments on the Google Doc? It's pretty hard to comment on the doc since copying is also disabled. In the scope definition 4.2, "The initial scope is to target unordered consumption flows. Even in the current world, there are challe

Re: Ability to decrease partition count in pulsar

2024-01-23 Thread Girish Sharma
Bumping this up! Hoping this can be discussed so that I get rule out that this approach has any fatal flaws. Regards On Fri, Jan 19, 2024 at 11:58 AM Girish Sharma wrote: > Hello everyone, > > A a true cloud native platform, which supports scale up and scale down, I > feel like there is a need

Ability to decrease partition count in pulsar

2024-01-18 Thread Girish Sharma
Hello everyone, A a true cloud native platform, which supports scale up and scale down, I feel like there is a need to be able to reduce partition count in pulsar to truly achieve a scale down after events like sales (akin to black friday, etc) or huge temporary publish burst due to backfill. I l