Hi Rajan,

Please find my answers inline.

Regards,
Heesung

On Wed, Jul 20, 2022 at 1:37 PM Rajan Dhabalia <rdhaba...@apache.org> wrote:

> Hi,
>
> I have gone through PIP but I don't see some basic information as part of
> PIP:
> 1. current issue in current load balancer strategy

2. Are there any performance and feature gaps in the current load balancer?

Please provide data or metrics to show the impact.

3. what exactly we are solving in new Load balancer
>

As we linked in the motivation section, this proposal is based on the Pulsar
Broker Load Balance Improvement Areas
<https://docs.google.com/document/d/1nXaiSK39E10awqinnDUX5Sial79FSTczFCmMdc9q8o8/>

doc shared by our StreamNative team last month
<https://lists.apache.org/thread/7r5pd6jlsy8pz4m540z2z5twvcdrow97>.


> 4. why we can not enhance current load balancer
>

As the PIP changes almost every place (data models, event handlers,
cache/storage, logs/metrics),
 creating a new load balancer and isolating the new code is safer and
cleaner.
Then, customers could safely enable/disable the new load balancer
by a configuration before deprecating the old one.


> 5. Show improvement numbers, metrics and impact with new load balancer

There were many metrics, historical data, and impacts were analyzed when
> introducing the current load balancer. So, I am expecting similar
> information documented and discussed before coming up with new
> implementation and merging it.
>
>
 I agree. We will be running load balance performance tests(old vs new)
when we validate the new load manager. We are in the early step of getting
this PIP
 approved by the community.

Also, here we have to clearly document that it will not impact behavior of
> existing load-balancers now or in future. Pulsar is used by many companies
> and orgs so, deprecating and not maintaining existing components is not
> acceptable in any circumstances.
>
>
 I agree. We mentioned this in the PIP like the following.

New Load Manager
...

   - It isolates the new code in the new classes without breaking the
   existing logic.


   - This new load manager will be disabled in the first releases until
   proven stable.



> Thanks,
> Rajan
>
>
>
> On Tue, Jul 19, 2022 at 10:15 PM Heesung Sohn
> <heesung.s...@streamnative.io.invalid> wrote:
>
> > Dear Pulsar dev community,
> >
> > We would like to open a discussion here about PIP-192: New Pulsar Broker
> > Load Balancer <https://github.com/apache/pulsar/issues/16691>.
> >
> > Regards,
> > Heesung
> >
>

Reply via email to