Re: [DISCUSS] Improving Pulsar broker cache design

2024-10-16 Thread Lari Hotari
Regarding Pulsar performance tuning, it's crucial to tune the Pulsar broker cache since the defaults in Pulsar are not optimal. Besides poor performance for Pulsar use cases, this leads to wasted CPU and unnecessary network transfer costs in cloud environments. Tuning the Pulsar broker cache impr

Re: [DISCUSS] Improving Pulsar broker cache design

2024-03-22 Thread Lari Hotari
Bumping this thread. Looking forward to some feedback. Thanks! -Lari On 2024/03/18 10:32:03 Lari Hotari wrote: > Hi all, > > I'd like to start a discussion about improving Pulsar broker cache design. > > In the Pulsar broker, there are two main scenarios for message > dispatching to consumers:

[DISCUSS] Improving Pulsar broker cache design

2024-03-18 Thread Lari Hotari
Hi all, I'd like to start a discussion about improving Pulsar broker cache design. In the Pulsar broker, there are two main scenarios for message dispatching to consumers: tailing (hot) reads and catch-up (cold) reads. In both scenarios consumers can be fast or slow which also impacts the scenari