Hi, Pulsar Community.

I added a new PR that aims to enhance our management of topic subscriptions
within PatternMultiTopicsConsumer in Pulsar client. This PR introduces the
ability to dynamically add or remove topics from a regex pattern
subscription, which can significantly improve our system’s responsiveness
and efficiency.

When subscribing to topics using regex patterns, it’s possible to encounter
scenarios where some topics process messages slower than others. This can
lead to significant performance bottlenecks, as slower topics might block
others. There’s a need to manage such situations dynamically to ensure
efficient processing and fair resource allocation among topics.

Related discussions can be found in [this Reddit thread](
https://www.reddit.com/r/ApachePulsar/comments/1fssbbn/roundrobin_between_wildcard_topics/),
which highlights issues similar to what we aim to address.

Currently, MultiTopicsConsumerImpl allows unsubscribing from specific
topics manually, as demonstrated here
<https://github.com/apache/pulsar/blob/5a3a1f169a7f90181bd5c213c8e9f479bc74f0f2/pulsar-client/src/main/java/org/apache/pulsar/client/impl/MultiTopicsConsumerImpl.java#L1246-L1258>
.


*This proposal seeks to integrate similar functionality into
PatternMultiTopicsConsumerImpl, allowing dynamically add or remove
specified topics.*



Thanks,
sinan

Reply via email to