Hi Pulsar community,

I'd like to propose PIP-460: Scalable Topics (Topics v5), a new topic
type that replaces modulo-based partition routing with range-based
routing, enabling transparent splitting and merging of streams without
breaking key ordering or requiring downtime. This proposal is based on
discussions I had with Matteo after starting the Pulsar 5.0 discussion
in the community [1].

This is a parent PIP, with detailed design across areas like the
segment model, producer protocol, consumer controller, message entry
format, and split/merge mechanics to be covered in dedicated sub-PIPs.
The feature targets Pulsar 5.0 LTS via an incremental delivery path
through 4.3.0 and 4.4.0.

Full proposal: https://github.com/lhotari/pulsar/blob/lh-pip-460/pip/pip-460.md
PR: https://github.com/apache/pulsar/pull/25315

Looking forward to your feedback!

Lari

[1] https://lists.apache.org/thread/3zclb8cq0dt95c8f1lh83qxyyj11m8pq

Reply via email to