> And I want to cherry-pick the improvement
> PR into branch-3.0

The issue described above will generate much more dirty partitioned and
non-partitioned topics, which should be fixed for the LTS version.

Thanks
Yubiao Feng


On Tue, May 14, 2024 at 2:56 AM Yubiao Feng <yubiao.f...@streamnative.io>
wrote:

> Hi community
>
> I want to change the behavior of DLQ/Retry Topic auto creation.
>
> ### Motivation
> After you set `defaultNumPartitions` to `16`, you will get `16` partitions
> per topic, and `16*16` DLQ partitions per subscription, you will get a huge
> number of DLQs if you have more than one subscription under one topic.  For
> example:
> - create topic `t1` with `16` partitions
> - you will get `t1-partition-0`, `t1-partition-1`...`tp-partition-15`.
> - after you enable DLQ, you will get the following `16*16` DLQs per
> subscription
>   - `t1-partition-0-{subscription}-DLQ-partition-0`
>   - `t1-partition-0-{subscription}-DLQ-partition-1`
>   - ...
>   - `t1-partition-15-{subscription}-DLQ-partition-15`
>   - `t1-partition-1-{subscription}-DLQ-partition-0`
>   - `t1-partition-1-{subscription}-DLQ-partition-1`
>   - ...
>   - ...
>   - ...
>   - `t1-partition-15-{subscription}-partition-15`
>
> ### Goal
> - Do not create partitioned DLQs/Retry topics automatically.
> - Users can also create partitioned DLQ manually if they need it.
>
> I have drafted a PR, please take a look
> - https://github.com/apache/pulsar/pull/22705
>
> Thanks
> Yubiao Feng
>

Reply via email to