Re: [DISCUSS] PIP-300: Add custom dynamic configuration for plugins

2023-09-18 Thread Zixuan Liu
> 1. When you want to cherry-pick a PR, it should be cherry-picked for all > branches after the target branch. Isn't it? I think we should cherry-pick this PR to Pulsar 2.10, 2.11, 3.0. > 2. I've got a slight concern about cherry-picking. Do you have any issue or > feature request in the commun

Re: [DISSCUSS] PIP-298: Consumer supports specifying consumption isolation level

2023-09-18 Thread Dave Fisher
Let me try a different approach. Please see the definition of a Pulsar Transaction - https://pulsar.apache.org/docs/3.1.x/transactions/ If messages that are uncommitted are consumed that definition is no longer true. If breaking the definition is going to be allowed to a consumer then the produ

Re: [DISSCUSS] PIP-298: Consumer supports specifying consumption isolation level

2023-09-18 Thread Xiangying Meng
Hi Dave, I greatly appreciate your perspective, yet it leaves me with some uncertainties that I am eager to address. Why would the introduction of isolation levels constitute an insecure action? >I think if this proceeds then the scope needs to be expanded to >producers/admins needing to proacti

Re: [DISSCUSS] PIP-298: Consumer supports specifying consumption isolation level

2023-09-18 Thread Dave Fisher
Thanks. So, this is to support exfiltration of uncommitted transaction data? This is IMO wrong and a security risk. Pulsar already supports CDC through IO Connectors. Kafka can be wrong about these isolation levels. There is really no information in those Paimon issues. How is Paimon’s ability

Re: [DISSCUSS] PIP-298: Consumer supports specifying consumption isolation level

2023-09-18 Thread Xiangying Meng
Hi Dave, This is an external request. Paimon has added support for Kafka but has not yet incorporated support for Pulsar. Therefore, the Paimon community desires to integrate Pulsar. Furthermore, when integrating Pulsar into Paimon, it is desired to enable the ability to configure isolation levels

Re: [VOTE] PIP-286: Make the TopicCompactionService to support find entry based on publishTime or index

2023-09-18 Thread Cong Zhao
Thanks. Close the vote with 3+ (binding): Penghui Mattison Jiwei Guo 1+(non-binding): Zike Regards Cong Zhao On 2023/09/14 03:23:29 Cong Zhao wrote: > Hi, all > > Since there are no other concerns in the discussion, I'm delighted to > start the voting process for the PIP-286. > > Here is the l

[VOTE] PIP-301: Introduce LoadBalanceResources to unify the load-date CRUD

2023-09-18 Thread houxiaoyu
Hi dev, This thread is to start a vote for PIP-301: Introduce LoadBalanceResources to unify the load-date CRUD Discuss thread : https://lists.apache.org/thread/7ngw9dc62tj2c4c5484dgsnlwgtstpbj PIP: https://github.com/apache/pulsar/pull/21129 Regards houxiaoyu

Re: [DISCUSS] Cherry-pick the tool method `Servercnx.checkConnectionLiveness` into branch-2.10 and branch-2.11

2023-09-18 Thread Yubiao Feng
Hi all Cherry-picked. Thanks Yubiao Feng On Thu, Sep 14, 2023 at 12:10 PM Yubiao Feng wrote: > Hi all > > The PR https://github.com/apache/pulsar/pull/21155 fixes an issue in > which the producer sends messages timeout due to the inability to reconnect > successfully. The root cause is the cli