Re: [VOTE] PIP-219: Support full scan and trim ledger

2022-11-07 Thread Cong Zhao
+1(non-binding) Thanks, Cong On 2022/11/01 14:28:14 linlin wrote: > Hi folks, > > I'd like to start a vote for the PIP-219: Support full scan and trim ledger > ( > https://github.com/apache/pulsar/issues/18128) > > The discussion can be found here: > https://lists.apache.org/thread/wy8sqs2fdmw3

Re: Request a site ID and tracking code for Apache Pulsar

2022-11-07 Thread tison
Hi Martijn, Thank you! Best, tison. Martijn Visser 于2022年11月7日周一 16:44写道: > Hi Tison, > > It most certainly is but I haven't had the time yet to reply yet. My > apologies! > > Here's the tracking code for Pulsar. The code will need to be integrated in > any page you want to track by adding it

Re: [PIP-214][broker]Add broker level metrics statistics and expose to prometheus discussion

2022-11-07 Thread Asaf Mesika
I'm reposting my comment from the PR as this requires further discussion to reach an agreement. --- You have decided to re-use the same metric name, but with removing the namespace dimension. So we would do something like this in case we turn on topic-level metrics: pulsar_rate_in{host="brok

Re: [DISCUSS] Release Pulsar 2.9.4

2022-11-07 Thread mattison chao
Thanks for volunteering to be the release manager Best, Mattison On Fri, 4 Nov 2022 at 16:28, Haiting Jiang wrote: > +1 > > Haiting > > On Fri, Nov 4, 2022 at 1:42 PM houxiaoyu wrote: > > > > +1 > > > > Best, > > Xiaoyu Hou > > > > 丛搏 于2022年11月3日周四 14:01写道: > > > > > Hello, Pulsar community:

Re: [DISCUSS] PIP-211: Introduce offload throttling

2022-11-07 Thread Jiuming Tao
> One alternative would be to throttle offload in the write path instead of > adding additional logic to the read path in managed ledgers. This is really a feasible method. But we need to make changes in FileSystem and BlobStore offloaders, event custom offloaders. I think this is not universal.

Re: [DISCUSS] PIP-211: Introduce offload throttling

2022-11-07 Thread Michael Marshall
This PIP is similar to autorecovery throttling. I think the feature makes sense for the same reasons that throttling autorecovery makes sense. Tangentially, can we decouple writes to tiered storage from the broker hosting the topic being offloaded? An independent service could write to tiered stor

Re: [PIP-214][broker]Add broker level metrics statistics and expose to prometheus discussion

2022-11-07 Thread PengHui Li
Hi Asaf, Agree with your point. +1 for the new indicator name solution. Penghui > On Nov 7, 2022, at 17:26, Asaf Mesika wrote: > > I'm reposting my comment from the PR as this requires further discussion to > reach an agreement. > > --- > > You have decided to re-use the same metric name

Re: [DISCUSS] Release Pulsar 2.9.4

2022-11-07 Thread lordcheng10
+1 mattison chao 于2022年11月7日周一 20:01写道: > Thanks for volunteering to be the release manager > > > Best, > Mattison > > On Fri, 4 Nov 2022 at 16:28, Haiting Jiang wrote: > > > +1 > > > > Haiting > > > > On Fri, Nov 4, 2022 at 1:42 PM houxiaoyu wrote: > > > > > > +1 > > > > > > Best, > > > Xiaoy

Re: [VOTE] PIP-219: Support full scan and trim ledger

2022-11-07 Thread Hang Chen
+1 (binding) Thanks, Hang Cong Zhao 于2022年11月7日周一 16:35写道: > > +1(non-binding) > > Thanks, > Cong > > On 2022/11/01 14:28:14 linlin wrote: > > Hi folks, > > > > I'd like to start a vote for the PIP-219: Support full scan and trim ledger > > ( > > https://github.com/apache/pulsar/issues/18128) >

Re: [VOTE] PIP-219: Support full scan and trim ledger

2022-11-07 Thread Haiting Jiang
+1 binding Thanks Haiting On Tue, Nov 8, 2022 at 11:13 AM Hang Chen wrote: > > +1 (binding) > > Thanks, > Hang > > Cong Zhao 于2022年11月7日周一 16:35写道: > > > > +1(non-binding) > > > > Thanks, > > Cong > > > > On 2022/11/01 14:28:14 linlin wrote: > > > Hi folks, > > > > > > I'd like to start a vote

[GitHub] [pulsar] mnit016 added a comment to the discussion: Why pulsar retention quota must exceed configured backlog quota

2022-11-07 Thread GitBox
GitHub user mnit016 added a comment to the discussion: Why pulsar retention quota must exceed configured backlog quota Hello @Jason918 , @michaeljmarshall , but I still confused, could you please explain for me why backlog quota couldn't exceed the retention? Is there any risk if we set backl

Pulsar Summit Asia 2022 is coming! Check the schedule and register now for free!

2022-11-07 Thread Sherlock Xu
Hi Apache Pulsar community members, Pulsar Summit Asia 2022 will be hosted virtually on November 19th and 20th, 2022. This two-day virtual event will feature 36 sessions by developers, engineers, architects, and technologists from ByteDance, Huawei, T

Re: [PIP-214][broker]Add broker level metrics statistics and expose to prometheus discussion

2022-11-07 Thread Michael Marshall
I agree with your point, too, Asaf. Thanks for posting it on the mailing list. - Michael On Mon, Nov 7, 2022 at 6:38 PM PengHui Li wrote: > > Hi Asaf, > > Agree with your point. > +1 for the new indicator name solution. > > Penghui > > > On Nov 7, 2022, at 17:26, Asaf Mesika wrote: > > > > I'm

[GitHub] [pulsar] leizhiyuan added a comment to the discussion: sometimes broker send messages to consumer,but consumer can not receive

2022-11-07 Thread GitBox
GitHub user leizhiyuan added a comment to the discussion: sometimes broker send messages to consumer,but consumer can not receive ``` Future writeAndFlushPromise = cnx.getCommandSender().sendMessagesToConsumer(consumerId, topicName, subscription, partitionIdx,

[GitHub] [pulsar] michaeljmarshall added a comment to the discussion: struggling with pulsar functions in kubernetes

2022-11-07 Thread GitBox
GitHub user michaeljmarshall added a comment to the discussion: struggling with pulsar functions in kubernetes Thanks, that is helpful. I looked closer at the function worker integration in the helm chart, because you're enabling tls in the broker, the helm chart should be adding `tlsTrustCer

[GitHub] [pulsar] TheDungNTU edited a discussion: [Pulsar JVM Dashboard] Zookeeper show No Data on direct memory

2022-11-07 Thread GitBox
GitHub user TheDungNTU edited a discussion: [Pulsar JVM Dashboard] Zookeeper show No Data on direct memory **Describe the bug** To monitor a Pulsar cluster, I used grafana and in the Pulsar JVM dashboard, Zookeeper Direct Memory is show No Data. While other dashboards have data such as Boo

[GitHub] [pulsar] TheDungNTU edited a discussion: [Pulsar JVM Dashboard] Zookeeper show No Data on column direct memory

2022-11-07 Thread GitBox
GitHub user TheDungNTU edited a discussion: [Pulsar JVM Dashboard] Zookeeper show No Data on column direct memory **Describe the bug** To monitor a Pulsar cluster, I used grafana and in the Pulsar JVM dashboard, Zookeeper Direct Memory is show No Data. While other dashboards have data such

[GitHub] [pulsar] TheDungNTU edited a discussion: [Pulsar JVM Dashboard] Zookeeper show No Data on column direct memory ?

2022-11-07 Thread GitBox
GitHub user TheDungNTU edited a discussion: [Pulsar JVM Dashboard] Zookeeper show No Data on column direct memory ? **Describe the bug** To monitor a Pulsar cluster, I used grafana and in the Pulsar JVM dashboard, Zookeeper Direct Memory is show No Data. While other dashboards have data suc