Re: CI - remove cmd line test retries?

2022-07-12 Thread PengHui Li
+1 Penghui On Tue, Jul 12, 2022 at 1:47 PM Michael Marshall wrote: > +1 I support removing the retries for the many reasons already mentioned. > > - Michael > > On Tue, Jul 12, 2022 at 12:35 AM Matteo Merli wrote: > > > > +1 > > > > The retry that repeats the whole maven job is often hiding th

Re: CI - remove cmd line test retries?

2022-07-12 Thread Enrico Olivelli
+1 Enrico Il giorno mar 12 lug 2022 alle ore 09:24 PengHui Li ha scritto: > > +1 > > Penghui > > On Tue, Jul 12, 2022 at 1:47 PM Michael Marshall > wrote: > > > +1 I support removing the retries for the many reasons already mentioned. > > > > - Michael > > > > On Tue, Jul 12, 2022 at 12:35 AM M

Batch Messages with only 1 message

2022-07-12 Thread Enrico Olivelli
Hello, I think that we could implement a small but effective enhancement to batching. It may happen that even if you enable batching you come to create entries with 1 only message. Processing batch messages requires a good amount of resources, both on the broker and on the client side. Especiall

Re: Batch Messages with only 1 message

2022-07-12 Thread Yubiao Feng
+1 Good idea. Thanks Yubiao Feng On Tue, Jul 12, 2022 at 3:54 PM Enrico Olivelli wrote: > Hello, > I think that we could implement a small but effective enhancement to > batching. > > It may happen that even if you enable batching you come to create > entries with 1 only message. > > Processing

Re: CI - remove cmd line test retries?

2022-07-12 Thread Zike Yang
+1 On Tue, Jul 12, 2022 at 3:36 PM Enrico Olivelli wrote: > > +1 > > Enrico > > Il giorno mar 12 lug 2022 alle ore 09:24 PengHui Li > ha scritto: > > > > +1 > > > > Penghui > > > > On Tue, Jul 12, 2022 at 1:47 PM Michael Marshall > > wrote: > > > > > +1 I support removing the retries for the ma

Re: CI - remove cmd line test retries?

2022-07-12 Thread Kai Wang
+1 Thanks, Kai

Re: [DISCUSS] PIP-184: Topic specific consumer priorityLevel

2022-07-12 Thread Dave Maughan
Hi Zike, > What about using the Pattern type to store the compiled Pattern in the TopicConsumerConfigurationData? Thanks for the suggestion - yes that's a good idea. I'll update the doc. - Dave On Mon, Jul 11, 2022 at 12:04 PM Zike Yang wrote: > Hi, Dave > > Thanks for your proposals. Overal

Re: Batch Messages with only 1 message

2022-07-12 Thread Qiang Huang
+1 Good idea! It will greatly reduce the resource consumption of small batches. Yubiao Feng 于2022年7月12日周二 16:00写道: > +1 > Good idea. > > Thanks > Yubiao Feng > > On Tue, Jul 12, 2022 at 3:54 PM Enrico Olivelli > wrote: > > > Hello, > > I think that we could implement a small but effective enhan

Re: Batch Messages with only 1 message

2022-07-12 Thread ZhangJian He
+1 Thanks ZhangJian He Qiang Huang 于2022年7月12日周二 17:34写道: > +1 > Good idea! It will greatly reduce the resource consumption of small > batches. > > Yubiao Feng 于2022年7月12日周二 16:00写道: > > > +1 > > Good idea. > > > > Thanks > > Yubiao Feng > > > > On Tue, Jul 12, 2022 at 3:54 PM Enrico Olivelli

[VOTE] Enable GitHub Discussion for user-facing discussion

2022-07-12 Thread tison
Hi, In the previous email[1] I started a discussion about enabling GitHub Discussions in apache/pulsar repository and we meet a consensus to avoid making development discussions truth happen on the sources. It's also a requirement of INFRA team[2] Apart of it, for user-facing discussions it's con

Re: Batch Messages with only 1 message

2022-07-12 Thread Anon Hxy
+1 Good idea Thanks, Xiaoyu Hou Enrico Olivelli 于2022年7月12日周二 15:54写道: > Hello, > I think that we could implement a small but effective enhancement to > batching. > > It may happen that even if you enable batching you come to create > entries with 1 only message. > > Processing batch messages r

Re: [VOTE] Enable GitHub Discussion for user-facing discussion

2022-07-12 Thread Yu
Hi tison, thanks for creating this vote! I thought we reached a lay consensus since there was no objection since the last discussion [1] +1 for this proposal. I've explained the reasons and showed the benefits previously [2] [1] https://lists.apache.org/thread/1y7zbchlbokwnpd0jv2tt5jtzg6px6yn [2]

[GitHub] [pulsar-site] urfreespace merged pull request #145: fix: transaction rest api render

2022-07-12 Thread GitBox
urfreespace merged PR #145: URL: https://github.com/apache/pulsar-site/pull/145 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@pulsar.a

Tool to calculate accurate backlog of a subscription (considering batching and entry filters)

2022-07-12 Thread Enrico Olivelli
Hello folks, there is a long standing issue about calculating an accurate backlog in presence of batch messages [1]. Now that we have PIP-105, broker side filters, the problem becomes bigger. I have sent a patch [2] to provide a feature to "analise" a Subscription and scan the non dispatched messa

Re: Tool to calculate accurate backlog of a subscription (considering batching and entry filters)

2022-07-12 Thread PengHui Li
Jiuming has pushed a fix before https://github.com/apache/pulsar/pull/14958 which uses the message index to calculate the precise backlog without going through all the messages. Penghui On Tue, Jul 12, 2022 at 8:58 PM Enrico Olivelli wrote: > Hello folks, > there is a long standing issue about

Re: Batch Messages with only 1 message

2022-07-12 Thread PengHui Li
+1 We should start with a proposal, so that we can clear on the On Tue, Jul 12, 2022 at 5:50 PM ZhangJian He wrote: > +1 > > Thanks > ZhangJian He > > Qiang Huang 于2022年7月12日周二 17:34写道: > > > +1 > > Good idea! It will greatly reduce the resource consumption of small > > batches. > > > > Yubiao

Re: [VOTE] Enable GitHub Discussion for user-facing discussion

2022-07-12 Thread Enrico Olivelli
+1 Enrico Il giorno mar 12 lug 2022 alle ore 13:05 Yu ha scritto: > > Hi tison, thanks for creating this vote! > I thought we reached a lay consensus since there was no objection since the > last discussion [1] > > +1 for this proposal. > I've explained the reasons and showed the benefits previ

Re: Batch Messages with only 1 message

2022-07-12 Thread guo jiwei
+1 Good idea Regards Jiwei Guo (Tboy) On Tue, Jul 12, 2022 at 9:07 PM PengHui Li wrote: > +1 > > We should start with a proposal, so that we can clear on the > > On Tue, Jul 12, 2022 at 5:50 PM ZhangJian He wrote: > > > +1 > > > > Thanks > > ZhangJian He > > > > Qiang Huang 于2022年7月12日周二 17:

Re: Batch Messages with only 1 message

2022-07-12 Thread Enrico Olivelli
Thank you all ! I am going to create a issue/feature request Is there anyone interested in working on that ? We need a PIP. The implementation probably won't be hard, but it may impact a few test cases in the repo, because sometimes we turn on batching to generate messages and now if you don't w

Re: [DISCUSS] PIP-180: Shadow Topic, an alternative way to support readonly topic ownership.

2022-07-12 Thread Haiting Jiang
Hi Asaf, On 2022/07/11 13:08:52 Asaf Mesika wrote: > On Thu, Jun 23, 2022 at 6:26 AM Haiting Jiang > wrote: > > > Hi Asaf, > > > > > I did a quick reading and I couldn't understand the gist of this change: > > > The shadow topic doesn't really have it's own messages, or it's own > > ledgers > > >

Re: Batch Messages with only 1 message

2022-07-12 Thread Anon Hxy
Hi Enrico I am interesting in working on this task. Could you please assign the work to me? @AnonHxy Thanks, Xiaoyu Hou Enrico Olivelli 于2022年7月12日周二 22:28写道: > Thank you all ! > > I am going to create a issue/feature request > > Is there anyone interested in working on that ? > > We need a P

Re: Batch Messages with only 1 message

2022-07-12 Thread Enrico Olivelli
Xiaoyu Il giorno mar 12 lug 2022 alle ore 16:36 Anon Hxy ha scritto: > > Hi Enrico > > I am interesting in working on this task. Could you please assign the work > to me? @AnonHxy This is the issue https://github.com/apache/pulsar/issues/16547 I am not sure I can "assign" the issue to you, bu

Re: Tool to calculate accurate backlog of a subscription (considering batching and entry filters)

2022-07-12 Thread Enrico Olivelli
Il giorno mar 12 lug 2022 alle ore 15:04 PengHui Li ha scritto: > > Jiuming has pushed a fix before https://github.com/apache/pulsar/pull/14958 > which uses the message index to calculate the precise backlog without going > through > all the messages. I am sorry but it does not cover my needs. Ac

Re: Batch Messages with only 1 message

2022-07-12 Thread Anon Hxy
Go it, thanks Enrico Best, Xiaoyu Hou Enrico Olivelli 于2022年7月12日周二 22:40写道: > Xiaoyu > > Il giorno mar 12 lug 2022 alle ore 16:36 Anon Hxy > ha scritto: > > > > Hi Enrico > > > > I am interesting in working on this task. Could you please assign the > work > > to me? @AnonHxy > > > This is th

Enable "Update branch" Github button in pull requests

2022-07-12 Thread Nicolò Boschi
Hi all, I'd like to propose to enable the Github button "update branch" in the pull requests. The main reason is that it helps when you want to rebase your pull to the current master. For instance today a fix for a failing job in the CI has been committed and you were forced to close/reopen the p

Re: [VOTE] PIP-136: Sync Pulsar policies across multiple clouds

2022-07-12 Thread Rajan Dhabalia
Hi, After multiple discussions during Community meetings: I have updated PIP with the changes and approach we agreed on. This PIP allows any metadata-store to generate change-events using plugable MetadataSynchronizer to publish and handle change events. PIP also uses change-event topic as a WAL t

[DISCUSS] PIP-184: Cluster migration or Blue-Green cluster deployment support in Pulsar

2022-07-12 Thread Rajan Dhabalia
Hi, We have created PIP-184 which helps users to perform cluster migration with Apache Pulsar. Cluster migration or Blue-Green cluster deployment is one of the proven solutions to migrate live traffic from one cluster to another. One of the examples is applications running on Kubernetes sometimes

Re: Batch Messages with only 1 message

2022-07-12 Thread Matteo Merli
-- Matteo Merli On Tue, Jul 12, 2022 at 12:54 AM Enrico Olivelli wrote: > > Hello, > I think that we could implement a small but effective enhancement to batching. > > It may happen that even if you enable batching you come to create > entries with 1 only message. > > Processing batch messages r

Re: Tool to calculate accurate backlog of a subscription (considering batching and entry filters)

2022-07-12 Thread PengHui Li
Oh, I see. I think we can start with a proposal? I saw the new REST API introduced in the PR. It's better to follow the proposal process to get explicit approvals. Thanks, Penghui On Tue, Jul 12, 2022 at 10:42 PM Enrico Olivelli wrote: > Il giorno mar 12 lug 2022 alle ore 15:04 PengHui Li > h

Re: [VOTE] Enable GitHub Discussion for user-facing discussion

2022-07-12 Thread guo jiwei
+1 Regards Jiwei Guo (Tboy) On Tue, Jul 12, 2022 at 9:53 PM Enrico Olivelli wrote: > +1 > > > Enrico > > Il giorno mar 12 lug 2022 alle ore 13:05 Yu ha scritto: > > > > Hi tison, thanks for creating this vote! > > I thought we reached a lay consensus since there was no objection since > the

[GitHub] [pulsar-site] momo-jun commented on pull request #133: Only generate Javadocs for released versions of Pulsar

2022-07-12 Thread GitBox
momo-jun commented on PR #133: URL: https://github.com/apache/pulsar-site/pull/133#issuecomment-1182700149 Hi @michaeljmarshall did your PR fix the reported three issues mentioned above? They are still in an open state. Not sure whether you will have follow-up fixes or not. -- This is an

[GitHub] [pulsar-site] michaeljmarshall commented on pull request #133: Only generate Javadocs for released versions of Pulsar

2022-07-12 Thread GitBox
michaeljmarshall commented on PR #133: URL: https://github.com/apache/pulsar-site/pull/133#issuecomment-1182732631 @momo-jun - this PR only fixed the `-SNAPSHOT` issue for Javadocs. The `tools` and the `cpp` client still have `-SNAPSHOT` docs. -- This is an automated message from the Apac

Re: [VOTE] Enable GitHub Discussion for user-facing discussion

2022-07-12 Thread Qiang Huang
+1 guo jiwei 于2022年7月13日周三 10:11写道: > +1 > > > Regards > Jiwei Guo (Tboy) > > > On Tue, Jul 12, 2022 at 9:53 PM Enrico Olivelli > wrote: > > > +1 > > > > > > Enrico > > > > Il giorno mar 12 lug 2022 alle ore 13:05 Yu ha > scritto: > > > > > > Hi tison, thanks for creating this vote! > > > I th