Re: [VOTE] Pulsar Node.js Client Release 1.8.0 Candidate 2

2023-01-03 Thread Zike Yang
Thank you for verifying this release. Closing the vote 3 binding +1s: * PengHui Li * Yunze Xu * Hang Chen 2 non-binding +1s: * Baodi Shi * Ran Gao > However, I'm still wondering whether we still need to upload the `napi-xxx.tar.gz` files? These files seem totally useless for users, no matter in

Re: [DISCUSS] PIP-236: Upload AUTO_CONSUME SchemaType to Broker

2023-01-03 Thread 丛搏
Hi, Yunze > What I am concerned about is that if the old clients with other > schemas (i.e. schema is neither null nor AUTO_CONSUME) subscribe to > the topic with AUTO_CONSUME schema, what will happen? AUTO_CONSUME schema will not store in `SchemaRegistryServiceImpl`, it only represents one consum

Re: [DISCUSS] PIP-236: Upload AUTO_CONSUME SchemaType to Broker

2023-01-03 Thread 丛搏
+1 (non-binding) Thanks, Bo 丛搏 于2023年1月3日周二 16:56写道: > > Hi, Yunze > > What I am concerned about is that if the old clients with other > > schemas (i.e. schema is neither null nor AUTO_CONSUME) subscribe to > > the topic with AUTO_CONSUME schema, what will happen? > > AUTO_CONSUME schema will no

Re: [DISCUSS] PIP-236: Upload AUTO_CONSUME SchemaType to Broker

2023-01-03 Thread Enrico Olivelli
(I apologise for top posting) What happens if a new client connects to a old broker? Enrico Il Mar 3 Gen 2023, 10:51 丛搏 ha scritto: > +1 (non-binding) > > Thanks, > Bo > > 丛搏 于2023年1月3日周二 16:56写道: > > > > Hi, Yunze > > > What I am concerned about is that if the old clients with other > > > sc

[ANNOUNCE] Apache Pulsar 2.9.4 released

2023-01-03 Thread 丛搏
The Apache Pulsar team is proud to announce Apache Pulsar version 2.9.4. Pulsar is a highly scalable, low latency messaging platform running on commodity hardware. It provides simple pub-sub semantics over topics, guaranteed at-least-once delivery of messages, automatic cursor management for subsc

Re: [DISCUSS] PIP-236: Upload AUTO_CONSUME SchemaType to Broker

2023-01-03 Thread SiNan Liu
If we use a consumer with AUTO_CONSUME schema to subscribe to a topic, there will be problems. Because the schema is not null, so the consumer with AUTO_CONSUME schema will not directly return topic.subscribe(option). This will result in check Schema Compatible or addSchema. 1. "errorMsg":"Incompat

Re: [DISCUSS] PIP-236: Upload AUTO_CONSUME SchemaType to Broker

2023-01-03 Thread Yunze Xu
Hi Bo, I got it now. The PIP title sounds ambiguous. Using the term "Upload xxx SchemaType" sounds like uploading the schema into the registry. Instead, it should be "carrying schema in the request when subscribing with AUTO_CONSUME schema". Thanks, Yunze On Tue, Jan 3, 2023 at 4:56 PM 丛搏 wrote

[DISCUSS] PIP-237: Make PulsarAdmin accessible in SinkContext and SourceContext

2023-01-03 Thread Alexander Preuss
Hi all, I opened a PIP to discuss making PulsarAdmin accessible in Pulsar IO connectors through SinkContext and SourceContext: https://github.com/apache/pulsar/issues/19123 Looking forward to hearing your thoughts, Alex

Re: [DISCUSS] PIP-236: Upload AUTO_CONSUME SchemaType to Broker

2023-01-03 Thread Enrico Olivelli
Il Mar 3 Gen 2023, 14:37 Yunze Xu ha scritto: > Hi Bo, > > I got it now. The PIP title sounds ambiguous. Using the term "Upload > xxx SchemaType" sounds like uploading the schema into the registry. > Instead, it should be "carrying schema in the request when subscribing > with AUTO_CONSUME schema

Re: [Discuss] Deprecate Index-based Publisher Stat Aggregation in Topics Partitioned-Stats

2023-01-03 Thread Heesung Sohn
Hi Pulsar dev, I raised a PIP for the default config change(change the aggregatePublisherStatsByProducerName config default to true) as requested. PIP: https://github.com/apache/pulsar/issues/19125 I guess we can continue to use this discussion thread for this PIP as well. Thank you, Heesung O

Re: [ANNOUNCE] Yunze Xu as a new PMC member in Apache Pulsar

2023-01-03 Thread houxiaoyu
Congrats! Best, Hou xiaoyu Qiang Huang 于2023年1月3日周二 14:53写道: > Congratulations!!! Yunze > > > Jun Ma 于2022年12月31日周六 17:26写道: > > > Congrats and well deserved! > > > > From: Dave Fisher > > Sent: Saturday, December 31, 2022 1:52 > > To: dev@pulsar.apache.org

Re: [ATTENTION] The source of Pulsar document is moved to apache/pulsar-site

2023-01-03 Thread Yu
Hi tison, thanks for your great work! On Fri, Dec 30, 2022 at 6:41 PM tison wrote: > Hi, > > With the resolution of [1], I moved the source of the Pulsar document to > the site repo[2][3][4][5]. > > Now, if you'd like to update Pulsar document, you should submit a PR > against the site repo (apa

Re: [DISCUSS] PIP-236: Upload AUTO_CONSUME SchemaType to Broker

2023-01-03 Thread SiNan Liu
You mean add an optional field in the subscribe request, like (optional bool is_autoconsume =6 [default = false];)? Enrico Olivelli 于 2023年1月4日周三 上午12:12写道: > Il Mar 3 Gen 2023, 14:37 Yunze Xu ha > scritto: > > > Hi Bo, > > > > I got it now. The PIP title sounds ambiguous. Using the term "Uploa

Re: [DISCUSS] PIP-236: Upload AUTO_CONSUME SchemaType to Broker

2023-01-03 Thread Yunze Xu
Modifying the subscribe request is better than exposing AUTO_CONSUME schema type IMO. The negative value of a schema type, like BYTES, AUTO_PRODUCE, means this schema type should only be used internally. Adding the negative enum value to the Schema definition in PulsarApi.proto looks very weird. B

Re: [ATTENTION] The source of Pulsar document is moved to apache/pulsar-site

2023-01-03 Thread Michael Marshall
Thanks for all of your work on this! One follow up is that we should update the PR template [0] so that contributors know where to contribute documentation. Thanks, Michael [0] https://github.com/apache/pulsar/blob/9ec1d071c7188a2db694e9d7b359faaf33cb076e/.github/PULL_REQUEST_TEMPLATE.md On Tu

Re: [ANNOUNCE] Yunze Xu as a new PMC member in Apache Pulsar

2023-01-03 Thread Michael Marshall
Congratulations, Yunze! - Michael On Tue, Jan 3, 2023 at 8:26 PM houxiaoyu wrote: > > Congrats! > > Best, > Hou xiaoyu > > Qiang Huang 于2023年1月3日周二 14:53写道: > > > Congratulations!!! Yunze > > > > > > Jun Ma 于2022年12月31日周六 17:26写道: > > > > > Congrats and well deserved! > > > __

Re: [ATTENTION] The source of Pulsar document is moved to apache/pulsar-site

2023-01-03 Thread tison
Thanks for your feedback! Michael: I've updated the "Edit this page" link to jump to the site repo and the Documentation guide should properly describe the process. Do you find some incorrect content in the PR template? Otherwise, I'd prefer not to put too many things in the template. Best, tiso

Re: [ATTENTION] The source of Pulsar document is moved to apache/pulsar-site

2023-01-03 Thread Michael Marshall
> I'd prefer not to put too many things in the template. I agree with this sentiment. I think the template is already too busy. Many active contributors ignore important sections leaving them with the default text. However, I think a link pointing to where to contribute documentation would help n

Re: [VOTE] Pulsar Release 2.11.0 Candidate-5

2023-01-03 Thread PengHui Li
+1 (binding) - Checked the signature - Build from source - Checked license(server and shell) - Start standalone with zookeeper - Checked function - Checked Cassandra connector - Checked stateful function - Checked the Pulsar SQL Thanks, Penghui On Mon, Jan 2, 2023 at 8:01 PM guo jiwei wrote: >

Re: [VOTE] Pulsar Release 2.11.0 Candidate-5

2023-01-03 Thread Yunze Xu
I found there are both apache-pulsar-shell-2.11.0-bin.tar.gz and apache-pulsar-shell-2.11.0-bin.zip, are they duplicates? Thanks, Yunze On Mon, Jan 2, 2023 at 8:01 PM guo jiwei wrote: > > This is the fifth release candidate for Apache Pulsar, version 2.11.0. > > This release contains 1617 commit

Re: [VOTE] Pulsar Release 2.11.0 Candidate-5

2023-01-03 Thread PengHui Li
> I found there are both apache-pulsar-shell-2.11.0-bin.tar.gz and apache-pulsar-shell-2.11.0-bin.zip, are they duplicates? I noticed here is the discussion about this part in Slack https://apache-pulsar.slack.com/archives/C5ZSVEN4E/p1672411025574369 Penghui On Wed, Jan 4, 2023 at 2:35 PM Yunze

Re: [ANNOUNCE] Yunze Xu as a new PMC member in Apache Pulsar

2023-01-03 Thread Lan Liang
Congrats! - Lan Liang Replied Message | From | Michael Marshall | | Date | 1/4/2023 13:09 | | To | | | Subject | Re: [ANNOUNCE] Yunze Xu as a new PMC member in Apache Pulsar | Congratulations, Yunze! - Michael On Tue, Jan 3, 2023 at 8:26 PM houxiaoyu wrote: Congrats! Best, Hou x

Re: [VOTE] Pulsar Release 2.11.0 Candidate-5

2023-01-03 Thread Yunze Xu
+0 (binding) - Checked the signature - Build from source (Java 17, Ubuntu 20.04 WSL2) - Start standalone with KoP branch-2.11 (ab9d761f) - Verify Pulsar client 2.11.0, Kafka client 3.3.1 (through KoP) - Verify pulsar-shell on Ubuntu 20.04 WSL2 and Windows: 1. Use `client` command to produce and co