Re: [ANNOUNCE] Apache Pulsar Go Client 0.7.0 released

2021-11-15 Thread r...@apache.org
Good news, thanks Chris work for this! -- Thanks Xiaolong Ran Chris Kellogg 于2021年11月16日周二 下午1:41写道: > The Apache Pulsar team is proud to announce Apache Pulsar Go Client > version 0.7.0. > > Pulsar is a highly scalable, low latency messaging platform running on > commodity hardware. It provide

Re: [PIP-78] Reduce redundant producers from partitioned producer

2021-11-15 Thread Yuri Mizushima
Dear Pulsar community, I have created a new PR https://github.com/apache/pulsar/pull/12401 for stats aggregation, but I didn't discuss about the wire protocol change. I hope we will discuss it here. Currently, partitioned producer can't aggregate by any key such as cnx, producerId, producerNam

[ANNOUNCE] Apache Pulsar Go Client 0.7.0 released

2021-11-15 Thread Chris Kellogg
The Apache Pulsar team is proud to announce Apache Pulsar Go Client version 0.7.0. Pulsar is a highly scalable, low latency messaging platform running on commodity hardware. It provides simple pub-sub semantics over topics, guaranteed at-least-once delivery of messages, automatic cursor management

Re: [DISCUSS] Add remove-clusters command for namespace in pulsar-admin

2021-11-15 Thread PengHui Li
+1, Penghui On Nov 16, 2021, 9:27 AM +0800, Ruguo Yu , wrote: > Hi Community, > > The tool ` pulsar-admin` supports `set-clusters` and `get-clusters` command > so that we can `set` / `get` replication clusters for a namespace. But it > lacks corresponding `remove-clusters` command to restore to

[DISCUSS] Add remove-clusters command for namespace in pulsar-admin

2021-11-15 Thread Ruguo Yu
Hi Community, The tool ` pulsar-admin` supports `set-clusters` and `get-clusters` command so that we can `set` / `get` replication clusters for a namespace. But it lacks corresponding `remove-clusters` command to restore to the unset state,  I think it is necessary to add this command to ensure

Re: [DISCUSS] Add Pulsar io Pulsar connector

2021-11-15 Thread Neng Lu
Just did a quick search, it's interesting we don't have a pulsar connector to move data among pulsar clusters. I guess people usually write their own pulsar client to move data around. On Mon, Nov 15, 2021 at 3:11 PM ZhangJian He wrote: > Yes, move data across different pulsar clusters which be

Re: [DISCUSS] Add Pulsar io Pulsar connector

2021-11-15 Thread ZhangJian He
Yes, move data across different pulsar clusters which belongs to different company or organization Thanks ZhangJian He Neng Lu 于2021年11月16日周二 上午2:50写道: > Hi, > > What's your new connector used for in the customer use cases? > A `pulsar-io-kafak-connector` is used for moving data between kafka a

[GitHub] [pulsar-dotpulsar] dgiannone87 commented on issue #8: Support - Message encryption

2021-11-15 Thread GitBox
dgiannone87 commented on issue #8: URL: https://github.com/apache/pulsar-dotpulsar/issues/8#issuecomment-969390727 Hi @JarrodJ83 - I know this is an old thread, but wonder if you ever took this on. Have a need for using DotPulsar with Pulsar encryption. Thanks -- This is an autom

Re: [DISCUSS] Add Pulsar io Pulsar connector

2021-11-15 Thread Neng Lu
Hi, What's your new connector used for in the customer use cases? A `pulsar-io-kafak-connector` is used for moving data between kafka and pulsar. But in your case, a `pulsar-io-pulsar-connector`, do you mean you want to move data across different pulsar clusters? On Mon, Nov 15, 2021 at 6:51 AM

[GitHub] [pulsar-helm-chart] javiramos1 commented on issue #164: 2.7.3 helm chart still use 2.7.2 images

2021-11-15 Thread GitBox
javiramos1 commented on issue #164: URL: https://github.com/apache/pulsar-helm-chart/issues/164#issuecomment-969177812 Hi, the chart is still using 2.7.2. I did change the tags to 2.8.1 but it did not work, the pods were stuck in init state. -- This is an automated message from the Apa

[DISCUSS] Add Pulsar io Pulsar connector

2021-11-15 Thread ZhangJian He
Dear all My team are suggesting some of our customers use pulsar instead of kafka for their needs. Before, my team used a pulsar-io-kafka-connector, now my team wants to use a pulsar-io-to-pulsar-connector server for these customers. And I notice now we don't have a pulsar-io-pulsar-connector. S

[DISCUSS] Optimize zookeeper client performance for loading amounts of topics

2021-11-15 Thread Haiting Jiang
Hi Pulsar Community, I have opened a issue in [1] https://github.com/apache/pulsar/issues/12812 Any suggestions will be appreciated. ## Motivation As described in [2], we are running a pulsar cluster with about a million topics, and 20% percent of brokers could break down at the sametime. Previ

Re: [DISCUSSION] PIP-104: Add new consumer type: TableView

2021-11-15 Thread Enrico Olivelli
Matteo, sorry late reply Il giorno gio 14 ott 2021 alle ore 01:40 Matteo Merli < matteo.me...@gmail.com> ha scritto: > https://github.com/apache/pulsar/issues/12356 > > --- Pasted here for quoting convenience --- > > > > > > ## Motivation > > In many use cases, applications are using Pulsar consu

Re: Enhancing the Pulsar Client with some a Shared State API

2021-11-15 Thread Enrico Olivelli
Jack, Il giorno lun 15 nov 2021 alle ore 10:37 Jack Vanlightly ha scritto: > Hi Enrico, > > This is interesting. I'm thinking of the KTables part of Kafka Streams and > also Raft state machines. > > You could build something equivalent to a Raft state machine on top of > Pulsar where WaitForExcl

Re: Enhancing the Pulsar Client with some a Shared State API

2021-11-15 Thread Jack Vanlightly
Hi Enrico, This is interesting. I'm thinking of the KTables part of Kafka Streams and also Raft state machines. You could build something equivalent to a Raft state machine on top of Pulsar where WaitForExclusive acts as leader election and the topic as the log. I would be interested in a PIP, th