[DISCUSS] PIP-65: Adapting Pulsar IO Sources to support Batch Sources

2020-05-13 Thread Sanjeev Kulkarni
Hi all, The current interfaces for sources in Pulsar IO are geared towards streaming sources where data is available on a continuous basis. There exist a whole bunch of data sources where data is not available on a continuous/streaming fashion, but rather arrives periodically/in spurts. These set

Re: [DISCUSS] PIP 64: Introduce REST endpoints for producing, consuming and reading messages

2020-05-13 Thread Matteo Merli
+1 The REST API is more simple and intuitive for developers compared to WebSocket. While it's easy to get started with Websocket API, the biggest problem for applications is how to handle errors and corner cases. Eg: re-establishing a producer session while maintaining a queue of pending messages

[GitHub] [pulsar-helm-chart] lukestephenson opened a new issue #10: symmetric / create_namespace flags were only working if last argument

2020-05-13 Thread GitBox
lukestephenson opened a new issue #10: URL: https://github.com/apache/pulsar-helm-chart/issues/10 **Describe the bug** symmetric / create_namespace flags were only working if last argument **To Reproduce** Run with a namespace which does not exist: `./scripts/pulsar/prepare_h

[GitHub] [pulsar-helm-chart] lukestephenson opened a new pull request #11: symmetric / create_namespace flags were only working if last argument

2020-05-13 Thread GitBox
lukestephenson opened a new pull request #11: URL: https://github.com/apache/pulsar-helm-chart/pull/11 Move defaults outside the while loop so they are not constantly reset Fixes #10 ### Motivation *Explain here the context, and why you're making that change. What is the

Re: [ANNOUNCE] new committer: Yijie Shen

2020-05-13 Thread Guangning E
Congrats Yijie Shen! Thanks, Guangning PengHui Li 于2020年5月14日周四 上午10:46写道: > Hi everyone, > > The Project Management Committee (PMC) for Apache Pulsar > has invited Yijie Shen to become a committer and we are pleased > to announce that he has accepted. > > Yijie has done good contribution to Ap

[ANNOUNCE] new committer: Yijie Shen

2020-05-13 Thread PengHui Li
Hi everyone, The Project Management Committee (PMC) for Apache Pulsar has invited Yijie Shen to become a committer and we are pleased to announce that he has accepted. Yijie has done good contribution to Apache Pulsar and continues to promote pulsar-connector in the Flink community. Being a comm

[VOTE] Pulsar Release 2.5.2 Candidate 1

2020-05-13 Thread Jia Zhai
This is the first release candidate for Apache Pulsar, version 2.5.2. It fixes the following issues: https://github.com/apache/pulsar/pulls?q=is%3Apr+label%3Arelease%2F2.5.2+is%3Aclosed *** Please download, test and vote on this release. This vote will stay open for at least 72 hours *** Note th

Re: [DISCUSS] PIP 64: Introduce REST endpoints for producing, consuming and reading messages

2020-05-13 Thread Jia Zhai
+1 Best Regards. Jia Zhai Beijing, China Mobile: +86 15810491983 On Wed, May 13, 2020 at 6:25 PM Sijie Guo wrote: > Hi all, > > Some of the people have been asking for a REST-proxy like equivalent > component in Pulsar. Pulsar already has a web service that provides the > management API

Re: [DISCUSS] PIP 64: Introduce REST endpoints for producing, consuming and reading messages

2020-05-13 Thread Ming Luo
Hi, Thanks for Sijie's proposal. I resonate Rajan's comment that this project should become a peripheral to Pulsar because of the stateless nature of HTTP and scaling up a web service inside Pulsar might be affecting its current design. For that reason, I developed a project with an HTTP interface

Re: [DISCUSS] PIP 64: Introduce REST endpoints for producing, consuming and reading messages

2020-05-13 Thread Rajan Dhabalia
*Hi,I would like to add little history about Websocket vs REST API implementation in Pulsar. Before open-sourcing Pulsar and WebSocket proxy in Yahoo, we had implemented and evaluated both WebSocket and REST-HTTP APIs options and then decided to not introduce REST-API and kept Websocket proxy solut

Re: [DISCUSS] PIP 64: Introduce REST endpoints for producing, consuming and reading messages

2020-05-13 Thread Christophe Bornet
Hi Sijie, What will be the difference with the WebSocket proxy ? Le mer. 13 mai 2020 à 12:25, Sijie Guo a écrit : > Hi all, > > Some of the people have been asking for a REST-proxy like equivalent > component in Pulsar. Pulsar already has a web service that provides the > management API over a

Re: Announcing Pulsar Summit Virtual Conference 2020 | June 17-18

2020-05-13 Thread Sijie Guo
Thank you David! I have moved the discussion to speak...@pulsar-summit.org. - Sijie On Wed, May 13, 2020 at 9:25 AM David Kjerrumgaard wrote: > Hi Sijie, > > Chris noticed that the description for his talk on June 17th was > incorrect, and should read as follows: > > " Learn how to secure a Pu

Re: Announcing Pulsar Summit Virtual Conference 2020 | June 17-18

2020-05-13 Thread David Kjerrumgaard
Hi Sijie, Chris noticed that the description for his talk on June 17th was incorrect, and should read as follows: " Learn how to secure a Pulsar cluster with Hashicorp Vault and deploy it on Kubernetes. Vault provides a secure way to generate tokens and store sensitive data and Pulsar has a pl

Announcing Pulsar Summit Virtual Conference 2020 | June 17-18

2020-05-13 Thread Sijie Guo
Hi all, Over the past few weeks, after having to reschedule Pulsar Summit San Francisco 2020, we have been working on delivering the event in an online format instead. Today, we are excited to announce the Pulsar Summit Virtual Conference, happening on June 17-18! Join the speakers from Splunk, V

[Pulsar Webinar]--Lessons From Managing A Pulsar Cluster on 05/26, 09:00 AM (PST)

2020-05-13 Thread Huanli Meng
Hi All, There will be a Pulsar Webinar on May 26, 2020, where Shivji Jha from Nutanix will share their experiences about managing pulsar clusters. Here is basic information about this webinar: Topic: Lessons From Managing A pulsar Cluster Topic description: How to performance test and optimize

Re: [DISCUSS] PIP 64: Introduce REST endpoints for producing, consuming and reading messages

2020-05-13 Thread Shivji Kumar Jha
+1 Feature parity between different pulsar clients will surely benefit from this. Java client, for instance, is generally ahead of other languages. If we can have a rest api for streaming, one could just add a feature there and have all the clients unblocked. Regards, Shivji Kumar Jha http://www.

[DISCUSS] PIP 64: Introduce REST endpoints for producing, consuming and reading messages

2020-05-13 Thread Sijie Guo
Hi all, Some of the people have been asking for a REST-proxy like equivalent component in Pulsar. Pulsar already has a web service that provides the management API over a Pulsar cluster. We don't actually need a separate component or service for supporting streaming events in and out of Pulsar usi

Slack digest for #dev - 2020-05-13

2020-05-13 Thread Apache Pulsar Slack
2020-05-13 04:07:49 UTC - Ankit Lohia: @Ankit Lohia has joined the channel