PIP 38: Batch Receiving Messages

2019-07-03 Thread PengHui Li
Dear all This is a PIP to add feature of batch receiving messages https://github.com/apache/pulsar/wiki/PIP-38%3A-Batch-Receiving-Messages Please take a look. — Regards, Penghui Li

Re: Timestamped-based synchronized reads from multiple input topics?

2019-07-03 Thread David Kjerrumgaard
Adam, That is my understanding as well, that the context is associated with a namespace, so as long as you run both functions in the same namespace you shouldn't have any issues. HTH, David K. On Wed, Jul 3, 2019 at 10:51 AM Adam Bellemare wrote: > Hi David > > Thanks for the fast reply. Just

Re: Timestamped-based synchronized reads from multiple input topics?

2019-07-03 Thread Adam Bellemare
Hi David Thanks for the fast reply. Just one follow up question. The context object provides access to the state state store in BookKeeper - is that context shared globally across all functions, or is it limited in scope to a given namespace unique to our two functions in question (ie: consumer g

Re: Timestamped-based synchronized reads from multiple input topics?

2019-07-03 Thread David Kjerrumgaard
Hi Adam, Your best bet for this might be to implement 2 separate Stateful Pulsar functions, each consuming from a different topic. The basic idea is to use the stateful context in order to share information about which timestamp they are processing and use that information to decide whether or not

Build failed in Jenkins: pulsar_release_nightly_snapshot #499

2019-07-03 Thread Apache Jenkins Server
See Changes: [mmerli] Issue #4638 : Update Kafka connect-api to version 2.3.0 (#4650) [mmerli] Improve and add authorization to function download and upload (#4644) [github] Fixed managed ledger

Slack digest for #dev - 2019-07-03

2019-07-03 Thread Apache Pulsar Slack
2019-07-02 12:00:44 UTC - Guillaume Rosauro: Hi Team, I try to add a new Integration Test but I do not understand how the available sources are declared. I have got this error : ```Invalid source type 'debezium-postgres' -- Available sources are: [data-generator, kafka-connect-adaptor, twitter, f

Build failed in Jenkins: pulsar-website-build #680

2019-07-03 Thread Apache Jenkins Server
See Changes: [mmerli] Issue #4638 : Update Kafka connect-api to version 2.3.0 (#4650) [mmerli] Improve and add authorization to function download and upload (#4644) [github] Fixed managed ledger admin tool