Re: Question about managedLedgerCacheEvictionFrequency

2021-03-30 Thread Michael Marshall
+1 I would like to better understand these trade offs as well. Thanks, Michael Marshall On Fri, Mar 26, 2021 at 3:09 PM Lari Hotari wrote: > Hi all, > > A broker with a lot of topics (10k+) consumes a considerable amount of CPU > even while idling (no messages being processed). > > In profiling

[DISCUSS] Request to Release 2.7.2 with Cursor Metrics Configuration Fix

2021-03-30 Thread Michael Marshall
Hi All, I propose and request that we release version 2.7.2 to fix a regression introduced in 2.7.1. Pulsar 2.7.1 introduced cursor level metrics without including the ability to disable them (https://github.com/apache/pulsar/pull/9618). I recently discovered the metrics when I created a Pulsar 2

Re: State of pulsar-adaptors project

2021-03-30 Thread Andrey Yegorov
Thank you, Sijie, for the context. There is a PR that at least makes adapters build with pulsar 2.8.-snapshot: https://github.com/apache/pulsar-adapters/pull/9 I'd appreciate help with getting this up to the apache standards - checkstyle, github CI, etc. IMO we should deal with tests/integration de

[GitHub] [pulsar-adapters] dlg99 commented on pull request #9: build pulsar-adaptors with pulsar-2.8-snapshot

2021-03-30 Thread GitBox
dlg99 commented on pull request #9: URL: https://github.com/apache/pulsar-adapters/pull/9#issuecomment-810571280 @eolivelli I am detaching project.version from pulsar.version and project.groupId from pulsar's groupId because: - eventually we'll have to release pulsar-adapters and pulsar

Re: [DISCUSS] PIP 83 : Pulsar client: Message consumption with pooled buffer

2021-03-30 Thread Matteo Merli
Using explicit release of the message resources, opens up many different ways to optimize the consumption path. Pooling the direct memory when consuming with ByteBuffer schema is just one of them, but definitely not the only one. For example we could also later on: * Pool instances of MessageImp

[GitHub] [pulsar-adapters] dlg99 commented on pull request #9: build pulsar-adaptors with pulsar-2.8-snapshot

2021-03-30 Thread GitBox
dlg99 commented on pull request #9: URL: https://github.com/apache/pulsar-adapters/pull/9#issuecomment-810473114 https://github.com/apache/pulsar/pull/10091 for pulsar-side fix -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: PIP 76: Streaming Offload

2021-03-30 Thread Sijie Guo
Part2 should complete most of the functionalities of this feature. Thanks, Sijie On Thu, Mar 25, 2021 at 9:50 PM Michael Marshall wrote: > Thanks for letting me know, Sijie. > > I will take a look at the PR. Do you have a sense of whether or not the PR > was close to completion? Are there other

Re: State of pulsar-adaptors project

2021-03-30 Thread Sijie Guo
It was my fault when I moved the adapters from master to the separate repo. The release process should be updated to include that repo. We need to fix it. Some of the projects in this adopters are deprecated. For example, the pulsar-flink connector is deprecated. Because it was an integration with

[GitHub] [pulsar-client-node] munir131 commented on issue #134: Getting error while installing

2021-03-30 Thread GitBox
munir131 commented on issue #134: URL: https://github.com/apache/pulsar-client-node/issues/134#issuecomment-810285687 I am closing this issue. I find out manual way to install deb files on arch linux. Also found that dev cpp is missing for 2.7.1 https://archive.apache.org/dist/pulsar/puls

[GitHub] [pulsar-client-node] munir131 closed issue #134: Getting error while installing

2021-03-30 Thread GitBox
munir131 closed issue #134: URL: https://github.com/apache/pulsar-client-node/issues/134 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, p

[GitHub] [pulsar-client-node] tuteng commented on issue #148: Appropriate authentication method to access Tuya cloud pulsar client

2021-03-30 Thread GitBox
tuteng commented on issue #148: URL: https://github.com/apache/pulsar-client-node/issues/148#issuecomment-810220747 It seems similar to oauth2 http://pulsar.apache.org/docs/en/security-oauth2/, cpp already supports oauth2 https://github.com/apache/pulsar/tree/master/pulsar-client-cpp/lib/

[GitHub] [pulsar-client-node] munir131 commented on issue #134: Getting error while installing

2021-03-30 Thread GitBox
munir131 commented on issue #134: URL: https://github.com/apache/pulsar-client-node/issues/134#issuecomment-810165684 > @munir131 Can you check this comment [#134 (comment)](https://github.com/apache/pulsar-client-node/issues/134#issuecomment-737630822) ? No it is not working. In t

[GitHub] [pulsar-dotpulsar] blankensteiner merged pull request #70: Fixed issue with producing with schema to non existing topic

2021-03-30 Thread GitBox
blankensteiner merged pull request #70: URL: https://github.com/apache/pulsar-dotpulsar/pull/70 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this ser

[GitHub] [pulsar-dotpulsar] kandersen82 opened a new pull request #70: Fixed issue with producing with schema to non existing topic

2021-03-30 Thread GitBox
kandersen82 opened a new pull request #70: URL: https://github.com/apache/pulsar-dotpulsar/pull/70 Fixed issue with producing with schema to non existing topic -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

Re: [DISCUSS] PIP 83 : Pulsar client: Message consumption with pooled buffer

2021-03-30 Thread Rajan Dhabalia
>> > 1. Does the consumer returns buffer of the batch message? > 2. If returns a batch message buffer, how do we handle the flow permits? It’s better to clarify in the proposal It will not change the semantics of the batch-message. Batch-message gets split into individual messages at the consumer

[GitHub] [pulsar-adapters] eolivelli commented on a change in pull request #9: build pulsar-adaptors with pulsar-2.8-snapshot

2021-03-30 Thread GitBox
eolivelli commented on a change in pull request #9: URL: https://github.com/apache/pulsar-adapters/pull/9#discussion_r603836052 ## File path: examples/flink/pom.xml ## @@ -36,7 +37,7 @@ - +