[GitHub] [pulsar-dotpulsar] oven-baked commented on issue #68: Consuming a Message generated by a Python Pulsar Function puts Consumer in Faulted state.

2021-02-11 Thread GitBox
oven-baked commented on issue #68: URL: https://github.com/apache/pulsar-dotpulsar/issues/68#issuecomment-777300403 Hi @blankensteiner Running Pulsar 2.7.0 and DotPulsar client is 0.10.1. There has been nothing explicitly set around batching for the function. Is this somethin

[GitHub] [pulsar-dotpulsar] blankensteiner commented on issue #68: Consuming a Message generated by a Python Pulsar Function puts Consumer in Faulted state.

2021-02-11 Thread GitBox
blankensteiner commented on issue #68: URL: https://github.com/apache/pulsar-dotpulsar/issues/68#issuecomment-777348231 Hi @oven-baked I suspect that this is a bug in DotPulsar. Could you maybe provide some python code that will generate messages that make DotPulsar fail? That wou

[GitHub] [pulsar-dotpulsar] oven-baked commented on issue #68: Consuming a Message generated by a Python Pulsar Function puts Consumer in Faulted state.

2021-02-11 Thread GitBox
oven-baked commented on issue #68: URL: https://github.com/apache/pulsar-dotpulsar/issues/68#issuecomment-777360419 Of course! We've been using this really simple function as supplied in the Pulsar documentation. ``` from pulsar import Function class ExclamationFunction(Fun

[GitHub] [pulsar-dotpulsar] blankensteiner commented on issue #68: Consuming a Message generated by a Python Pulsar Function puts Consumer in Faulted state.

2021-02-11 Thread GitBox
blankensteiner commented on issue #68: URL: https://github.com/apache/pulsar-dotpulsar/issues/68#issuecomment-777440578 Thanks! I see the problem. Some time ago I checked if a message was batched or not by checking the NumOfMessagesInBatch field, which has a default value of '1'. I

[GitHub] [pulsar-dotpulsar] blankensteiner commented on issue #68: Consuming a Message generated by a Python Pulsar Function puts Consumer in Faulted state.

2021-02-11 Thread GitBox
blankensteiner commented on issue #68: URL: https://github.com/apache/pulsar-dotpulsar/issues/68#issuecomment-777459731 Ah looks like the Python function is compressing the message using LZ4. Maybe that is why it can't extract the messages in the batched message because DotPulsar doe

[GitHub] [pulsar-dotpulsar] blankensteiner edited a comment on issue #68: Consuming a Message generated by a Python Pulsar Function puts Consumer in Faulted state.

2021-02-11 Thread GitBox
blankensteiner edited a comment on issue #68: URL: https://github.com/apache/pulsar-dotpulsar/issues/68#issuecomment-777459731 Ah looks like the Python function is compressing the message using LZ4. Maybe that is why it can't extract the messages in the batched message because DotPul

[GitHub] [pulsar-dotpulsar] oven-baked commented on issue #68: Consuming a Message generated by a Python Pulsar Function puts Consumer in Faulted state.

2021-02-11 Thread GitBox
oven-baked commented on issue #68: URL: https://github.com/apache/pulsar-dotpulsar/issues/68#issuecomment-777490393 Hey @blankensteiner, I've been rooting around the documentation and config files, but it doesn't _appear_ like there is any way to change compression being applied. I'm not e

[GitHub] [pulsar-dotpulsar] blankensteiner commented on issue #68: Consuming a Message generated by a Python Pulsar Function puts Consumer in Faulted state.

2021-02-11 Thread GitBox
blankensteiner commented on issue #68: URL: https://github.com/apache/pulsar-dotpulsar/issues/68#issuecomment-06562 Hi @oven-baked I had a quick look at Pulsar functions (mainly deployed via the YAML file) about 1½ year ago, but it's not something I know much about. I would find

Re: Five minute interview blog posts

2021-02-11 Thread Joshua Odmark
Sijie, What is the next best step here? How should we present this so that it can get a vote if it makes sense to proceed on? I’d be happy to contribute as a technical writer as well. I think we have all the contributors we need listed here in this thread to make this happen quickly once it is

Re: Five minute interview blog posts

2021-02-11 Thread Dave Fisher
> >> Clean up the header by folding Clients, REST APIs, and Cli into Docs > > One of the reasons that why "Clients, REST APIs, and CLI" are added to the > menu, not the sidebar is due to the limitation of the documentation > framework we are using. If there is a way to improve this, that would

RE: [VOTE] Pulsar Client Go Release 0.4.0 Candidate 1

2021-02-11 Thread Masahiro Sakamoto
+1 (binding) - Verified the checksum - Ran producer and consumer However, I also failed to verify the GPG signature: $ gpg --verify apache-pulsar-client-go-0.4.0-src.tar.gz.asc gpg: Signature made Tue 09 Feb 2021 04:25:01 AM UTC us

Working on Kafka Connector

2021-02-11 Thread Enrico Olivelli
Hello everyone, here in our Pulsar repository we have a simple Kafka Connector for Pulsar IO composed by a Sink and a Source. https://github.com/apache/pulsar/tree/master/pulsar-io/kafka I have started to work on a set of enhancements to this connector in order to make it more powerful and to bett

Re: Fixing flaky tests: help needed

2021-02-11 Thread Lari Hotari
Hi all, There has been some great progress in fixing the flaky tests. It seems that there's more stability in the builds after more fixes have been merged to master. This work has an impact. Thank you for the contributions. Our work is not over. There's a lot more to fix. Please continue contribu