Re: Major performance issue uncovered

2021-05-18 Thread Devin Bost
Lari, Thanks for sharing your thoughts. I'll work on making this easier to reproduce. That's a good suggestion. > How did you detect that nothing else is executed? Based on log output? I suppose it may be misleading for me to say that "nothing" else is executed since I'm judging based on debug l

Re: Major performance issue uncovered

2021-05-18 Thread Lari Hotari
Thanks Devin, very thoughtful observations. Do you think that it would be possible to create a repro of the case with some "dummy" code in the functions? Perhaps messages could be produced to the input topic partitions with pulsar-perf? There's a lot of interesting and useful details in your obse

Major performance issue uncovered

2021-05-17 Thread Devin Bost
While researching https://github.com/apache/pulsar/issues/6054, I discovered some key things that revealed a major performance issue that manifests in high-velocity workloads: 1. The problem can be reproduced when batching is disabled on all Pulsar functions 2. When a subscription is "frozen," it'