Re: [DISCUSS] Dropping the StreamingDispatcher

2023-05-17 Thread Michael Marshall
I think we have reached lazy consensus on this topic. I marked my PR as "Ready for Review" and I will merge it once I get tests passing. https://github.com/apache/pulsar/pull/20279 Thanks, Michael On Tue, May 9, 2023 at 12:40 PM Michael Marshall wrote: > > I just had a flaky test failure due to

Re: [DISCUSS] Dropping the StreamingDispatcher

2023-05-09 Thread Michael Marshall
I just had a flaky test failure due to the streaming dispatcher, so I decided to move this discussion along by creating a PR to do what Enrico proposed [0]. Do we need to discuss this any further before making the PR "ready for review" and removing the streaming dispatcher? > Shouldn't it first b

Re: [DISCUSS] Dropping the StreamingDispatcher

2023-04-10 Thread Christophe Bornet
Shouldn't it first be deprecated before removal ? Le mar. 4 avr. 2023 à 08:47, Enrico Olivelli a écrit : > > Hello, > It has been a long time that we have in the Pulsar code a new > experimental Dispatcher implementation named StreamingDispatcher. > > https://github.com/apache/pulsar/pull/9056 >

Re: [DISCUSS] Dropping the StreamingDispatcher

2023-04-07 Thread Xiangying Meng
Hi all, +1 for removing the StreamingDispatcher in Pulsar 3.0. Balancing maintainability, scalability, and usability is critical for an open-source project. In this case, the StreamingDispatcher seems to be neither widely adopted nor actively maintained, and its code quality and unstable tests hav

Re: [DISCUSS] Dropping the StreamingDispatcher

2023-04-07 Thread Cong Zhao
+1, I support removing it if the code isn't being used or maintained. Thanks, Cong Zhao On 2023/04/04 06:47:24 Enrico Olivelli wrote: > Hello, > It has been a long time that we have in the Pulsar code a new > experimental Dispatcher implementation named StreamingDispatcher. > > https://github.co

Re: [DISCUSS] Dropping the StreamingDispatcher

2023-04-07 Thread Yunze Xu
+1 for the reason that it was added when there is no PIP restriction for new APIs. The original author has left the community for some time and recently it seems that no one touched the code except for some necessary API changes. Thanks, Yunze On Thu, Apr 6, 2023 at 11:48 AM wrote: > > Totally a

Re: [DISCUSS] Dropping the StreamingDispatcher

2023-04-05 Thread mattisonchao
Totally agree with it. +1 Best Mattison On Apr 6, 2023, 10:53 +0800, Devin Bost , wrote: > +1 since it can be pulled back up in git history if someone decides to do > something with it to improve it at a later time. > > I also agree that it's a pain to maintain, and I don't know anyone using > it.

Re: [DISCUSS] Dropping the StreamingDispatcher

2023-04-05 Thread Devin Bost
+1 since it can be pulled back up in git history if someone decides to do something with it to improve it at a later time. I also agree that it's a pain to maintain, and I don't know anyone using it. I've gone through some of those code paths, and I was concerned about divergence anyway. - Devin

Re: [DISCUSS] Dropping the StreamingDispatcher

2023-04-05 Thread Michael Marshall
If the code isn't being used or maintained, I support removing it. The code will be available in the git history in case someone decides to resurrect it. Thanks, Michael On Wed, Apr 5, 2023 at 7:14 AM Enrico Olivelli wrote: > > Yunze, > > Il Mar 4 Apr 2023, 09:57 Yunze Xu ha scritto: > > > If t

Re: [DISCUSS] Dropping the StreamingDispatcher

2023-04-05 Thread Enrico Olivelli
Yunze, Il Mar 4 Apr 2023, 09:57 Yunze Xu ha scritto: > If the flaky tests were the only concern, I think we can just disable > these tests. My concern is not about the the flaky tests but a out maintenance of dead code. Whatever, this config in `ServiceConfiguration` has > existed for a lon

Re: [DISCUSS] Dropping the StreamingDispatcher

2023-04-05 Thread Devin Bost
It looks like the purpose of the StreamingDispatcher was to improve performance by implementing an improved readahead mechanism. Was it actually able to accomplish this objective? If so, why do we need a separate code path for it instead of updating the existing dispatcher to use the improvement? I

Re: [DISCUSS] Dropping the StreamingDispatcher

2023-04-04 Thread Yunze Xu
If the flaky tests were the only concern, I think we can just disable these tests. Whatever, this config in `ServiceConfiguration` has existed for a long time, though when it was introduced, the PIP rule was not clear so there is no PIP for it. Thanks, Yunze On Tue, Apr 4, 2023 at 3:09 PM Gavin g

Re: [DISCUSS] Dropping the StreamingDispatcher

2023-04-04 Thread Gavin gao
+1, I totally agree with this idea. Enrico Olivelli 于2023年4月4日周二 14:47写道: > Hello, > It has been a long time that we have in the Pulsar code a new > experimental Dispatcher implementation named StreamingDispatcher. > > https://github.com/apache/pulsar/pull/9056 > > There are many flaky tests abo

[DISCUSS] Dropping the StreamingDispatcher

2023-04-03 Thread Enrico Olivelli
Hello, It has been a long time that we have in the Pulsar code a new experimental Dispatcher implementation named StreamingDispatcher. https://github.com/apache/pulsar/pull/9056 There are many flaky tests about that feature and I believe that it has never been used in Production by anyone, becaus