I would check with the veterans like Matteo to see what was the initial reasoning behind sharing threads with the BK client.
On Tue, Apr 18, 2023 at 1:59 PM Cong Zhao <zhaoc...@apache.org> wrote: > I think this is a good idea for the reasonable use of pulsar threads. > > Thanks, > Cong Zhao > > On 2023/04/18 02:07:55 mattisonc...@gmail.com wrote: > > > > Hello, folks. > > > > I would like to start discussing the pulsar internal thread pool sorting > out. > > > > How did I get this idea? > > > > Recently, we met some problems with the BK operation timeout. After > investigating, we found an issue that is we share the IO > executor(workgroup) with the Bookkeeper client and internal client and do > some other async task in the dispatcher or somewhere to avoid deadlock. > > > > But the problem over here. If we use this executor to do some kind of > `blocking`(or spend much time computing. e.g. reply to many delayed > messages) operation, it will block BK clients from sending requests if they > are using the same thread. > > > > And then, I checked all the usage of the thread pool. We need the rule > to constrain what thread pool we should use. > > > > What am I expecting? > > > > I want to collect all the thread pools and define a clear usage guide to > avoid wrong use and improve the fault tolerance(the component problem > shouldn't affect the whole broker) > > > > > > > > I need to hear your guy's opinions. Please feel free to leave any > questions. Thanks! > > > > > > Best, > > Mattison > > > > > > >
