Jackie-Jiang opened a new issue, #16441: URL: https://github.com/apache/pinot/issues/16441
Enhance `PeriodicTaskScheduler` to address the following problems: - When a particular periodic task is running (e.g. background scheduled one), manual triggering won't start until the first one is done. This could cause problem when the periodic task takes long time to finish on all tables, but we need urgent fix on a particular table (e.g. `RealtimeSegmentValidationManager`) - When ad-hoc task is scheduled, given the lock is acquired within the `run()` method (see `BasePeriodicTask` class), it occupies a slot in the task scheduler, which can prevent other tasks to be executed. We want to fix the problems by: - Either allow multiple tables to be executed together (we still want to prevent same table being processed in parallel), or insert the ad-hoc triggered tables in front of the remaining tables - Do not use the same executor for ad-hoc triggering -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
