shounakmk219 opened a new pull request, #16631: URL: https://github.com/apache/pinot/pull/16631
## Description This PR introduces zk based central locking for task generation to avoid concurrent task generator execution across multiple controllers that can occur due to user triggers through manual schedule or adhoc run. The approach relies on creation of a znode (acquire lock) for each table and taskType tuple when any controller runs the task generation and the znode is deleted (release lock) upon task generation completion. There is also a hard limit of 5 minutes after which the lock is considered stale and is cleaned up before acquiring it again. Introduced `MinionTaskGenerationLockManager` to manage the lock lifecycle. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
