tarmacmonsterg commented on issue #24380: URL: https://github.com/apache/pulsar/issues/24380#issuecomment-2948588729
> Not directly related to this issue, but related to the use of a large amount of delayed messages: [#23990 (reply in thread)](https://github.com/apache/pulsar/discussions/23990#discussioncomment-12233561) It's worth being aware that acknowledgement state could be lost when a topic is moved from one broker to another due to load balancing or broker restart if the configuration isn't tuned. We encountered this issue in production — and it hit us hard. As a result, we reworked the architecture for handling delayed messages and improved how the application deals with duplicates in such cases. Initially, a single topic could grow to hundreds of gigabytes. After refactoring the architecture, it’s now reduced to just a few gigabytes, thanks to proper and timely cleanup finally working. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
