lhotari commented on issue #24380: URL: https://github.com/apache/pulsar/issues/24380#issuecomment-2949279270
> To prevent this behavior, we reorganized the messages into topics based on their delivery time: • 10 minutes • 1 hour • 1 day • 1 month • infinity > > Since most of our messages fall within the 10-minute range, cleanup now occurs in a timely manner, and restarts no longer lead to re-reading large volumes of messages. Makes sense, that's a solution that I've heard that has been used elsewhere as well. > However, a restart still resets the cursor state, requiring already-read messages to be read again. To handle this, the application skips duplicates. You might want to take a look at #24392 and #24391 to address this problem as well as the discussion https://github.com/apache/pulsar/discussions/23990 . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
