jnioche opened a new issue, #2062: URL: https://github.com/apache/stormcrawler/issues/2062
### What would you like to be improved? URLFrontier 2.6 added a batch endpoint for sending DISCOVERED urls, which should greatly improve the performance. Known URLs should continue to use the streaming mode. In addition, a better control flow mechanism is available compared to the existing polling. See https://github.com/crawler-commons/url-frontier/blob/master/client/src/main/java/crawlercommons/urlfrontier/client/PutURLs.java for best practices ### How should we improve? _No response_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
