GitHub user JaspreetSinghChahal created a discussion: Don't index sitemap 
inopensearch

In stormcrawler, I want to fetch and parse sitemaps to discover new urls but 
don't want to index it in opensearch.

I can't exclude it in regex as new urls won't be discovered then.

GitHub link: https://github.com/apache/stormcrawler/discussions/1803

----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]

Reply via email to