TamimEhsan commented on issue #1588: URL: https://github.com/apache/stormcrawler/issues/1588#issuecomment-3194099513
What I understood after reading the Nutch codebase: might be wrong though. Nutch has two class `SpellCheckedMetadata` and `CaseInsensitiveMetadata` both extending the `Metadata` class. `CaseInsensitiveMetadata` as the name suggests is case insensitive, but is not typo tolerant. On the other hand, SpellCheckedMetadata works a bit differently. There are some prefixed common headers. The class tries to normalize keys to these headers with LevenshteinDistance for typo tolerance. However, if the key doesn't match any of the prefixed headers, then it is kept as it is, ie not case sensitive then. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@stormcrawler.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
