jnioche opened a new pull request, #1362: URL: https://github.com/apache/incubator-stormcrawler/pull/1362
... when the tag has more than one value As specified in [here](https://developer.mozilla.org/en-US/docs/Web/HTML/Attributes/rel) > the value of the rel attribute, which, if present, must have a value that is an unordered set of unique space-separated keywords. we currently assume that `nofollow` is the entire value of a `rel` tag and so, if any other keyword is specified, we miss it. This PR includes a test case and a fix. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@stormcrawler.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org