rzo1 opened a new pull request, #2074: URL: https://github.com/apache/stormcrawler/pull/2074
`HostURLFilter.configure()` read the `ignoreOutsideDomain` parameter but tested the `ignoreOutsideHost` node for null. A configuration naming only `ignoreOutsideDomain` was silently discarded and the filter let every URL through; one naming only `ignoreOutsideHost` threw a `NullPointerException` at topology startup. Each parameter is now tested on its own. Topologies setting only `ignoreOutsideDomain` will start restricting outlinks to the source domain, as configured. Configurations setting both keys, including all three archetypes, are unaffected. ### For all changes - [ ] Is there a issue associated with this PR? Is it referenced in the commit message? - no issue - [ ] Does your PR title start with `#XXXX` where `XXXX` is the issue number you are trying to resolve? - no issue - [x] Has your PR been rebased against the latest commit within the target branch (typically main)? - [x] Is your initial contribution a single, squashed commit? - [x] Is the code properly formatted with `mvn git-code-format:format-code -Dgcf.globPattern="**/*" -Dskip.format.code=false`? ### For code changes - [ ] Have you ensured that the full suite of tests is executed via `mvn clean verify`? - `core` module tests only (348 run, all green) - [x] Have you written or updated unit tests to verify your changes? - two new cases in `HostURLFilterTest`, both fail without the fix - [x] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under [ASF 2.0](http://www.apache.org/legal/resolved.html#category-a)? - no new dependencies - [x] If applicable, have you updated the LICENSE file, including the main LICENSE file? - n/a - [x] If applicable, have you updated the NOTICE file, including the main NOTICE file? - n/a -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
