TamimEhsan commented on code in PR #1631:
URL: https://github.com/apache/stormcrawler/pull/1631#discussion_r2280257913
##########
core/src/main/java/org/apache/stormcrawler/filtering/basic/BasicURLFilter.java:
##########
@@ -48,7 +48,11 @@ public String filter(
public final String filterPathRepeat(String urlToFilter) {
// check whether a path element is repeated N times
String[] paths = urlToFilter.split("/");
- if (paths.length <= 4) return urlToFilter;
+
+ final int minimumPathLength = 5;
Review Comment:
I think similar occurances can be refactored together and moved to class
variable as const int?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@stormcrawler.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
