dev  

Messages by Date

• 2026/09/17 Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler] via GitHub
• 2026/09/17 Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler] via GitHub
• 2026/09/17 Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler] via GitHub
• 2026/09/17 Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler] via GitHub
• 2026/09/17 [GH] (stormcrawler/meta-charset-overflow): Workflow run "Java CI with Maven" is working again! GitBox
• 2026/09/17 [GH] (stormcrawler/meta-charset-overflow): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/16 [GH] (stormcrawler/regenerate_license_file_after_dep_upgrade): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/16 [GH] (stormcrawler/regenerate_license_file_after_dep_upgrade): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/16 Re: [PR] #2095 Apply the IP address filter to the requests made by the Playwright browser [stormcrawler] via GitHub
• 2026/09/16 [GH] (stormcrawler/perf/fetch-timeout-call-cancel): Workflow run "Java CI with Maven" is working again! GitBox
• 2026/09/16 [GH] (stormcrawler/perf/fetch-timeout-call-cancel): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/16 Re: [PR] #2095 Apply the IP address filter to the requests made by the Playwright browser [stormcrawler] via GitHub
• 2026/09/16 Re: [PR] #2089 Send http.basicauth credentials only to the hosts in http.basicauth.hosts [stormcrawler] via GitHub
• 2026/09/15 Re: [I] Send host info on a specific stream [stormcrawler] via GitHub
• 2026/09/15 [GH] (stormcrawler/meta-charset-overflow): Workflow run "Java CI with Maven" is working again! GitBox
• 2026/09/15 Re: [I] HostURLFilter memoizes the source host in plain fields shared by all fetcher threads [stormcrawler] via GitHub
• 2026/09/15 Re: [I] Send host info on a specific stream [stormcrawler] via GitHub
• 2026/09/15 Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler] via GitHub
• 2026/09/15 Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler] via GitHub
• 2026/09/15 Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler] via GitHub
• 2026/09/15 [PR] #2095 Apply the IP address filter to the requests made by the Playwright browser [stormcrawler] via GitHub
• 2026/09/15 [GH] (stormcrawler/main): Workflow run "Java CI with Maven" is working again! GitBox
• 2026/09/15 [PR] #2162 Send credential headers from http.custom.headers only to the hosts in http.custom.headers.hosts [stormcrawler] via GitHub
• 2026/09/15 [I] Scope credential headers in http.custom.headers to hosts [stormcrawler] via GitHub
• 2026/09/15 [PR] #2089 Send http.basicauth credentials only to the hosts in http.basicauth.hosts [stormcrawler] via GitHub
• 2026/09/15 [GH] (stormcrawler/regenerate_license_file_after_dep_upgrade): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/15 [GH] (stormcrawler/main): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/15 Re: [PR] Regenerated License file after dependency upgrades [stormcrawler] via GitHub
• 2026/09/15 Re: [PR] build(deps): bump langchain4j.version from 1.19.0 to 1.20.0 [stormcrawler] via GitHub
• 2026/09/15 Re: [PR] Regenerated License file after dependency upgrades [stormcrawler] via GitHub
• 2026/09/15 [PR] Regenerated License file after dependency upgrades [stormcrawler] via GitHub
• 2026/09/15 Re: [PR] build(deps): bump storm-client.version from 3.0.0 to 3.1.0 [stormcrawler] via GitHub
• 2026/09/15 Re: [PR] build(deps): bump storm-client.version from 3.0.0 to 3.1.0 [stormcrawler] via GitHub
• 2026/09/15 [GH] (stormcrawler/regenerate_license_file_after_dep_upgrade): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/15 [PR] Regenerated License file after dependency upgrades [stormcrawler] via GitHub
• 2026/09/15 Re: [PR] Regenerated License file after dependency upgrades [stormcrawler] via GitHub
• 2026/09/15 [GH] (stormcrawler/regenerate_license_file_after_dep_upgrade): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/15 [PR] Regenerated License file after dependency upgrades [stormcrawler] via GitHub
• 2026/09/15 Re: [PR] build(deps): bump software.amazon.awssdk:bom from 2.54.12 to 2.54.16 [stormcrawler] via GitHub
• 2026/09/15 [PR] #2094 Make ignoring HTTPS errors in the Playwright protocol configurable and independent of the proxy [stormcrawler] via GitHub
• 2026/09/15 Re: [PR] build(deps): bump org.slf4j:slf4j-simple from 2.0.18 to 2.0.19 [stormcrawler] via GitHub
• 2026/09/15 Re: [PR] Upgrade to Apache Storm 3.1.0 and Java 25 [stormcrawler] via GitHub
• 2026/09/15 Re: [PR] build(deps): bump storm-client.version from 3.0.0 to 3.1.0 [stormcrawler] via GitHub
• 2026/09/15 Re: [PR] #2102 Redact proxy credentials from worker logs [stormcrawler] via GitHub
• 2026/09/15 Re: [PR] build(deps): bump actions/setup-java from 6.0.0 to 6.0.1 [stormcrawler] via GitHub
• 2026/09/15 Re: [PR] #2102 Redact proxy credentials from worker logs [stormcrawler] via GitHub
• 2026/09/15 [GH] (stormcrawler/fix/proxy-credential-redaction): Workflow run "Java CI with Maven" is working again! GitBox
• 2026/09/15 [GH] (stormcrawler/meta-charset-overflow): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/15 [PR] #2092 Bound the meta charset look-ahead and catch charset detection failures in JSoupParserBolt [stormcrawler] via GitHub
• 2026/09/15 Re: [PR] #2102 Redact proxy credentials from worker logs [stormcrawler] via GitHub
• 2026/09/14 Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler] via GitHub
• 2026/09/14 Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler] via GitHub
• 2026/09/14 Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler] via GitHub
• 2026/09/14 [PR] build(deps): bump actions/setup-java from 6.0.0 to 6.0.1 [stormcrawler] via GitHub
• 2026/09/13 [PR] build(deps): bump software.amazon.awssdk:bom from 2.54.12 to 2.54.16 [stormcrawler] via GitHub
• 2026/09/13 [PR] build(deps): bump org.slf4j:slf4j-simple from 2.0.18 to 2.0.19 [stormcrawler] via GitHub
• 2026/09/13 [PR] build(deps): bump storm-client.version from 3.0.0 to 3.1.0 [stormcrawler] via GitHub
• 2026/09/13 [PR] build(deps): bump langchain4j.version from 1.19.0 to 1.20.0 [stormcrawler] via GitHub
• 2026/09/13 Re: [PR] #108 Normalize misspelled HTTP headers [stormcrawler] via GitHub
• 2026/09/13 Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler] via GitHub
• 2026/09/13 Re: [I] HostURLFilter memoizes the source host in plain fields shared by all fetcher threads [stormcrawler] via GitHub
• 2026/09/13 Re: [I] URLFrontier channels are always plaintext and the module has no TLS option [stormcrawler] via GitHub
• 2026/09/13 [PR] #2102 Redact proxy credentials from worker logs [stormcrawler] via GitHub
• 2026/09/13 Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler] via GitHub
• 2026/09/13 Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler] via GitHub
• 2026/09/12 Re: [PR] Run redirect hops through the URL filters [stormcrawler] via GitHub
• 2026/09/12 Re: [I] Redirect hops taken inside okhttp are not run through the URL filters [stormcrawler] via GitHub
• 2026/09/12 Re: [I] Persistence spouts emit stored URLs without checking the scheme [stormcrawler] via GitHub
• 2026/09/12 Re: [PR] Spouts check the scheme of stored URLs before emitting [stormcrawler] via GitHub
• 2026/09/12 Re: [I] SCProxy.toString() rebuilds the proxy URL with user and password, and the protocol logs it [stormcrawler] via GitHub
• 2026/09/12 Re: [PR] #1998 WARC writer: WARC-Protocol header to follow WARC field proposals [stormcrawler] via GitHub
• 2026/09/12 Re: [PR] SiteMapParserBolt: strict parsing, opt-in sniffing, non-terminal parse failure [stormcrawler] via GitHub
• 2026/09/12 Re: [I] Politeness queues and the robots.txt cache key on the raw host string, so percent-escaped host aliases get their own queue and their own robots.txt fetch [stormcrawler] via GitHub
• 2026/09/12 Re: [I] SiteMapParserBolt sniffs every document, parses sitemaps non-strict, and turns a failed sitemap parse into a terminal ERROR [stormcrawler] via GitHub
• 2026/09/12 Re: [PR] #1998 WARC writer: WARC-Protocol header to follow WARC field proposals [stormcrawler] via GitHub
• 2026/09/12 Re: [PR] Canonicalise hosts for politeness queues and the robots.txt cache [stormcrawler] via GitHub
• 2026/09/12 [PR] Upgrade to Apache Storm 3.1.0 and Java 25 [stormcrawler] via GitHub
• 2026/09/12 Re: [I] [Improvement] WARC writer: WARC-Protocol header to follow WARC field proposals [stormcrawler] via GitHub
• 2026/09/12 Re: [PR] URLFrontier StatusUpdaterBolt: make lock objects transient so the bolt can be serialized [stormcrawler] via GitHub
• 2026/09/12 Re: [PR] Run redirect hops through the URL filters [stormcrawler] via GitHub
• 2026/09/12 Re: [PR] Canonicalise hosts for politeness queues and the robots.txt cache [stormcrawler] via GitHub
• 2026/09/12 Re: [PR] SiteMapParserBolt: strict parsing, opt-in sniffing, non-terminal parse failure [stormcrawler] via GitHub
• 2026/09/12 Re: [PR] Spouts check the scheme of stored URLs before emitting [stormcrawler] via GitHub
• 2026/09/12 Re: [PR] Spouts check the scheme of stored URLs before emitting [stormcrawler] via GitHub
• 2026/09/12 Re: [PR] Run redirect hops through the URL filters [stormcrawler] via GitHub
• 2026/09/12 Re: [PR] Spouts check the scheme of stored URLs before emitting [stormcrawler] via GitHub
• 2026/09/12 Re: [PR] SiteMapParserBolt: strict parsing, opt-in sniffing, non-terminal parse failure [stormcrawler] via GitHub
• 2026/09/12 Re: [PR] Canonicalise hosts for politeness queues and the robots.txt cache [stormcrawler] via GitHub
• 2026/09/12 [GH] (stormcrawler/sc-1998-warc-protocol-header): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/12 [GH] (stormcrawler/sc-1998-warc-protocol-header): Workflow run "Java CI with Maven" is working again! GitBox
• 2026/09/12 Re: [PR] #1998 WARC writer: WARC-Protocol header to follow WARC field proposals [stormcrawler] via GitHub
• 2026/09/11 Re: [PR] SiteMapParserBolt: strict parsing, opt-in sniffing, non-terminal parse failure [stormcrawler] via GitHub
• 2026/09/11 Re: [PR] Spouts check the scheme of stored URLs before emitting [stormcrawler] via GitHub
• 2026/09/11 Re: [PR] SiteMapParserBolt: strict parsing, opt-in sniffing, non-terminal parse failure [stormcrawler] via GitHub
• 2026/09/11 Re: [PR] Canonicalise hosts for politeness queues and the robots.txt cache [stormcrawler] via GitHub
• 2026/09/11 Re: [PR] Keep the fetcher off private address space by default [stormcrawler] via GitHub
• 2026/09/11 Re: [I] Nothing in the shipped configuration keeps the fetcher off private address space [stormcrawler] via GitHub
• 2026/09/11 Re: [PR] Spouts check the scheme of stored URLs before emitting [stormcrawler] via GitHub
• 2026/09/11 [PR] URLFrontier StatusUpdaterBolt: make lock objects transient so the bolt can be serialized [stormcrawler] via GitHub
• 2026/09/11 Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler] via GitHub
• 2026/09/11 Re: [PR] Canonicalise hosts for politeness queues and the robots.txt cache [stormcrawler] via GitHub
• 2026/09/11 [GH] (stormcrawler/issue-2080-private-address-default): Workflow run "Java CI with Maven" is working again! GitBox
• 2026/09/11 [GH] (stormcrawler/regenerate_license_file_after_dep_upgrade): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/10 Re: [I] [Improvement] Use batch endpoint in URLFrontier module for DISCOVERED urls [stormcrawler] via GitHub
• 2026/09/10 [PR #2135] fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols Gianluca Graziadei
• 2026/09/10 Re: [PR] #2104 feat: implement MIME type whitelist filtering in ParserBolt for Tika [stormcrawler] via GitHub
• 2026/09/10 [GH] (stormcrawler/main): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/10 Re: [PR] SQL IndexerBolt: only plain identifiers may be used as column names, fixes #2096 [stormcrawler] via GitHub
• 2026/09/10 Re: [PR] Regenerated License file after dependency upgrades [stormcrawler] via GitHub
• 2026/09/10 Re: [PR] OKHttp: authenticated TLS by default, credentials withheld from unauthenticated servers [stormcrawler] via GitHub
• 2026/09/10 Re: [I] Credentials are sent over connections the okhttp protocol never authenticated, and the trust-all path uses an "SSL" context with an always-true hostname verifier [stormcrawler] via GitHub
• 2026/09/10 [GH] (stormcrawler/fix/tika-whitelist-detected-mimetype): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/10 Re: [PR] SQL IndexerBolt: only plain identifiers may be used as column names, fixes #2096 [stormcrawler] via GitHub
• 2026/09/10 [GH] (stormcrawler/issue-2080-private-address-default): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/10 Re: [PR] Upgrade to Tika 4.0.0 [stormcrawler] via GitHub
• 2026/09/10 Re: [I] Upgrade to Tika 4.0 [stormcrawler] via GitHub
• 2026/09/10 [GH] (stormcrawler/issue-2080-private-address-default): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/10 Re: [I] SQL IndexerBolt interpolates metadata labels into the statement as unquoted identifiers [stormcrawler] via GitHub
• 2026/09/10 Re: [PR] #2104 feat: implement MIME type whitelist filtering in ParserBolt for Tika [stormcrawler] via GitHub
• 2026/09/10 [GH] (stormcrawler/fix/tika-whitelist-detected-mimetype): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/10 [PR] Regenerated License file after dependency upgrades [stormcrawler] via GitHub
• 2026/09/10 Re: [PR] Upgrade to Tika 4.0.0 [stormcrawler] via GitHub
• 2026/09/10 Re: [PR] #2104 feat: implement MIME type whitelist filtering in ParserBolt for Tika [stormcrawler] via GitHub
• 2026/09/10 Re: [PR] #2104 feat: implement MIME type whitelist filtering in ParserBolt for Tika [stormcrawler] via GitHub
• 2026/09/10 Re: [I] Tika mimetype whitelist is checked against the HTTP header while the parser is chosen from the bytes [stormcrawler] via GitHub
• 2026/09/10 Re: [PR] Upgrade to Tika 4.0.0 [stormcrawler] via GitHub
• 2026/09/10 [GH] (stormcrawler/issue-2080-private-address-default): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/10 [GH] (stormcrawler/fix-main-formatting): Workflow run "Java CI with Maven" is working again! GitBox
• 2026/09/10 [GH] (stormcrawler/issue-2079-okhttp-trust-v2): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/10 Re: [PR] Minor: Fix formatting in ColumnNameValidationTest [stormcrawler] via GitHub
• 2026/09/10 Re: [PR] Use batch endpoint in URLFrontier module for DISCOVERED urls [stormcrawler] via GitHub
• 2026/09/10 [PR] Minor: Fix formatting in ColumnNameValidationTest [stormcrawler] via GitHub
• 2026/09/10 [GH] (stormcrawler/main): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/10 [GH] (stormcrawler/main): Workflow run "Java CI with Maven" is working again! GitBox
• 2026/09/10 [GH] (stormcrawler/fix/tika-whitelist-detected-mimetype): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/10 [GH] (stormcrawler/regenerate_license_file_after_dep_upgrade): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/10 [GH] (stormcrawler/issue-2079-okhttp-trust-v2): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/10 [GH] (stormcrawler/fix/sql-indexer-identifier-injection): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/10 [GH] (stormcrawler/main): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/10 Re: [PR] Keep the fetcher off private address space by default [stormcrawler] via GitHub
• 2026/09/10 Re: [PR] Upgrade to Tika 4.0.0 [stormcrawler] via GitHub
• 2026/09/10 Re: [PR] OKHttp: authenticated TLS by default, credentials withheld from unauthenticated servers [stormcrawler] via GitHub
• 2026/09/10 Re: [PR] OKHttp: authenticated TLS by default, credentials withheld from unauthenticated servers [stormcrawler] via GitHub
• 2026/09/10 Re: [PR] #2104 feat: implement MIME type whitelist filtering in ParserBolt for Tika [stormcrawler] via GitHub
• 2026/09/10 Re: [PR] SQL IndexerBolt: only plain identifiers may be used as column names, fixes #2096 [stormcrawler] via GitHub
• 2026/09/10 Re: [PR] Keep the fetcher off private address space by default [stormcrawler] via GitHub
• 2026/09/10 Re: [PR] OKHttp: authenticated TLS by default, credentials withheld from unauthenticated servers [stormcrawler] via GitHub
• 2026/09/09 [GH] (stormcrawler/fix/sql-indexer-identifier-injection): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/09 [GH] (stormcrawler/fix/sql-indexer-identifier-injection): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/09 [GH] (stormcrawler/fix/sql-indexer-identifier-injection): Workflow run "Java CI with Maven" is working again! GitBox
• 2026/09/09 [GH] (stormcrawler/issue-2088-redirect-filtering): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/09 [GH] (stormcrawler/main): Workflow run "Java CI with Maven" is working again! GitBox
• 2026/09/09 Re: [PR] Spouts check the scheme of stored URLs before emitting [stormcrawler] via GitHub
• 2026/09/09 Re: [PR] Run redirect hops through the URL filters [stormcrawler] via GitHub
• 2026/09/09 Re: [PR] SiteMapParserBolt: strict parsing, opt-in sniffing, non-terminal parse failure [stormcrawler] via GitHub
• 2026/09/09 Re: [PR] Canonicalise hosts for politeness queues and the robots.txt cache [stormcrawler] via GitHub
• 2026/09/09 [GH] (stormcrawler/fix/sql-indexer-identifier-injection): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/09 Re: [PR] Run redirect hops through the URL filters [stormcrawler] via GitHub
• 2026/09/09 Re: [PR] OKHttp: authenticated TLS by default, credentials withheld from unauthenticated servers [stormcrawler] via GitHub
• 2026/09/09 [PR] SQL IndexerBolt: only plain identifiers may be used as column names, fixes #2096 [stormcrawler] via GitHub
• 2026/09/09 Re: [I] The file scheme is enabled by default and FileProtocol reads any path the worker can open [stormcrawler] via GitHub
• 2026/09/09 Re: [PR] File scheme off by default; reads confined to file.protocol.root [stormcrawler] via GitHub
• 2026/09/09 Re: [PR] Upgrade to Tika 4.0.0 [stormcrawler] via GitHub
• 2026/09/09 Re: [PR] #2129 FetcherBolt: lock-free fetch queues ordered by next fetch time [stormcrawler] via GitHub
• 2026/09/09 Re: [PR] File scheme off by default; reads confined to file.protocol.root [stormcrawler] via GitHub
• 2026/09/09 Re: [PR] Robots.txt fetch no longer replaces the configured content limit [stormcrawler] via GitHub
• 2026/09/09 Re: [PR] Keep the fetcher off private address space by default [stormcrawler] via GitHub
• 2026/09/09 Re: [PR] Canonicalise hosts for politeness queues and the robots.txt cache [stormcrawler] via GitHub
• 2026/09/09 Re: [PR] Spouts check the scheme of stored URLs before emitting [stormcrawler] via GitHub
• 2026/09/09 Re: [PR] Canonicalise hosts for politeness queues and the robots.txt cache [stormcrawler] via GitHub
• 2026/09/09 Re: [PR] Upgrade to Tika 4.0.0 [stormcrawler] via GitHub
• 2026/09/09 Re: [PR] Upgrade to Tika 4.0.0 [stormcrawler] via GitHub
• 2026/09/09 Re: [PR] Canonicalise hosts for politeness queues and the robots.txt cache [stormcrawler] via GitHub
• 2026/09/09 Re: [I] FetcherBolt: global lock and linear scan in FetchItemQueues stall the executor with many hosts [stormcrawler] via GitHub
• 2026/09/09 Re: [I] URLFilters.filter() returns the URL as accepted when a filter in the chain throws [stormcrawler] via GitHub
• 2026/09/09 Re: [PR] URLFilters: treat an exception from a filter as a rejection [stormcrawler] via GitHub
• 2026/09/09 Re: [I] The robots.txt fetch replaces the configured http.content.limit with no limit at all [stormcrawler] via GitHub
• 2026/09/09 Re: [PR] File scheme off by default; reads confined to file.protocol.root [stormcrawler] via GitHub
• 2026/09/08 Re: [PR] SiteMapParserBolt: strict parsing, opt-in sniffing, non-terminal parse failure [stormcrawler] via GitHub
• 2026/09/08 [GH] (stormcrawler/issue-2082-host-canonicalisation): Workflow run "Java CI with Maven" is working again! GitBox
• 2026/09/08 Re: [PR] IPFilterRules: add anylocal and multicast keywords, fail on unparseable rules [stormcrawler] via GitHub
• 2026/09/08 Re: [I] IPFilterRules has no keyword for link-local addresses and the documented example leaves them allowed [stormcrawler] via GitHub
• 2026/09/08 Re: [PR] Canonicalise hosts for politeness queues and the robots.txt cache [stormcrawler] via GitHub
• 2026/09/08 [GH] (stormcrawler/issue-2079-okhttp-trust-v2): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/08 Re: [PR] #2129 FetcherBolt: lock-free fetch queues ordered by next fetch time [stormcrawler] via GitHub
• 2026/09/08 Re: [PR] Spouts check the scheme of stored URLs before emitting [stormcrawler] via GitHub
• 2026/09/08 Re: [PR] #2129 FetcherBolt: lock-free fetch queues ordered by next fetch time [stormcrawler] via GitHub
• 2026/09/08 Re: [PR] Canonicalise hosts for politeness queues and the robots.txt cache [stormcrawler] via GitHub
• 2026/09/08 [GH] (stormcrawler/issue-2085-spout-scheme-check): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/08 Re: [PR] Canonicalise hosts for politeness queues and the robots.txt cache [stormcrawler] via GitHub
• 2026/09/08 Re: [PR] Canonicalise hosts for politeness queues and the robots.txt cache [stormcrawler] via GitHub
• 2026/09/08 [GH] (stormcrawler/fix/tika-whitelist-detected-mimetype): Workflow run "Java CI with Maven" is working again! GitBox
• 2026/09/08 Re: [PR] Spouts check the scheme of stored URLs before emitting [stormcrawler] via GitHub
• 2026/09/08 [GH] (stormcrawler/issue-2082-host-canonicalisation): Workflow run "Java CI with Maven" failed! GitBox
• 2026/09/08 Re: [PR] #2104 feat: implement MIME type whitelist filtering in ParserBolt for Tika [stormcrawler] via GitHub
• 2026/09/08 Re: [PR] #2104 feat: implement MIME type whitelist filtering in ParserBolt for Tika [stormcrawler] via GitHub
• 2026/09/08 Re: [PR] #2104 feat: implement MIME type whitelist filtering in ParserBolt for Tika [stormcrawler] via GitHub
• 2026/09/08 Re: [PR] IPFilterRules: add anylocal and multicast keywords, fail on unparseable rules [stormcrawler] via GitHub
• 2026/09/08 Re: [PR] Canonicalise hosts for politeness queues and the robots.txt cache [stormcrawler] via GitHub
• 2026/09/08 Re: [PR] Use batch endpoint in URLFrontier module for DISCOVERED urls [stormcrawler] via GitHub

• Earlier messages
• Later messages