Messages by Date
-
2026/09/23
Re: [PR] #2097 Tika ParserBolt: optional timeout for the parse with parser.tika.timeout [stormcrawler]
via GitHub
-
2026/09/23
Re: [PR] #2097 Tika ParserBolt: optional timeout for the parse with parser.tika.timeout [stormcrawler]
via GitHub
-
2026/09/23
[GH] (stormcrawler/fix-2097-tika-parse-timeout): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/23
Re: [PR] #2097 Tika ParserBolt: optional timeout for the parse with parser.tika.timeout [stormcrawler]
via GitHub
-
2026/09/23
Re: [PR] #2097 Tika ParserBolt: optional timeout for the parse with parser.tika.timeout [stormcrawler]
via GitHub
-
2026/09/23
Re: [PR] #2097 Tika ParserBolt: optional timeout for the parse with parser.tika.timeout [stormcrawler]
via GitHub
-
2026/09/23
[PR] #2093 LLM text extractor: keep page markers out of the prompt and clean the reply [stormcrawler]
via GitHub
-
2026/09/23
[PR] #2097 Tika ParserBolt: optional timeout for the parse with parser.tika.timeout [stormcrawler]
via GitHub
-
2026/09/23
Re: [PR] #2098 URLFrontier: optional TLS for the channels to the frontier [stormcrawler]
via GitHub
-
2026/09/23
Re: [I] URLFrontier channels are always plaintext and the module has no TLS option [stormcrawler]
via GitHub
-
2026/09/23
Re: [PR] #2103 OpenSearchConnection: send the credentials only to the configured addresses [stormcrawler]
via GitHub
-
2026/09/23
Re: [I] OpenSearch addresses default to http and Basic credentials are registered for any host [stormcrawler]
via GitHub
-
2026/09/23
[GH] (stormcrawler/fix-2098-urlfrontier-tls): Workflow run "Java CI with Maven" is working again!
GitBox
-
2026/09/23
[GH] (stormcrawler/fix-2103-opensearch-credentials-scope): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/23
Re: [PR] #2098 URLFrontier: optional TLS for the channels to the frontier [stormcrawler]
via GitHub
-
2026/09/23
Re: [PR] #2103 OpenSearchConnection: send the credentials only to the configured addresses [stormcrawler]
via GitHub
-
2026/09/22
[GH] (stormcrawler/regenerate_license_file_after_dep_upgrade): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/22
[GH] (stormcrawler/regenerate_license_file_after_dep_upgrade): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/22
[GH] (stormcrawler/regenerate_license_file_after_dep_upgrade): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/22
Re: [PR] #2098 URLFrontier: optional TLS for the channels to the frontier [stormcrawler]
via GitHub
-
2026/09/22
sending fetched pages to a remote tika over grpc
Davide Polato
-
2026/09/22
Re: [PR] Regenerated License file after dependency upgrades [stormcrawler]
via GitHub
-
2026/09/22
[GH] (stormcrawler/main): Workflow run "Java CI with Maven" is working again!
GitBox
-
2026/09/22
[PR] Regenerated License file after dependency upgrades [stormcrawler]
via GitHub
-
2026/09/22
Re: [PR] Regenerated License file after dependency upgrades [stormcrawler]
via GitHub
-
2026/09/22
[GH] (stormcrawler/regenerate_license_file_after_dep_upgrade): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/21
Re: [PR] Regenerated License file after dependency upgrades [stormcrawler]
via GitHub
-
2026/09/21
[PR] Regenerated License file after dependency upgrades [stormcrawler]
via GitHub
-
2026/09/21
[PR] Regenerated License file after dependency upgrades [stormcrawler]
via GitHub
-
2026/09/21
Re: [PR] build(deps): bump software.amazon.awssdk:bom from 2.54.16 to 2.55.0 [stormcrawler]
via GitHub
-
2026/09/21
Re: [PR] build(deps): bump com.microsoft.playwright:playwright from 1.62.0 to 1.63.0 [stormcrawler]
via GitHub
-
2026/09/21
Re: [I] [Improvement] Add a cap on the number of outlinks emitted per sitemap [stormcrawler]
via GitHub
-
2026/09/21
Re: [PR] #2166 SiteMapParserBolt: cap the number of URLs emitted per sitemap [stormcrawler]
via GitHub
-
2026/09/21
Re: [PR] #2097 Tika ParserBolt: limit the extracted text with parser.tika.text.maxlength [stormcrawler]
via GitHub
-
2026/09/21
Re: [PR] #2097 Tika ParserBolt: limit the extracted text with parser.tika.text.maxlength [stormcrawler]
via GitHub
-
2026/09/21
Re: [PR] #2098 URLFrontier: optional TLS for the channels to the frontier [stormcrawler]
via GitHub
-
2026/09/20
[PR] build(deps): bump software.amazon.awssdk:bom from 2.54.16 to 2.55.0 [stormcrawler]
via GitHub
-
2026/09/20
[PR] build(deps): bump com.microsoft.playwright:playwright from 1.62.0 to 1.63.0 [stormcrawler]
via GitHub
-
2026/09/19
[PR] #2097 Tika ParserBolt: limit the extracted text with parser.tika.text.maxlength [stormcrawler]
via GitHub
-
2026/09/19
[PR] #2098 URLFrontier: optional TLS for the channels to the frontier [stormcrawler]
via GitHub
-
2026/09/19
[PR] #2103 OpenSearchConnection: send the credentials only to the configured addresses [stormcrawler]
via GitHub
-
2026/09/19
[PR] #2166 SiteMapParserBolt: cap the number of URLs emitted per sitemap [stormcrawler]
via GitHub
-
2026/09/19
Re: [I] Gzipped sitemap files are expanded with no size bound, and SiteMapParserBolt reads Content-Type under a key that is never present [stormcrawler]
via GitHub
-
2026/09/19
Re: [PR] #2100 SiteMapParserBolt: read the content type under the protocol prefix [stormcrawler]
via GitHub
-
2026/09/19
Re: [PR] #2099 Fetcher bolts: skip a metrics.* value which is not a number [stormcrawler]
via GitHub
-
2026/09/19
Re: [I] Response headers can populate the reserved verbatim request and response metadata keys [stormcrawler]
via GitHub
-
2026/09/19
Re: [PR] #2091 Protocols: reject metadata keys arriving in a response header [stormcrawler]
via GitHub
-
2026/09/19
Re: [I] Response headers named metrics.* are fed straight into the fetcher metric registry, and a non-numeric one fails the fetch [stormcrawler]
via GitHub
-
2026/09/19
Re: [I] A response header named set-header becomes a request header directive [stormcrawler]
via GitHub
-
2026/09/19
Re: [PR] #2095 Apply the IP address filter to the requests made by the Playwright browser [stormcrawler]
via GitHub
-
2026/09/19
Re: [PR] #2090 Fetcher bolts: drop a set-header value coming from a response [stormcrawler]
via GitHub
-
2026/09/19
Re: [I] Playwright protocol applies neither the IP filter nor the URL filters to the requests it makes [stormcrawler]
via GitHub
-
2026/09/19
[GH] (stormcrawler/2095-playwright-ip-filter): Workflow run "Java CI with Maven" is working again!
GitBox
-
2026/09/19
Re: [PR] #2100 SiteMapParserBolt: read the content type under the protocol prefix [stormcrawler]
via GitHub
-
2026/09/19
Re: [PR] #2091 Protocols: reject metadata keys arriving in a response header [stormcrawler]
via GitHub
-
2026/09/19
Re: [PR] #2099 Fetcher bolts: skip a metrics.* value which is not a number [stormcrawler]
via GitHub
-
2026/09/19
[GH] (stormcrawler/fix-2091-reserved-metadata-keys): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/19
Re: [PR] #2101 HostURLFilter: drop the source host memoization shared by all fetcher threads [stormcrawler]
via GitHub
-
2026/09/19
Re: [I] HostURLFilter memoizes the source host in plain fields shared by all fetcher threads [stormcrawler]
via GitHub
-
2026/09/19
Re: [PR] #2091 Protocols: reject metadata keys arriving in a response header [stormcrawler]
via GitHub
-
2026/09/19
Re: [PR] #2100 SiteMapParserBolt: read the content type under the protocol prefix [stormcrawler]
via GitHub
-
2026/09/19
Re: [PR] #2099 Fetcher bolts: skip a metrics.* value which is not a number [stormcrawler]
via GitHub
-
2026/09/19
Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler]
via GitHub
-
2026/09/19
Re: [I] fetcher.thread.timeout: cancel the okhttp call instead of interrupting a helper thread [stormcrawler]
via GitHub
-
2026/09/18
Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler]
via GitHub
-
2026/09/18
[GH] (stormcrawler/fix-2099-metrics-header-parse): Workflow run "Java CI with Maven" is working again!
GitBox
-
2026/09/18
[GH] (stormcrawler/fix-2091-reserved-metadata-keys): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/18
[PR] #2101 HostURLFilter: drop the source host memoization shared by all fetcher threads [stormcrawler]
via GitHub
-
2026/09/18
[PR] #2091 Protocols: reject metadata keys arriving in a response header [stormcrawler]
via GitHub
-
2026/09/18
[PR] #2099 Fetcher bolts: skip a metrics.* value which is not a number [stormcrawler]
via GitHub
-
2026/09/18
[PR] #2100 SiteMapParserBolt: read the content type under the protocol prefix [stormcrawler]
via GitHub
-
2026/09/18
[PR] #2090 Fetcher bolts: drop a set-header value coming from a response [stormcrawler]
via GitHub
-
2026/09/18
[I] [Improvement] Add a cap on the number of outlinks emitted per sitemap [stormcrawler]
via GitHub
-
2026/09/18
Re: [I] CharsetIdentification retries the meta charset lookup ten bytes at a time by recursing, and the call sits outside JSoupParserBolt's catch block [stormcrawler]
via GitHub
-
2026/09/18
Re: [PR] #2092 Bound the meta charset look-ahead and catch charset detection failures in JSoupParserBolt [stormcrawler]
via GitHub
-
2026/09/18
Re: [I] Scope credential headers in http.custom.headers to hosts [stormcrawler]
via GitHub
-
2026/09/18
Re: [PR] #2162 Send credential headers from http.custom.headers only to the hosts in http.custom.headers.hosts [stormcrawler]
via GitHub
-
2026/09/18
Re: [I] SCProxy.toString() rebuilds the proxy URL with user and password, and the protocol logs it [stormcrawler]
via GitHub
-
2026/09/18
Re: [I] http.basicauth credentials are attached to every request, whatever the host [stormcrawler]
via GitHub
-
2026/09/18
Re: [I] SCProxy.toString() rebuilds the proxy URL with user and password, and the protocol logs it [stormcrawler]
via GitHub
-
2026/09/18
Re: [I] http.basicauth credentials are attached to every request, whatever the host [stormcrawler]
via GitHub
-
2026/09/18
Re: [PR] #2089 Send http.basicauth credentials only to the hosts in http.basicauth.hosts [stormcrawler]
via GitHub
-
2026/09/18
Re: [PR] #2094 Make ignoring HTTPS errors in the Playwright protocol configurable and independent of the proxy [stormcrawler]
via GitHub
-
2026/09/18
Re: [I] Playwright browser context stops validating certificates as soon as a proxy is configured [stormcrawler]
via GitHub
-
2026/09/17
Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler]
via GitHub
-
2026/09/17
Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler]
via GitHub
-
2026/09/17
Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler]
via GitHub
-
2026/09/17
Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler]
via GitHub
-
2026/09/17
[GH] (stormcrawler/meta-charset-overflow): Workflow run "Java CI with Maven" is working again!
GitBox
-
2026/09/17
[GH] (stormcrawler/meta-charset-overflow): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/16
[GH] (stormcrawler/regenerate_license_file_after_dep_upgrade): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/16
[GH] (stormcrawler/regenerate_license_file_after_dep_upgrade): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/16
Re: [PR] #2095 Apply the IP address filter to the requests made by the Playwright browser [stormcrawler]
via GitHub
-
2026/09/16
[GH] (stormcrawler/perf/fetch-timeout-call-cancel): Workflow run "Java CI with Maven" is working again!
GitBox
-
2026/09/16
[GH] (stormcrawler/perf/fetch-timeout-call-cancel): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/16
Re: [PR] #2095 Apply the IP address filter to the requests made by the Playwright browser [stormcrawler]
via GitHub
-
2026/09/16
Re: [PR] #2089 Send http.basicauth credentials only to the hosts in http.basicauth.hosts [stormcrawler]
via GitHub
-
2026/09/15
Re: [I] Send host info on a specific stream [stormcrawler]
via GitHub
-
2026/09/15
[GH] (stormcrawler/meta-charset-overflow): Workflow run "Java CI with Maven" is working again!
GitBox
-
2026/09/15
Re: [I] HostURLFilter memoizes the source host in plain fields shared by all fetcher threads [stormcrawler]
via GitHub
-
2026/09/15
Re: [I] Send host info on a specific stream [stormcrawler]
via GitHub
-
2026/09/15
Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler]
via GitHub
-
2026/09/15
Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler]
via GitHub
-
2026/09/15
Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler]
via GitHub
-
2026/09/15
[PR] #2095 Apply the IP address filter to the requests made by the Playwright browser [stormcrawler]
via GitHub
-
2026/09/15
[GH] (stormcrawler/main): Workflow run "Java CI with Maven" is working again!
GitBox
-
2026/09/15
[PR] #2162 Send credential headers from http.custom.headers only to the hosts in http.custom.headers.hosts [stormcrawler]
via GitHub
-
2026/09/15
[I] Scope credential headers in http.custom.headers to hosts [stormcrawler]
via GitHub
-
2026/09/15
[PR] #2089 Send http.basicauth credentials only to the hosts in http.basicauth.hosts [stormcrawler]
via GitHub
-
2026/09/15
[GH] (stormcrawler/regenerate_license_file_after_dep_upgrade): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/15
[GH] (stormcrawler/main): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/15
Re: [PR] Regenerated License file after dependency upgrades [stormcrawler]
via GitHub
-
2026/09/15
Re: [PR] build(deps): bump langchain4j.version from 1.19.0 to 1.20.0 [stormcrawler]
via GitHub
-
2026/09/15
Re: [PR] Regenerated License file after dependency upgrades [stormcrawler]
via GitHub
-
2026/09/15
[PR] Regenerated License file after dependency upgrades [stormcrawler]
via GitHub
-
2026/09/15
Re: [PR] build(deps): bump storm-client.version from 3.0.0 to 3.1.0 [stormcrawler]
via GitHub
-
2026/09/15
Re: [PR] build(deps): bump storm-client.version from 3.0.0 to 3.1.0 [stormcrawler]
via GitHub
-
2026/09/15
[GH] (stormcrawler/regenerate_license_file_after_dep_upgrade): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/15
[PR] Regenerated License file after dependency upgrades [stormcrawler]
via GitHub
-
2026/09/15
Re: [PR] Regenerated License file after dependency upgrades [stormcrawler]
via GitHub
-
2026/09/15
[GH] (stormcrawler/regenerate_license_file_after_dep_upgrade): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/15
[PR] Regenerated License file after dependency upgrades [stormcrawler]
via GitHub
-
2026/09/15
Re: [PR] build(deps): bump software.amazon.awssdk:bom from 2.54.12 to 2.54.16 [stormcrawler]
via GitHub
-
2026/09/15
[PR] #2094 Make ignoring HTTPS errors in the Playwright protocol configurable and independent of the proxy [stormcrawler]
via GitHub
-
2026/09/15
Re: [PR] build(deps): bump org.slf4j:slf4j-simple from 2.0.18 to 2.0.19 [stormcrawler]
via GitHub
-
2026/09/15
Re: [PR] Upgrade to Apache Storm 3.1.0 and Java 25 [stormcrawler]
via GitHub
-
2026/09/15
Re: [PR] build(deps): bump storm-client.version from 3.0.0 to 3.1.0 [stormcrawler]
via GitHub
-
2026/09/15
Re: [PR] #2102 Redact proxy credentials from worker logs [stormcrawler]
via GitHub
-
2026/09/15
Re: [PR] build(deps): bump actions/setup-java from 6.0.0 to 6.0.1 [stormcrawler]
via GitHub
-
2026/09/15
Re: [PR] #2102 Redact proxy credentials from worker logs [stormcrawler]
via GitHub
-
2026/09/15
[GH] (stormcrawler/fix/proxy-credential-redaction): Workflow run "Java CI with Maven" is working again!
GitBox
-
2026/09/15
[GH] (stormcrawler/meta-charset-overflow): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/15
[PR] #2092 Bound the meta charset look-ahead and catch charset detection failures in JSoupParserBolt [stormcrawler]
via GitHub
-
2026/09/15
Re: [PR] #2102 Redact proxy credentials from worker logs [stormcrawler]
via GitHub
-
2026/09/14
Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler]
via GitHub
-
2026/09/14
Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler]
via GitHub
-
2026/09/14
Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler]
via GitHub
-
2026/09/14
[PR] build(deps): bump actions/setup-java from 6.0.0 to 6.0.1 [stormcrawler]
via GitHub
-
2026/09/13
[PR] build(deps): bump software.amazon.awssdk:bom from 2.54.12 to 2.54.16 [stormcrawler]
via GitHub
-
2026/09/13
[PR] build(deps): bump org.slf4j:slf4j-simple from 2.0.18 to 2.0.19 [stormcrawler]
via GitHub
-
2026/09/13
[PR] build(deps): bump storm-client.version from 3.0.0 to 3.1.0 [stormcrawler]
via GitHub
-
2026/09/13
[PR] build(deps): bump langchain4j.version from 1.19.0 to 1.20.0 [stormcrawler]
via GitHub
-
2026/09/13
Re: [PR] #108 Normalize misspelled HTTP headers [stormcrawler]
via GitHub
-
2026/09/13
Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler]
via GitHub
-
2026/09/13
Re: [I] HostURLFilter memoizes the source host in plain fields shared by all fetcher threads [stormcrawler]
via GitHub
-
2026/09/13
Re: [I] URLFrontier channels are always plaintext and the module has no TLS option [stormcrawler]
via GitHub
-
2026/09/13
[PR] #2102 Redact proxy credentials from worker logs [stormcrawler]
via GitHub
-
2026/09/13
Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler]
via GitHub
-
2026/09/13
Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler]
via GitHub
-
2026/09/12
Re: [PR] Run redirect hops through the URL filters [stormcrawler]
via GitHub
-
2026/09/12
Re: [I] Redirect hops taken inside okhttp are not run through the URL filters [stormcrawler]
via GitHub
-
2026/09/12
Re: [I] Persistence spouts emit stored URLs without checking the scheme [stormcrawler]
via GitHub
-
2026/09/12
Re: [PR] Spouts check the scheme of stored URLs before emitting [stormcrawler]
via GitHub
-
2026/09/12
Re: [I] SCProxy.toString() rebuilds the proxy URL with user and password, and the protocol logs it [stormcrawler]
via GitHub
-
2026/09/12
Re: [PR] #1998 WARC writer: WARC-Protocol header to follow WARC field proposals [stormcrawler]
via GitHub
-
2026/09/12
Re: [PR] SiteMapParserBolt: strict parsing, opt-in sniffing, non-terminal parse failure [stormcrawler]
via GitHub
-
2026/09/12
Re: [I] Politeness queues and the robots.txt cache key on the raw host string, so percent-escaped host aliases get their own queue and their own robots.txt fetch [stormcrawler]
via GitHub
-
2026/09/12
Re: [I] SiteMapParserBolt sniffs every document, parses sitemaps non-strict, and turns a failed sitemap parse into a terminal ERROR [stormcrawler]
via GitHub
-
2026/09/12
Re: [PR] #1998 WARC writer: WARC-Protocol header to follow WARC field proposals [stormcrawler]
via GitHub
-
2026/09/12
Re: [PR] Canonicalise hosts for politeness queues and the robots.txt cache [stormcrawler]
via GitHub
-
2026/09/12
[PR] Upgrade to Apache Storm 3.1.0 and Java 25 [stormcrawler]
via GitHub
-
2026/09/12
Re: [I] [Improvement] WARC writer: WARC-Protocol header to follow WARC field proposals [stormcrawler]
via GitHub
-
2026/09/12
Re: [PR] URLFrontier StatusUpdaterBolt: make lock objects transient so the bolt can be serialized [stormcrawler]
via GitHub
-
2026/09/12
Re: [PR] Run redirect hops through the URL filters [stormcrawler]
via GitHub
-
2026/09/12
Re: [PR] Canonicalise hosts for politeness queues and the robots.txt cache [stormcrawler]
via GitHub
-
2026/09/12
Re: [PR] SiteMapParserBolt: strict parsing, opt-in sniffing, non-terminal parse failure [stormcrawler]
via GitHub
-
2026/09/12
Re: [PR] Spouts check the scheme of stored URLs before emitting [stormcrawler]
via GitHub
-
2026/09/12
Re: [PR] Spouts check the scheme of stored URLs before emitting [stormcrawler]
via GitHub
-
2026/09/12
Re: [PR] Run redirect hops through the URL filters [stormcrawler]
via GitHub
-
2026/09/12
Re: [PR] Spouts check the scheme of stored URLs before emitting [stormcrawler]
via GitHub
-
2026/09/12
Re: [PR] SiteMapParserBolt: strict parsing, opt-in sniffing, non-terminal parse failure [stormcrawler]
via GitHub
-
2026/09/12
Re: [PR] Canonicalise hosts for politeness queues and the robots.txt cache [stormcrawler]
via GitHub
-
2026/09/12
[GH] (stormcrawler/sc-1998-warc-protocol-header): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/12
[GH] (stormcrawler/sc-1998-warc-protocol-header): Workflow run "Java CI with Maven" is working again!
GitBox
-
2026/09/12
Re: [PR] #1998 WARC writer: WARC-Protocol header to follow WARC field proposals [stormcrawler]
via GitHub
-
2026/09/11
Re: [PR] SiteMapParserBolt: strict parsing, opt-in sniffing, non-terminal parse failure [stormcrawler]
via GitHub
-
2026/09/11
Re: [PR] Spouts check the scheme of stored URLs before emitting [stormcrawler]
via GitHub
-
2026/09/11
Re: [PR] SiteMapParserBolt: strict parsing, opt-in sniffing, non-terminal parse failure [stormcrawler]
via GitHub
-
2026/09/11
Re: [PR] Canonicalise hosts for politeness queues and the robots.txt cache [stormcrawler]
via GitHub
-
2026/09/11
Re: [PR] Keep the fetcher off private address space by default [stormcrawler]
via GitHub
-
2026/09/11
Re: [I] Nothing in the shipped configuration keeps the fetcher off private address space [stormcrawler]
via GitHub
-
2026/09/11
Re: [PR] Spouts check the scheme of stored URLs before emitting [stormcrawler]
via GitHub
-
2026/09/11
[PR] URLFrontier StatusUpdaterBolt: make lock objects transient so the bolt can be serialized [stormcrawler]
via GitHub
-
2026/09/11
Re: [PR] #2134 fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols [stormcrawler]
via GitHub
-
2026/09/11
Re: [PR] Canonicalise hosts for politeness queues and the robots.txt cache [stormcrawler]
via GitHub
-
2026/09/11
[GH] (stormcrawler/issue-2080-private-address-default): Workflow run "Java CI with Maven" is working again!
GitBox
-
2026/09/11
[GH] (stormcrawler/regenerate_license_file_after_dep_upgrade): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/10
Re: [I] [Improvement] Use batch endpoint in URLFrontier module for DISCOVERED urls [stormcrawler]
via GitHub
-
2026/09/10
[PR #2135] fetcher.thread.timeout: cancel the okhttp call, bounded helper pool for other protocols
Gianluca Graziadei
-
2026/09/10
Re: [PR] #2104 feat: implement MIME type whitelist filtering in ParserBolt for Tika [stormcrawler]
via GitHub
-
2026/09/10
[GH] (stormcrawler/main): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/10
Re: [PR] SQL IndexerBolt: only plain identifiers may be used as column names, fixes #2096 [stormcrawler]
via GitHub
-
2026/09/10
Re: [PR] Regenerated License file after dependency upgrades [stormcrawler]
via GitHub
-
2026/09/10
Re: [PR] OKHttp: authenticated TLS by default, credentials withheld from unauthenticated servers [stormcrawler]
via GitHub
-
2026/09/10
Re: [I] Credentials are sent over connections the okhttp protocol never authenticated, and the trust-all path uses an "SSL" context with an always-true hostname verifier [stormcrawler]
via GitHub
-
2026/09/10
[GH] (stormcrawler/fix/tika-whitelist-detected-mimetype): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/10
Re: [PR] SQL IndexerBolt: only plain identifiers may be used as column names, fixes #2096 [stormcrawler]
via GitHub
-
2026/09/10
[GH] (stormcrawler/issue-2080-private-address-default): Workflow run "Java CI with Maven" failed!
GitBox
-
2026/09/10
Re: [PR] Upgrade to Tika 4.0.0 [stormcrawler]
via GitHub
-
2026/09/10
Re: [I] Upgrade to Tika 4.0 [stormcrawler]
via GitHub