dev  

Messages by Thread

• [GH] (stormcrawler/status-updater-benchmark-perf): Workflow run "Java CI with Maven" is working again! GitBox
  • [GH] (stormcrawler/status-updater-benchmark-perf): Workflow run "Java CI with Maven" is working again! GitBox
• [PR] Speed up the input of StatusUpdaterBenchmark [stormcrawler] via GitHub
  • Re: [PR] Parse StatusUpdaterBenchmark input in parallel to raise its baseline throughput [stormcrawler] via GitHub
• [GH] (stormcrawler/fix-2199-query-separator): Workflow run "Java CI with Maven" failed! GitBox
• [PR] Add baseline StatusUpdaterBolt class for benchmarking [stormcrawler] via GitHub
  • Re: [PR] Add baseline StatusUpdaterBolt class for benchmarking [stormcrawler] via GitHub
• [PR] build(deps): bump okhttp.version from 5.5.0 to 5.5.1 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump okhttp.version from 5.5.0 to 5.5.1 [stormcrawler] via GitHub
• [PR] build(deps): bump com.mysql:mysql-connector-j from 26.7.0 to 26.10.0 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump com.mysql:mysql-connector-j from 26.7.0 to 26.10.0 [stormcrawler] via GitHub
• [PR] build(deps): bump software.amazon.awssdk:bom from 2.56.0 to 2.57.3 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump software.amazon.awssdk:bom from 2.56.0 to 2.57.3 [stormcrawler] via GitHub
• [PR] build(deps): bump org.apache.httpcomponents.core5:httpcore5 from 5.4.3 to 5.4.4 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump org.apache.httpcomponents.core5:httpcore5 from 5.4.3 to 5.4.4 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump org.apache.httpcomponents.core5:httpcore5 from 5.4.3 to 5.4.4 [stormcrawler] via GitHub
• [PR] build(deps): bump com.microsoft.playwright:playwright from 1.63.0 to 1.64.0 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump com.microsoft.playwright:playwright from 1.63.0 to 1.64.0 [stormcrawler] via GitHub
• [PR] build(deps): bump com.ibm.icu:icu4j from 78.3 to 79.1 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump com.ibm.icu:icu4j from 78.3 to 79.1 [stormcrawler] via GitHub
• [PR] build(deps): bump org.apache.maven.plugins:maven-surefire-plugin from 3.6.0 to 3.6.1 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump org.apache.maven.plugins:maven-surefire-plugin from 3.6.0 to 3.6.1 [stormcrawler] via GitHub
• [PR] #2266 Remove the dependency on HttpCore 5 [stormcrawler] via GitHub
  • Re: [PR] #2266 Remove the dependency on HttpCore 5 [stormcrawler] via GitHub
  • Re: [PR] #2266 Remove the dependency on HttpCore 5 [stormcrawler] via GitHub
  • Re: [PR] #2266 Remove the dependency on HttpCore 5 [stormcrawler] via GitHub
• [D] Help us test StormCrawler 4.0 before the release [stormcrawler] via GitHub
  • Re: [D] Help us test StormCrawler 4.0 before the release [stormcrawler] via GitHub
  • Re: [D] Help us test StormCrawler 4.0 before the release [stormcrawler] via GitHub
• [GH] (stormcrawler/migrate-httpclient5): Workflow run "Java CI with Maven" failed! GitBox
  • [GH] (stormcrawler/migrate-httpclient5): Workflow run "Java CI with Maven" failed! GitBox
• [I] Remove dependency on httpcomponents.core5 [stormcrawler] via GitHub
  • Re: [I] Remove dependency on httpcomponents.core5 [stormcrawler] via GitHub
• [PR] #<ISSUE> - Use entrySet() when iterating maps in WARCSpout and Solr IndexerBolt [stormcrawler] via GitHub
  • Re: [PR] #<ISSUE> - Use entrySet() when iterating maps in WARCSpout and Solr IndexerBolt [stormcrawler] via GitHub
  • Re: [PR] #<ISSUE> - Use entrySet() when iterating maps in WARCSpout and Solr IndexerBolt [stormcrawler] via GitHub
  • Re: [PR] #<ISSUE> - Use entrySet() when iterating maps in WARCSpout and Solr IndexerBolt [stormcrawler] via GitHub
  • Re: [PR] #2264 Use entrySet() when iterating maps in WARCSpout and Solr IndexerBolt [stormcrawler] via GitHub
• [I] Use entrySet() instead of keySet()+get() in WARCSpout and Solr IndexerBolt [stormcrawler] via GitHub
  • Re: [I] Use entrySet() instead of keySet()+get() in WARCSpout and Solr IndexerBolt [stormcrawler] via GitHub
• [PR] #158 restore Xerces for sitemap and feed parsing [stormcrawler] via GitHub
  • Re: [PR] #158 restore Xerces for sitemap and feed parsing [stormcrawler] via GitHub
  • Re: [PR] #158 document the JDK XML limits for sitemaps and feeds [stormcrawler] via GitHub
  • Re: [PR] #158 document the JDK XML limits for sitemaps and feeds [stormcrawler] via GitHub
  • Re: [PR] #158 document the JDK XML limits for sitemaps and feeds [stormcrawler] via GitHub
  • Re: [PR] #158 restore Xerces for sitemap and feed parsing [stormcrawler] via GitHub
• StormCrawler 4.0 is around the corner Julien Nioche
  • Re: StormCrawler 4.0 is around the corner Richard Zowalla
• [GH] (stormcrawler/remove-DOM): Workflow run "Java CI with Maven" failed! GitBox
• [PR] #158 remove the DOM from the ParseFilters [stormcrawler] via GitHub
  • Re: [PR] #158 remove the DOM from the ParseFilters [stormcrawler] via GitHub
• [PR] Enable Storm dynamic producer batching in archetype configs and docum… [stormcrawler] via GitHub
  • Re: [PR] Enable Storm dynamic producer batching in archetype configs and docum… [stormcrawler] via GitHub
  • Re: [PR] Enable Storm dynamic producer batching in archetype configs and docum… [stormcrawler] via GitHub
  • Re: [PR] Enable Storm dynamic producer batching in archetype configs and docum… [stormcrawler] via GitHub
  • Re: [PR] Enable Storm dynamic producer batching in archetype configs and docum… [stormcrawler] via GitHub
  • Re: [PR] Enable Storm dynamic producer batching in archetype configs and docum… [stormcrawler] via GitHub
  • Re: [PR] Enable Storm dynamic producer batching in archetype configs and docum… [stormcrawler] via GitHub
• [PR] #2199 BasicURLNormalizer: split the query on & only, not on ; [stormcrawler] via GitHub
• [PR] Use commons-secure-xml for the XPath and DOM factories in core [stormcrawler] via GitHub
  • Re: [PR] Use commons-secure-xml for the XPath and DOM factories in core [stormcrawler] via GitHub
• [PR] XPathFilter: skip blank values and try the next expression [stormcrawler] via GitHub
  • Re: [PR] XPathFilter: skip blank values and try the next expression [stormcrawler] via GitHub
  • Re: [PR] XPathFilter: skip blank values and try the next expression [stormcrawler] via GitHub
• [GH] (stormcrawler/jsoup-xpath-single-conversion): Workflow run "Java CI with Maven" is working again! GitBox
• [GH] (stormcrawler/tika-jsoup-filters): Workflow run "Java CI with Maven" failed! GitBox
• [PR] Tika ParserBolt: apply the JSoupFilters to the documents parsed by Tika [stormcrawler] via GitHub
  • Re: [PR] Tika ParserBolt: apply the JSoupFilters to the documents parsed by Tika [stormcrawler] via GitHub
  • Re: [PR] Tika ParserBolt: apply the JSoupFilters to the documents parsed by Tika [stormcrawler] via GitHub
  • Re: [PR] Tika ParserBolt: apply the JSoupFilters to the documents parsed by Tika [stormcrawler] via GitHub
• [PR] docs: fix light-mode logo not displayed in versioned docs pages [stormcrawler-site] via GitHub
  • Re: [PR] docs: fix light-mode logo not displayed in versioned docs pages [stormcrawler-site] via GitHub
  • Re: [PR] docs: fix light-mode logo not displayed in versioned docs pages [stormcrawler-site] via GitHub
• [I] [Bug report] Logo not displayed in the documentation [stormcrawler] via GitHub
  • Re: [I] [Bug report] Logo not displayed in the documentation [stormcrawler] via GitHub
  • Re: [I] [Bug report] Logo not displayed in the documentation [stormcrawler] via GitHub
• [PR] #158 remove the DOM-based LDJsonParseFilter and LinkParseFilter [stormcrawler] via GitHub
  • Re: [PR] #158 remove the DOM-based LDJsonParseFilter and LinkParseFilter [stormcrawler] via GitHub
  • Re: [PR] #158 remove the DOM-based LDJsonParseFilter and LinkParseFilter [stormcrawler] via GitHub
• [PR] #158 jsoup XPathFilter: convert to W3C DOM once per page, not once per expression [stormcrawler] via GitHub
  • Re: [PR] #158 jsoup XPathFilter: convert to W3C DOM once per page, not once per expression [stormcrawler] via GitHub
  • Re: [PR] #158 jsoup XPathFilter: convert to W3C DOM once per page, not once per expression [stormcrawler] via GitHub
• Re: [I] wish: WARCHdfsBolt with CDX index [stormcrawler] via GitHub
  • Re: [I] wish: WARCHdfsBolt with CDX index [stormcrawler] via GitHub
• Re: [I] Capture stats about hosts on status stream post fetching [stormcrawler] via GitHub
  • Re: [I] Capture stats about hosts on status stream post fetching [stormcrawler] via GitHub
• Re: [I] New XPATH implementation based on JSON file and organised per hostname or domain [stormcrawler] via GitHub
  • Re: [I] New XPATH implementation based on JSON file and organised per hostname or domain [stormcrawler] via GitHub
• [GH] (stormcrawler/codex/prevent-slash-query-unmangling): Workflow run "Java CI with Maven" is working again! GitBox
• [GH] (stormcrawler/charset-protocol-prefix): Workflow run "Java CI with Maven" failed! GitBox
  • [GH] (stormcrawler/charset-protocol-prefix): Workflow run "Java CI with Maven" failed! GitBox
  • [GH] (stormcrawler/charset-protocol-prefix): Workflow run "Java CI with Maven" failed! GitBox
• [PR] #2250 CharsetIdentification: read the content type under the protocol prefix [stormcrawler] via GitHub
  • Re: [PR] #2250 CharsetIdentification: read the content type under the protocol prefix [stormcrawler] via GitHub
  • Re: [PR] #2250 CharsetIdentification: read the content type under the protocol prefix [stormcrawler] via GitHub
  • Re: [PR] #2250 CharsetIdentification: read the content type under the protocol prefix [stormcrawler] via GitHub
  • Re: [PR] #2250 CharsetIdentification: read the content type under the protocol prefix [stormcrawler] via GitHub
  • Re: [PR] #2250 CharsetIdentification: read the content type under the protocol prefix [stormcrawler] via GitHub
  • Re: [PR] #2250 CharsetIdentification: read the content type under the protocol prefix [stormcrawler] via GitHub
  • Re: [PR] #2250 CharsetIdentification: read the content type under the protocol prefix [stormcrawler] via GitHub
  • Re: [PR] #2250 CharsetIdentification: read the content type under the protocol prefix [stormcrawler] via GitHub
  • Re: [PR] #2250 CharsetIdentification: read the content type under the protocol prefix [stormcrawler] via GitHub
  • Re: [PR] #2250 CharsetIdentification: read the content type under the protocol prefix [stormcrawler] via GitHub
• [I] CharsetIdentification reads Content-Type under a key that is never present, so the HTTP charset is ignored [stormcrawler] via GitHub
  • Re: [I] CharsetIdentification reads Content-Type under a key that is never present, so the HTTP charset is ignored [stormcrawler] via GitHub
• [PR] build(deps): bump actions/setup-java from 6.0.1 to 6.1.0 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump actions/setup-java from 6.0.1 to 6.1.0 [stormcrawler] via GitHub
• [PR] build(deps): bump software.amazon.awssdk:bom from 2.55.13 to 2.56.0 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump software.amazon.awssdk:bom from 2.55.13 to 2.56.0 [stormcrawler] via GitHub
• [PR] build(deps): bump com.github.ben-manes.caffeine:caffeine from 3.3.0 to 3.3.1 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump com.github.ben-manes.caffeine:caffeine from 3.3.0 to 3.3.1 [stormcrawler] via GitHub
• [GH] (stormcrawler/2145-punycode-host-keys): Workflow run "Java CI with Maven" failed! GitBox
• [PR] #2145 Punycode the host in politeness, partition and robots.txt keys [stormcrawler] via GitHub
  • Re: [PR] #2145 Punycode the host in politeness, partition and robots.txt keys [stormcrawler] via GitHub
  • Re: [PR] #2145 Punycode the host in politeness, partition and robots.txt keys [stormcrawler] via GitHub
  • Re: [PR] #2145 Punycode the host in politeness, partition and robots.txt keys [stormcrawler] via GitHub
• [PR] #2212 retry 429 items and flush bulk requests by size [stormcrawler] via GitHub
  • Re: [PR] #2212 retry 429 items and flush bulk requests by size [stormcrawler] via GitHub
  • Re: [PR] #2212 retry 429 items and flush bulk requests by size [stormcrawler] via GitHub
  • Re: [PR] #2212 retry 429 items and flush bulk requests by size [stormcrawler] via GitHub
  • Re: [PR] #2212 retry 429 items and flush bulk requests by size [stormcrawler] via GitHub
• [PR] #2212 move the opensearch-java implementation into external/opensearch [stormcrawler] via GitHub
  • Re: [PR] #2212 move the opensearch-java implementation into external/opensearch [stormcrawler] via GitHub
  • Re: [PR] #2212 move the opensearch-java implementation into external/opensearch [stormcrawler] via GitHub
  • Re: [PR] #2212 move the opensearch-java implementation into external/opensearch [stormcrawler] via GitHub
  • Re: [PR] #2212 move the opensearch-java implementation into external/opensearch [stormcrawler] via GitHub
• [GH] (stormcrawler/migrate-httpclient5): Workflow run "Java CI with Maven" is working again! GitBox
  • [GH] (stormcrawler/migrate-httpclient5): Workflow run "Java CI with Maven" is working again! GitBox
• [GH] (stormcrawler/regenerate_license_file_after_dep_upgrade): Workflow run "Java CI with Maven" is working again! GitBox
  • [GH] (stormcrawler/regenerate_license_file_after_dep_upgrade): Workflow run "Java CI with Maven" is working again! GitBox
• [PR] build(deps): bump software.amazon.awssdk:bom from 2.55.10 to 2.55.13 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump software.amazon.awssdk:bom from 2.55.10 to 2.55.13 [stormcrawler] via GitHub
• [PR] build(deps): bump commons-codec:commons-codec from 1.22.1 to 1.23.0 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump commons-codec:commons-codec from 1.22.1 to 1.23.0 [stormcrawler] via GitHub
• [GH] (stormcrawler/codex/prevent-slash-query-unmangling): Workflow run "Java CI with Maven" failed! GitBox
  • [GH] (stormcrawler/codex/prevent-slash-query-unmangling): Workflow run "Java CI with Maven" failed! GitBox
• [PR] opensearch-java: fix the search_after values sent by HybridSpout [stormcrawler] via GitHub
  • Re: [PR] opensearch-java: fix the search_after values sent by HybridSpout [stormcrawler] via GitHub
  • Re: [PR] opensearch-java: fix the search_after values sent by HybridSpout [stormcrawler] via GitHub
• [PR] #2211 Migrate core to HttpClient 5 and preserve parsing behavior [stormcrawler] via GitHub
  • Re: [PR] #2211 Migrate core to HttpClient 5 and preserve parsing behavior [stormcrawler] via GitHub
  • Re: [PR] #2211 Migrate core to HttpClient 5 and preserve parsing behavior [stormcrawler] via GitHub
  • Re: [PR] #2211 Migrate core to HttpClient 5 and preserve parsing behavior [stormcrawler] via GitHub
  • Re: [PR] #2211 Migrate core to HttpClient 5 and preserve parsing behavior [stormcrawler] via GitHub
  • Re: [PR] #2211 Migrate core to HttpClient 5 and preserve parsing behavior [stormcrawler] via GitHub
  • Re: [PR] #2211 Migrate core to HttpClient 5 and preserve parsing behavior [stormcrawler] via GitHub
  • Re: [PR] #2211 Migrate core to HttpClient 5 and preserve parsing behavior [stormcrawler] via GitHub
  • Re: [PR] #2211 Migrate core to HttpClient 5 and preserve parsing behavior [stormcrawler] via GitHub
  • Re: [PR] #2211 Migrate core to HttpClient 5 and preserve parsing behavior [stormcrawler] via GitHub
  • Re: [PR] #2211 Core now depends only on HttpCore 5 [stormcrawler] via GitHub
  • Re: [PR] #2211 Core now depends only on HttpCore 5 [stormcrawler] via GitHub
• [GH] (stormcrawler/urlfrontier-spout-query-time): Workflow run "Java CI with Maven" is working again! GitBox
• [PR] URLFrontier Spout: report the query time [stormcrawler] via GitHub
  • Re: [PR] URLFrontier Spout: report the query time [stormcrawler] via GitHub
• [GH] (stormcrawler/dependabot/maven/commons-codec-commons-codec-1.23.0): Workflow run "Java CI with Maven" is working again! GitBox
• [PR] build(deps): bump langchain4j.version from 1.20.2 to 1.22.0 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump langchain4j.version from 1.20.2 to 1.22.0 [stormcrawler] via GitHub
• [PR] Add a Prometheus reporter for the Storm V2 metrics [stormcrawler] via GitHub
  • Re: [PR] Add a Prometheus reporter for the Storm V2 metrics [stormcrawler] via GitHub
  • Re: [PR] Add a Prometheus reporter for the Storm V2 metrics [stormcrawler] via GitHub
  • Re: [PR] Add a Prometheus reporter for the Storm V2 metrics [stormcrawler] via GitHub
  • Re: [PR] Add a Prometheus reporter for the Storm V2 metrics [stormcrawler] via GitHub
• [GH] (stormcrawler/status-updater-cache-counters): Workflow run "Java CI with Maven" is working again! GitBox
• [PR] fix: preserve query strings containing slashes [stormcrawler] via GitHub
  • Re: [PR] #2198 preserve query strings containing slashes [stormcrawler] via GitHub
  • Re: [PR] #2198 preserve query strings containing slashes [stormcrawler] via GitHub
  • Re: [PR] #2198 preserve query strings containing slashes [stormcrawler] via GitHub
  • Re: [PR] #2198 preserve query strings containing slashes [stormcrawler] via GitHub
  • Re: [PR] #2198 preserve query strings containing slashes [stormcrawler] via GitHub
  • Re: [PR] #2198 preserve query strings containing slashes [stormcrawler] via GitHub
  • Re: [PR] #2198 preserve query strings containing slashes [stormcrawler] via GitHub
  • Re: [PR] #2198 preserve query strings containing slashes [stormcrawler] via GitHub
  • Re: [PR] #2198 preserve query strings containing slashes [stormcrawler] via GitHub
  • Re: [PR] #2198 preserve query strings containing slashes [stormcrawler] via GitHub
• [PR] AbstractStatusUpdaterBolt: report cache hits/misses with a counter, not reset-on-read gauges [stormcrawler] via GitHub
  • Re: [PR] AbstractStatusUpdaterBolt: report cache hits/misses with a counter, not reset-on-read gauges [stormcrawler] via GitHub
• [GH] (stormcrawler/1901-pdf-max-pages): Workflow run "Java CI with Maven" is working again! GitBox
• [GH] (stormcrawler/proxy-round-robin): Workflow run "Java CI with Maven" is working again! GitBox
• [PR] MultiProxyManager: thread-safe round-robin rotation [stormcrawler] via GitHub
  • Re: [PR] MultiProxyManager: thread-safe round-robin rotation [stormcrawler] via GitHub
• [PR] #1901 Tika ParserBolt: limit the pages parsed in a PDF with parser.tika.pdf.maxpages [stormcrawler] via GitHub
  • Re: [PR] #1901 Tika ParserBolt: limit the pages parsed in a PDF with parser.tika.pdf.maxpages [stormcrawler] via GitHub
  • Re: [PR] #1901 Tika ParserBolt: limit the pages parsed in a PDF with parser.tika.pdf.maxpages [stormcrawler] via GitHub
  • Re: [PR] #1901 Tika ParserBolt: limit the pages parsed in a PDF with parser.tika.pdf.maxpages [stormcrawler] via GitHub
• Re: [I] URLPartitionerBolt to partition on arbitrary metadata value [stormcrawler] via GitHub
  • Re: [I] URLPartitionerBolt to partition on arbitrary metadata value [stormcrawler] via GitHub
  • Re: [I] URLPartitionerBolt to partition on arbitrary metadata value [stormcrawler] via GitHub
• [GH] (stormcrawler/spout-benchmark): Workflow run "Java CI with Maven" is working again! GitBox
• [PR] Add SpoutBenchmark to measure the read performance of spouts [stormcrawler] via GitHub
  • Re: [PR] Add SpoutBenchmark to measure the read performance of spouts [stormcrawler] via GitHub
• [GH] (stormcrawler/2197): Workflow run "Java CI with Maven" failed! GitBox
• [PR] opensearch-java: send bulk requests with the OpenSearchAsyncClient [stormcrawler] via GitHub
  • Re: [PR] opensearch-java: send bulk requests with the OpenSearchAsyncClient [stormcrawler] via GitHub
  • Re: [PR] opensearch-java: send bulk requests with the OpenSearchAsyncClient [stormcrawler] via GitHub
  • Re: [PR] opensearch-java: send bulk requests with the OpenSearchAsyncClient [stormcrawler] via GitHub
• [PR] URLFrontier StatusUpdaterBolt: cheaper bookkeeping of the acks [stormcrawler] via GitHub
  • Re: [PR] URLFrontier StatusUpdaterBolt: cheaper bookkeeping of the acks [stormcrawler] via GitHub
• [PR] StatusUpdaterBenchmark: run several instances of the status updater in parallel [stormcrawler] via GitHub
  • Re: [PR] StatusUpdaterBenchmark: run several instances of the status updater in parallel [stormcrawler] via GitHub
• [PR] build(deps): bump org.apache.commons:commons-lang3 from 3.20.0 to 3.21.0 [stormcrawler] via GitHub

• Earlier messages