Re: Possible bug in internal SolR communication when the CertAuthPlugin is active

2021-04-01 Thread Mike Drob
Hello Dominik, The mailing list strips attachments, so we’re not able to see your Admin UI errors. If you can create a jira issue to track this, that would be great. I don’t remember testing adding a response writer when working in the plugin, so it’s very possible that there is a bug. If possib

[ANNOUNCE] Apache Solr 8.8.2 released

2021-04-12 Thread Mike Drob
The Solr PMC is pleased to announce the release of Apache Solr 8.8.2 Solr is the popular, blazing fast, open source NoSQL search platform from the Apache Lucene project. Its major features include powerful full-text search, hit highlighting, faceted search and analytics, rich document parsing, geo

CVE-2021-29943: Apache Solr Unprivileged users may be able to perform unauthorized read/write to collections

2021-04-12 Thread Mike Drob
Description: When using ConfigurableInternodeAuthHadoopPlugin for authentication, Apache Solr versions prior to 8.8.2 would forward/proxy distributed requests using server credentials instead of original client credentials. This would result in incorrect authorization resolution on the receiving h

CVE-2021-29262: Apache Solr: Misapplied Zookeeper ACLs can result in leakage of configured authentication and authorization settings

2021-04-12 Thread Mike Drob
allow it to be readable. Additionally, with any ZkACLProvider, if the security.json is already present, Solr will not automatically update the ACLs. This issue is being tracked as SOLR-15249 Mitigation: Manually set appropriate ACLs on /security.json znode. Credit: Timothy Potter and Mike Drob

CVE-2021-27905: Apache Solr: SSRF vulnerability with the Replication handler

2021-04-12 Thread Mike Drob
Description: The ReplicationHandler (normally registered at "/replication" under a Solr core) has a "masterUrl" (also "leaderUrl" alias) parameter that is used to designate another ReplicationHandler on another Solr core to replicate index data into the local core. To prevent a SSRF vulnerability

Re: Building on Mac OS X Catalina

2021-04-15 Thread Mike Drob
OpenJDK 11 is fine for building the main (9x) branch. This is probably https://issues.apache.org/jira/browse/SOLR-14084 or https://issues.apache.org/jira/browse/SOLR-15222 and happens sometimes when the test randomization includes the security policy. It's something I've been wanting to look at b

Re: API for Threads info

2021-06-03 Thread Mike Drob
It’s basically a random number to prevent http response caching. On Wed, Jun 2, 2021 at 4:17 PM Raveendra Yerraguntla wrote: > All, > I am trying to collect threads info across a huge cluster > Based on the Network calls from https://localhost:port/solr/#/~threads. > - https://localhost:por

Re: Migration from NRT to TLOG performance issues

2021-06-11 Thread Mike Drob
Are you using HDFSDirectory to serve your indices? I noticed that tlogDfsReplication is set, so that's why I'm asking. 8 maxWarmingSearchers is very high, typically that value is 2 or maybe 4, but you would know if this was an issue by looking at your logs. I'm assuming that you had 30 NRT repl

Re: Migration from NRT to TLOG performance issues

2021-06-11 Thread Mike Drob
99, which is still higher than NRT > result, but better than it was. > > I also tried with only TLOG replicas, and the results are more or less the > same, ~340ms p99 and ~110ms p95. So, both are slower, TLOG + PULL and TLOG > only. > > > > > On 11. Jun 2021, at 5

Re: Defense against deep paging?

2021-06-25 Thread Mike Drob
This was discussed somewhat in https://issues.apache.org/jira/browse/SOLR-15252 with no implementation provided. On Fri, Jun 25, 2021 at 11:52 AM Walter Underwood wrote: > > I already said that we have a limit in the client code. I’m asking about a > limit in Solr. > > wunder > Walter Underwood

Re: Reads only on replicas?

2021-06-28 Thread Mike Drob
8.9 has just been released, so if there is an 8.10 then it will likely be 1-3 months out based on historical trends. No promises or guarantees here, of course. On Mon, Jun 28, 2021 at 3:47 PM Stephen Lewis Bianamara < stephen.bianam...@gmail.com> wrote: > Hi Folks, > > I'm happy to say that Wei's

Re: Solr stop doesn't cope with zombie process - should it?

2021-07-21 Thread Mike Drob
That seems like a reasonable check to add, the only caution I would advise is that a lot of developers use macs for local testing so make sure that whatever flags you invoke are generally cross platform compatible, or hidden behind appropriate conditions. On Wed, Jul 21, 2021 at 5:59 AM Colvin Cow

Re: Solr nodes crashing

2021-07-21 Thread Mike Drob
You may want to look into enabling docvalues for your fields in your scheme, if not already enabled. That often helps with memory usage during query, but requires a reindex of your data. There are also first searches and new searches queries you can configure in your Solr config, those would be ab

Re: Solr Jira Create bug not working

2021-09-30 Thread Mike Drob
It’s possible that your account got flagged as suspicious based on the content of your bug report by the automated spam filters. Something like including phone numbers would do it, which might unfortunately be a valid part of your data. Can you share some of the bug report details here on list? O

Re: Solr Jira Create bug not working

2021-09-30 Thread Mike Drob
Never mind, I see your other email to the dev list now On Thu, Sep 30, 2021 at 2:47 PM Mike Drob wrote: > It’s possible that your account got flagged as suspicious based on the > content of your bug report by the automated spam filters. Something like > including phone numbers wo

Re: Solr and CVE-2021-44228

2021-12-10 Thread Mike Drob
Solr is affected. Please see the statement at the https://solr.apache.org/security.html page On Fri, Dec 10, 2021 at 12:44 PM Walter Underwood wrote: > Does all Solr logging go through slf4j? If so, that should protect against > this vulnerability. > > If not, who has tested Solr with log4j 2.15

Re: Solr and CVE-2021-44228

2021-12-10 Thread Mike Drob
indicates that you should be protected if you are using > > Java 11.0.1 and up > > > > https://www.lunasec.io/docs/blog/log4j-zero-day/ > > > > On Fri, Dec 10, 2021 at 3:07 PM Mike Drob wrote: > > > > > Solr is affected. Please see the statement at

Re: Solr and CVE-2021-44228

2021-12-10 Thread Mike Drob
be in the same > situation as the pre 7.0 releases. > > Is this correct? > > - Andy - > > On Fri, Dec 10, 2021 at 4:32 PM Mike Drob wrote: > > > If you are opting in to using a lookup capable appender then you are > > vulnerable. I don’t have a POC for testing

Re: Solr and CVE-2021-44228

2021-12-10 Thread Mike Drob
prior to 7.0 (i.e. all Solr 5 > and Solr 6 releases) use log4j 1.2.17". > > 7.0 should be updated to 7.4. > > - Andy - > > On Fri, Dec 10, 2021 at 5:10 PM Mike Drob wrote: > > > Andy - you are correct, we will update the notice on the site. Thank you > > fo

Re: Question Apache Solr 7.7.0, 8.7 and 8.9 - log4j vulnerability

2021-12-14 Thread Mike Drob
You can download log4j at https://logging.apache.org/log4j/2.x/download.html When replacing the jar files, you will also need to restart your services. On Tue, Dec 14, 2021 at 9:30 AM Manisha Rahatadkar < manisha.rahatad...@anjusoftware.com> wrote: > Hello all > > > > We are using Apache Solr 7

Re: Log4J saga (CVE-2021-45046)

2021-12-15 Thread Mike Drob
That should be sufficient based on our current understanding of the situation, yes. On Wed, Dec 15, 2021 at 12:53 PM Scott Derrick wrote: > I find these files in my solr install > > ./server/lib/ext/log4j-core-2.11.0.jar > ./server/lib/ext/log4j-1.2-api-2.11.0.jar > ./server/lib/ext/log4j-api-2.

Re: Problem with Join query and FilterCache

2022-01-20 Thread Mike Drob
Yep, you should change from LRUCache to CaffeineCache in your solrconfig.xml The page that error message refers to is https://solr.apache.org/guide/8_11/query-settings-in-solrconfig.html#caches Mike On Thu, Jan 20, 2022 at 4:50 AM PatentPulse wrote: > Hello, > > > > We updated SOLR to 8.11.0 a

Re: Solr core is getting deleted on system reboot.

2022-01-24 Thread Mike Drob
Make sure you’re not using /tmp for your data directory. Do you see deletions on system reboot only or also process restart? On Mon, Jan 24, 2022 at 12:37 PM Modassar Ather wrote: > Hi, > > Please provide your suggestions to fix the issue. Is there some > configuration which I am missing so the

Re: Solr custom file types

2022-01-26 Thread Mike Drob
I suspect the missing libraries are somehow related to https://github.com/Unidata/netcdf-java Mike On Wed, Jan 26, 2022 at 6:32 PM Shawn Heisey wrote: > On 1/26/2022 5:10 PM, Mike Domzalski wrote: > > Server ErrorCaused > by:java.lang.NoClassDefFoundError: ucar/nc2/NetcdfFile > > a

Re: Memory and thread leak using SolrJ

2022-02-04 Thread Mike Drob
SolrClient has a close() method. On Fri, Feb 4, 2022 at 8:41 PM Walter Underwood wrote: > Is the code talking to 10,000 different Solr servers? > > Create one SolrClient per server and reuse it for all traffic to that > server. It keeps a pool of connections. > > wunder > Walter Underwood > wun.

Re: High CPU utilisation on Solr-8.11.0

2022-03-26 Thread Mike Drob
Can you provide more details on what they CPU time is spent on? Maybe look at some JFR profiles or collect several jstacks to see where they bottlenecks are. On Sat, Mar 26, 2022 at 3:49 AM Modassar Ather wrote: > Hi, > > We are trying to migrate to Solr-8.11.0 from Solr-6.5.1. Following are the

Re: Solr - Spring cloud – CVE-2022-22963

2022-04-05 Thread Mike Drob
Rajath, All of our known and disclosed security vulnerabilities are posted to https://solr.apache.org/security.html If something is not listed there than it is either not known, not disclosed, or not a problem. If you believe you have discovered a new vulnerability please follow the reporting gui

Re: Solr 8.10.1 performance degradation vs Solr 6.6.1

2022-04-06 Thread Mike Drob
Can you try running with debug=query to see if the two are getting parsed differently? On Wed, Apr 6, 2022 at 8:26 AM Sergio García Maroto wrote: > Forgot to mention. > Solr 8 = 5 seconds > Solr 6 = 1 second > > On Wed, 6 Apr 2022 at 14:58, Sergio García Maroto > wrote: > > > Hi, > > > > I am

Re: Need help with DIH plugin SOLR

2022-04-08 Thread Mike Drob
Hi Dominique, Are there any guides available on using Nifi ETL with Solr? What do you consider to be good references for it? Thanks, Mike On Wed, Apr 6, 2022 at 3:56 PM Dominique Bejean wrote: > Hi, > > I suggest to take a look at Apache Nifi ETL in order to replace DIH. It can > read and writ

Re: solr not picking security.json config

2022-05-14 Thread Mike Drob
What version of Solr are you using? Are there errors in your logs? On Fri, May 13, 2022 at 10:26 AM Gummadi, Ramesh < rameshchandra.gumm...@ironmountain.com> wrote: > Hi, I have this configuration for security.json. I uploaded it to the > zookeeper. Solr is not picking the role collectionreadwri

Re: Upgrade SOLR 7.3 to 8.9,json.facet query performance drops a lot

2022-05-31 Thread Mike Drob
I don't think this will make a huge difference, but would you be able to retest with Solr 8.11.1 instead of 8.9? Mike On Tue, May 31, 2022 at 10:54 AM slly wrote: > Hello everyone. > > > We recently upgraded our online environment to a new solr version(8.9.0) > from 7.3, we found that facet que

[ANNOUNCE] Apache Solr 8.11.2 released

2022-06-21 Thread Mike Drob
The Lucene and Solr PMCs are pleased to announce the release of Apache Solr 8.11.2. Solr is the popular, blazing fast, open source NoSQL search platform from the Apache Lucene project. Its major features include powerful full-text search, hit highlighting, faceted search, dynamic clustering, da

Re: Cannot SSL-secure Solr 8 on Java 1.8 JRE (HTTP/1 , HTTP/2 issue)

2022-08-17 Thread Mike Drob
I think this is covered in the ref guide https://solr.apache.org/guide/8_11/major-changes-in-solr-8.html#ssl-support-with-http2 In order to support SSL over HTTP/2 connections, Solr uses ALPN. Java 8 does not include an implementation of ALPN, therefore Solr will start with HTTP/1 only when SSL i

Re: mod function applied to ms function not working correctly

2022-08-31 Thread Mike Drob
I think this is https://issues.apache.org/jira/browse/SOLR-16361 which is already being worked on, and should be fixed in there next release. I don’t think we have a workaround currently. Mike On Wed, Aug 31, 2022 at 4:07 PM gnandre wrote: > mod function is not returning correct values when app

Re: SQL module does not work in Solr release 9.0.0

2022-09-24 Thread Mike Drob
The mailing list removes images, you may need to upload them and link from an external service. On Sat, Sep 24, 2022 at 7:22 AM Farrukh Zamir wrote: > Also i am seeing this error in log while /sql handler is initialized. > [image: Untitled23.png] > > On Sat, Sep 24, 2022 at 2:16 PM Farrukh Zamir

Re: Solr7 / 8 interop

2022-09-25 Thread Mike Drob
This is likely the same situation described in the upgrade notes: https://solr.apache.org/guide/8_11/solr-upgrade-notes.html#solr-8-5 Solr 8.5 introduces a change in the format used for the elements in the Overseer queues and maps Please let us know if that matches and helps Mike On Sun, Sep 25

Re: group=true solrcloud 8.11

2022-12-07 Thread Mike Drob
Have you tried the group.main and group.query options? https://solr.apache.org/guide/8_11/result-grouping.html#grouping-examples On Wed, Dec 7, 2022 at 4:16 PM James Greene wrote: > Is the group=true functionality supposed to work in solrcloud 8.11? I've > tried the most basic options and rec

Re: Solr Operator Autoscaling

2023-05-27 Thread Mike Drob
I don’t know much about this area, but it looks like there will be a session on exactly this at Berlin Buzzwords in a few weeks! https://program.berlinbuzzwords.de/berlin-buzzwords-2023/talk/ELVNYV/ On Sat, May 27, 2023 at 10:59 AM Aurélien MAZOYER < aurelien.mazo...@gmail.com> wrote: > Hello So

Re: Re-index after upgrade

2023-08-25 Thread Mike Drob
One thing that makes the cutover easier would be using aliases feature in your Solr cloud. You have old data in something like collection_2022 and the alias is just collection. Then new index format with new Solr version goes to collection_2023 assuming you have the spare space and CPU. Do some te

Re: Suggestions to improve Star queries latencies

2023-11-17 Thread Mike Drob
Maybe also experiment with cache=false On Fri, Nov 17, 2023 at 2:38 PM Mikhail Khludnev wrote: > > What causes this issue? > You may try to find an answer with distrib=false and debug=timing > > > On Fri, Nov 17, 2023 at 8:49 PM rajani m wrote: > > > Hi again, > > > > Thank you for all the

Re: my solr 8.11 is indexing 5000 only using custom code.

2023-12-17 Thread Mike Drob
You can! https://lists.apache.org/thread/brw7r0cf0t0m1wltxg5sky6t6d9crgxm On Sun, Dec 17, 2023 at 3:12 PM Vince McMahon wrote: > Thanks, Gus. I wish I can "bookmark this reply. lol. > > On Sat, Dec 16, 2023 at 11:10 PM Gus Heck wrote: > > > Yes. see the detectChangesViaHashing option here: > >

Re: Node roles vs SIP-20 Separation of Compute and Storage

2024-01-17 Thread Mike Drob
Don’t we already have implementation for shared storage backend using HDFS (and S3 transitively through the HDFS-S3 connectors)? On Wed, Jan 17, 2024 at 5:26 AM Ilan Ginzburg wrote: > HI, > Thanks for asking that question. > > The separation of compute and storage would be relevant for the nodes

Re: 3x+ performance reduction for the prefixed wildcard fl (like fl=abc_*) in 9.5.0 compared to 9.4.1

2024-02-26 Thread Mike Drob
Since the change was released, please create a new Jira. That way future software archaeologists can track which version has the degradation and which version has the fix. On Mon, Feb 26, 2024 at 7:41 AM Justin Sweeney wrote: > I can take another look at this. Changed the implementation for matc

Re: Solr not distributing search requests among replicas

2021-03-10 Thread Mike Drob
I believe a server will always try to prefer local cores. Can you do an experiment with 3 nodes, and send http queries to the node not hosting any replicas? That should confirm the balanced distribution. If you have multiple shards, the receiving server will forward the requests for shards it does

Re: Solr not distributing search requests among replicas

2021-03-10 Thread Mike Drob
on you're > : > : > : > > running (8.4) you might also take a look at > : > : > : > > https://issues.apache.org/jira/browse/SOLR-14471 < > https://issues.apache.org/jira/browse/SOLR-14471>. (If SOLR-14471 is the > : > : > : > > problem, remov

Re: Best throttling / push-back strategy for updates?

2021-03-11 Thread Mike Drob
The new circuit breakers might be able to offer some rate limiting. On Thu, Mar 11, 2021 at 6:25 PM Jan Høydahl wrote: > Yes, that is what I'm recommending customers right now, to manually match > indexing threads with CPUs, and that is the "manual" way. > > My question was rather whether we hav

Re: Solr 8 Reference Guide Not Loading Properly

2025-03-19 Thread Mike Drob
In the web console I see errors relating to unable to find jquery. Did we remove it at some point? Or link to a wrong version? On Wed, Mar 19, 2025 at 4:37 PM Chris Hostetter wrote: > > : I'm not able to see any article text on the webpages for Solr Reference > : Guide versions 8.6 through 8.11