Confirmation - Object Storage

Hello, Just want to confirm that while Solr provides a backup/restore API to S3 - object storage - there is no option to run Solr on object storage. Is this correct? Thanks, Matt

LTS, UserManaged Mode

Hello, Does Solr mark any versions for Long Term Support (LTS) like other technology? I have not seen this, but wanted to check. I realize that SolrCloud is the recommended approach. Are there any concerns of Solr user-managed-mode being deprecated in 1 year, 3 years, 5 years or 10 years? User

Re: Confirmation - Object Storage

Hi Jan, Do you know if there would be many hurdles to implement SOLR SIP-20 with on-prem object storage rather than say S3 in the cloud? Matt On Tue, Oct 15, 2024 at 5:28 PM mtn search wrote: > Thanks Jan! > > On Tue, Oct 15, 2024 at 4:46 PM Jan Høydahl wrote: > >> Hi, >

Security - Solr in UserManaged Mode

Hello, I see from the documentation - https://solr.apache.org/guide/solr/latest/deployment-guide/securing-solr.html - there are a number of options to secure Solr. Any recommendations for securing Solr in User-Managed mode? Particularly how to handle these cases: - Security between leader and

Re: Security - Solr in UserManaged Mode

.png] On Mon, Sep 23, 2024 at 12:18 PM mtn search wrote: > Hello, > > I see from the documentation - > https://solr.apache.org/guide/solr/latest/deployment-guide/securing-solr.html > - there are a number of options to secure Solr. > > Any recommendations for securing Solr i

Re: Security - Solr in UserManaged Mode (Encrypted Delivery)

> [image: The Hartford] <https://www.thehartford.com/> > > The Hartford > 83 Wooster Heights Rd. | 2nd floor > Danbury, CT, 06810 > W: 475-329-6251 > > Email: richard.hod...@thehartford.com > > www.thehartford.com > www.facebook.com/thehartford > twitter.com/th

Re: Confirmation - Object Storage

Thanks Jan! On Tue, Oct 15, 2024 at 4:46 PM Jan Høydahl wrote: > Hi, > > That is correct. But plans are being made to add such support: > https://cwiki.apache.org/confluence/display/SOLR/SIP-20%3A+Separation+of+Compute+and+Storage+in+SolrCloud > > Jan > > > 15. ok

Solr 6.x Distributed Search to Solr 8.x SolrCloud

Hello Solr Users, Starting on a project to transition a very large number of Solr 6 servers (master/slave) to Solr 8.x SolrCloud. The current query approach involves a Distributed Index search (specifying the appropriate Solr 6 shards for each query). One thought to maintain current query strate

Solr 8.8.2 Error on Distributed Index Query

Hello, Has anyone observed a Distributed Index Query against a Solr 8 server fail when a shard outside the cluster (and from a different Solr version) is specified in the shards list? Note the shard white list is disabled. This type of query works in both Solr 6.4.2 and 7.7.3 combinations, but n

Re: Solr 8.8.2 Error on Distributed Index Query

e > problem when comparing field values for sorting. As for date field type > for example, old Lucene used > java.util.Date (I'm sorry if it's wrong, but this is just an example) > while if the latest Lucene > uses long, you'll get runtime exception when you try to sort on

Number of Collections in a SolrCloud

Hello, I am interested to learn what others have experienced in terms of hitting a limit for the number of collections supported by a SolrCloud instance. Also, does anyone have any tips/questions for evaluating when to create a new SolrCloud and begin adding new collections to it rather than grow

Re: Number of Collections in a SolrCloud

on the master nodes of a legacy master/slave installation to SolrCloud. I figure that we will push the limits of a single SolrCloud instance. Thanks again, Matt On Fri, Jun 25, 2021 at 10:15 AM mtn search wrote: > Hello, > > I am interested to learn what others have experienced in

Re: Number of Collections in a SolrCloud

f our high numbers 8 > threads would take forever upon startup (look at 'coreLoadThreads') . At > the very least, perf test out something on a similar scale of what you're > thinking and see how it scales. > Best of Luck, > Brian > > On Mon, Jun 28, 2021 at 1

Quick Query Question: "body":""

Hello, Some documents in my collection have an empty body field. "body":"", I am looking for a query to find docs with a body field with this "empty" value. Normally, I might run with a filter fq=-body:* On this large set of shards that I am querying it times out with the wildcard. On

Re: Quick Query Question: "body":""

he schema, it matches a boolean field > definition for most efficiency. > > Regards, >Alex. > > On Wed, 28 Jul 2021 at 11:55, mtn search wrote: > > > > Hello, > > > > Some documents in my collection have an empty body field. > > "body":

Delete using Streaming Expressions

Hello, I have heard that there can be issues when using the Solr delete by query approach ( *:*) for large sets of documents. That it may block other indexing activities... I have also heard that using Solr Streaming Expressions would be a better approach, more efficient for large doc sets to be

Re: Delete using Streaming Expressions

Thanks Jan - Exactly what I was looking for. Matthew On Fri, Aug 13, 2021 at 3:35 AM Jan Høydahl wrote: > Please see > https://solr.apache.org/guide/8_9/stream-decorator-reference.html#delete > > Jan > > > 12. aug. 2021 kl. 21:05 skrev mtn search : > > > >

Solr Best Practices

Hello Solr Group, Is there a general summary page of Solr best practices? And particularly one for sizing Solr nodes, shards, and collections? Thanks, Ed

Re: Solr and CVE-2021-44228

Thanks for the information Mike! I noticed that on https://solr.apache.org/security.html it lists the following statement for Solr releases prior to 7: Apache Solr releases prior to 7.0 (i.e. all Solr 5 and Solr 6 releases) use log4j 1.2.17 which may be vulnerable for installations using non-defa

Re: Solr and CVE-2021-44228

nly be > affected if you’re using this functionality explicitly > > On Fri, Dec 10, 2021 at 3:21 PM mtn search wrote: > > > Thanks for the information Mike! > > > > I noticed that on https://solr.apache.org/security.html it lists the > > following statement for Sol

Solr 6 Replication - Trouble Shooting

Hello, While our team is building out a SolrCloud solution for our product we are still needing to maintain the product in production which uses Solr 6 (master/slave configuration). We regularly encounter Replication failures between the slaves and the master. I have used the following api call

Re: Solr 6 Replication - Trouble Shooting

22 at 3:19 PM Shawn Heisey wrote: > On 1/3/2022 2:21 PM, mtn search wrote: > > From the Solr Admin UI > (server:8080/solr/old.html#/collection1/replication) > > I can select the Replicate Now button. This will successfully replicate > > once, but not restart the periodic

TLOG Replicas

Hello, I am considering using TLOG replicas in the next phase of our project. I understand that this type has been around since Solr 7. I am curious how much use TLOG replicas are getting within Solr deployments across the board and if there are any gotchas to look out for. We are currently run

SolrCloud HOT|HOT HA Arch

Hello, My team is looking to deploy Solr 8 SolrCloud on two on-prem datacenters via EKS. We are considering a HOT | HOT HA architecture between the data centers where data would be indexed (duplicated) to SolrCloud instances in both datacenters. Then via service (to be worked out) queries could g

How to clear vulnerability test errors

Hello, Our company recently started running vulnerability tests against our Solr 6 servers by sending api calls to create cores with the core names being a nefarious string. This string is actually an invalid core name and so the core is not actually created (which is good). However, it adds the

Re: How to clear vulnerability test errors

ome. > > > > > > > > The most straightforward defense here is to do IP-based restriction > on > > > > the jetty-level to only allow admin calls from localhost + (maybe) > > > > other solr servers. > > > > > > > > Different ver

Solr and Spring Core Framework - CVE-2022-22965

Hello, A couple questions: Any information if Solr 6.x and later uses the Spring Core Framework? Any information if Solr 6.x and later is vulnerable to CVE-2022-22965: Spring Framework RCE via Data Binding on JDK 9+? https://tanzu.vmware.com/security/cve-2022-22965 Thanks, Matt

Re: Solr 8.4.0 | Solr Slave | Invalid Master Issue

Hi Saquib In an older version of Solr configured for Master/Slave, I have the masterUrl field set to the url to the collection. I do not have "/replication" added to the end of the URL. Give *https://solr1.mdi.com.eg:8983/solr/sit.mdi_core_index

Re: Solr 8.4.0 | Solr Slave | Invalid Master Issue

I should say https://solr1.mdi.com.eg:8983/solr/sit.mdi_core_index a try On Wed, Apr 13, 2022 at 11:21 AM mtn search wrote: > Hi Saquib > > In an older version of Solr configured for Master/Slave, I have > the masterUrl field set to the url to the collection. I do not have >

After Solr restart disk space freed up

Hello, I have noticed that after restarting a Solr instance (particularly when the disk storing the index has filled up) that more disk space is available. I am familiar with the Solr merge process, but understand that it removes deleted docs in the background while Solr is running. What is goin

Re: After Solr restart disk space freed up

at 2:04 PM mtn search wrote: > Hello, > > I have noticed that after restarting a Solr instance (particularly when > the disk storing the index has filled up) that more disk space is > available. > > I am familiar with the Solr merge process, but understand that it removes

Solr Security - BYOK

Hello, My leadership is wondering to what extent Solr supports BYOK encryption, and/or if it is on the roadmap. Any info on this topic? I did not see much in my initial look. Thanks, Matt

Solr 6 Replication question

Hello, I am learning more about replication as I maintain a large Solr 6 set of Solr servers configured for Master/Slave. I noticed during some replication activities in addition to the original index dir under the core name on the file system is a dir named "index" with a timestamp. index.. Fi

Re: Solr 6 Replication question

against the core in question. On Mon, Oct 10, 2022 at 12:38 PM mtn search wrote: > Hello, I am learning more about replication as I maintain a large Solr 6 > set of Solr servers configured for Master/Slave. > > I noticed during some replication activities in addition to the original >

Re: Solr 6 Replication question

ady to handle this you’re going to eventually run into some serious > issues, or just not be able to replicate > > -dave > > > On Oct 10, 2022, at 2:56 PM, mtn search wrote: > > > > As I go back through > > https://solr.apache.org/guide/6_6/index-replication.

Re: Solr 6 Replication question

ch > > Take care and good luck. Also another tip from experience, use only one > slave for queen and have the others as backup, as a single server can cache > the fields way faster than round robin or whatever other metric uses to > determine who serves. > -Dave > > > &g

How to run many SolrClouds within a single K8s cluster?

Hello, We have a single SolrCloud running in K8s (dev env) by implementing a Zookeeper stateful set and a Solr node stateful set. On startup the Solr pods connect to the ZK ensemble defined in the ZK stateful set. If we wanted more SolrClouds in this K8s cluster, would we create more stateful se

Solr 8/9 and JMX

Hello, We are transitioning from Solr 6 to Solr8/9. In the past we have enabled JMX in production to access MBean solr and jvm metrics. It appears a good bit has changed in terms of Solr metrics configuration as I read the docs. However, it looks like enabling JMX is still an option - https://so

SolrJ client question

Hello, What is the guidance regarding when to reuse versus when to recreate a SolrJ client? Specifically, the app in question is a provisioning app that will periodically create collections/aliases for a client. The calls to SolrJ might be hours to sometimes days apart. Querying/Indexing is han

Re: SolrJ client question

Thanks Shawn and Eric! On Tue, May 30, 2023 at 2:57 PM Eric Pugh wrote: > I think that creating it when you run it and closing it will be just > fine. As Shawn said, it’ll be “well under a second” ;-)./ > > > On May 30, 2023, at 2:01 PM, Shawn Heisey wrote: > > >

Solr 6 - unexpected docvalues type NONE for field

Hello, Any tips as to why this error is occurring? Occurs with query when sorting on sortableSender or other fields with docvalues set to false. Plan to re-index, but would like to better understand this issue. Why would it expect "=SORTED" when docvalues is set to false? Solr version 6.4.2 6

Re: Solr 6 - unexpected docvalues type NONE for field

the core but also wondered if we needed to take further action. Your email confirms that we should delete the index (and files/dirs) before re-indexing. Thanks again, Matt On Mon, Jun 12, 2023 at 12:28 PM Shawn Heisey wrote: > On 6/12/23 10:24, mtn search wrote: > > Any tips as to

docValues question

Hello, If the dest field of a copyField action has docValues=true, does that require the source field to also have docValues turned on? Found this config in our historical Solr 6 schema and wondered if it is valid: Thanks, Matt

Solr Operator - Multiple PV/PVC for Zookeeper

Hello, Zookeeper documentation recommends separate storage devices for datadir and datalogdir. https://zookeeper.apache.org/doc/r3.6.4/zookeeperAdmin.html *Advanced Configuration* The configuration settings in the section are optional. You can use them to further fine tune the behaviour of your

Re: doc values type=SORTED to inconsistent type=NONE

I believe I have run into the same error when someone made a change to docvalues setting. My understanding, and what we did, the only solution is to delete the index and recreate. https://solr.apache.org/guide/solr/latest/indexing-guide/reindexing.html Matt On Mon, Aug 14, 2023 at 2:23 PM raja

Default Shard Placement Question

Hello, Based on observation it appears that SolrCloud will place shard replicas for a shard on different Solr nodes/instances (i.e. not place 2 shard replicas for the same shard on the Solr node) as long as there are an equal or greater number of Solr nodes/instances relative to the number of shar

Solr 6 Replication Question

Hello, While building/deploying a new SolrCloud based solution our team is still maintaining a Solr 6 M/S large deployment, and I have a replication question. We are in a situation where we likely need to take down our set of primary slave cores. My understanding is that there is a point where S

Re: Solr 6 Replication Question

Realized my question was not very clear. It pertains to when we bring the primary cores back up, after X number of days, how does Solr determine to do an standard replication of updates or a full replication of the set of index files. On Thu, Mar 7, 2024 at 4:12 PM mtn search wrote: > He

Re: Solr 6 Replication Question

is helpful information. > > Matt > > On Fri, Mar 8, 2024 at 2:26 AM Shawn Heisey > wrote: > > > On 3/7/24 16:22, mtn search wrote: > > > Realized my question was not very clear. It pertains to when we bring > > the > > > primary cores back up, a

SolrCloud behavior when Zookeeper has lost a quorum.

Hello, Will a SolrJ client connection (configured with a ZKhost list) to a SolrCloud still work for querying a SolrCloud when the Zookeeper ensemble has lost its quorum, but some ZK nodes remain up? I understand that indexing will not work. Follow-on - will the Solr query work to the same SolrCl

Solr 6 - org.apache.lucene.index.CorruptIndexException

Hello, We are in the process of moving to SolrCloud Solr 9, but my team is still maintaining a *large Solr 6 farm (Solr/Lucene 6.4.2).* In the last 6 months we have noticed a good number of CorruptIndexException errors. Most, if not all, we relate to an event on Vsphere where a large number of V

Collection Backup API

Hello, Does the Backup API - https://solr.apache.org/guide/solr/latest/deployment-guide/collection-management.html#backup - work if there is live indexing going on to the collection while the backup is in progress? Thanks, Matt

Re: Collection Backup API

And the same question for the Snapshot API - https://solr.apache.org/guide/solr/latest/deployment-guide/backup-restore.html#create-snapshot-api On Fri, Jul 26, 2024 at 9:28 AM mtn search wrote: > Hello, > > Does the Backup API - > https://solr.apache.org/guide/solr/latest/depl

Re: Collection Backup API

to be executed against the index as usual. With that said if anyone has any tips/warnings for using the backup/restore API feel free to share. On Fri, Jul 26, 2024 at 9:35 AM mtn search wrote: > And the same question for the Snapshot API - > https://solr.apache.org/guide/solr/latest/deployment-

Re: Collection Backup API

and it will represent data from > > the latest index commit point. All indexing and search operations will > > continue to be executed against the index as usual. > > > With that said if anyone has any tips/warnings for using the backup/restore > API feel free to share. >

Tlog replica - SolrCloud

Hello, Any suggestions for troubleshooting a situation where a TLOG replica is not up to date with its leader replica, and over time will not update? Logs not showing anything in terms of Errors/Warnings. It appears replication is not happening between the replicas. Not sure if there is a bette

Re: Tlog replica - SolrCloud

Looked a further back in logs, and found a single log related to this shard in the last month, which I am sure relates. However, the t1 replica for shard2 no longer exists. [image: image.png] On Fri, Aug 2, 2024 at 1:19 PM mtn search wrote: > Hello, > > Any suggestions for troubles

Re: Tlog replica - SolrCloud

Nevermind the last post. That log is for a different collection... I am trying to confuse myself :) On Fri, Aug 2, 2024 at 1:53 PM mtn search wrote: > Looked a further back in logs, and found a single log related to this > shard in the last month, which I am sure relates. However,

Re: Collection Backup API

> The backup command is an asynchronous call, and it will represent data > from > > > the latest index commit point. All indexing and search operations will > > > continue to be executed against the index as usual. > > > > > > With that said if anyone has any ti

oom_solr.sh

Hello, oom_solr.sh is provided by Solr to kill the solr process on OOM and log this event. Is it a common practice to then also create supporting functionality to automatically restart solr after the kill? - On *nix systems, we recommend that Solr be run with the "OOM killer script" (see

New CDCR approach - Solr XDC

Hi, We have been pursuing a cross DC DR solution for SolrCloud. I recently came across this talk from Anshum Gupta on a new CDCR approach - https://www.youtube.com/watch?v=z9OLNWrYihk. Does anyone have an update on this work, or if/when there are plans to include it in the Solr baseline? T

SolrCloud Delete by Query - Issues?

Hello, I believe I have heard there are some issues with Delete by Query for SolrCloud. I did not pick up on what the symptoms were. If this is true, what are the issues? Thanks, Matt