Re: Newbie Help: Replicating Between Two SolrCloud Instances (Solr 9.2.1)

2023-10-23 Thread Shawn Heisey
On 10/20/2023 5:23 PM, David Filip wrote: From a matter of perspective, however, I think what I am not clear on is having more than one ZK “server”, and when and why I would need more than one? Perhaps it is just terminology, but if I have three (3x) Solr instances (cores) running on three (3

Re: SOLR 8.11.2 Cloud issue

2023-10-23 Thread Scott Q.
Oops, here we go: https://imgur.com/a/jSVKgkZ On Monday, 23/10/2023 at 02:24 Ishan Chattopadhyaya wrote: Unfortunately, the mailing list doesn't allow images to be attached. I think it is time to retire this mailing list, move to a modern discussion forum. Thankfully, some community members ar

Re: what is SOLR syntax to remove duplicated documents

2023-10-23 Thread Thomas Corthals
Probably not very helpful for the original question, but for the sake of completeness: you can use the Lucene documentID with the Luke Request Handler. https://solr.apache.org/guide/solr/latest/indexing-guide/luke-request-handler.html You can not use it as a reliable identifier for your Solr docu

Paging a delete query?

2023-10-23 Thread Koen De Groote
I'm looking to delete a big set of documents, based on a list of ids I have. Testing this in a test environment has caused the VM to be unresponsive for several minutes, which isn't ideal. Are there options to paginate a delete query? Also, are there options to ask solr about a specific query it

Re: Paging a delete query?

2023-10-23 Thread Thomas Corthals
Hi Koen, You'll have to implement that on the client side. If you happen to use PHP, the Solarium PHP client has a plugin that does just that: https://solarium.readthedocs.io/en/stable/plugins/#buffereddelete-plugin (Full disclosure: I wrote the plugin.) Thomas Op ma 23 okt 2023 om 10:47 schre

Performance issue in Wildcard Query in Solr 8.9.0

2023-10-23 Thread Vishal Patel
We are using Solr 8.9.0. We have configured Solr cloud like 2 shards and each shard has one replica. We have used 5 zoo keepers for Solr cloud. We have created collection name documents and index size of one shard is 21GB. Schema fields like here We want to search data which cont

Re: SOLR 9.3 - JVM Crashes

2023-10-23 Thread Ing. Andrea Vettori
> On 22 Oct 2023, at 22:28, rajani m wrote: > > Hi Andrea, > > Good to hear that. Would be nice to understand why it’s happening however… :) > What type of *cache* config do you have in the old > configuration? I ask because Legacy Solr Cache from 8.x does not work when > solr is upgraded

Re: SOLR 9.3 - JVM Crashes

2023-10-23 Thread Ing. Andrea Vettori
> On 22 Oct 2023, at 23:31, Shawn Heisey wrote: > > On 10/21/2023 2:31 AM, Ing. Andrea Vettori wrote: >> Hello, we’re using two SOLR servers (same hw, same version of solr and java, >> same solr config). The SOLR version is 9.3 and JVM is Adoptium JDK 17.0.8.1 >> on Linux. >> They both were ru

Re: Paging a delete query?

2023-10-23 Thread Koen De Groote
Hello Thomas, Thanks for the reply. Using nodejs here, but thanks for the information, it does help. Kind regards, Koen On Mon, Oct 23, 2023 at 11:22 AM Thomas Corthals wrote: > Hi Koen, > > You'll have to implement that on the client side. > > If you happen to use PHP, the Solarium PHP client

Solved/Working but Network Interface Question (was: Newbie Help: Replicating Between Two SolrCloud Instances (Solr 9.2.1))

2023-10-23 Thread David Filip
Thanks Shawn! I have since created 3x physical servers (Virtual Machines running on a cloud server), each one running its own instance of both ZooKeeper and Solr, and every Zookeeper/Solr instance configured to know about the others. Everything seems to be working as expected, and any configur

Re: Solved/Working but Network Interface Question

2023-10-23 Thread Shawn Heisey
On 10/23/2023 8:18 AM, David Filip wrote: In theory I guess I could bind Solr only to the Ethernet network (it currently binds to 0.0.0.0, a.k.a. all network interfaces), but then I would need to set up a separate proxy from my WiFi network to each of the Solr servers, which I would rather not

Looking for a consultant to review our solr instance

2023-10-23 Thread Alu, Pino [EMR/ENT/IT/STL]
Hello, Not sure if this is group to ask but we are potentially looking for a solr expert to examine our solr instance to help provide action items to optimize performance. Thanks, Pino Alu | HCL Commerce Administrator :: Emerson.com | Enterprise IT Emerson | 8000 West Florissant Ave. | St. Lou

Re: Looking for a consultant to review our solr instance

2023-10-23 Thread Markus Jelsma
Hello Pino, there is a list [1] of companies offering support. Regards, Markus [1] https://cwiki.apache.org/confluence/display/SOLR/Support Op ma 23 okt 2023 om 17:15 schreef Alu, Pino [EMR/ENT/IT/STL] < pino@emerson.com>: > Hello, > > > > Not sure if this is group to ask but we are potenti

Re: knn query parser, number of results and filtering by score

2023-10-23 Thread Mirko Sertic
Hi! I tested this, and it seems the problem is related to Solr cloud mode. It works perfectly in a non-cloud setup. Here is the debug response: {   "responseHeader":{     "status":0,     "QTime":2,     "params":{   "q":"{!knn f=TESTEMBEDDING_EU_3  topK=3}[1.0,1.0,1.0]",   "defType":"lu

TruncateFieldUpdateProcessorFactor isn't being applied

2023-10-23 Thread Walter Underwood
I’ve defined TruncateFieldUpdateProcessorFactor in our update request processor chain, targeted at solr.StrField, but it isn’t truncating the content. That field is populated by a copyField directive. Is the copyField evaluated after the update chain? Could that cause this to not work? wunder W

Solr Heap usage

2023-10-23 Thread Surya R
Hi. We have a solr index with around 2.5M documents , running solr 8.11 . We have bunch of fields that we faceet/sort/highlight on. Heap is 8GB, out of 12 GB RAM These fields were not defined with docValues=true due to some legacy design issues , but if we were to rewrite the app, we would definit

Re: Unknown CVEs in 8.11.2?

2023-10-23 Thread Ishan Chattopadhyaya
Thanks Jamie. I've upgraded some of these in branch_8_11. I didn't have a Hadoop cluster handy, so wasn't able to upgrade the Hadoop dependency, though. My naive attempt to just increase the Hadoop library version resulted in several failed tests that I wasn't able to debug. On Tue, 3 Oct 2023 at

Re: Unknown CVEs in 8.11.2?

2023-10-23 Thread Jamie Jackson
Thanks for the reply, Ishan. Once these make it into a docker image, I'll rescan. On Mon, Oct 23, 2023 at 3:23 PM Ishan Chattopadhyaya < ichattopadhy...@gmail.com> wrote: > Thanks Jamie. I've upgraded some of these in branch_8_11. I didn't have a > Hadoop cluster handy, so wasn't able to upgrade

Re: Paging a delete query?

2023-10-23 Thread Chris Hostetter
If you want to "delete by query" but you don't care about the atomicity of the "delete by query" (ie: queries and or other updates may process in the middle of the delete) then that is exactly what the delete() streaming expression decorator was designed for... https://solr.apache.org/guide/s

Re: TruncateFieldUpdateProcessorFactor isn't being applied

2023-10-23 Thread Mikhail Khludnev
Hello Walter. I'm afraid the copyField directive is handled quite after update processor chain. May you try with CloneFieldUpdateProcessorFactory before truncating? On Mon, Oct 23, 2023 at 8:29 PM Walter Underwood wrote: > I’ve defined TruncateFieldUpdateProcessorFactor in our update request >