Re: solr 8.11.1 auto data deletion?

2025-06-24 Thread Jan Høydahl
Hi, There is no auto deletion in Solr itself. So suspects would be your software integrating with Solr. You'd probably have more success discussing it with CMS guys and owners of Camel stack. If you have monitoring on Solr (metrics) you can see number of delete requests and when they happen. If

Re: "Zk Status" in Solr GUI not working :: External Zookeeper TLS only port 2182

2025-06-04 Thread Jan Høydahl
You are correct, you found the JIRA and contributions are welcome as always 😉 Jan > 4. juni 2025 kl. 12:04 skrev Edgar Santos : > > Solr version: > > $ solr --version > Solr version is: 9.8.1 > > Zookeeper version: > > [zk: > madbanana-solr-zookeeper-cluster01-hhe-dev-3.madbanana.inc:2182(C

Re: Options to manage multiple Solr versions on my development machine?

2025-05-28 Thread Jan Høydahl
The Solr Operator manages as many SolrCloud clusters as you wish :) $ kubectl get solrclouds NAME VERSION TARGETVERSION DESIREDNODES NODES READYNODES AGE foo 8.8.2 1 1 173s bar 9.8,1 3 3

Re: Recovery from disk failure

2025-05-06 Thread Jan Høydahl
Hi, I have seen the same happening myself, and I agree it is somewhat unexpected. I believe there may be some reason beind the behavior, but cannot think of any right now. So what would work for you right now would be to get rid of the dead replica in zookeeper (try DELETEREPLICA), and then do

Re: copyField'ing child documents

2025-05-02 Thread Jan Høydahl
Seems you are using the field guessing logic. It is helpful for quick experimentation, as any text field will have a string equivalent "mytext_str" which can be immediately used for sorting or faceting, and thus requires *_str to be defined. It is not a recommended feature to use in production,

Re: Possible OOM risk after huge REINDEXCOLLECTION requests

2025-04-30 Thread Jan Høydahl
We provide jattach for these purposes in the official docker image: https://solr.apache.org/guide/solr/latest/deployment-guide/solr-in-docker.html#debugging-with-jattach Jan > 30. apr. 2025 kl. 13:11 skrev Jason Gerlowski : > > Hi Florian, > > I haven't heard any reports of a memory leak trigg

Re: Query syntax

2025-04-17 Thread Jan Høydahl
Hi, You're running into corner cases of Lucene's pure negative query. Google and you'll find some articles. Try rewriting your query in a more explicit way, e.g. q=(*:* -attributename1:*) OR (*:* -attributename2:*) AND Class:Document Jan > 17. apr. 2025 kl. 20:05 skrev Farmerie, Henry > : >

Re: solr 9.8.1 docker image - solr-precreate - how to transport custom cmd arguments to solr-fg

2025-04-08 Thread Jan Høydahl
I see it can be a hassle to bootstrap things. Feel free to make PR to introduce such PRECREATE_ARGS option or similar. You may want to start with filing a JIRA. Jan > 8. apr. 2025 kl. 11:23 skrev Torsten Krah : > > Am Dienstag, dem 08.04.2025 um 11:09 +0200 schrieb Jan Høydahl:

Re: solr 9.8.1 docker image - solr-precreate - how to transport custom cmd arguments to solr-fg

2025-04-08 Thread Jan Høydahl
Due to limitations like this, I'd recommend moving away from solr-precreate and instead start an "empty" solr, and then boostrap it with API commands. Jan > 7. apr. 2025 kl. 14:43 skrev Torsten Krah : > > Am Montag, dem 07.04.2025 um 12:50 +0200 schrieb Torsten Krah: >> I had a look at [0] but

Re: How to connect to Node of a Solr-Cloud-Cluster

2025-04-05 Thread Jan Høydahl
Hi, Any of the above :) If you don't care about minimizing network hops during indexing/search, you can use a LB like HAProxy, NginX or some hardware product in front of your nodes for simplified logic in your application. However, the best practice these days is to provide your application w

Re: Solr 8 Reference Guide Not Loading Properly

2025-03-27 Thread Jan Høydahl
rev Jan Høydahl : > > Hi, > > We fixed our main website alrady: > https://issues.apache.org/jira/browse/SOLR-17342 > Except the artifacthub widgets on solr-operator page. We should just disable > those scripts and do a static link instead. > > The 9.x series ref-guide s

Re: Solr 8 Reference Guide Not Loading Properly

2025-03-20 Thread Jan Høydahl
Hi, We fixed our main website alrady: https://issues.apache.org/jira/browse/SOLR-17342 Except the artifacthub widgets on solr-operator page. We should just disable those scripts and do a static link instead. The 9.x series ref-guide seems to work, but the previous not. That's basically a bunch

Re: Solr upgrade from 8.11 to 9.x (latest if possible)

2025-03-19 Thread Jan Høydahl
Hi, It's fairly well described in the reference guide https://solr.apache.org/guide/solr/latest/upgrade-notes/major-changes-in-solr-9.html Normally we recommend not to "upgrade" your existing nodes on a major upgrade, but instead stand up a clean new 9.x cluster/server and do a full re-index.

Re: How to do an ordered export of a Solr index

2025-03-18 Thread Jan Høydahl
Hi Do you have all fields either "stored" or "docValues"? In that case, /export would be the "correct" solution for you. Have you tried the new export CLI command? https://solr.apache.org/guide/solr/latest/deployment-guide/solr-control-script-reference.html#exporting-documents-to-a-file > bin/

Re: Upgrade issues 9.1 to 9.7

2025-02-05 Thread Jan Høydahl
Hi, Have you checked that the date/time of all six servers are 100% in sync? Have you read through the Upgrade Notes for all 9.x versions to figure out if you need to take special precaution during rolling upgrade between those versions? The PKI auth method is used for internal traffic betwen n

Re: Alertmanager or grafana rules for solr core state not firing

2025-02-05 Thread Jan Høydahl
Hi, Have a look at https://issues.apache.org/jira/browse/SOLR-15767 and assiciated PR which proposes some common alerting rules. Jan > 4. feb. 2025 kl. 17:08 skrev Afroz, Neshat (NIH/NLM/NCBI) [C] > : > > Hello > > I am setting up solr monitoring using Prometheus, solr-exporter and Grafana.

Re: I may fork nutch. Is it a good plan?

2025-01-12 Thread Jan Høydahl
ork zoekt it could be better. >> >> Sorry for the off topic! Do you know any on-topic list or community please? >> >> Le jeu. 9 janv. 2025 à 10:02, Jan Høydahl a >> écrit : >> >>> Zoekt is open source available under the same license as Solr, Open

Re: I may fork nutch. Is it a good plan?

2025-01-09 Thread Jan Høydahl
an. 2025 kl. 22:59 skrev anon anon : > > https://github.com/sourcegraph/zoekt is owned by sourcegraph I will choose > livegrep or opengrok > > Le mer. 8 janv. 2025 à 22:16, Jan Høydahl a écrit : > >> I think a tailored code search engine is better for your job. Lik

Re: I may fork nutch. Is it a good plan?

2025-01-08 Thread Jan Høydahl
I think a tailored code search engine is better for your job. Like livegrep, zoekt or opengrok. Jan Høydahl > 8. jan. 2025 kl. 20:41 skrev anon anon : > > I already knew and tested grep.app. It is definitely a great soft! > > I need my own search because: > - I need regex

Re: Solr 9.7: Define permissions using chart helm

2025-01-06 Thread Jan Høydahl
Hi, Yes indeed. You can have Solr Operator bootstrap your entire security.json. Either through defining user/password and using a built-in template, or by providing a complete security.json file in a k8s secret which will then be bootstrapped for you. Documented here https://apache.github.io/s

Re: Solr performance much worse in SolrCloud mode ?!

2024-12-03 Thread Jan Høydahl
Hi, First, this performance (48ms) is not necessarily bad at all. Make sure when running tests, to start from the same state, newly started servers, and use the same test suite, running for the same duration, preferably 10+ minutes. Else various caches may play games with you. There is very li

Re: Solr Langid backwards compatibility with "langid.whitelist" is borken?

2024-11-27 Thread Jan Høydahl
t is approved. I can try attempt a PR as well. >> >> Regards >> >> On Tue, Nov 26, 2024 at 1:43 PM Jan Høydahl wrote: >> >>> Hi, >>> >>> Thanks for finding this. Although I have not checked the code paths you >>> mention, I

Re: Ports to be opened for SolrCloud to connect to ZooKeeper

2024-11-27 Thread Jan Høydahl
Hi, That one port should be enough. Remember to configure your new zk cluster with 4lw.commands.whitelist==mntr,conf,ruok as specified in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-ensemble.html#configuration-for-a-zookeeper-ensemble Between ZKs you need more ports for

Re: RAMDirectoryFactory with Solrj 9.7.0

2024-11-26 Thread Jan Høydahl
You might want to try org.apache.solr.core.MockDirectoryFactory in your tests when using embedded. See https://github.com/apache/solr/pull/2598 for a similar issue in the main tests. Jan > 26. nov. 2024 kl. 22:13 skrev Péter Király : > > Dear all, > > I am developing an application that inten

Re: Solr Langid backwards compatibility with "langid.whitelist" is borken?

2024-11-26 Thread Jan Høydahl
Hi, Thanks for finding this. Although I have not checked the code paths you mention, I think this warrants a JIRA issue and a bug fix. Would you lke to file a JIRA issue for us, and perhaps also attempt a GitHub Pull Request with a fix. Ideally the PR would add a unit test that fails due to the

Re: Solr Index Size Analysis Tool on cloudless installation

2024-11-26 Thread Jan Høydahl
. If you use Prometheus exporter you can also find grafana graphs for index size over time and you can craft your own PromQL to summarize all indices. Jan Høydahl > On 25 Nov 2024, at 16:28, Josef Svoboda > wrote: > > Hello everyone, > > I need to gather information about t

Re: Security and Zookeeper

2024-11-20 Thread Jan Høydahl
Hi, It is not a requirement to implement ACL or TLS with zookeeper. But it will make your install more secure. The warning is to inform you about the risks. If you have a dedicated Zookeeper for Solr, you can achieve similar protection by locking down Zookeeper with firewalls that only allow the

Re: Does lack of documentation indicate lack of support or just lack of documentation?

2024-11-14 Thread Jan Høydahl
Jan > 14. nov. 2024 kl. 09:53 skrev Jan Høydahl : > > Thanks. > > You may find some assistance in contributing here > https://github.com/apache/solr/blob/main/dev-docs/how-to-contribute.adoc and > here https://github.com/apache/solr/tree/main/dev-docs/ref-guide > Ask h

Re: Does lack of documentation indicate lack of support or just lack of documentation?

2024-11-14 Thread Jan Høydahl
uring review. Jan > 13. nov. 2024 kl. 22:47 skrev Christine Feldmann > : > > I haven’t yet contributed to the project but I should be able to figure that > out. I’ll get educated on the process and see if I can make it happen. > Thanks! > > From: Jan Høydahl

Re: Does lack of documentation indicate lack of support or just lack of documentation?

2024-11-13 Thread Jan Høydahl
Never heard of such intent, likely a miss? Would you be willing to produce a Pull Request for bringing the content back? Jan Høydahl > On 13 Nov 2024, at 22:03, Christine Feldmann > wrote: > > Looking for opinions here from those of you that know Solr best… > > A change

Re: configset api in 8.11?

2024-11-11 Thread Jan Høydahl
Cool, there is the reason for null byte. And it is fixed in 8.11.1, good. Question is if we want guard rails for people with already messed-up zk content.. Jan Høydahl > On 11 Nov 2024, at 13:01, Steffen Moldenhauer > wrote: > > Maybe it is something as described in this iss

Re: configset api in 8.11?

2024-11-11 Thread Jan Høydahl
Hi, I agree that an additional safeguard for what is deemed "empty" could be added here. If you like to attempt a Pull Request, feel free. Or if not, perhaps create a JIRA issue. Jan > 9. nov. 2024 kl. 20:45 skrev Dmitri Maziuk : > > On 11/7/24 04:53, David Eric Pugh wrote: >> Would you mind

Re: configset api in 8.11?

2024-11-07 Thread Jan Høydahl
Try -cmd put to insert either an empty string or {} and it should start working. No idea how the null got there… Jan Høydahl > On 7 Nov 2024, at 19:32, Dmitri Maziuk wrote: > > PS. can that NUL be coming from one of the config files? -- I'm thinking > BOM, thankyouverymuc

Re: configset api in 8.11?

2024-11-07 Thread Jan Høydahl
It will write the content to "foo.txt", and according to the stack trace, that file will be non-empty and contain non-JSON. Jan > 7. nov. 2024 kl. 16:03 skrev Dmitri Maziuk : > > On 11/7/24 05:31, Jan Høydahl wrote: > >> Can you go to Solr Admin UI and inspect what

Re: configset api in 8.11?

2024-11-05 Thread Jan Høydahl
There are some docs with examples in ref guideConfigsets API | Apache Solr Reference Guide 8.11solr.apache.orgJan HøydahlOn 5 Nov 2024, at 22:45, Dmitri Maziuk wrote:Hi all,anyone knows if```curl -X POST -H 'Content-type:application/octet-stream" \ --data-binary @solrconfig.xml "http://solrnode:8

Re: Fresh Installation with Status and Access Issues

2024-10-28 Thread Jan Høydahl
Hi, Solr by default binds only to localhost, as you have confirmed. See https://solr.apache.org/guide/solr/latest/deployment-guide/taking-solr-to-production.html#security-considerations So please set SOLR_JETTY_HOST="0.0.0.0" to allow access from other hosts. Jan > 28. okt. 2024 kl. 18:35 skr

Re: backup of a Solr core

2024-10-17 Thread Jan Høydahl
In solr standalone, you can simply zip up your SOLR_HOME folder and unzip it into the new container. Jan > On 17 Oct 2024, at 09:24, Matthias Apitz wrote: > >  > Hello, > > With the motivation to move a Solr core into a podman container I'm > trying to understand how to do a backup/restore.

Re: Confirmation - Object Storage

2024-10-16 Thread Jan Høydahl
er looking at the > directory (the underlying MinIO bucket directory) and it just works. It's > like the new MinIO stores the files in it's own format - maybe great for > S3-like things (IDK maybe versions? I'm not sure) but it's not possible > just to look a

Re: Confirmation - Object Storage

2024-10-16 Thread Jan Høydahl
n search : > > Hi Jan, > > Do you know if there would be many hurdles to implement SOLR SIP-20 with > on-prem object storage rather than say S3 in the cloud? > > Matt > > On Tue, Oct 15, 2024 at 5:28 PM mtn search wrote: > >> Thanks Jan! >> >

Re: Error when creating collection with Solr 9 data node and Solr 8 overseer node

2024-10-16 Thread Jan Høydahl
Hi I believe that the objects on the Overseer queue are serialized java objects and so you cannot create collections while in the middle of a major upgrade. I'd pause such cluster events during the rolling upgrade so that the Overseer queues are empty once the overseer node is upgraded. Jan >

Re: Confirmation - Object Storage

2024-10-15 Thread Jan Høydahl
Hi, That is correct. But plans are being made to add such support: https://cwiki.apache.org/confluence/display/SOLR/SIP-20%3A+Separation+of+Compute+and+Storage+in+SolrCloud Jan > 15. okt. 2024 kl. 20:17 skrev mtn search : > > Hello, > > Just want to confirm that while Solr provides a backup/r

Re: Migration to ConcurrentUpdateHttp2SolrClient

2024-10-09 Thread Jan Høydahl
I see the javadoc has been fixed on main but not in 9.x. So I guess you have to first create a Http2SolrClient for yourself and pass it in. https://github.com/apache/solr/blob/main/solr/solrj/src/java/org/apache/solr/client/solrj/impl/ConcurrentUpdateHttp2SolrClient.java#L709-L729 Jan > 9. okt.

Re: solr.autoSoftCommit.maxDocs:1

2024-10-09 Thread Jan Høydahl
ror found in all the SorCloud nodes was > "java.util.concurrent.RejectedExecutionException: Max requests queued per > destination 3000 exceeded for HttpDestination". > > On Mon, Oct 7, 2024 at 2:04 PM Jan Høydahl wrote: > >> Rule of thumb is to commit as infrequent

Re: solr.autoSoftCommit.maxDocs:1

2024-10-07 Thread Jan Høydahl
Rule of thumb is to commit as infrequently as possible and to batch ADD requests instead of pushing one doc at a time. Also avoid the client application doing explicit COMMIT calls to Solr. All this has a cost. So if your requirement is an indexing latency of 30s, set autoCommit based on time 3

Re: solr.autoSoftCommit.maxDocs:1

2024-10-06 Thread Jan Høydahl
Such a low number generally doesn't make much sense, other than perhaps very special collection where you want to trigger commits immediately, however maxTime:1 would normally be a better setting. Perhaps the one creating that config intended the default to be -1? Jan > 2. okt. 2024 kl. 16:15

Re: Basic auth plugin in solr 9.6.1

2024-09-18 Thread Jan Høydahl
prompt can be done only in Solr Cloud right? > But we are using solr as standalone server, Is there a way for enabling auth > through command prompt in Standalone server? > > Thanks&Regards > KrishnaVamsi > > -Original Message- > From: Jan Høydahl > Sent

Re: Basic auth plugin in solr 9.6.1

2024-09-17 Thread Jan Høydahl
Hi Solr's admin UI uses the same API layer as query clients. So there is no way to limit "just the UI" per se. Of course you can let /select and /update be totally un-authenticated and just protect various admin APIs, that's probably what you are looking for? I'd recommed you enable auth using

Re: Error loading class when trying to update

2024-09-12 Thread Jan Høydahl
Hi,All you need to know is in the docs https://solr.apache.org/guide/solr/latest/indexing-guide/indexing-with-tika.htmlIn particular* Your config references "contribs" folder which is gone in 9.x, see docs* Enable the extraction module with e.g. SOLR_MODULES=extractionWe encourage you to take the

Re: SOLR SSL Enabled

2024-09-09 Thread Jan Høydahl
Hi, One flaw is that you need --module=https Perhaps walk through all the cmdline parameters from bin\solr.cmd once again to see if you captured them all correctly. BTW: I highly recommend you upgrade to 8.11.3, and soon after that to latest 9.x Jan > 9. sep. 2024 kl. 21:04 skrev Hodder, Ric

Re: Solr 9.6.0 with open telemetry module enabled - CoreContainerProvider could not start Solr Error

2024-08-08 Thread Jan Høydahl
Including my reply that by mistake was sent directly to Sathish for reference. Turned out that upgrading to JDK17 resolved the issue - Thanks for the extra info. There is some loop during class loading of OTEL client's http client that causes stack overflow. > at java.base/java.la

Re: Solr 9.6.0 with open telemetry module enabled - CoreContainerProvider could not start Solr Error

2024-08-07 Thread Jan Høydahl
Hi, Please provide more information, such as the complete stack trace, the complete solr.in .sh file, all ENV variables etc, how Solr was intstalled, what Linux flavor etc. Is it so that Solr starts fine if opentelementry module is not enabled? Do you have an OTEL collector setu

Re: Solr Clients

2024-07-30 Thread Jan Høydahl
have been fixed in recent 9.x versions of Http2SolrClient, in particular related to some authentication flows, so you may want to check for your particular use case. Jan > 30. juli 2024 kl. 14:04 skrev dario.v...@coop.ch: > > Hi Jan Høydahl > > Indeed, you are correct. Th

Re: Solr Clients

2024-07-29 Thread Jan Høydahl
Hi Http2SolrClient is no longer experimental as of 9.6.0. See https://solr.apache.org/guide/solr/latest/upgrade-notes/major-changes-in-solr-9.html#solr-9-6 Jan Høydahl > 29. juli 2024 kl. 10:35 skrev dario.v...@coop.ch: > > Dear Solr Team, > > I am a little Confused as t

Re: Solr 9.2.1 : Change caseSensitive to caseInsensitive on a field

2024-06-28 Thread Jan Høydahl
Field type change requires full re-index. Either delete all then reindex or recreate collection. Jan Høydahl > 27. juni 2024 kl. 22:29 skrev L'HARHANT Mikael > : > > Hello, > > I have, in the schema.xml, a field like this. > > docValues="true" requir

Re: Doing frequency statistics on a field ?

2024-06-27 Thread Jan Høydahl
facet.field=inv Jan Høydahl > 27. juni 2024 kl. 16:14 skrev Bruno Mannina : > > Hi Solr Team, > > > > The Goal : To calculate the frequency of inventor’s name from a query result > > SOLR 8.11.3 > > > > I have a field named “inv” (like inventor, i

Re: CVE-2022-42889

2024-06-18 Thread Jan Høydahl
Hi, Please see the security page https://solr.apache.org/security.html#cve-reports-for-apache-solr-dependencies which lists CVEs that are vulnerable. CVE-2022-42889 is listed as "not affected" > Solr uses commons-text directly (StringEscapeUtils.escapeEcmaScript) in > LoadAdminUiServlet that

Re: Issue with SolrJ api.mustache template / generated API classes

2024-06-08 Thread Jan Høydahl
Thanks for researching this. If you are Java savvy it would be super with a PR with a failing unit test. If you searched Jira and could not find a duplicate, feel free to report it. Jan Høydahl > 8. juni 2024 kl. 11:21 skrev Christos Malliaridis : > > Hello everyone, > > I w

"Not enough eligible nodes" errors with Affinity placement plugin

2024-06-05 Thread Jan Høydahl
Hi, I run a small 3-node test cluster with Solr Operator and Solr 9.6.1. Have configured the affinity placement plugin as follows { "plugin": { ".placement-plugin": { "name": ".placement-plugin", "class": "org.apache.solr.cluster.placement.plugins.AffinityPlacementFactory",

Re: Avoiding _shard1_replica_n1-directories in Solr cloud mode

2024-06-03 Thread Jan Høydahl
Hi, Cloud mode is not designed for you to micro manage core.properties. In fact you are not supposed to work on the "core" level at all, but rather issue API requests to create a collection, and let Solr create all the underlying cores. You should not need to care what the names of those core d

Re: solr query sanitizer?

2024-05-30 Thread Jan Høydahl
I wrote this little plugin years ago https://github.com/cominvent/request-sanitizer-component That would be useful if you don't have control over the client doing the requests. If you control the client I'd add some sanitation there. Jan > 29. mai 2024 kl. 16:11 skrev Dmitri Maziuk : > > Hi al

Re: SolrCloud Collections with Helm

2024-05-28 Thread Jan Høydahl
deprecated > and removed in Kubernetes deployments (like in Kafka with KRaft). Are there > any further discussions I could track for updates besides those in > SOLR-16739 <https://issues.apache.org/jira/browse/SOLR-16739>? > > Best regards, > Christos > > On Mon, May 27,

Re: Cannot Run Solr as the Solr User

2024-05-28 Thread Jan Høydahl
Hi, If using "sudo service solr start/stop" works for you, then what is your pain point? Please explain. As Shawn points out, the systed start script takes care of running the process under the "solr" user. Jan > 28. mai 2024 kl. 04:09 skrev Dmitri Maziuk : > > On 5/27/24 14:43, Lee Daniel wr

Re: SolrCloud Collections with Helm

2024-05-27 Thread Jan Høydahl
Hi You are correct that you'll use the ordinary Solr APIs to provision collections. Normally I'd recommend that the application that needs the collection should also have the responsibility of bootstrapping its config set and collection. Another popular option is to have an init container with

Re: Did Spring stopped supporting Solr from spring boot version 3.x ?

2024-05-24 Thread Jan Høydahl
Hi, There are a few things here. If you are talking about Spring Data, then the Solr integration was deprecated 4 years ago. I'm not aware of any fork of the project. If you do not use spring data for Apache solr, but use SolrJ client directly, you may encounter another issue with some depende

Re: CREATE via GUI or API fails - BaseHttpSolrClient$RemoteSolrException: Error from server

2024-05-16 Thread Jan Høydahl
The images did not make it to the list. Can you share them elsewhere? Does it work if you disable authentication plugin? I see a HTTP 403 error in the log which suggests there is an auth issue. Are you using forwardCredentials=true? Which solr version are you on? Jan Høydahl > 16. mai 2

Re: Solr 9.7.0 Release Date

2024-05-16 Thread Jan Høydahl
Hi There is no date. We don’t plan releases in advance. But a 9.6.1 release is soon to leave the station. You should check whether all your wanted fixes are in branch_9_6, if not feel free to back port the ones you care about. Jan Høydahl > 16. mai 2024 kl. 21:02 skrev Himanshu S

Re: Problems migrating solrj to run with SpringBoot 3

2024-05-16 Thread Jan Høydahl
You’ll have to wait for a later solr release with a compatible jetty. We have a plan to make jetty optional for SolrJ but it still is needed. Jan Høydahl > 16. mai 2024 kl. 19:07 skrev Luke Kot-Zaniewski (BLOOMBERG/ 919 3RD A) > : > > Hard to say without seeing your project but

Re: Memory tuning advice for small single-node Solr instance

2024-05-07 Thread Jan Høydahl
Hi, If you have not tuned your heap, it will default to 512m. THe lines in solr.in.sh prefixed with hash # are comments and do nothing. If you experience OOME during use that is likely not enough for your use case. So edit the file, remove the hash and set SOLR_HEAP=1024m to give yourself some m

Re: AUTHC_OPTS environment variable ignored in solr.cmd

2024-05-06 Thread Jan Høydahl
Looks like a bug. In the linux script the AUTHC_OPTS var is added to SCRIPT_SOLR_OPTS but that does not seem to be the case for windows script. I think you can open a JIRA. In the ticket, please provide a step by step instruction to reproduce from a fresh git checkout. And if you have the bandw

Re: Facets search in Jave spring framework

2024-05-02 Thread Jan Høydahl
Hi, You'll want to use SolrJ as a client, see https://solr.apache.org/guide/solr/latest/deployment-guide/solrj.html Here is one tutorial that shows some code https://www.baeldung.com/full-text-search-with-solr Feel free to ask more specific questions as you progress. Jan > 1. mai 2024 kl. 18:

Re: [EXTERNAL] SOLR Shard nodes are unhealthy

2024-04-25 Thread Jan Høydahl
Make sure you use fully qualified domain names everywhere, and that they are routable everywhere. If you start Solr with -h my-short-name then it will be persisted in zk state and will not be routable from all other solr hosts. Jan Høydahl > 25. apr. 2024 kl. 13:34 skrev Ritesh Ku

Re: Zookeeper Expanded - Solr not connecting

2024-04-24 Thread Jan Høydahl
Hi, You could try some manual commands from the Solr node, check out "bin/solr zk", where you can try e.g. an "ls" command. Perhaps you get some more details in the logs. Note that the Zookeeper protocol talks on TCP level, not HTTP. You can also check the connection with a command like this ec

Re: [EXTERNAL] SOLR Shard nodes are unhealthy

2024-04-24 Thread Jan Høydahl
Hi, Indeed, Solr 8.11 used zk client v3.6.2, but I believe it will also work with newer 3.x versions, you can test this locally on your laptop first to be sure. Note also that network resolution should work between all nodes on the FQDN. So if your ZK1 node is called ZK1.region3.example.com and

Re: SOLR Shard nodes are unhealthy

2024-04-24 Thread Jan Høydahl
Hi, First, you should use the latest 8.11.3 which has a lot of fixes. Your setup could work if the regions are connected with really low latency and high bandwidth. Your description suggests that your Solr-ZK connection is not as it should. A few assumptions for this to work: * You ave install

Re: Solr-9.5 | collection creation error

2024-04-23 Thread Jan Høydahl
the same error. > > I can see the clusterprops.json file is missing to update urlScheme. Can you > please let me know how to address this? > > > > > On Tue, Apr 23, 2024 at 2:20 AM Jan Høydahl <mailto:jan@cominvent.com>> wrote: >> Hi, >> >

Re: Solr-9.5 | collection creation error

2024-04-22 Thread Jan Høydahl
s, i can see the same error from UI also and also with _default > configset as well* > > *- Did the Solr node crash or recover during this process?* > No > *- Are there ERRORs in Zookeeper's log files?* > No errors in ZK logs. > > Please let me know if any other info is r

Re: Error installing solr-8.11.3 on RHEL 9.3

2024-04-17 Thread Jan Høydahl
and I think you should be able to make it work for Solr 9.x. Jan > 17. apr. 2024 kl. 23:22 skrev Dmitri Maziuk : > > On 4/17/24 15:47, Jan Høydahl wrote: >> Hi, >> I believe RHEL uses systemd, so you'll have to first install the package for >> initd, I cannot

Re: Error installing solr-8.11.3 on RHEL 9.3

2024-04-17 Thread Jan Høydahl
Hi, I believe RHEL uses systemd, so you'll have to first install the package for initd, I cannot remember the yum name now. Then try the install script again. Jan > 17. apr. 2024 kl. 17:43 skrev Johnnie W Adams : > > Hi, folks, > > I've hit some errors on attempting this install: > > ./i

Re: Solr-9.5 | collection creation error

2024-04-17 Thread Jan Høydahl
Hi, Do you mind sharing the details with us? - Exactly how did you install Solr, and what is your ZK_HOST connection string? - Exactly how did you install ZK, and what is your zoo.cfg, on each of the three nodes. - Which command did you use to create the collection? - Does this happen every time

Re: enableRemoteStreaming+enableStreamBody-change in Solr 8.11.3

2024-04-12 Thread Jan Høydahl
Hi, You are right that the env.vars approach was not backported to 8.x. The workaround you can use in solr.in.sh is: The workaround is to set in solr.in.sh: SOLR_OPTS="$SOLR_OPTS -Dsolr.enableRemoteStreaming=true -Dsolr.enableStreamBody=true" This should have been documented in the reference

Re: Deploying solr war in jetty

2024-03-13 Thread Jan Høydahl
Hi. You are correct. Solr is no longer a WAR, it is a standalone app. All attempt to rip out pieces to make it run elsewehre is unsupported and on your own risk (though probably possible). We highly recommend following the documented means of installing Solr into your environment. Please treat

Re: Document routing.

2024-03-07 Thread Jan Høydahl
t;> >> On Wed, Mar 6, 2024 at 9:10 AM Modassar Ather >> wrote: >> >>> Thanks Jan for your response. >>> >>> I am doing completely fresh indexing after the id change. >>> >>> Best regards, >>> Modassar >>> >>&

Re: Document routing.

2024-03-06 Thread Jan Høydahl
Never change the ID of a document, it must be static in order for routing to work. If you need to change an ID, first issue a delete command for the old id. Read more about routing and composite ID here https://solr.apache.org/guide/solr/latest/deployment-guide/solrcloud-shards-indexing.html#doc

Re: Setting up basic authentication in Solr 8.11.1 Standalone

2024-02-28 Thread Jan Høydahl
You need a few more permissions in order for that Admin screen to work. Try instead the default security.json generated by bin/solr auth enable (cloud mode): { "authentication":{ "blockUnknown": true, "class":"solr.BasicAuthPlugin", "credentials":{"solr":"cHFNAKbTL930UaGklonJT02g/NVUS

Re: Is this list alive? I need help

2024-02-23 Thread Jan Høydahl
I think EFS is a terribly slow file system to use for Solr, who recommended it? :) Better use one EBS per node. Not sure if the gradually slower performance is due to EFS though. We need to know more about your setup to get a clue. What role does stunnel play here? How are you indexing the conte

Re: Run solr in cloud mode and debug from intellij

2024-02-23 Thread Jan Høydahl
Hi, Thanks for this contrib. My only concern is that it is duplicating what is already explained in https://github.com/apache/solr/blob/main/dev-docs/solr-source-code.adoc But that file is also too hard to find, so agree the main README should at least provide a hint on how to build and run lo

Re: Stripping HTML before indexing

2024-02-20 Thread Jan Høydahl
I have never used the "typeClass" option. Have you tried with "typeName" or "fieldName" as an alternative? Jan > 20. feb. 2024 kl. 13:44 skrev Gino Rodrigues : > > O left a small mismatch on the field type, the fields I am trying to clean > are all “text_general“ (class solr.TextField) > > Em

Re: CVE-2021-31684: SOLR- net.minidev_json-smart (Out of Bounds Read)

2024-02-13 Thread Jan Høydahl
Not vulnerable since 9.3. Newest is 9.5. Changelog on Solr website and in GitHub. Always check newest version before filing a bug/mail. 9.x versions prior to 9.5 will not receive bug fixes. Jan Høydahl > 13. feb. 2024 kl. 18:07 skrev Shahryar Shagoshtasbi > : > > Hi there, &g

Re: CVE-2021-31684: SOLR- net.minidev_json-smart (Out of Bounds Read)

2024-02-13 Thread Jan Høydahl
Hi Shahryar, You do not specify what versions of Solr you believe to be vulnerable to those two CVEs. A quick check finds that they are both already plugged both in all actively supported versions of Solr (i.e. 9.x and 8.11.x). In the future you can check this yourself by looking at Solr's chan

Re: Does documentCache still make sense in modern Solr?

2024-02-10 Thread Jan Høydahl
I've always told clients that DocumentCache only make sense if they can achieve a significant cache hit ratio and have slow disks. For most installs I've been involved with, that has not been the case, and we have disabled the cache. Interesting find that it may actually hurt performance, so I l

Re: Memory usage reported by Solr

2024-02-09 Thread Jan Høydahl
Hi, You may want to upload those screenshots to some external service as they did not display on the list. Solr uses Java APIs to ask for system memory, and when running in a container which is resource limited, it will show the max limit allocated to that container. Jan > 9. feb. 2024 kl. 1

Re: [EXTERNAL] - Re: Solr9 support for Tomcat10

2024-02-02 Thread Jan Høydahl
he procedure to > create a private build. > Can we migrate the jars using the Tomcat migration tool? > > Thanks, > Suraksha > > -----Original Message- > From: Jan Høydahl [mailto:jan@cominvent.com] > Sent: Thursday, February 1, 2024 1:23 PM > To: users@solr

Re: Solr9 support for Tomcat10

2024-01-31 Thread Jan Høydahl
you can make a private build of Solr earlier of course. Jan Høydahl > 1. feb. 2024 kl. 07:05 skrev Suraksha Shetty : > > Hi All, > > We are migrating Tomcat 9 to 10.1 in our product. As part of this migration > namespace Javax is changed to Jakarta. > We are using Solr9 a

Re: Setting up Basic Authentication on Solr Cloud

2024-01-26 Thread Jan Høydahl
Hi, You probably want to enable SSL for Solr if you use BasicAuth. For ZK, ACL protection could be the first step, as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html Protecting ZK connection with SSL is probably also smart, but it is unfortun

Re: Connection refused in solr 9.4.0

2024-01-25 Thread Jan Høydahl
This same question was asked yesterday on this list. Answer is to set SOLR_JETTY_HOST=0.0.0.0 to bind to any network interface, not only local. Jan > 25. jan. 2024 kl. 14:05 skrev Gummadi, Ramesh > : > > I am trying to upgrade solr cloud from version 8.11.1 to 9.4.0. Solr > service started but

Re: Correct Procedure for making Basic Authentication Changes LIVE across Multiple Nodes in Solr Cloud 8.10

2023-12-29 Thread Jan Høydahl
No need to shut down servers. Do the configuration change in security.json. Done. What is the remaining question here? Jan Høydahl > 29. des. 2023 kl. 18:44 skrev Uday Kumar : > > Hello yilmaz, > > But we cannot afford to shutdown all our servers for some time. > >>

Re: stopfilter nullpointerexception

2023-12-29 Thread Jan Høydahl
Hi, It is indeed an empty (null) stopwords "CharArraySet" being passed in https://github.com/apache/lucene/blob/branch_9_8/lucene/core/src/java/org/apache/lucene/analysis/StopFilter.java#L39 If you flip back to class="solr.StopFilterFactory", does it work then? Does your stopwords.txt file conta

Re: Correct Procedure for making Basic Authentication Changes LIVE across Multiple Nodes in Solr Cloud 8.10

2023-12-27 Thread Jan Høydahl
Sorry no Experience with Kerberos. Jan Høydahl > 27. des. 2023 kl. 01:13 skrev Uday Kumar : > > Hi Jan, > Need One small confirmation, out of curiosity! > > Document2 reference does not apply to you as it is Kerberos plugin. > Let's assume if we try to go with K

Re: Correct Procedure for making Basic Authentication Changes LIVE across Multiple Nodes in Solr Cloud 8.10

2023-12-26 Thread Jan Høydahl
security.json > > Thanks and regards, > Uday Kumar > > > > > On Tue, Dec 26, 2023, 16:04 Jan Høydahl wrote: > >> It is correct that Auth changes take effect across all nodes. So that >> would be your procedure, done. >> >> May you have looked

Re: Correct Procedure for making Basic Authentication Changes LIVE across Multiple Nodes in Solr Cloud 8.10

2023-12-26 Thread Jan Høydahl
It is correct that Auth changes take effect across all nodes. So that would be your procedure, done. May you have looked at docs for self-managed Solr with no zookeeper? In that case you must touch each node at a time. Jan Høydahl > 26. des. 2023 kl. 08:20 skrev Uday Kumar : > > 

  1   2   3   4   >