Re: Rule-Based Authorization Plugins with JWT Authentication Plugin

2022-04-05 Thread Dominique Bejean
Hi, I reply to myself. I had to go in debug mode in order to see that Set userRoles = getUserRoles(principal); was returning null due to the fact the username attribute in the principal was the keycloak user uuid (the default sub attribute value) and not the preferred_username. I fixed this in se

Re: Help with stopwords filter

2022-04-05 Thread Arif Shaon
Hi Dominique, Thanks for replying to my query. "is" is defined as a stopword for the _en (English) fields but _ar (Arabic) uses a custom analyser which is not clear about how it deals with stopwords. I will look into it. Thanks again. Best Arif On Mon, Apr 4, 2022 at 3:42 PM Dominique Bejean wr

Need help with DIH plugin SOLR

2022-04-05 Thread Neha Gupta
Dear Solr Community, Need your help. I am running SOLR(8.11) as a standalone (on Windows) and want to index from the relational database(Postgres) and as such i tried to install DIH plugin by following the instructions given at: - https://github.com/rohitbemax/dataimporthandler I am stuck at

Solr Cloud - Query with results around 2 million records time out.

2022-04-05 Thread Puttaganti, Venkat
Hi Team, I hope you are doing good. We have come across an issue/limitation with Solr cloud, when users are trying to query with around 2 million data as part of the response. The same query works fine and return the results with standalone Solr. Can you suggested if it requires any ad

Re: Solr Cloud - Query with results around 2 million records time out.

2022-04-05 Thread Thomas Corthals
Hi Venkat, Do you mean 2 million documents in a single response? You should really consider pagination , preferably using a cursorMark. Regards, Thomas Op di 5 apr. 2022 om 13:40 schreef Puttaganti, Venkat < venkat.puttaga...@taylor

Re: Solr Cloud - Query with results around 2 million records time out.

2022-04-05 Thread Dave
I’ve been able to download a response from standalone solr with over 40 million records, just takes a bit, using wget and a long timeout. I don’t know if a browser would be able to handle that size and time to download, let alone crash the browser altogether > On Apr 5, 2022, at 8:00 AM, Thomas

Re: Solr Cloud - Query with results around 2 million records time out.

2022-04-05 Thread Ere Maijala
Hi, Doing what you describe won't work with SolrCloud. The reason for this is that Solr will have to merge a large number of records from the nodes to get the results you ask, and this is a really resource-intensive task. Deep paging for a limited number of results isn't much better since Sol

solr relatedness weirdness on json facet function

2022-04-05 Thread Dan Rosher
Hi, If I run a facet on relatedness on a qf field (examples below) which has stopword removal, I get stopwords in the json facet? Anyone know why, and if this can be avoided? Many thanks, Dan = Details Solr 7.7.2 http://localhost:8983/solr/collection/select? q=my query& defTyp

Re: Solr as a dedicated data store?

2022-04-05 Thread James Greene
The 'no' response is traditional and a bit dated. If you have proper backup/snapshots happening it is totally plausible to use solr (lucene) as a primary data store. If you need field/config changes you can import a collection from an existing collection doing the field transforms on the fly. The

Re: Need help with DIH plugin SOLR

2022-04-05 Thread James Greene
Stand alone mode does not use zookeeper, you do not need to upload configs using zkcli.sh. On Tue, Apr 5, 2022, 6:55 AM Neha Gupta wrote: > Dear Solr Community, > > Need your help. > I am running SOLR(8.11) as a standalone (on Windows) and want to index > from the relational database(Postgres)

Re: Solr Cloud - Query with results around 2 million records time out.

2022-04-05 Thread James Greene
Also make sure the timeout isn't at the transport layer. People often get failures and after much headache realize some transport layer timeout of 300s killed the response stream. On Tue, Apr 5, 2022, 7:42 AM Puttaganti, Venkat < venkat.puttaga...@taylorandfrancis.com> wrote: > Hi Team, > I

Re: Solr as a dedicated data store?

2022-04-05 Thread Markus Jelsma
> The 'no' response is traditional and a bit dated. Agreed, we have been using Solr as a main data store for many years for some usecases. But, we only store either logs or data that we can reproduce or regenerate. The original message wrote about storing a CrawlDB, in that case storing it in Sol

Re: solr relatedness weirdness on json facet function

2022-04-05 Thread Michael Gibney
Both `qf` and `relatedness` should be orthogonal to your question, iiuc. Understanding that your question is mainly about which terms are included (i.e. included at all -- nevermind ranking), then the only thing that should determine that is the field and fieldType config for the terms facet "field

Solr - Spring cloud – CVE-2022-22963

2022-04-05 Thread Rajath Banagi Ravindra
Hi, We are using Solr 7.5 version and Solr 6.4 version in our applications. Wanted to check if there is any impact due to vulnerability - CVE-2022-22963. I did googling and didn’t find any clear answers regarding same. Are Solr instances vulnerable and any action needed from our end, please let

Re: Solr - Spring cloud – CVE-2022-22963

2022-04-05 Thread Mike Drob
Rajath, All of our known and disclosed security vulnerabilities are posted to https://solr.apache.org/security.html If something is not listed there than it is either not known, not disclosed, or not a problem. If you believe you have discovered a new vulnerability please follow the reporting gui

Sore Core not showing in Dashboard

2022-04-05 Thread Dharambir Singh
Hi Team, I am facing an issue, I have few core present in ~\solr-7.5.0\server\solr but it is not getting listed in Core Selector. Any pointer where should I check the reason for not getting displayed in Sitecore Dashboard. Sent from Mail for Wi

Re: Sore Core not showing in Dashboard

2022-04-05 Thread Charlie Hull
Sitecore is a commercial product and thus outside the scope of this list which is focused on Solr. Best Charlie On 05/04/2022 17:06, Dharambir Singh wrote: Hi Team, I am facing an issue, I have few core present in ~\solr-7.5.0\server\solr but it is not getting listed in Core Selector. Any p

Re: Atomic indexing without whole document getting indexed again

2022-04-05 Thread gnandre
Hi, here are the relevant fields from the schema. There are no copyfields for views_count. Here are the corresponding atomic indexing and commit requests: curl http://solr:8983/solr/answers/update -d '[{"id" : "answers:question:8029","views_count" : {"set":111}}]' curl "http://solr:8983/solr

Re: Atomic indexing without whole document getting indexed again

2022-04-05 Thread Shawn Heisey
On 4/5/22 10:53, gnandre wrote: Hi, here are the relevant fields from the schema. There are no copyfields for views_count. Here are the corresponding atomic indexing and commit requests: curl http://solr:8983/solr/answers/update -d '[{"id" : "answers:question:8029","views_count" : {"set":1

Re: Atomic indexing without whole document getting indexed again

2022-04-05 Thread gnandre
Thanks, Shawn. I conducted the test that you mentioned. Here is the diff - https://www.diffchecker.com/sdsMiGW5 Left hand side is the state before the in-place update. Right hand side is the state after the in-place update. On Tue, Apr 5, 2022 at 1:05 PM Shawn Heisey wrote: > On 4/5/22 10:53,

Re: Atomic indexing without whole document getting indexed again

2022-04-05 Thread Matthew Lapointe
Hi, I encountered a similar issue recently trying to differentiate between atomic and in-place updates. I ended up enabling debug logging for the DirectUpdateHandler2 class via Solr UI → Logging → Level options. Then the logs should print something like "DirectUpdateHandler2 updateDocValues" for a

Re: Atomic indexing without whole document getting indexed again

2022-04-05 Thread gnandre
Thanks, Matthew. I tried debugging as you suggested. It seems that it is still doing atomic update instead of in-place update. I am not using SolrCloud, so I don't think that SOLR-13081 is applicable in my situation. I am using Solr 8.5.2 in standalone mode. I am not sure why in-place updates are

Re: Atomic indexing without whole document getting indexed again

2022-04-05 Thread Matthew Lapointe
That's odd! The only other thing I can think to check would be to verify that the "id" field is configured as the unique key field for the collection. Matthew On Tue, Apr 5, 2022 at 3:43 PM gnandre wrote: > Thanks, Matthew. > > I tried debugging as you suggested. It seems that it is still doing

Re: Atomic indexing without whole document getting indexed again

2022-04-05 Thread gnandre
It is configured as a unique field. id On Tue, Apr 5, 2022 at 4:10 PM Matthew Lapointe wrote: > That's odd! The only other thing I can think to check would be to verify > that the "id" field is configured as the unique key field for the > collection. > > Matthew > > On Tue, Apr 5, 2022 at 3:4

Re: Atomic indexing without whole document getting indexed again

2022-04-05 Thread Matthew Lapointe
Are there any update request processors defined that could be adding default values? On Tue, Apr 5, 2022 at 4:53 PM gnandre wrote: > It is configured as a unique field. > > id > > > > On Tue, Apr 5, 2022 at 4:10 PM Matthew Lapointe > > wrote: > > > That's odd! The only other thing I can think

Re: Atomic indexing without whole document getting indexed again

2022-04-05 Thread Shawn Heisey
On 4/5/2022 12:38 PM, gnandre wrote: I conducted the test that you mentioned. Here is the diff - https://www.diffchecker.com/sdsMiGW5 Left hand side is the state before the in-place update. Right hand side is the state after the in-place update. That looks very strange to me.  If it were doin