Re: Sorting is working in primitive multivalued fields without docValues

2021-06-11 Thread Mónica Marrero
Thanks, Alessandro, I will wait for your investigation and let you know if I find anything else in the meantime. About the trie fields, yes, we are about to replace them with the point fields, hopefully in the next reindexing we run. Cheers, Mónica On Thu, 10 Jun 2021 at 10:30, Alessandro Bene

Re: Return name of the collection/core with the document

2021-06-11 Thread Jan Høydahl
Try to add shards.info=true to your request, and you should get the core name in the response.. Jan > 10. jun. 2021 kl. 23:55 skrev ufuk yılmaz : > > Is it possible to return which collection a matching document came from, when > querying against an alias? > > Suppose alias “myAlias” is point

ClassicTokenizer not working as expected

2021-06-11 Thread Tom Van Cuyck
Hi, I have an issue with the ClassicTokenizer. According to the documentation ( https://solr.apache.org/guide/8_8/tokenizers.html#classic-tokenizer) this should work as follows: - Words are split at hyphens, unless there is a number in the word, in which case the token is not split and the number

Re: Schema Changes are not Visible after Collection Restore - Solr 8.8.2

2021-06-11 Thread Jason Gerlowski
Hey Steffen, I took a quick look at the backup/restore codepath involved here - surprisingly the restore code itself hasn't changed between 8.6.3 and 8.8.2. In both 8.6.3 and 8.8.2, if the configset mentioned in the backup has the same name as a config currently in ZooKeeper, the version in ZK is

RE: Return name of the collection/core with the document

2021-06-11 Thread ufuk yılmaz
I tried it but shards.info returned all shard information of all collections in the alias, not just where the document came from. I still don’t know which collection the response docs came from. Sent from Mail for Windows 10 From: Jan Høydahl Sent: 11 June 2021 12:44 To: users@solr.apache.org S

Migration from NRT to TLOG performance issues

2021-06-11 Thread Nick Vladiceanu
hello, I’m facing some performance issues when moving from NRT replica types to TLOG + PULL. We’re constantly indexing new data and heavily querying (~2k rps). - index size is ~ 2.5Gi; - number of docs ~4.6M; - 2 shards; - 7 cores and 14Gi of memory - 30 instances - JVM Heap is 12Gi When running

Re: Schema Changes are not Visible after Collection Restore - Solr 8.8.2

2021-06-11 Thread Jason Gerlowski
Hey Steffen, I can reproduce the issue on 8.8.2 using the steps you laid out in your original email. (With one deviation - I had to enable auth to get around an error about "Can't create a configset with an unauthenticated request from a trusted baseConfigSet") The steps you're using to trigger t

Re: Approaches to indexing indigenous languages?

2021-06-11 Thread Alexandre Rafalovitch
Hi Peter, This is a fascinating problem. I would not mind seeing a resolved solution fed back into the list. I think your best bet lies in exploring the icu4j library that ships with Solr, but needs to be enabled in solrconfig.xml. A little bit is explained at https://solr.apache.org/guide/8_8/l

Re: Approaches to indexing indigenous languages?

2021-06-11 Thread Michael Gibney
+1 to ICU, and I'd also be interested in follow-up. In case transliteration might also be helpful for your case, I took a cursory glance at the out-of-the-box transliteration ids (https://github.com/unicode-org/icu/tree/main/icu4c/source/data/translit) and I don't think there's anything for the scr

Re: Migration from NRT to TLOG performance issues

2021-06-11 Thread Timothy Potter
Hi Nick, What does your response time look like if you use shards.preference=replica.type:PULL,replica.location:local as a query parameter? Basically route all queries to PULL replicas only. LMK Tim On Fri, Jun 11, 2021 at 6:55 AM Nick Vladiceanu wrote: > > hello, > I’m facing some performance

Re: Migration from NRT to TLOG performance issues

2021-06-11 Thread Nick Vladiceanu
Hi Tim, thanks for your reply. Forgot to mention, I’ve tried with shards.preference=replica.type:PULL,replica.type:TLOG,replica.location:local, and the results are basically the same as with only replica.location:local or without any additional query parameters. Sometimes, under heavier load, s

Re: Migration from NRT to TLOG performance issues

2021-06-11 Thread Mike Drob
Are you using HDFSDirectory to serve your indices? I noticed that tlogDfsReplication is set, so that's why I'm asking. 8 maxWarmingSearchers is very high, typically that value is 2 or maybe 4, but you would know if this was an issue by looking at your logs. I'm assuming that you had 30 NRT repl

Re: Migration from NRT to TLOG performance issues

2021-06-11 Thread Nick Vladiceanu
actually not using HDFSDirectory, it’s a leftover in the config from some previous tests. I don’t see anything in the logs related to maxWarmingSearchers, nor other errors/warnings show in the logs. I tried to reduce maxWarmingSearchers to 3 and increased the Hard commit maxTime to 2mins, the r

Re: Migration from NRT to TLOG performance issues

2021-06-11 Thread Mike Drob
When you have 6TLOG+24PULL and you're setting shards.preference=replica.type:PULL,replica.type:TLOG,replica.location:local, I would expect zero queries going to the TLOG replicas, can you confirm that is the case? If so, this might be an issue of 24 nodes trying to keep up with the work that 30 wer

Re: Migration from NRT to TLOG performance issues

2021-06-11 Thread Nick Vladiceanu
Very good point Mike. To avoid this, I’ve scaled the cluster to 34 nodes (which would compensate the 6TLOG that aren’t going to be used for search), and we were only 2 nodes less for search queries than the NRT cluster had. At lower request rate, the results weren’t better either. TLOG replica

solr user admin interface doesn't work after 8.4

2021-06-11 Thread Maria Muslea
Hi, I am having trouble with the online user admin interface. Everything worked fine up to version 8.4. Now I am trying version 8.8 and the links to different screens seem to be broken. For example, in the working version the query screen is accessed with: http://localhost:8983/solr/#/corenam

Re: solr user admin interface doesn't work after 8.4

2021-06-11 Thread Colvin Cowie
Hello, I'm on 8.8.2 and I've not heard of anything like that or had any problems, e.g. http://localhost:8983/solr/#//query and http://localhost:8983/solr/#//query both work fine. The one thing I can suggest is that you try it with a Private/Incognito window and see if you have the same problem. I

Re: Migration from NRT to TLOG performance issues

2021-06-11 Thread Houston Putman
So the issue seems to be with the autocommit time. The PULL and TLOG followers fetch the index every x seconds. This 'x' is 1/2 of the autocommit time, so when you increased your autocommit, you were actually just increasing the amount of time your TLOG followers and PULL replicas were able to kee

Re: solr user admin interface doesn't work after 8.4

2021-06-11 Thread Atita Arora
Works fine for Solr 8.8.2. On Fri, 11 Jun 2021, 18:37 Colvin Cowie, wrote: > Hello, > > I'm on 8.8.2 and I've not heard of anything like that or had any problems, > e.g. > http://localhost:8983/solr/#//query and > http://localhost:8983/solr/#//query both work fine. > > The one thing I can sugges

Re: solr user admin interface doesn't work after 8.4

2021-06-11 Thread Eric Pugh
Could you retest using a browser in “incognito” mode, I believe the issue is that you have cached JS files from one version used in another version ;-( Eric > On Jun 11, 2021, at 12:44 PM, Atita Arora > wrote: > > Works fine for Solr 8.8.2. > > On Fri, 11 Jun 202

Re: Reads only on replicas?

2021-06-11 Thread Bram Van Dam
On 11/06/2021 00.28, Walter Underwood wrote: Are you trying to send queries to less loaded machines? If so, this won’t do that. Leaders only do a little bit more work than followers. All indexing processing is local and that is most of the CPU usage. I suspect that depends on the type of repl

Re: solr user admin interface doesn't work after 8.4

2021-06-11 Thread Maria Muslea
Yup, that was it. Thank you so much. I was on the same browser where I was using the interface for 8.4. Maria On Fri, Jun 11, 2021 at 9:56 AM Eric Pugh wrote: > Could you retest using a browser in “incognito” mode, I believe the issue > is that you have cached JS files from one version used in

Re: ClassicTokenizer not working as expected

2021-06-11 Thread Shawn Heisey
On 2021-06-11 05:49, Tom Van Cuyck wrote: I have an issue with the ClassicTokenizer. According to the documentation (https://solr.apache.org/guide/8_8/tokenizers.html#classic-tokenizer) this should work as follows: - Words are split at hyphens, unless there is a number in the word, in which case