Re: Redindex Collection API stalled

2023-05-25 Thread rajani m
oh ok, it may be the silent timeout then. It has reindexed over a million records that mostly have stored fields. It stalled after that, the source collection has 20m records so it may be a large collection and silent timeout. The endpoint created a checkpoint collection that has one document in

Re: Vector Search Parser(!vp) : calculate cosine

2023-05-25 Thread rajani m
That also invokes knn, correct? I just need the vector math response, a cosine value of the query vector and document vector. For example, the streaming api endpoint vector-math.html#dot-product-and-cosine-similarity

Re: Vector Search Parser(!vp) : calculate cosine

2023-05-30 Thread rajani m
nkedin.com/company/sease-ltd> | Twitter > <https://twitter.com/seaseltd> | Youtube > <https://www.youtube.com/channel/UCDx86ZKLYNpI3gzMercM7BQ> | Github > <https://github.com/seaseltd> > > > On Thu, 25 May 2023 at 22:12, rajani m wrote: > > > That al

Streaming expr as LTR feature

2023-05-30 Thread rajani m
Hi Solr Users, Does LTR Solr Feature support streaming expressions? Steaming expr supports vector math , I am trying to configure s

Re: Streaming expr as LTR feature

2023-05-31 Thread rajani m
ay of values but it didn't work, so tried the single value to start with. output of the expression is an exception - [image: image.png] The value is not null as seen below, so am I wrong in terms of expression syntax then, any suggestions? [image: image.png] On Tue, May 30, 2023 at 4:47 PM

Re: Streaming expr as LTR feature

2023-06-01 Thread rajani m
; *Apache Lucene/Solr Committer* > >> *Apache Solr PMC Member* > >> > >> e-mail: a.benede...@sease.io > >> > >> > >> *Sease* - Information Retrieval Applied > >> Consulting | Training | Open Source > >> > >>

COLSTATUS api raw size summary of shard

2023-06-15 Thread rajani m
Hi Solr Users, The "COLSTATUS " api that generates a summary of collection index is timing out when querying a large size index even with sampling size set to 0.01. Any other alternatives? Is it po

Re: COLSTATUS api raw size summary of shard

2023-06-16 Thread rajani m
or need to run the tool as jar? On Thu, Jun 15, 2023 at 3:11 PM rajani m wrote: > Hi Solr Users, > > The "COLSTATUS > <https://solr.apache.org/guide/solr/latest/deployment-guide/collection-management.html#colstatus>" > api that generates a summary of collecti

Json ambiguous condition b/n a flat and child doc for partial updates

2023-07-24 Thread rajani m
Hi Solr Users, Sending a partial update in json format to a doc that has only 2 fields { "id":"10", "contributor_name":"john"} fails with an error as seen below. { "id":"10", "contributor_name":{"set":"Doe"}} Unable to index docs with children: the schema must include definitions for both a uniq

Re: Json ambiguous condition b/n a flat and child doc for partial updates

2023-07-24 Thread rajani m
The field type is SortableTextField <https://solr.apache.org/__root/docs.solr.apache.org/docs/8_0_0/solr-core/org/apache/solr/schema/https://solr.apache.org/__root/docs.solr.apache.org/docs/8_0_0/solr-core/org/apache/solr/schema/SortableTextField.html> On Mon, Jul 24, 2023 at 2:03 PM ra

solr 9.3.0 file permissions issues snapshot_metadata dir

2023-07-26 Thread rajani m
Hi, Trying to upgrade from 9.1.1 to the latest version solr 9.3.0, encountered a file permissions issue specific to this directory "snapshot_metadata" which is not seen in 9.1.1. It is there in 9.2.x and the latest version. org.apache.solr.common.SolrException:org.apache.solr.common.SolrExcept

Re: solr 9.3.0 file permissions issues snapshot_metadata dir

2023-07-27 Thread rajani m
licy#L4 > . > You'll want to make sure the right properties are being set for your > Solr data directory to ensure Solr has file permissions to that > directory. > > On Wed, Jul 26, 2023 at 10:48 AM rajani m wrote: > > > > Hi, > > > >Trying to upg

doc values type=SORTED to inconsistent type=NONE

2023-08-14 Thread rajani m
Hi Solr Users, There is a sortable text field that has docValues enabled by default, tried to disable it by setting "docValues=false" in the schema and indexing(update) the same docs, but

Select Request handler - Remove Query Parameter

2023-08-16 Thread rajani m
Hi Solr Users, Is it possible to remove query params from the query by the select request handler? It has been difficult to reconfigure all the clients to remove certain query parameters not supported after solr version upgrade such as negative boosts, so such queries are failing. Thinking of alt

Re: Select Request handler - Remove Query Parameter

2023-08-16 Thread rajani m
Perfect, thank you so much, Mikhail. On Wed, Aug 16, 2023 at 10:30 AM Mikhail Khludnev wrote: > I'm not sure if > > https://solr.apache.org/guide/solr/latest/configuration-guide/requesthandlers-searchcomponents.html#invariants > may do that. > > On Wed, Aug 16, 2023 at

What is this plugin? /v1/appconfiguration/

2023-08-22 Thread rajani m
Hi Solr Users, I see this error showing up in logs. What plugin is this referring to? Any solution to resolve this? 2023-08-21 11:18:10.273 ERROR (qtp1725062057-26751) [] o.a.s.a.V2HttpCall Error in init() => org.apache.solr.common.SolrException: Could not load plugin at /v1/appconfiguration/ at

Re: What is this plugin? /v1/appconfiguration/

2023-08-22 Thread rajani m
You are right, it is a custom configuration, thank you Shawn. On Tue, Aug 22, 2023 at 7:06 PM Shawn Heisey wrote: > On 8/22/23 08:59, rajani m wrote: > > I see this error showing up in logs. What plugin is this referring to? > Any > > solution to resolve this? > > >

Return Query A results upon a failure of Reranker (Query B)

2023-08-25 Thread rajani m
Hi Solr Users, Is there a feature to request main ranker results in case of a reranker request failure due to incorrect request params, for example, incase of LTR as reranker, if the model is not found, the complete request fails with "model not found" error, instead of that is it possible to

Restart on a node triggers restart like impact on all the other nodes in cluster

2023-09-12 Thread rajani m
Hi Solr Users, Solr 9.1.1 version, upon restarting solr on any node in the cluster, a unique event is triggered across all the *other* nodes in the cluster that has an impact similar to restarting solr on all the other nodes in the cluster. There is dip in the cpu usage, all the caches are empti

Configure zk to not send requests to new node for x minutes

2023-09-13 Thread rajani m
Hi Solr Users, Is there a way to stop sending search queries to a newly joined node/respective shards for a few minutes? Thanks, Rajani

Re: Restart on a node triggers restart like impact on all the other nodes in cluster

2023-09-13 Thread rajani m
22] at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355) ~[jetty-server-9.4.48.v20220622.jar:9.4.48.v20220622] Thanks, Rajani On Wed, Sep 13, 2023 at 1:59 PM Shawn Heisey wrote: > On 9/12/23 18:28, rajani m wrote: > >Solr 9.1.1 version, upon restarting solr on any node in the cluster, a >

Re: Restart on a node triggers restart like impact on all the other nodes in cluster

2023-09-14 Thread rajani m
oints to be gradually ramped up. However this will be > using actual consumer traffic so whilst it would help with overwhelming a > solr node when it first starts, some consumers will experience slow query > performance initially. > > Both of these solutions are Kubernetes-centric but

Restore from aws ebs volume snapshots

2023-09-19 Thread rajani m
Hi Solr Users, Have you tried to restore indexes from aws ebs volumes snapshots and does that work? I am aware of the s3 backup and restore api but thinking if this option of taking the volume snapshot and restoring indexes from the snapshot works? All the replicas are nrt type. Thanks, Rajani

Timeout on LTR query causing out of memory

2023-09-26 Thread rajani m
Hi Solr Users, Is there an alternative way to time limit an LTR query and request main ranker results if a reranker such as an LTR query takes more time than allowed? I see there is a SOLR-14607 regarding LTR time allowed issue, but it is ope

Re: Timeout on LTR query causing out of memory

2023-09-27 Thread rajani m
re.java:229) ~[?:?] 4. at org.apache.solr.ltr.LTRScoringQuery$ModelWeight.scorer(LTRScoringQuery.java:500) ~[?:?] On Tue, Sep 26, 2023 at 10:20 PM rajani m wrote: > Hi Solr Users, > >Is there an alternative way to time limit an LTR query and request main > ranker results if a re

Some nodes show high query latency

2023-09-29 Thread rajani m
Hi Solr Users, What could cause some nodes in a cluster to have high query latency when compared to the rest? It is Solr 9.1.1 cluster of 32 nodes. Cluster has one collection divided into 32 shards and replication 3, so each node has one Solr server hosting 3 replicas. It is composite route

Re: Some nodes show high query latency

2023-10-03 Thread rajani m
ction? > > The nodes that consistently display high latency, do they have the same > > replicas? I mean, are they the only nodes where such high latency queries > > can be executed? > > > > On Fri, Sep 29, 2023 at 9:29 PM rajani m wrote: > > > > > Hi

Re: Timeout on LTR query causing out of memory

2023-10-08 Thread rajani m
I have filed a Jira SOLR-17018 <https://issues.apache.org/jira/browse/SOLR-17018> explaining the issue and think it is just a certain type of queries causing the issue and not any bug, but still looking into it to see if anything else. On Wed, Sep 27, 2023 at 11:38 AM rajani m wrote:

Re: Timeout on LTR query causing out of memory

2023-10-11 Thread rajani m
Hi Shawn, Thank you for looking into this. I have updated the jira with further investigation https://issues.apache.org/jira/browse/SOLR-17018. Please take a look and let me know what you all think. On Mon, Oct 9, 2023 at 2:22 PM Shawn Heisey wrote: > On 10/8/23 18:24, rajani m wrote: &g

Re: Timeout on LTR query causing out of memory

2023-10-16 Thread rajani m
se/SOLR-14607>? Thank you all for looking into this one. Rajani On Wed, Oct 11, 2023 at 2:47 PM rajani m wrote: > Hi Shawn, > > Thank you for looking into this. I have updated the jira with further > investigation https://issues.apache.org/jira/browse/SOLR-17018. Please > take

Re: SOLR 9.3 - JVM Crashes

2023-10-22 Thread rajani m
Hi Andrea, Good to hear that. What type of *cache* config do you have in the old configuration? I ask because Legacy Solr Cache from 8.x does not work when solr is upgraded to 9.x. As per the docs

Num Found of docs containing vector fields

2023-10-22 Thread rajani m
Hi Solr Users, How do you query Solr to get a count of the number of docs consisting of vector fields? Would you make use of knn qp and populate a query vector of the same length with 1's? For example, localhost:8983/solr/v9/select?q={!knn f=vector_field topK=10}[512 dim vector]. Also, this ht

Re: Num Found of docs containing vector fields

2023-10-24 Thread rajani m
;t try right now, can you check if that's implemented correctly? > > Cheers > > On Mon, 23 Oct 2023, 01:35 rajani m, wrote: > > > Hi Solr Users, > > > > How do you query Solr to get a count of the number of docs consisting > of > > vector fields? Would y

Re: Solr Heap usage

2023-10-24 Thread rajani m
When you see memory filling up on the visualvm gui, request a heap dump. The heap dump file gets stored on the node's /tmp location. Use the eclipse memory analyzer tool (MAT) to load the downloaded ".dmp" file, the MAT analyzes the heap and generates a report of objects on the heap. On Mon, Oct 2

Re: Suggestions to improve Star queries latencies

2023-11-01 Thread rajani m
Sorry, it took too long to get back to this one. The search query "http://host:8983/solr/v9/select?&q=*&rows=10"; consistently took ~500 ms. With "distrib=false" all the 96 shards have QTime 0-25 ms. Does this mean aggregation of results from all the shards is taking ~475 ms? I also tried shards

Why does edismax resets field level wild query to *:*

2023-11-15 Thread rajani m
Hi Solr Users, Why does edismax query reset field exist query to *:*? Is this expected behavior or a bug? Edismax query "q": "{!edismax qf=keywords v='*'}" or in the other form "q=*&qf=keywords.en&defType=edismax" I expected this to translate into keywords:* Parser debug query response is

Re: Why does edismax resets field level wild query to *:*

2023-11-15 Thread rajani m
cted behavior. The value for > the query is coming from the parameter v and qf is coming from the > parameter qf which in this example is set to "*". Hence q=* and qf = > keywords.en. > > --Thanks and regards > Vaijanath > > On Wed, Nov 15, 2023 at 7:06 AM rajani m wrot

Re: Why does edismax resets field level wild query to *:*

2023-11-15 Thread rajani m
Thank you, Hoss. That answered my question. On Wed, Nov 15, 2023, 1:08 PM Chris Hostetter wrote: > > : Why does edismax query reset field exist query to *:*? Is this > : expected behavior or a bug? > : > : Edismax query "q": "{!edismax qf=keywords v='*'}" or in the other > : form "q=*&qf=

Re: Suggestions to improve Star queries latencies

2023-11-17 Thread rajani m
large number of docs from any query fields, which is often the keywords field in this case, it has high latency. What causes this issue? What are my options to optimize such queries latency? Thank you, Rajani On Thu, Nov 2, 2023 at 12:30 PM Mikhail Khludnev wrote: > On Thu, Nov 2, 2023 at 5:01

Re: Suggestions to improve Star queries latencies

2023-11-18 Thread rajani m
find an answer with distrib=false and debug=timing > > > > > > On Fri, Nov 17, 2023 at 8:49 PM rajani m wrote: > > > > > Hi again, > > > > > > Thank you for all the pointers, they were very helpful. After > digging > > in &g

IllegalArgumentException: Comparison method violates its general contract! - LTR query exception

2023-11-27 Thread rajani m
Hi Solr Users, LTR query throwing the following exception, what could be the reasons? It is Solr 9.1.1 o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: java.lang.IllegalArgumentException: Comparison method violates its general contract! => org.apache.solr.common.SolrException: jav

Conditional query re-ranking

2023-11-28 Thread rajani m
Hi Solr Users, Does query reranking support checking a condition before applying the re rank query? Thank you, Rajani

Re: Conditional query re-ranking

2023-12-03 Thread rajani m
http://joelsolr.blogspot.com/ > > > On Tue, Nov 28, 2023 at 10:29 AM rajani m wrote: > > > Hi Solr Users, > > > > Does query reranking support checking a condition before applying the > re > > rank query? > > > > Thank you, > > Rajani > > >

Re: IllegalArgumentException: Comparison method violates its general contract! - LTR query exception

2023-12-03 Thread rajani m
Hi Hoss, I don't have a query that reproduces it yet. The error is seen in production logs only, and I cannot apply patches on those nodes. I will keep looking for the query and will keep you updated. Another bit of extended exception trace is as follows - Caused by: java.lang.IllegalArgumentEx

Sortable Text Field use case

2023-12-03 Thread rajani m
Hi Solr Users, Would query performance improve if a text field such as "description" or "summary" are Sortable Text Field type instead of TextField type? The fields are queried with edismax syntax in which caret (^) boost is applied. For example, q=cats&description^10 title^50 Thanks, Rajani

Optimize latency of queries with facets

2024-01-02 Thread rajani m
Hi Solr Users, Queries with facets show 2x increase in latency. This facet field is a boolean field with docvalues enabled[1]. Same queries without facets have ~50 ms and with facets it is ~120ms. Is this an expected performance? Appreciate any suggestions to optimize it. Additional details

Solr query using full heap and triggers stop the world pause

2024-01-03 Thread rajani m
Hi Solr Users and Devs, Solr query with LTR as a re-ranker is using full heap all of sudden and triggering STW pause. Could you please take a look and let me know your thoughts? What is causing this? The STW is putting nodes in an unhealthy state causing nodes to restart and bringing the enti

Re: Solr query using full heap and triggers stop the world pause

2024-01-04 Thread rajani m
: > On 1/3/24 13:33, rajani m wrote: > > Solr query with LTR as a re-ranker is using full heap all of sudden > and > > triggering STW pause. Could you please take a look and let me know your > > thoughts? What is causing this? The STW is putting nodes in an unhealthy >

Re: Solr query using full heap and triggers stop the world pause

2024-01-04 Thread rajani m
wunderwood.org > http://observer.wunderwood.org/ (my blog) > > > On Jan 4, 2024, at 9:28 AM, rajani m wrote: > > > > Thank you Shawn, that was very helpful. I have tried the > G1HeapRegionSize > > setting. I set it to 32m(XX:G1HeapRegionSize=32m) and replayed the sa

ExitableDirectoryReader warning

2024-01-04 Thread rajani m
Hi, What scenarios would solr warn about "ExitableDirectoryReader" ? I see several "ExitableDirectoryReader$ExitingReaderException: The request took too long to iterate over terms.". What causes this this? Is it a shard size issue or lack of any resources, heap, ram or cpu? . Log snippets -

Re: ExitableDirectoryReader warning

2024-01-04 Thread rajani m
Hi Mikhail, Did you intend to include a list of reasons? I only got "It might be any or all of these reasons." Thank you, Rajani On Thu, Jan 4, 2024 at 3:20 PM Mikhail Khludnev wrote: > It might be any or all of these reasons. > > On Thu, Jan 4, 2024 at 10:18 PM rajani

Cross-dc release process

2024-01-05 Thread rajani m
Hi Solr Users/Dev, Would cross-dc plugin continue to be outside of solr repo as of 9.x version? I am considering to deploy and test it locally, there are no releases/jars to download. I didn't find any documentation on how to build and generate the release jar. Could you provide me with these

Node roles vs SIP-20 Separation of Compute and Storage

2024-01-16 Thread rajani m
Hi All, Saw a post on the dev-mailing list about SIP-20 Separation of Compute and Storage . Trying to understand what extra features it adds when compared to configuring a solrcloud clust

ML Model Management in Solr

2024-01-23 Thread rajani m
Hi All, Is it in the road map to support trained ML model deployment in solr? Models that can be deployed to generate text embedding at ingest time and query embeddings at query time. Thanks, Rajani

Re: ML Model Management in Solr

2024-01-24 Thread rajani m
seaseltd> > > > > > > On Wed, 24 Jan 2024 at 08:19, uyil...@vivaldi.net.INVALID > > wrote: > > > >> There's a way to produce, use and store them but it only supports a > fixed > >> format: > >> > >> https://solr.apache.org

LTR model upload API issue

2024-01-27 Thread rajani m
Hi All, Similar to any schema APIs, I expected the LTR model upload endpoint to distribute and make the model available across all the nodes, however it does not. After upload, it continues to report "model not found exception". The model becomes available only after a collection "reload" api

Re: LTR model upload API issue

2024-01-28 Thread rajani m
, > I think the LTR models could take advantage of the File store APIs that was > built for distributed management of package files. If you file a JIRA for > it, someone can pick it up and work on it. > Thanks and regards, > Ishan > > On Sat, 27 Jan, 2024, 11:

Re: LTR model upload API issue

2024-01-29 Thread rajani m
Open Source > > > > Website: Sease.io <http://sease.io/> > > LinkedIn <https://linkedin.com/company/sease-ltd> | Twitter > > <https://twitter.com/seaseltd> | Youtube > > <https://www.youtube.com/channel/UCDx86ZKLYNpI3gzMercM7BQ> | Github &

Block MAX WAND feature use

2024-01-31 Thread rajani m
Hi All, To leverage the query time improvements that come with the Block MAX WAND feature, what are the required configurations? I am on solr 9.1.1 version. As per docs, including "minExactCount=100" query param should do it, however I don't see any drop in query time, it is more or less the sa

Re: Block MAX WAND feature use

2024-02-01 Thread rajani m
h, if needed. > https://github.com/fullstorydev/solr-bench > > On Thu, 1 Feb, 2024, 11:20 am Ishan Chattopadhyaya, < > ichattopadhy...@gmail.com> wrote: > > > Some documentation is here > > > https://solr.apache.org/guide/8_6/common-query-parameters.html#minexac

Re: Block MAX WAND feature use

2024-02-05 Thread rajani m
owers card&defType=edismax&qf=keywords description title*&minExactCount=10* On Thu, Feb 1, 2024 at 8:36 AM rajani m wrote: > Hi Ishan, >I have looked into that doc, and it looks like the solr version has to > be >8.8 and the config needed is to add the query parameter &q

Re: Block MAX WAND feature use

2024-02-05 Thread rajani m
never tried it myself. > > On Mon, Feb 5, 2024 at 6:20 PM rajani m wrote: > > > I ran performance tests with different query sets and the results look no > > good, it is adding to the latency around ~15% instead of reducing or even > > matching. Not sure if I am missing s

Override similarity scoring algorithm via query param

2024-02-05 Thread rajani m
Hi Solr Users, Is it possible to override similarity scoring algorithm via query param? I know it can be set in schema field type definition but this needs schema update, is it possible to request

Re: Block MAX WAND feature use

2024-02-06 Thread rajani m
well. > > As far as I understand this feature works with large segments since it > > skips a block of a segment, not a segment (?). > > > > On Mon, Feb 5, 2024 at 8:04 PM rajani m wrote: > > > > > The "numFound" value is 200-300 docs difference

Group by query reports null pointer when unique key is not stored

2024-02-06 Thread rajani m
Hi Solr Users, Group by query is failing with the following error message. It looks like TopGroupsResultTransformer.java

Query num docs having vector fields

2024-02-13 Thread rajani m
Hi Solr Users, Is there a way to query the total number of documents in the index that have vector fields? I tried the luke endpoint which returns definition, but it does not return "docs" attribute. The vector:* does not work. Any alternatives to this? Solr 9.1.1 version. Thank you, Rajani

firstSearcher listener replaying queries 3 times

2024-02-13 Thread rajani m
Hi Solr Users, The first searcher listener replays the list of queries under the listener list 3 times, wondering what could be the reason for it? In the below example, when the collection is reloaded, the "q" is replayed 3 times, I expected it to be once. Is it a bug or the first searcher tri

Re: Block MAX WAND feature use

2024-02-14 Thread rajani m
mmon to most queries. What are your thoughts? Thank you, Rajani On Tue, Feb 6, 2024 at 2:54 PM rajani m wrote: > > > With a 400M index it's worth experimenting with skipping about a million > of docs. > Is there a param that allows setting how many docs to skip? > > &q

Re: Block MAX WAND feature use

2024-02-14 Thread rajani m
Mikhail Khludnev wrote: > Cool. > Btw can you rerank results with the corresponding boost query? > > On Wed, Feb 14, 2024 at 8:46 PM rajani m wrote: > > > Milkhail, > > > > Thanks for that pointer to test with a simple query. It works perfectly > > with luc

Re: Block MAX WAND feature use

2024-02-15 Thread rajani m
ev channel regarding what is expected when there are multiple query fields. Thanks again for all your help and pointers. On Thu, Feb 15, 2024 at 2:25 AM Mikhail Khludnev wrote: > Hello, > Please check inline below. > > On Thu, Feb 15, 2024 at 2:11 AM rajani m wrote: > > >

Marking replicas down at startup and waiting does not wait SOLR-17049

2024-02-15 Thread rajani m
Hi Solr Users, Any alternatives to the bug reported on SOLR-17049 ? When solr is restarted it seems like the replicas are active sooner than the core reload is complete. ZK, unaware of the core reload, starts sending requests to those replicas and hence queries during this period have high late

Run solr in cloud mode and debug from intellij

2024-02-19 Thread rajani m
Hi Solr Devs, Are there any docs to debug solr in cloud mode from intellij? I found this [1] article which covers what I am looking for but it is from 2015, could you take a look and verify if all still apply as of today? In that artic

Knn queries Index out of bound: auto-warming of key:org.apache.solr.search.QueryResultKey

2024-02-20 Thread rajani m
Hi Solr Users, I see the following index out of bound errors from "QueryResultKey" cache when running knn queries, is this known issue? The complete stack trace is as follows. Solr version 9.1.1 2024-02-20 13:36:59.859 ERROR (searcherExecutor-23-thread-1-processing-10.146.100.131:8983_solr v9

Core vs Shard activities upon startup of solr

2024-02-22 Thread rajani m
Hi Solr Users/Dev, What needs to happen to core, shard and node recovery during startup of solr? Currently, is not taking place in the right order so the solr goes into an unresponsive state for a few minutes even when shard is marked active. This causes a handful of queries to fail to return

Re: firstSearcher listener replaying queries 3 times

2024-02-26 Thread rajani m
reload. (or some other situation > that causes 3 replicas on this one node) > > firstSearcher and newSearcher events are processed on individual > SolrIndexSearchers -- and each replica has it's own SolrIndexSearchers > > : Date: Tue, 13 Feb 2024 16:57:59 -0500 >

Multiple query parsers syntax

2024-02-26 Thread rajani m
Hi Solr Users, Could you please help me with an example query syntax that uses more than one query parser in the same query? I tried the following, edismax to search against the description field and lucene parser to search against the keywords field, but it does not work. What is wrong? host

Re: Multiple query parsers syntax

2024-02-28 Thread rajani m
Thank you Hoss, the slides and presentation are gold. Thank you Robi and Mikhail for looking into this one. On Wed, Feb 28, 2024, 1:50 PM Robi Petersen wrote: > Thanks Hoss! I'd forgotten that link didn't work... I'd just scrolled thru > the slides (a long time ago) > > On Wed, Feb 28, 2024 at

Bury search results with bq

2024-03-13 Thread rajani m
Hi Solr Users, How do you bury results based on subquery such as bq=-(keywords:2023)? Thank you, Rajani

Re: Bury search results with bq

2024-03-13 Thread rajani m
ude them entirely > (not just sort them last), have a look if the Query Elevation Component > suits your needs. > > > https://solr.apache.org/guide/solr/latest/query-guide/query-elevation-component.html > > Thomas > > Op wo 13 mrt 2024 om 17:36 schreef rajani m : > > &g

edismax boost query(bq) with local params syntax

2024-03-25 Thread rajani m
Hi Solr Users, Could you help me with the bq syntax that supports boosting a term with caret ? Given the following boost query, I need to multiply the payload value with 10. bq={!payload_score f=field_name v

Re: edismax boost query(bq) with local params syntax

2024-03-25 Thread rajani m
ok, I figured, the syntax - bq= _query_:"" AND _val_:"" seems to be working. On Mon, Mar 25, 2024 at 1:44 PM rajani m wrote: > Hi Solr Users, > > Could you help me with the bq syntax that supports boosting a term with > caret > <https://solr.a

Re: Performance Suggestion for Dense Vectors

2024-03-28 Thread rajani m
Run the same knn queries at a slow throughput for 30-60 minutes, this should warm up disk caches with hnsw index files, and then you should see a significant drop in the query time. Also make use of "fq" and reduce the document space as much as you can. On Thu, Mar 28, 2024 at 12:50 PM Iram Tariq

Re: Performance Suggestion for Dense Vectors

2024-03-28 Thread rajani m
and look for. On Thu, Mar 28, 2024 at 3:33 PM rajani m wrote: > Run the same knn queries at a slow throughput for 30-60 minutes, this > should warm up disk caches with hnsw index files, and then you should see a > significant drop in the query time. Also make use of "fq&q

Re: Performance Suggestion for Dense Vectors

2024-03-28 Thread rajani m
rajani m wrote: > @Alessandro, > Is there a solr blog site where we can submit work/articles or are you > suggesting to post on my own site and share a link here? I prefer the > former if there is one because there were times when I had my own, > it hardly had any views and on top

Date syntax : Filter by month independent of the year

2024-04-05 Thread rajani m
Hi Solr Users, Any creative date range syntax that allows filters by month independent of the year? Such as date_added:[*-01-29T00:00:00Z TO *-04-09T00:00:00Z] The date format in the index is tries/kd-trees so thinking this could be possible. Appreciate any thoughts. Thank you for your time,

Re: Date syntax : Filter by month independent of the year

2024-04-05 Thread rajani m
it, clone the field without > storage > > and preprocess to just leave the months behind. That's like 12 possible > > values - super efficient for filtering. Or set all years to year 1 in the > > copy if you are still doing day as well. > > > > Regards,

Re: Memory tuning advice for small single-node Solr instance

2024-05-06 Thread Rajani M
What type of queries do you send to Solr, what is the QTime returned per query on an average, and how many queries per second/minute? Try increasing the heap to 512 mb and 1024 mb and test it. Solr 9.6 supports QueryLimits termination which should avoid queries from excessive usage of resources and

Re: Memory tuning advice for small single-node Solr instance

2024-05-08 Thread Rajani M
>I think I have limited the documents returned in each query to 10,000 via the client software. Did you mean the solr query rows param is limited to 10,000? Fetching a large number of records can be inefficient, it should be less than 100, a standard page size. Go through this[1] doc. Hope it help

Re: 5xx on Node Restart After Upgrading from Solr 8.10 to 9.6.1

2024-09-03 Thread Rajani M
This should have been fixed in the latest version. I have not tested it but experienced the same issue in the 9.1.1 version and the work around was to add as many warming queries as possible