Wrong number of found documents (grouping)

[Mike]

Hello!

Much fewer documents are displayed for me than are available in grouped ..
-> numFound.

Is a trick maybe necessary to display the correct number of found documents
in grouping mode and multi core search.

Thanks

Mike

Re: Slowness when searching in child documents.

[Walter Underwood]

On Jan 3, 2023, at 2:11 AM, Noah Torp-Smith  wrote:
> 
> I have also looked at denormalizing 
> (https://blog.innoventsolutions.com/innovent-solutions-blog/2018/05/avoid-the-parentchild-trap-tips-and-tricks-for-denormalizing-solr-data.html
>  
> )
>  and it helps when doing it for a few child fields. But as said, there are 
> more properties in the real model than those I have mentioned here, so that 
> also involves some complications.

I would look at denormalizing (flattening) the schema. That will make things 
much simpler. A pre-filter on work level fields is just a filter on the work 
fields in the manifest level objects, easy and fast, plus it gets cached in the 
filter cache. Sharding will also be straightforward, if needed.

I wouldn’t worry about lots of fields. We had a smallish index (150k docs) with 
30,000 fields per doc. Only a few fields were searched or used for ranking on 
each query. It was very fast.

You will need to update all the manifest level documents when there is a work 
level update, but those shouldn’t be frequent.

wunder
Walter Underwood
wun...@wunderwood.org
http://observer.wunderwood.org/  (my blog)

Re: Wrong number of found documents (grouping)

[Shawn Heisey]

On 1/5/23 08:08, Mike wrote:

Much fewer documents are displayed for me than are available in grouped ..
-> numFound.

Is a trick maybe necessary to display the correct number of found documents
in grouping mode and multi core search.


The "group.ngroups" parameter is the only thing I am aware of that is 
related to getting correct counts back in grouping.


https://solr.apache.org/guide/6_6/result-grouping.html#ResultGrouping-RequestParameters

A warning, group.ngroups=true will make a grouping query a lot slower.

Can you elaborate on the EXACT problem you're seeing so we can determine 
whether I am headed down the right path?


There is also the group.limit parameter, which depending on exactly what 
you are seeing, could be what you need to add/change.


Thanks,
Shawn

Delete a document using the Update Script Processor

[Matthew Castrigno]

I need to be able to delete a document based on the value of a specific field. 
I am already using the update script processor. There does not seem to be a 
method for

SolrInputDocument to do this. How can I delete a document in the Script Update 
Processor if I know the document id?

Thank you for any insights.

https://solr.apache.org/docs/7_1_0/solr-solrj/org/apache/solr/common/SolrInputDocument.html

--
"This message is intended for the use of the person or entity to which it is 
addressed and may contain information that is confidential or privileged, the 
disclosure of which is governed by applicable law. If the reader of this 
message is not the intended recipient, you are hereby notified that any 
dissemination, distribution, or copying of this information is strictly 
prohibited. If you have received this message by error, please notify us 
immediately and destroy the related message."

Setting a parameter from a update script processor script

[Matthew Castrigno]

The documentation show how to get a parameter but I cannot see where I can find 
out how to set a parameter in my update script processor.
https://solr.apache.org/guide/solr/latest/configuration-guide/script-update-processor.html#javascript

Does anyone know where I can find this information?
Thank you for any insights.

--
"This message is intended for the use of the person or entity to which it is 
addressed and may contain information that is confidential or privileged, the 
disclosure of which is governed by applicable law. If the reader of this 
message is not the intended recipient, you are hereby notified that any 
dissemination, distribution, or copying of this information is strictly 
prohibited. If you have received this message by error, please notify us 
immediately and destroy the related message."

Re: Setting a parameter from a update script processor script

[Shawn Heisey]

On 1/5/23 17:09, Matthew Castrigno wrote:

The documentation show how to get a parameter but I cannot see where I can find 
out how to set a parameter in my update script processor.
https://solr.apache.org/guide/solr/latest/configuration-guide/script-update-processor.html#javascript

Does anyone know where I can find this information?
Thank you for any insights.


From what I can tell, parameters are a way to get arbitrary information 
from solrconfig.xml to the processor ... I don't think that 
communication can flow the other direction, so there should be no need 
to set a parameter inside a processor.


Anyone else have a comment on it?

Thanks,
Shawn