Gentle ping! Promise it's my final one! :)
On Thu, Jan 13, 2022 at 8:01 AM Ashwin Ramesh <[email protected]> wrote:
> Hi everyone,
>
> I have a few questions about how we can improve our solr query
> performance, especially for boosts (BF, BQ, boost, etc).
>
> *System Specs:*
> Solr Version: 7.7.x
> Heap Size: 31gb
> Num Docs: >100M
> Shards: 8
> Replication Factor: 6
> Index is completely mapped into memory
>
>
> Example query:
> {
> q=hello world
> qf=title description keywords
> pf=title^0.5
> ps=0
> fq=type:P
> boost:def(boostFieldA,1) // boostFieldA is docValue float type
> bf=mul(termfreq(termScoreFieldB,$q),1000.0) // termScoreFieldB is a
> textField. No docValue, just indexed
> rows:500
> fl=id,score
> }
>
> numFound: >21M
> qTime: 800ms
>
> Experimentation of params:
>
> - When I remove the boost parameter, the qTime drops to 525ms
> - When I remove the bf parameter, the qTime dropes to 650ms
> - When I remove both the boost & bf parameters, the qTime drops to
> 400ms
>
>
> Questions:
>
> 1. Is there any way to improve the performance of the boosts (specific
> field types, etc)?
> 2. Will sharding further such that each core only has to score a
> smaller subset of documents help with query performance?
> 3. Is there any performance impact when boosting/querying against
> sparse fields, both indexed=true or docValues=true?
> 4. It seems the base case scoring is 400ms, which is already quite
> high. Is this because the query (hello world) implicitly gets parsed as
> (hello OR world)? Thus it would be more computationally expensive?
> 5. Any other advice :) ?
>
>
> Thanks in advance,
>
> Ash
>
>
>
>
>
>
>
--
**
** <https://www.canva.com/>Empowering the world to design
Share accurate
information on COVID-19 and spread messages of support to your community.
Here are some resources
<https://about.canva.com/coronavirus-awareness-collection/?utm_medium=pr&utm_source=news&utm_campaign=covid19_templates>
that can help.
<https://twitter.com/canva> <https://facebook.com/canva>
<https://au.linkedin.com/company/canva> <https://twitter.com/canva>
<https://facebook.com/canva> <https://au.linkedin.com/company/canva>
<https://instagram.com/canva>
