On 4/16/23 07:24, Rajani Maski wrote:
What are your suggestions to improve star queries latencies? By star
queries I mean "*:*" or single term queries having boost formulas (such as
doc recency and many others) taking 10 or more seconds. It is a large
collection with good compute
> And why is per shard latency so high? (~120 ms)
ok. this proves that it's a problem with low level search.
Make sure you have swap disabled, and plenty of ram available for mmaping
(limited heap).
Then, you need to put a search load: some simple script looping keywords
with cache and distrib di
q=cats&defType=edismax&qf=keywords&fl=id&rows=10
&distrib=false&cache=false&debug=timing
For query with distrib=false and cache=false, most shards have Qtime ~120
and few of them have QTime 0. It is the same with cache=true or without
cache param in the query.
debug time response from one shard is
Maybe also experiment with cache=false
On Fri, Nov 17, 2023 at 2:38 PM Mikhail Khludnev wrote:
> > What causes this issue?
> You may try to find an answer with distrib=false and debug=timing
>
>
> On Fri, Nov 17, 2023 at 8:49 PM rajani m wrote:
>
> > Hi again,
> >
> > Thank you for all the
> What causes this issue?
You may try to find an answer with distrib=false and debug=timing
On Fri, Nov 17, 2023 at 8:49 PM rajani m wrote:
> Hi again,
>
> Thank you for all the pointers, they were very helpful. After digging in
> enough, I figured that it is a certain text field that matc
Hi again,
Thank you for all the pointers, they were very helpful. After digging in
enough, I figured that it is a certain text field that matches a large set
of docs for a given query. And it is the one adding to the latency.
Appreciate any suggestions to optimize it.
An example query that mat
On Thu, Nov 2, 2023 at 5:01 AM rajani m wrote:
> Sorry, it took too long to get back to this one.
>
> The search query "http://host:8983/solr/v9/select?&q=*&rows=10";
> consistently
> took ~500 ms. With "distrib=false" all the 96 shards have QTime 0-25 ms.
> Does this mean aggregation of result
On 11/1/23 20:01, rajani m wrote:
The search query "http://host:8983/solr/v9/select?&q=*&rows=10"; consistently
took ~500 ms. With "distrib=false" all the 96 shards have QTime 0-25 ms.
Does this mean aggregation of results from all the shards is taking ~475
ms? I also tried shards.rows=5 and i
, 2023 at 7:59 AM Mikhail Khludnev
>> wrote:
>>>>>
>>>>>> Hello, Rajani.
>>>>>> I meant [SOLR-14765] optimize DocList creation by skipping sort for
>>>>>> sort-irrelevant cases - ASF JIRA (apache.org)
>>>>
relevant cases - ASF JIRA (apache.org)
> > >> > <https://issues.apache.org/jira/browse/SOLR-14765>
> > >> >
> > >> > On Wed, Apr 19, 2023 at 4:05 AM Rajani Maski >
> > >> > wrote:
> > >> >
> > >> > &g
> >Yes, 9.1.1, that should be helpful, can you please point me to the
> >> > > related jira(s) and/or docs?
> >> > >
> >> > > Thank you,
> >> > > Rajani
> >> > >
> >> > >
> >> > >
>
> Thank you,
>> > > Rajani
>> > >
>> > >
>> > >
>> > > On Mon, Apr 17, 2023 at 2:09 AM Mikhail Khludnev
>> > wrote:
>> > >
>> > > > Hello Rajani.
>> > > > Which version are
Mikhail Khludnev
> > wrote:
> > >
> > > > Hello Rajani.
> > > > Which version are you running? IIRC 9.1.2 has some
> > > > improvement about caching short queries.
> > > >
> > > > On Sun, Apr 16, 2023 at 4:25 PM Rajani Mas
; On Mon, Apr 17, 2023 at 2:09 AM Mikhail Khludnev
> wrote:
> >
> > > Hello Rajani.
> > > Which version are you running? IIRC 9.1.2 has some
> > > improvement about caching short queries.
> > >
> > > On Sun, Apr 16, 2023 at 4:25 PM Rajani Maski
out caching short queries.
> >
> > On Sun, Apr 16, 2023 at 4:25 PM Rajani Maski
> > wrote:
> >
> > > Hi Solr Users,
> > >
> > > What are your suggestions to improve star queries latencies? By star
> > > queries I mean "*:*" or si
pr 17, 2023 at 2:09 AM Mikhail Khludnev
>> wrote:
>>>>
>>>> Hello Rajani.
>>>> Which version are you running? IIRC 9.1.2 has some
>>>> improvement about caching short queries.
>>>>
>>>> On Sun, Apr 16, 2023 at 4:25 PM Raj
; Which version are you running? IIRC 9.1.2 has some
> >> improvement about caching short queries.
> >>
> >> On Sun, Apr 16, 2023 at 4:25 PM Rajani Maski
> >> wrote:
> >>
> >>> Hi Solr Users,
> >>>
> >>> What are your
9 AM Mikhail Khludnev wrote:
>>
>> Hello Rajani.
>> Which version are you running? IIRC 9.1.2 has some
>> improvement about caching short queries.
>>
>> On Sun, Apr 16, 2023 at 4:25 PM Rajani Maski
>> wrote:
>>
>>> Hi Solr Users,
>&g
ing short queries.
>
> On Sun, Apr 16, 2023 at 4:25 PM Rajani Maski
> wrote:
>
> > Hi Solr Users,
> >
> > What are your suggestions to improve star queries latencies? By star
> > queries I mean "*:*" or single term queries having boost formulas (such
Hello Rajani.
Which version are you running? IIRC 9.1.2 has some
improvement about caching short queries.
On Sun, Apr 16, 2023 at 4:25 PM Rajani Maski wrote:
> Hi Solr Users,
>
> What are your suggestions to improve star queries latencies? By star
> queries I mean "*:*"
Hi Solr Users,
What are your suggestions to improve star queries latencies? By star
queries I mean "*:*" or single term queries having boost formulas (such as
doc recency and many others) taking 10 or more seconds. It is a large
collection with good compute resources, however I am gue
21 matches
Mail list logo
