Hi,
We have a filter query in our system
"fq=negativeattribute:(citychennai%20citydelhi)", in solr 6.5 it was
working fine.
solr 6.5 parsed query as
negativeattribute:citychennai negativeattribute:citydelhi
After upgrading the solr to 8.7, this query broke. It is not working as
before
solr 8.
a of negattribute field
<
filter class="solr.TrimFilterFactory"/>
Schema of mcatid field
On Wed, Jul 21, 2021 at 8:42 PM Shawn Heisey wrote:
> On 7/20/2021 11:37 PM, Satya Nand wrote:
> > We have a filter query in our system
> > "fq=negativeattribute:(
Hi,
We have recently upgraded solr from version 6.5 to version 8.7. But
opposite to our expectations, the response time increased by 40 %.
On solr 8.7 the difference between optimized and unoptimized index is also
very huge. 350 ms on optimized and 650 ms on unoptimized. The difference is
only 5
ot;Plant a Tree, Go Green"
>
> Make In India : http://www.makeinindia.com/home
>
>
> On Tue, Aug 3, 2021 at 12:10 PM Satya Nand .invalid>
> wrote:
>
> > Hi,
> >
> > We have recently upgraded solr from version 6.5 to version 8.7. But
> > opposite t
Hi,
We are facing a strange issue in our solr system. Most of the days it keeps
running fine but once or twice in a month, we face OutofMemory on solr
servers.
We are using Leader-Follower architecture, one Leader and 4 followers.
Strangely we get OutofMemory error on all follower servers.
Before
o the user's queries, to how
> you build your queries ... but 70% is a good value. At some point
> increasing the size again and again won't increase cumulative_hitratio a
> lot as it is a logarithmic curve.
>
> Check also the heap usage also with your JVM GC logs and a tool
d-solr-temp1
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
search-central-prd-solr-temp1
at org.eclipse.jetty.server.Server.handle(Server.java:534)
search-central-prd-solr-temp1
On Tue, Aug 10, 2021 at 6:30 AM Shawn Heisey wrote:
> On 8/8/2021 11:43 PM, Sa
the issue? Sould we reduce this to 1 ? what impact would it
have if we reduced it ?
On Wed, Aug 11, 2021 at 2:15 AM Dominique Bejean
wrote:
> Pretty sure the issue is caused by caches size at new searcher warmup time.
>
> Dominique
>
>
> Le mar. 10 août 2021 à 09:07, Satya Nand a
1 at 4:12 AM Shawn Heisey wrote:
> On 8/10/2021 1:06 AM, Satya Nand wrote:
> > Document count is 101893353.
>
> The OOME exception confirms that we are dealing with heap memory. That
> means we won't have to look into the other resource types that can cause
> OOME.
>
&
k: https://www.facebook.com/deicool
> LinkedIn: www.linkedin.com/in/deicool
>
> "Plant a Tree, Go Green"
>
> Make In India : http://www.makeinindia.com/home
>
>
> On Tue, Aug 3, 2021 at 3:25 PM Satya Nand .invalid>
> wrote:
>
> > Hi Deepak,
> >
> > We a
Facebook: https://www.facebook.com/deicool
> LinkedIn: www.linkedin.com/in/deicool
>
> "Plant a Tree, Go Green"
>
> Make In India : http://www.makeinindia.com/home
>
>
> On Wed, Aug 11, 2021 at 12:38 PM Satya Nand
> wrote:
>
> > Thanks, Deepak, We wi
20 PM Shawn Heisey wrote:
> On 8/10/2021 11:17 PM, Satya Nand wrote:
> > Thanks for explaining it so well. We will work on reducing the filter
> > cache size and auto warm count.
> >
> > Though I have one question.
> >
> > If your configured 4000 entry filter
straint(filter cache size) would apply only on bitmap or
this alternate structure too or their sum?
On Wed, 11 Aug, 2021, 6:50 pm Shawn Heisey, wrote:
> On 8/11/2021 6:04 AM, Satya Nand wrote:
> > *Filter cache stats:*
> >
> https://drive.google.com/file/d/19MHEzi9m3KS4s-M86
Hi Michael,
1. set `pf=` (phrase field empty string), disabling implicit phrase query
> building. This would help give a sense of whether phrase queries are
> involved in the performance issues you're seeing.
We are also in the process of moving from standalone 6.6 to 8.7 Solr cloud,
We also no
can restore
> performance, it would be at the expense of nuances of functionality. Longer
> term I'd really like to help solve this properly, involving some
> combination of the issues linked to in the above thread ...)
>
> Michael
>
> On Thu, May 5, 2022 at 3:0
Hi,
I have an 8 shards collection, where I am using *compositeId* routing
with *router.field
*(a field named parentglUsrId). The unique Id of the collection is a
different field *displayid*.
I am trying a delete by id operation where I pass a list of displayids to
delete. I observed that no docum
gt; Best regards,
> Radu
> --
> Elasticsearch/OpenSearch & Solr Consulting, Production Support & Training
> Sematext Cloud - Full Stack Observability
> http://sematext.com/
>
>
> On Tue, Jun 28, 2022 at 7:55 AM Satya Nand .invalid>
> wrote:
>
> > Hi,
lient that uses the url of the
> shard where the record exists.
>
> Regards,
> Peter.
>
> -----Original Message-
> From: Satya Nand
> Sent: 28 June 2022 10:43
> To: users@solr.apache.org
> Subject: Re: Delete by Id in solr cloud
>
> EXTERNAL SENDER: Do not
same issue, and had
> to use deleteByQuery instead, but like you said, it's much slower. We're
> using solr 8.11
>
> On Tue, Jun 28, 2022 at 4:59 AM Satya Nand .invalid>
> wrote:
>
> > Thanks, Peter,
> > I am checking that, also UpdateRequest class seems
eId. We had the same issue, and had
> to use deleteByQuery instead, but like you said, it's much slower. We're
> using solr 8.11
>
> On Tue, Jun 28, 2022 at 4:59 AM Satya Nand .invalid>
> wrote:
>
> > Thanks, Peter,
> > I am checking that, also UpdateReque
Hi,
Currently, we have 8+1 solr nodes cluster. Where 1 Indexing node contains
all(8) NRT Primary shards. This is where all indexing happens. Then We have
another 8 nodes consisting of one pull replica of each primary shard.
For querying, we have used *shard.preference as PULL *so that all queries
wrote:
> On 8/30/22 08:08, Satya Nand wrote:
> > For querying, we have used *shard.preference as PULL *so that all queries
> > are returned from pull replicas.
> >
> > How can I force solr to use only pull replicas? in case one of the pull
> > replicas is not availab
.
On Thu, Sep 1, 2022 at 11:22 AM Satya Nand wrote:
> Thank you Shawn.
> If I eliminate this indexing node and create 8 NRT shards on these 8 query
> nodes. Meaning indexing will be happening on all 8 nodes and queries too.
>
> Will it create any impact on response time?
Thanks, Shawn.
I will try to create another post covering as many details as possible,
then somebody from this mailing list can help me in reviewing my
architecture,
On Wed, Sep 7, 2022 at 9:21 PM Shawn Heisey
wrote:
> On 8/31/22 23:52, Satya Nand wrote:
> > Thank you Shawn.
> >
Hi All,
We have recently moved from solr 6.5 to solr cloud 8.10.
*Earlier Architecture:*We were using a master-slave architecture where we
had 4 slaves(14 cpu, 96 GB ram, 20 GB Heap, 110 GB index size). We used to
optimize and replicate nightly.
*Now.*
We didn't have a clear direction on the nu
t; 7. How do you maintain versioning of config in zookeeper?
> I bootstrap my configset and use the api’s.
> https://github.com/querqy/chorus/blob/main/quickstart.sh#L119 <
> https://github.com/querqy/chorus/blob/main/quickstart.sh#L119> for an
> example.
Thank you, I will check
ck out your cache performance (in JMX or the solr ui) and increase
> those if you index infrequently. Ideally your entire index should be
> landing in memory.
>
> On Thu, Sep 8, 2022 at 1:59 AM Satya Nand
> wrote:
> >
> > Hi All,
> >
> > We have recently moved
Hi,
Is there any configuration, where we can define the replication interval
when pull replica should pull indexes from NRT replicas?
l
> pull new segment data from the current shard leader as they become
> available. No specific configuration is needed.
>
> Regards,
> Markus
>
> Op ma 3 okt. 2022 om 11:48 schreef Satya Nand
> :
>
> > Hi,
> >
> > Is there any configuration, where we can def
Hi,
This is what our solr cloud's merge policy looks like. and we have approx
30% deleted documents in the index.
- is this normal?
- If not How can I decrease the number of deleted documents?
- Will the above help us in response time?
* 200 53 *
see better
> response times.
>
> Regards,
> Markus
>
> [1]
>
> https://lucene.apache.org/core/8_9_0/core/org/apache/lucene/index/TieredMergePolicy.html#setDeletesPctAllowed-double-
>
> Op ma 3 okt. 2022 om 12:06 schreef Satya Nand
> :
>
> > Hi,
> >
> &
Hi,
We have an 8-node cluster, Where each node contains only 1 replica of PULL
time.
For the last few hours suddenly we are facing high CPU usage and load on
one of the servers (double of the other servers)
Upon checking in the Solr Graphna Dashboard it was found that *Mapped Total
Capacity(Jvm
-22_shard2_replica_p19] main
- Searcher@6f3bd5b7[im-search-03-08-22_shard2_replica_p19] main
Sharing the cache configuration as well. Total documents in this replica
are 18 million.(25 mn maxdoc, 7 mn deleted doc.
On Fri, 7 Oct 2022 at 6:32 PM, Shawn Heisey wrote:
> On 10/7/22 06:23, Sa
Shawn,
I just observed that 2nd searcher is not getting closed. It was also there
when I originally posted the question.
On Fri, 7 Oct 2022 at 7:25 PM, Satya Nand wrote:
> Hi Shawn,
>
> I dont think it was heap size. We have assigned only 8 GB heap size. This
> was named as
0/7/22 07:55, Satya Nand wrote:
> > I guess it is something related to mmap directory implementation of index
> > directory though I could be wrong.
>
> That makes sense. MMAP space is not a count of memory actually taken,
> just the amount of data that is accessible. The OS ma
Shawn,
After sometime mapped total capacity reached to 100 GB(probably after some
commit). Young GC count doubled and server threw out of memory error.
Any insights? What we can check to avoid this?
On Fri, 7 Oct, 2022, 8:03 pm Satya Nand, wrote:
> Shawn,
>
> Yes earlier I did not
Hi,
Good Morning.
we have 8+1 solr nodes cluster. Where 1 Indexing node contains all(8) NRT
Primary shards. This is where all indexing happens. Then We have another 8
nodes consisting of one pull replica of each primary shard.
To limit the query on replicas we have done the following changes in
e anything I can do to make it work? I just want to use some
specific set of replicas with shard.tolrent=true.
On Mon, Oct 10, 2022 at 5:07 PM Shawn Heisey wrote:
> On 10/10/22 01:57, Satya Nand wrote:
>
> >> *"Do not add the shards parameter to the standard request han
i cam not able to make it work.
On Mon, 10 Oct, 2022, 6:14 pm Shawn Heisey, wrote:
> On 10/10/22 06:00, Satya Nand wrote:
> > Yes, we are using solr cloud. The reason I don't want to specify the
> > shards' names is that a request can be sent to any replica of a shard
Thanks Shawn for sharing all possibilities , we will try to evaluate all
these.
On Mon, 10 Oct, 2022, 6:45 pm Shawn Heisey, wrote:
> On 10/10/22 06:58, Satya Nand wrote:
> > Actually we were using the preference parameter but recently we faced an
> > issue where 1 pull replica
Hi,
We are planning to use an external file field.
How do we manage it in solr cloud? Do we need to make a copy of this file
in every shard's data directory or somehow solr cloud can manage it. ?
Hi,
Greetings for the day,
We are facing a strange problem in Solr cloud where a few requests are
taking hours to complete. Some requests return with a 0 status code and
some with a 500 status code. The recent request took more than 5 hours to
complete with only a 9k results count.
These querie
++ GC report
https://gceasy.io/my-gc-report.jsp?p=c2hhcmVkLzIwMjIvMTIvOC9zb2xyX2djLmxvZy0tMTEtMzktMzE=&channel=WEB
On Thu, Dec 8, 2022 at 4:57 PM Satya Nand wrote:
> Hi,
>
> Greetings for the day,
>
> We are facing a strange problem in Solr cloud where a few requests ar
low query logging might be
> enabled and can give more clues for troubleshooting. AFAIK ParallelGC
> despite its name is quite old and not really performant.
>
> On Thu, Dec 8, 2022 at 2:28 PM Satya Nand .invalid>
> wrote:
>
> > Hi,
> >
> > Greetings for the
he start or rows parameter) is a typical issue
> (see e.g. https://yonik.com/solr/paging-and-deep-paging/ for more
> information).
>
> Best,
> Ere
>
> Satya Nand kirjoitti 8.12.2022 klo 13.27:
> > Hi,
> >
> > Greetings for the day,
> >
> > We are fac
Pinging on this thread again to bring it to the top.
Any idea why one request is stuck for hours in solr cloud.?
On Fri, Dec 9, 2022 at 3:35 PM Satya Nand wrote:
> Hi Ere,
>
> We tried executing this request again and it didn't take any time. So it
> is not repeatable. average
Hi,
mailing list strips the attachments, you probably need to provide links for
screenshots.
On Thu, Dec 22, 2022 at 2:17 PM NEERAJ VERMA wrote:
> Solr's Grouping feature is not working for one of our datasets. It yields
> the grouping field's value as *null* at times, randomly (we haven't
> es
> Dominique
>
>
> Le dim. 18 déc. 2022 à 09:10, Satya Nand .invalid>
> a écrit :
>
> > Pinging on this thread again to bring it to the top.
> >
> > Any idea why one request is stuck for hours in solr cloud.?
> >
> > On Fri, Dec 9, 2022 at 3:35 PM S
when I
diverted the traffic to another infra .
https://drive.google.com/file/d/197QFkNNsbkhOL57lVn0EkPe6FEzKkWFL/view?usp=share_link
On Thu, Dec 22, 2022 at 3:19 PM Satya Nand wrote:
> Hi Dominique,
>
> I looked at the stack trace but I couldn't know for sure why the thread is
Thanks, Shawn
I will check that too.
On Fri, Dec 23, 2022 at 12:42 AM Shawn Heisey wrote:
> On 12/22/22 02:49, Satya Nand wrote:
> > I looked at the stack trace but I couldn't know for sure why the thread
> is
> > waiting. can anyone help me in decoding th
Hi,
Try force reloading the page, ctrl+f5.
It happened when we upgraded the solr.
On Fri, Jan 13, 2023 at 9:36 AM Anuj Bhargava wrote:
> Already added *SOLR_JETTY_HOST="0.0.0.0" *in solr.in.sh
> But getting the following error now -
>
> HTTP ERROR 503 Service Unavailable
> URI: /solr/
> S
Hi,
I wanted to check the merges happening in my index to relate it to CPU
usage. I checked out this metric UPDATE.updateHandler.merges.count on this
path ?type=update&entry=updateHandler, But it returns 0.
Should I be looking somewhere else?
52 matches
Mail list logo
