Regarding solr field cache

2022-05-26 Thread Poorna Murali
Hi, I would like to know when will a solr field cache be invalidated or cleared? In our production configuration, we are doing a hard commit with opensearcher = false and we do not have any soft commit in our config. We can observe that fieldcache size is growing , at the same time it has not bec

RE: Regarding solr field cache

2022-05-26 Thread Poorna Murali
segment merging happens during hard commit? On 2022/05/26 14:54:22 Poorna Murali wrote: > Hi, > I would like to know when will a solr field cache be invalidated or > cleared? > > In our production configuration, we are doing a hard commit with > opensearcher = false and we do

Reg Solr field cache

2022-05-26 Thread Poorna Murali
Hi, Adding more details to my previous email. We are using Solr 8.4 . In our solr config we have autoCommit as hardcommit with opensearcher =false.and we do NOT have autosoftCommit Or explicit soft commit. Hence I presume that new searched won't be opened to invalidate the field cache. But it loo

RE: Re: Regarding solr field cache

2022-05-26 Thread Poorna Murali
Thanks Shawn for the information. Is it possible that the segment merging which happens during hardcommit can open a new searcher thereby making index updates visible during search? On 2022/05/26 17:19:21 Shawn Heisey wrote: > On 5/26/22 10:14, Poorna Murali wrote: > > In our configur

DocValues usage

2022-05-31 Thread Poorna Murali
Hi, We are planning to introduce docValues and reduce the usage of fieldcache in our application. I have a few doubts on these. Please help me to clarify them. 1) Will there be a performance impact if we use docValues as it does I/O read? Especially at the time of index generation? 2) Are there

RE: Re: DocValues usage

2022-05-31 Thread Poorna Murali
Thanks Mikhail! Regarding the id field, is it possible that while doing faceting or sorting, the id fields will be loaded in field cache by default? On 2022/05/31 21:27:57 Mikhail Khludnev wrote: > Hi, Poorna. > Pls check inline below. > > On Tue, May 31, 2022 at 4:21 PM Poorna Mur

Unique key field

2022-06-07 Thread Poorna Murali
Hi All, We have an id field(unique key) in our schema as follows, We are planning to introduce docValues to this field to save fieldcache space. My understanding on this is that, going forward all the sort or faceting done on id field will make use of docValues and since the stored flag is true

RE: Re: Unique key field

2022-06-07 Thread Poorna Murali
functionality version specific? On 2022/06/07 12:35:39 Vincenzo D'Amore wrote: > "string" field type usually has "docValues"=true as default. > > On Tue, Jun 7, 2022 at 11:22 AM Poorna Murali > wrote: > > > Hi All, > > > > We have an id field(uniqu

RE: Re: Re: Unique key field

2022-06-07 Thread Poorna Murali
sets/_default/conf/managed-schema.xml#L41 > > > > On Tue, Jun 7, 2022 at 9:43 AM Poorna Murali > > wrote: > > > >> If docValues are enabled by default for string field, then the sort > >> queries > >> on the field will not occupy field cache

RE: Re: Re: Re: Unique key field

2022-06-07 Thread Poorna Murali
--OF-l", > > Or you can use the schema browser to get the same information in a > more visual way: > http://localhost:8983/solr/#/techproducts/schema?field=id > > Thomas > > > Op di 7 jun. 2022 om 17:40 schreef Poorna Murali : > > > Thanks Gus! The only way to check i

RE: Re: Re: Unique key field

2022-06-07 Thread Poorna Murali
Thanks Vincenzo! I will check the schema too. On 2022/06/07 16:08:21 Vincenzo D'Amore wrote: > The easiest thing to do is double check your schema.xml and see how the > field type "string" is defined. > > On Tue, Jun 7, 2022 at 3:44 PM Poorna Murali wrote: > &

Auto recovery of solr

2022-06-21 Thread Poorna Murali
Hi All, If we have an alerting mechanism which says if a solr node is down, is it possible to configure the alert with some action which will restart that solr node and recover automatically? Please advise. Thanks, Poorna

Regarding Solr auto recovery

2022-06-22 Thread Poorna Murali
Thanks everyone for the inputs on my post yesterday! It did help me to clarify the doubts. @David - I believe that the clearcache.sh you mentioned in the link ( https://www.tecmint.com/clear-ram-memory-cache-buffer-and-swap-space-on-linux/) will clear the solr caches and field cache too. Please co

RE: Re: Regarding Solr auto recovery

2022-06-22 Thread Poorna Murali
Thanks Shawn for the clarification! On 2022/06/22 14:03:43 Shawn Heisey wrote: > On 6/22/22 04:40, Poorna Murali wrote: > > Thanks everyone for the inputs on my post yesterday! It did help me to > > clarify the doubts. > > > > @David - I believe that the clearcache.s

Solr faceting

2022-07-15 Thread Poorna Murali
Hi all, I would like to know if solr adds faceting fields by default when we do any search. We have an id field which is still coming up in field cache even after it is removed from sorting and faceting queries in the code. Therefore, I would like to know if solr is adding this by any chance. Ple

RE: Re: Solr faceting

2022-07-18 Thread Poorna Murali
Hi Andy, There is a solr search api which does not have either sorting or faceting done with id field. But, after we execute the API, we do see id field entry in field cache. I checked the solrconfig file too, we have not added any id configuration that could have caused this. Please help me cla

RE: Re: Solr faceting

2022-07-20 Thread Poorna Murali
Thanks Andy for helping.I was able to find the place in our code which was causing this issue. It's fixed now. On 2022/07/18 13:38:09 Andy Lester wrote: > > > > On Jul 18, 2022, at 3:11 AM, Poorna Murali wrote: > > > > There is a solr search api which does not ha

RE: Re: Re: Solr faceting

2022-07-20 Thread Poorna Murali
on what version, and some other configuration options) > > -Gus > > On Mon, Jul 18, 2022 at 4:44 AM Poorna Murali > wrote: > > > Hi Andy, > > > > There is a solr search api which does not have either sorting or faceting > > done with id field. But, after we execu