Re: tlog size issue- solr cloud 6.6

2021-03-22 Thread Ritvik Sharma
Yes, I did. With the use of CloudClollection Utility. On Tue, 23 Mar 2021 at 12:01 AM, Dominique Bejean wrote: > Hi, > > Did you try to force a hard commit in order to see the inpact on tlog ? > http://localhost:8983/solr/[collection_name]/update?commit=true > > Did you read this article ? > >

Re: tlog size issue- solr cloud 6.6

2021-03-22 Thread Dominique Bejean
Hi, Did you try to force a hard commit in order to see the inpact on tlog ? http://localhost:8983/solr/[collection_name]/update?commit=true Did you read this article ? https://lucidworks.com/post/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/ Regards Dominique Le lun. 22 m

Re: tlog size issue- solr cloud 6.6

2021-03-22 Thread Ritvik Sharma
Hi Dominique Any suggestions? On Mon, 22 Mar 2021 at 10:23, Ritvik Sharma wrote: > HI Dominique > > softcommit=false is coming in logs, > > > INFO - 2021-03-22 07:40:58.129; [c:solrcollection s:shard2 r:core_node1 > x:solrcollection_shard2_replica1] > org.apache.solr.update.processor.LogUpdate

Re: tlog size issue- solr cloud 6.6

2021-03-21 Thread Ritvik Sharma
HI Dominique softcommit=false is coming in logs, INFO - 2021-03-22 07:40:58.129; [c:solrcollection s:shard2 r:core_node1 x:solrcollection_shard2_replica1] org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor; [solrcollection_shard2_replica1] webapp=/solr path=/update p

Re: tlog size issue- solr cloud 6.6

2021-03-21 Thread Dominique Bejean
Hi, If your tlogs grow, It looks like hard commit are never executed. Are you seeing hard commits in logs (grep 'softCommit=false') ? What is it happening if you force a hard commit ? Are tlog truncated ? http://localhost:8983/solr/[collection_name]/update?commit=true Did you read this article

Re: tlog size issue- solr cloud 6.6

2021-03-20 Thread Ritvik Sharma
Hi Dominique Heavy query means high query rate on solr. Honestly for 2-3 days we have stopped the queries on solr only we are doing indexing !!! As you see we have enabled Hard commit also to decrease tlog log size or more and the same is written on solr docs. Still the same behaviour is occurri

Re: tlog size issue- solr cloud 6.6

2021-03-20 Thread Dominique Bejean
Hi, By heavy query, do you mean you have a high query rate and/or you need index update be available fast after few seconds (NRT search) ? Do you see the hard commits in logs ? Can you try to increase autoSoftCommit to 30 seconds or more ? Regards Dominique Le sam. 20 mars 2021 à 18:53, Ritvik

Re: tlog size issue- solr cloud 6.6

2021-03-20 Thread Ritvik Sharma
Hi Guys We have faced an issue where tlog size is increasing unnecessarily. We are using a "heavy indexing, heavy query" approach. We enabled hard commit also, solr cloud: 6.6 zk: 3.4.10 shards: 2, replication factor= 2 solrconfig, ${solr.autoCommit.maxTime:15000} 1

tlog size issue- solr cloud 6.6

2021-03-19 Thread Ritvik Sharma
Hi Guys We have faced an issue where tlog size is increasing unnecessarily. We are using a "heavy indexing, heavy query" approach. We enabled hard commit also, solr cloud: 6.6 zk: 3.4.10 shards: 2, replication factor= 2 solrconfig, ${solr.autoCommit.maxTime:15000} 1