RE: Very High CPU when indexing

2022-12-02 Thread Matias Laino
! MATIAS LAINO | DIRECTOR OF PASSARE REMOTE DEVELOPMENT matias.la...@passare.com | +54 11-6357-2143 -Original Message- From: Jan Høydahl Sent: Thursday, December 1, 2022 10:11 PM To: users@solr.apache.org Subject: Re: Very High CPU when indexing What are your cache settings? Are you using a

Re: Very High CPU when indexing

2022-12-01 Thread Jan Høydahl
RECTOR OF PASSARE REMOTE DEVELOPMENT > matias.la...@passare.com | +54 11-6357-2143 > > > -Original Message- > From: Matias Laino > Sent: Thursday, December 1, 2022 1:11 PM > To: users@solr.apache.org > Subject: RE: Very High CPU when indexing > > Hi Shawn, thanks again

RE: Very High CPU when indexing

2022-12-01 Thread Matias Laino
ny help will be really appreciated MATIAS LAINO | DIRECTOR OF PASSARE REMOTE DEVELOPMENT matias.la...@passare.com | +54 11-6357-2143 -Original Message- From: Matias Laino Sent: Thursday, December 1, 2022 1:11 PM To: users@solr.apache.org Subject: RE: Very High CPU when indexing Hi Shaw

RE: Very High CPU when indexing

2022-12-01 Thread Matias Laino
n Heisey Sent: Thursday, December 1, 2022 1:07 AM To: users@solr.apache.org Subject: Re: Very High CPU when indexing On 11/30/22 08:57, Matias Laino wrote: > Q: What is the total document count? > A: Based on the dashboard, it's Total #docs: 68.6mn each node (I'm > replicat

Re: Very High CPU when indexing

2022-11-30 Thread Shawn Heisey
On 11/30/22 08:57, Matias Laino wrote: Q: What is the total document count? A: Based on the dashboard, it's Total #docs: 68.6mn each node (I'm replicating the same data on both) Each core has a count.  And here you can see what I was talking about with max doc compared to num docs. https://

RE: Very High CPU when indexing

2022-11-30 Thread Matias Laino
...@passare.com | +54 11-6357-2143 -Original Message- From: Shawn Heisey Sent: Tuesday, November 29, 2022 7:10 PM To: users@solr.apache.org Subject: Re: Very High CPU when indexing On 11/29/22 13:58, Matias Laino wrote: > Thank you Shawn, I'm definitely checking out those reco

Re: Very High CPU when indexing

2022-11-29 Thread Shawn Heisey
On 11/29/22 13:58, Matias Laino wrote: Thank you Shawn, I'm definitely checking out those recommendations, but what I cannot explain is how this worked fine for the last 3 months and then suddenly this issue started happening. I'd say you got REALLY lucky that there weren't problems sooner. H

RE: Very High CPU when indexing

2022-11-29 Thread Matias Laino
m | +54 11-6357-2143 -Original Message- From: Shawn Heisey Sent: Tuesday, November 29, 2022 5:52 PM To: users@solr.apache.org Subject: Re: Very High CPU when indexing On 11/29/22 13:35, Matias Laino wrote: > it takes about 10 minutes for those records to be available on search,

Re: Very High CPU when indexing

2022-11-29 Thread Shawn Heisey
On 11/29/22 13:35, Matias Laino wrote: it takes about 10 minutes for those records to be available on search, our commit strategy has been hard commit every 60 seconds and soft commit every 1 second. Don't do that.  Chances are that the commits will take longer than 1 second to complete, so i

Very High CPU when indexing

2022-11-29 Thread Matias Laino
Hi all, I have a Cluster of 2 Solr 8.11 nodes running in cloud mode and 1 zookeeper node, this is used for our testing environment, the servers are in Amazon Ec2 and are t3.xlarge (4 cores and 16gb of ram), heap has been set to 8g. Everything has been working very well since I installed these,