Re: Autoscaling

2022-08-05 Thread Jan Høydahl
ks in advance, > Adi > > -----Original Message- > From: Shawn Heisey > Sent: Monday, July 18, 2022 12:42 AM > To: users@solr.apache.org > Subject: Re: Autoscaling > > On 7/17/22 11:25, Kaminski, Adi wrote: >> For example, if we have 10 shards each 100k (1M total)

RE: Autoscaling

2022-07-18 Thread Kaminski, Adi
hear some direction. Thanks in advance, Adi -Original Message- From: Shawn Heisey Sent: Monday, July 18, 2022 12:42 AM To: users@solr.apache.org Subject: Re: Autoscaling On 7/17/22 11:25, Kaminski, Adi wrote: > For example, if we have 10 shards each 100k (1M total) documents size fo

Re: Autoscaling

2022-07-17 Thread Shawn Heisey
On 7/17/22 11:25, Kaminski, Adi wrote: For example, if we have 10 shards each 100k (1M total) documents size for best and optimized ingestion/query performance...adding more documents will make sense to have 11th shard, and reaching 1.1M total will make sense to add 12th one eventually. One

Re: Autoscaling

2022-07-17 Thread Dave
ization (per volume, date, any other custom logic..). > > Thanks in advance, > Adi > > > Get Outlook for Android<https://aka.ms/AAb9ysg> > > From: Shawn Heisey > Sent: Sunday, July 17, 2022 5:44:24 PM > To: users@solr.apach

Re: Autoscaling

2022-07-17 Thread Kaminski, Adi
other custom logic..). Thanks in advance, Adi Get Outlook for Android<https://aka.ms/AAb9ysg> From: Shawn Heisey Sent: Sunday, July 17, 2022 5:44:24 PM To: users@solr.apache.org Subject: Re: Autoscaling On 7/17/22 07:40, Ronen Nussbaum wrote: > We a

Re: Autoscaling

2022-07-17 Thread dmitri maziuk
On 2022-07-17 11:37 AM, Dave wrote: ... Containers are great for developing and fast deployment but I would never put one in front of live users. Maybe it’s a trust issue? But I like metal Bare metal is great when you have your own datacenter. When you don't have the money to build one from s

Re: Autoscaling

2022-07-17 Thread Dave
For my specific situation it just seemed having one super hot server in action worked best, and the cold ones were in a separate data center than the primary web server, with the other two db/web servers, so they were more of a if sht hits the fan sort of set up while keeping one solr, one db, a

Re: Autoscaling

2022-07-17 Thread Walter Underwood
I’ve never understood paying for “cold” backup machines that don’t take traffic. Keep them all hot. That way you know they work and you don’t have cold cache slow startup problems when you put them into service. Yes, agree about containers. Containers are great for CPU-only applications. They j

Re: Autoscaling

2022-07-17 Thread Dave
Three nodes with nginx in front will handle well over 50k searches a day on a half terabyte index, but only one node is to serve the searches the rest are backups. I would never put solr in a container > On Jul 17, 2022, at 10:44 AM, Shawn Heisey wrote: > > On 7/17/22 07:40, Ronen Nussbaum w

Re: Autoscaling

2022-07-17 Thread Shawn Heisey
On 7/17/22 07:40, Ronen Nussbaum wrote: We are planning to migrate our Solr Cloud clusters to the cloud. Currently it is installed on-prem for each customer. It is already deployed as Docker containers. Instead of estimating in advance what is the number of shards needed, or the number of pods, w