Re: Best Practices for Solr Cloud Testing Infra Setup

2023-11-06 Thread Eric Pugh
I tend to separate the search quality requirements from the search performance requirements. For example, often in environments where data changes frequently, and I’m doing search quality testing, then I’ll use a “date frozen” data set. If recency is a part of my algorithm then I’ll set the N

Re: Best Practices for Solr Cloud Testing Infra Setup

2023-11-06 Thread Saksham Gupta
Hi Eric, Thanks for the valuable inputs. A big one is, are you testing query/indexing performance or are you testing search quality? Mostly we are testing search quality but once in a while query/indexing performance. The major problem here is how to keep the data on test shards updated as we have

Re: Best Practices for Solr Cloud Testing Infra Setup

2023-11-03 Thread Eric Pugh
I think there are a lot of ways of setting this. A big one is, are you testing query/indexing performance or are you testing search quality? If it’s search quality, you need a representative data set…. The easiest way to do that is to have a copy of production data in your test environment. B

Re: Best Practices for Solr Cloud Testing Infra Setup

2023-11-03 Thread Saksham Gupta
Hi All, Pinging again for some assistance regarding the aforementioned problem. On Fri, Nov 3, 2023 at 9:56 AM Saksham Gupta wrote: > Hi Solr Developers, > > Reaching out to inquire about the best practices to set up staging and dev > environments for solr cloud. > > We are using solr cloud with

Best Practices for Solr Cloud Testing Infra Setup

2023-11-02 Thread Saksham Gupta
Hi Solr Developers, Reaching out to inquire about the best practices to set up staging and dev environments for solr cloud. We are using solr cloud with a cluster of 8 nodes ~25 gb of data(15-16 million docs) present on each shard. The resources used are optimized to server heavy indexing/searchi