Re: Documents of same group going into different shards.

2024-11-09 Thread Modassar Ather
Hi, Kindly provide your suggestions! I can share further details if required. Thanks, Modassar Ather On Fri, 8 Nov 2024 at 11:04 AM, Modassar Ather wrote: > Hi, > > We have the following setup of Solr-8.11.0 running on an AWS EC2 instance. > >- Number of shards: 48 [W

Documents of same group going into different shards.

2024-11-07 Thread Modassar Ather
please help us with your suggestions? Thanks, Modassar Ather

Re: Document routing.

2024-03-06 Thread Modassar Ather
tempted to delete all docs and then send new data to existing >collection (least preferred) > > Which of these things are you doing? > > -Gus > > > On Wed, Mar 6, 2024 at 9:10 AM Modassar Ather > wrote: > > > Thanks Jan for your response. > > > >

Re: Document routing.

2024-03-06 Thread Modassar Ather
t issue a delete command for the old id. > > Read more about routing and composite ID here > https://solr.apache.org/guide/solr/latest/deployment-guide/solrcloud-shards-indexing.html#document-routing > > Jan > > > 6. mar. 2024 kl. 05:26 skrev Modassar Ather : > > >

Re: Document routing.

2024-03-05 Thread Modassar Ather
Hi, Kindly provide you valuable suggestions. Thanks, Modassar On Tue, 5 Mar 2024 at 7:14 PM, Modassar Ather wrote: > Hi, > > As it is required for the documents of the same group to be co-located on > the same shard for grouping and faceting on SolrCloud I am using a document >

Document routing.

2024-03-05 Thread Modassar Ather
Hi, As it is required for the documents of the same group to be co-located on the same shard for grouping and faceting on SolrCloud I am using a document router with a unique family id and document id when indexing. i.e *familyId!documentId* Recently I had to add new data into the index for which

Re: Effect of facet.limit on facet count value.

2023-08-24 Thread Modassar Ather
t; > > https://medium.com/@sarkaramrit2/overrequest-and-refine-json-facet-bucket-counts-in-solr-1acfa77cd90c > > -ufuk yilmaz > > Sent from Mail for Windows > > From: Modassar Ather > Sent: Wednesday, August 23, 2023 2:01 PM > To: users@solr.apache.org > Subj

Re: Effect of facet.limit on facet count value.

2023-08-23 Thread Modassar Ather
ake a look at the overrequest and overrefine parameters, > especially if running SolrCloud and collection in question has multiple > shards > > Sent from Mail for Windows > > From: Modassar Ather > Sent: Wednesday, August 23, 2023 11:36 AM > To: users@solr.apache.org > Sub

Effect of facet.limit on facet count value.

2023-08-23 Thread Modassar Ather
Hi, With an increase and decrease in the value of facet.limit the facet counts are changing. This is happening in grouped faceting. I noticed when the facet limit is set to -1 or a higher number the grouped facet counts are correct. Kindly help me understand and resolve this issue to get the co

Grouped search - Slow response.

2022-04-13 Thread Modassar Ather
Hi, The grouped search is very slow in Solr-8.11.0 as compared with Solr-6.5.1. The slowness increases with increasing number of rows in search query. Following is the definition of the group field. The search performance of ungrouped queries is not slow and the row's value does not decrease it.

Re: High CPU utilisation on Solr-8.11.0

2022-04-12 Thread Modassar Ather
validated the configurations and schema. Not sure what is the reason for the slowness or am I missing any configurations. Kindly advise. Thanks, Modassar On Fri, Apr 8, 2022 at 11:04 AM Modassar Ather wrote: > Thanks Walter for your reply. Yes it is the same disk shared on all > ins

Re: High CPU utilisation on Solr-8.11.0

2022-04-07 Thread Modassar Ather
should have its own > disk volumes. I’m looking at this part of your config. > > Storage : Multi-attach EBS Volume. Provisioned IOPS SSD (io1) with 3000 > IOPS. > > wunder > Walter Underwood > wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > > > O

Re: High CPU utilisation on Solr-8.11.0

2022-04-07 Thread Modassar Ather
ar On Mon, Mar 28, 2022 at 2:51 AM Shawn Heisey wrote: > On 3/27/2022 1:20 PM, Modassar Ather wrote: > > Just to add one point, even the queries without the wildcards e.g. a > > boolean query or a query with 1 ids ORed has also become slow and it > is > > also takin

Re: High CPU utilisation on Solr-8.11.0

2022-03-27 Thread Modassar Ather
is mailing list exchange from June 2021 [1] should be helpful/relevant. > (Also note that wrt the issue you're encountering, there's no real > difference between WordDelimiterFilter and WordDelimiterGraphFilter). > > [1] https://lists.apache.org/thread/kbjgztckqdody9859knq

Re: High CPU utilisation on Solr-8.11.0

2022-03-27 Thread Modassar Ather
awn Heisey wrote: > On 3/26/2022 6:24 AM, Mike Drob wrote: > > Can you provide more details on what they CPU time is spent on? Maybe > look > > at some JFR profiles or collect several jstacks to see where they > > bottlenecks are. > > > > On Sat, Mar 26, 2022 at

High CPU utilisation on Solr-8.11.0

2022-03-26 Thread Modassar Ather
Hi, We are trying to migrate to Solr-8.11.0 from Solr-6.5.1. Following are the details of Solr installation. Server : EC2 instance with 32 CPUs and 521 GB Storage : EBS Volume. General Purpose SSD (gp3) with 3000/5000 IOPS Ubuntu :Ubuntu 20.04.3 LTS Java : openjdk 11.0.14 SolrCloud : 12 shards ha

Timeout during indexing.

2022-01-28 Thread Modassar Ather
Hi, I am using Solrj for indexing and indexing is being done in batches with different threads. There is no heavy load on solr server memory/CPU. I am getting the following timeout exceptions multiple times during indexing. *Solr Version* : Solr - 8.11.0 *Part of Exception:* org.apache.solr.clien

Re: Solr core is getting deleted on system reboot.

2022-01-28 Thread Modassar Ather
I suspect that latency will be a > problem > > On Thu, Jan 27, 2022 at 6:48 AM matthew sporleder > wrote: > > > How performant is solr on EFS? In my experience EFS is slow in > > general and I don't think lucene recommends NFS at all. > > > >

Re: Solr core is getting deleted on system reboot.

2022-01-26 Thread Modassar Ather
Solr nodes restart but only on system reboot. Your inputs will be very helpful. Thanks, Modassar On Tue, Jan 25, 2022 at 12:22 PM Modassar Ather wrote: > Thanks for the reply Mike. > > The zookeeper data directory is set to a different location and not to > /tmp. > > The deletion

Re: Solr core is getting deleted on system reboot.

2022-01-24 Thread Modassar Ather
o you see deletions on system reboot only or also process restart? > > On Mon, Jan 24, 2022 at 12:37 PM Modassar Ather > wrote: > > > Hi, > > > > Please provide your suggestions to fix the issue. Is there some > > configuration which I am missing so the nodes ar

Re: Solr core is getting deleted on system reboot.

2022-01-24 Thread Modassar Ather
20, 2022 at 10:27 AM Shawn Heisey wrote: > On 1/19/2022 9:37 PM, Modassar Ather wrote: > > The clusterstate.json file is empty. > > It's completely normal for recent Solr versions to have an empty > clusterstate.json file. The empty file is still used by Solr's >

Re: Solr core is getting deleted on system reboot.

2022-01-19 Thread Modassar Ather
22 at 4:53 AM Shawn Heisey wrote: > On 1/19/22 3:31 AM, Modassar Ather wrote: > > It creates the collection and the cores but as soon as the server is > > rebooted and Solr nodes are restarted the cores get deleted. > > The state.json file of the collection shows all the cores

Solr core is getting deleted on system reboot.

2022-01-19 Thread Modassar Ather
Hi, I am using the following collection API on Solr 8.11.0 to create a new collection. http://host:port /solr/admin/collections?action=CREATE&name=test&numShards=12&replicationFactor=1&wt=xml&collection.configName=test It creates the collection and the cores but as soon as the server is rebooted

Re: Running Solr on AWS Lambda.

2021-07-20 Thread Modassar Ather
> On Tue, 20 Jul 2021 at 15:05, Modassar Ather > wrote: > > > Hi, > > > > I have a requirement of simple search and grouping of the result on the > > index created using Solr-6.5.1 spread across 12 shards on a server > outside > > Solr context. > > The

Running Solr on AWS Lambda.

2021-07-20 Thread Modassar Ather
Hi, I have a requirement of simple search and grouping of the result on the index created using Solr-6.5.1 spread across 12 shards on a server outside Solr context. These searches can run on AWS Lambda using its resources to minimise the load on the main Solr server with the index EBS volume attac

Lucene grouping on non-doc value field.

2021-07-15 Thread Modassar Ather
Hi, I need to implement grouping search using Lucene APIs on fields which are non-doc value fields. The index is created using Solr-6.5.1 and spread across 12 shards. The group field's definition is as follows. I tried to use Lucene group related APIs but it is failing as the fields are not ind

Lucene grouping on non-doc value field.

2021-07-15 Thread Modassar Ather
Hi, I need to implement grouping search using Lucene APIs on fields which are non-doc value fields. The index is created using Solr-6.5.1 and spread across 12 shards. The group field's definition is as follows. I tried to use Lucene group related APIs but it is failing as the fields are not ind