Thanks Shawn. Get Outlook for iOS<https://aka.ms/o0ukef> ________________________________ From: Shawn Heisey <elyog...@elyograg.org> Sent: Thursday, July 6, 2023 6:35:59 PM To: users@solr.apache.org <users@solr.apache.org> Subject: Re: SOLR suitable backend ( AWS Aurora / Redshift)
On 7/6/23 05:30, Vishnuvarthan P wrote: > We are seeking assistance from the community to identify the most suitable > database backend (AWS Aurora or AWS Redshift) for SOLR. Currently, we are > utilizing AWS Aurora (We will be performing regular inserts/updates on our > source table) and have observed a decrease in performance when indexing data > into SOLR. If I understand what you're asking, Solr does not use a database backend. Solr uses Lucene for its backend and it is not possible to change that. If you are asking about a data source for Solr ... your best option for ANY data source is to write an indexing system from scratch that is multi-threaded or multi-process. The DataImportHandler works for using JDBC to import from a database, but it is no longer included with Solr and has some limitations, one of which is that it indexes with one thread. This severely limits its potential performance. I don't know anything about the AWS systems you have indicated. The only database I have really used is MySQL. I've had some VERY limited exposure to Postgres. Thanks, Shawn