On 7/6/23 05:30, Vishnuvarthan P wrote:
We are seeking assistance from the community to identify the most suitable database backend (AWS Aurora or AWS Redshift) for SOLR. Currently, we are utilizing AWS Aurora (We will be performing regular inserts/updates on our source table) and have observed a decrease in performance when indexing data into SOLR.
If I understand what you're asking, Solr does not use a database backend. Solr uses Lucene for its backend and it is not possible to change that.
If you are asking about a data source for Solr ... your best option for ANY data source is to write an indexing system from scratch that is multi-threaded or multi-process.
The DataImportHandler works for using JDBC to import from a database, but it is no longer included with Solr and has some limitations, one of which is that it indexes with one thread. This severely limits its potential performance.
I don't know anything about the AWS systems you have indicated. The only database I have really used is MySQL. I've had some VERY limited exposure to Postgres.
Thanks, Shawn
