Re: solr 9.8.0 and data import handler

2025-02-19 Thread Mikhail Khludnev
For the reference https://github.com/SearchScale/dataimporthandler/issues/91 there's the reason, solution and mitigation measures. On Sat, Feb 15, 2025 at 2:42 AM Mike Phillips < m.phill...@prosperodigital.com> wrote: > Summary: > > Performing multiple delta imports causes solr to fail imports un

Re: solr 9.8.0 and data import handler

2025-02-18 Thread Dmitri Maziuk
On 2/18/25 13:15, Mike Phillips wrote: When did this go wrong? We are running on solr 8.4.1 and full and delta imports work just fine. I'm sure they do, given a sufficiently straightforward schema and clean data and preferably a "last updated" column in each table. Which is not what our sourc

Re: solr 9.8.0 and data import handler

2025-02-18 Thread Mikhail Khludnev
On Tue, Feb 18, 2025 at 10:16 PM Mike Phillips < m.phill...@prosperodigital.com> wrote: > Is there a mail group or a way to reach just the data import handler > project? > It's hosted here https://github.com/SearchScale/dataimporthandler > Our project depends solely on the data import handler t

Re: solr 9.8.0 and data import handler

2025-02-18 Thread Mike Phillips
The database connection count to my database goes After Full import 1:  25 connections After Full import 2:  50 connections After Full import 3:  73 connections After Full import 4:  90 connections         Exception about reading, that is no doubt related to lack of cleanup of database connectio

Re: solr 9.8.0 and data import handler

2025-02-18 Thread Mike Phillips
When did this go wrong? We are running on solr 8.4.1 and full and delta imports work just fine. We need to get to a solr version without log security CVEs and we rely on the DIH. Is there a mail group or a way to reach just the data import handler project? It is miss leading to say the DIH o

Re: solr 9.8.0 and data import handler

2025-02-15 Thread Dmitri Maziuk
On 2/15/25 01:30, Mikhail Khludnev wrote: Hello, Mike. First of all DIH left solr and is maintaited at https://github.com/SearchScale/dataimporthandler Personally, I never rely on deltaImport but rather come along with full imports with a special form of SQL SELECTs. FWIW we never got the delt

Re: solr 9.8.0 and data import handler

2025-02-14 Thread Mikhail Khludnev
Hello, Mike. First of all DIH left solr and is maintaited at https://github.com/SearchScale/dataimporthandler Personally, I never rely on deltaImport but rather come along with full imports with a special form of SQL SELECTs. Hanging full import is an issue. May you check that heap is enough? Enla