Re: how to fix full-import indexed document not shown on query search

Hello, 1. Start on small scope 2. UI may crash if you request debug to respond back a lot of verbose data that's not a way to go. 3. use curl or postman to receive big respionses 4. you may open log file with less which is a perfect tool for large logs. Looking logs in ui hardly may be an option.

Re: how to fix full-import indexed document not shown on query search

Thanks for pointing that out. I work with relatively large data volumes. Last time when I use verbose logging via Solr UI, it crashed. What is the better way to gather the logs without the crashing? On Fri, Dec 8, 2023 at 5:11 PM Mikhail Khludnev wrote: > Vince, > Regardless of DIH, LogUpdat

Re: how to fix full-import indexed document not shown on query search

Vince, Regardless of DIH, LogUpdateProcessorFactory should log deleteQuery which wiped the docs. You can enable verbose logging and find out what

Re: how to fix full-import indexed document not shown on query search

Hi, ufuk I was thinking along the same lines to broaden the tool of choice on handling delta-load. Flume looks like an interesting option. I'm so blessed to be working with so many smart and kind people in this mailing list. Thank you. Happy Friday. On Fri, Dec 8, 2023 at 1:48 AM ufuk y

Re: how to fix full-import indexed document not shown on query search

Hi Vince, It shouldn’t take too much time to write a simple loop in your favorite language which fetches rows from the db and sends them to Solr over http to /update handler. Imo It’s easier than trying to figure out DIH’s particularities. Especially in the future, if you need to modify the doc

Re: how to fix full-import indexed document not shown on query search

Thanks, Shawn. DIH full-import, by itself works very well. It is bummer that my incremental load itself is into millions. When specifying batchSize on data source, the delta-import will honor that batch size once, for the first fetch, then will loop the rest by hundreds per sec. That doesn't he

Re: how to fix full-import indexed document not shown on query search

On 12/7/23 07:56, Vince McMahon wrote: { "responseHeader": { "status": 0, "QTime": 0 }, "initArgs": [ "defaults", [ "config", "db-data-config.xml" ] ], "command": "status", "status": "idle", "importResponse": "", "statusMessages": {

Re: how to fix full-import indexed document not shown on query search

Thanks for showing me where to look from the log. It is super useful. thank you so much. love it. I Index again with Full Import with &clean=false &commit=true It suggests (264013 adds) and again count is 5000 documents /select params={q=*:*&indent=true&q.op=OR&rows=0&_=1701960293895} hits=5000

Re: how to fix full-import indexed document not shown on query search

Hi, Here's the answer in the log .t&clean=true&r .9{deleteByQuery=*:* (-17845900 On Thu, Dec 7, 2023 at 6:42 AM Vince McMahon wrote: > Hi, > > I have indexed *915000 * documents into solr. I double check with my > database, and its the same number of lines/documents. The solr query co