Re: DIH and import from other core

Hi, I suggest to take a look to Apache Nifi, a great multi-threaded ETL including plugin in order to read from or write to Solr. Dominique Le jeu. 31 mars 2022 à 13:12, Tealdi Paolo a écrit : > Hi all, > > I'm searching for alternative to DIH functionality for record ingestion > from one core

Re: R: DIH and import from other core

On 2022-03-31 11:17 AM, Thomas Corthals wrote: You can speed that up significantly by sending multiple documents in the same request and only committing once: https://web.archive.org/web/20170418205443/http://www.raspberry.nl/2011/04/08/solr-update-performance/ Yes: batching multiple documents

Re: R: DIH and import from other core

Op do 31 mrt. 2022 om 18:05 schreef dmitri maziuk : > On 2022-03-31 9:29 AM, Tealdi Paolo wrote: > > Hi Eric > > > > Many thanks for the answer. > > I noticed that reindexcollection seems to be SLOWER than DIH import. > > (Warning: there be python there) > > This is trimmed down from a working scr

Re: DIH and import from other core

On 2022-03-31 11:11 AM, matthew sporleder wrote: commitWithin will help you a ton, even a short one Yeah. It's a small table and a "playground" Solr index so I haven't bothered tuning it... yet. Dima

Re: DIH and import from other core

> On Mar 31, 2022, at 12:05 PM, dmitri maziuk wrote: > > On 2022-03-31 9:29 AM, Tealdi Paolo wrote: >> Hi Eric >> Many thanks for the answer. >> I noticed that reindexcollection seems to be SLOWER than DIH import. > > (Warning: there be python there) > > This is trimmed down from a working

Re: R: DIH and import from other core

On 2022-03-31 9:29 AM, Tealdi Paolo wrote: Hi Eric Many thanks for the answer. I noticed that reindexcollection seems to be SLOWER than DIH import. (Warning: there be python there) This is trimmed down from a working script: https://gist.github.com/dmaziuk/57b9c1926578bc10f12c0999c4b7ab53

R: DIH and import from other core

- | Da: Eric Pugh | Inviato: giovedì 31 marzo 2022 13:00 | A: users@solr.apache.org | Oggetto: Re: DIH and import from other core | | I’ve used thehttps://solr.apache.org/guide/8_1/collections- | api.html#reindexcollection | https://solr.apache.org/guide/8_1/collections- | api.html

Re: DIH and import from other core

I’ve used thehttps://solr.apache.org/guide/8_1/collections-api.html#reindexcollection https://solr.apache.org/guide/8_1/collections-api.html#reindexcollection> command for testing new configurations… It uses Solr Streaming under the covers: https://solr.apache.org/guide/8_1/streaming-expressi

DIH and import from other core

Hi all, I'm searching for alternative to DIH functionality for record ingestion from one core to another. It's very useful, simple and quick function to check for new configurations. The new external plugin seems to support only database connection. Any hints ? Best regards, Paolo Tealdi Ing.