Retain Data Import Handler In Solr9.0

Dear Team, Hope you are doing well, So far we were using Solr 8.9.0 for one of our application which was using DataImportHandler, As we need to move to the latest version Solr9.0.0 the below configuration is SolrCOnfig.xml is throwing an exception "org.apache.solr.common.SolrException:org.apache.so

Docvalues in Unique key field

Hi all, We are introducing docvalues in our unique key field(id field) and we are using Solr 8.4.1. The unique key field will be set to both stored=true and docvalues =true . Please let me know if this is supported in the version we are using and also if we need to add any additional configuration

Re: Retain Data Import Handler In Solr9.0

You have two options basically: 1. consider using the externally maintained DIH from https://github.com/rohitbemax/dataimporthandler (there appears to be a 9.x branch) 2. move away from DIH and write new ingestor code to pull data from your sources Cheers Charlie On 22/07/2022 04:38, GAN

Re: Retain Data Import Handler In Solr9.0

The DIH does not yet support Solr 9 but I don't think it'll be long before it does. https://github.com/rohitbemax/dataimporthandler/issues/32 Note the dubious choice of the word "deprecated" was used because it's no longer a part of Solr. Practically speaking, it *moved* and isn't gone. ~ David

BufferUnderFlowException

Does anyone know what would be the reason for BufferUnderFlowException while solr is reading? We have a profiler setup and at times we are seeing a lot of exceptions related to buffer underflow exception: [image: image.png] Any insights would be appreciated. thanks, hasmik -- Hasmik Sarkezians

Re: BufferUnderFlowException

On 7/22/22 08:16, Hasmik Sarkezians wrote: Does anyone know what would be the reason for BufferUnderFlowException while solr is reading? We have a profiler setup and at times we are seeing a lot of exceptions related to buffer underflow exception: The image did not make it through.  The mailin

Re: [External Email] Re: BufferUnderFlowException

Basically the call stack is this: SegmentTermsEnum.seekExact SegmentTermsEnumFrame.loadBlock() ByteBufferIndexInput.readBytes ByteBufferGuide.getBytes DirectByteBuffer.get ByteBuffer.get Buffer.nextGetIndex BufferUnderflowException.init At times we see a lot of such exceptions and cannot find, wh

Re: Retain Data Import Handler In Solr9.0

On 2022-07-22 8:46 AM, David Smiley wrote: The DIH does not yet support Solr 9 but I don't think it'll be long before it does. FWIW I've been gradually migrating our DIH imports to little python scripts; with all the extra things you can do in those, and less bloat in the main JVM, you gotta

Re: Retain Data Import Handler In Solr9.0

> On Jul 22, 2022, at 1:19 PM, dmitri maziuk wrote: > >> The DIH does not yet support Solr 9 but I don't think it'll be long before >> it does. > > FWIW I've been gradually migrating our DIH imports to little python scripts; > with all the extra things you can do in those, and less bloat in t

Re: Retain Data Import Handler In Solr9.0

Not to mention using dynamic fields on the fly in the indexer, applying code logic to the documents and just having full control over it has a lot of benefits to the point that a DIH was a cute idea when it came out but it reality it was just hand holding > On Jul 22, 2022, at 2:19 PM, dmitri m

Re: Retain Data Import Handler In Solr9.0

Oh look into perls fork manager module, https://metacpan.org/pod/Parallel::ForkManager . Only trick is each time it spawns a process you have to redeclare the dbh and any stored procedures but it’s a small price to pay for being able to simply adjust the number of parallel jobs it will do

Re: Retain Data Import Handler In Solr9.0

> On Jul 22, 2022, at 1:39 PM, Dave wrote: > > Oh look into perls fork manager module, > > https://metacpan.org/pod/Parallel::ForkManager > I’m aware of the numerous tools like that (I’ve been doing Perl since the 90s https://metacpan.or