Looks like DIH only supports local file-system backed dataimport.properties.
In Cloud mode you'll likely get an exception when it tries to resolve the 
"conf" directory on disk.

Try to explicitly configure a <propertyWriter> in your config, where you define 
"directory" to some other folder, perhaps it will succeed in writing the 
properties file to disk
https://solr.apache.org/guide/8_11/uploading-structured-data-store-data-with-the-data-import-handler.html#property-writer
 
<https://solr.apache.org/guide/8_11/uploading-structured-data-store-data-with-the-data-import-handler.html#property-writer>

You may of course also open an issue on that 3rd party repo, but I would not 
hold my breath as it seems there are no active committers over there.

Jan

> 1. apr. 2022 kl. 01:35 skrev James Greene <ja...@jamesaustingreene.com>:
> 
> Sure a redirect was expected but this solr users right? Not solr team
> itself... does anyone have dataimport.properties being maintained with
> zookeeper?  I'm okay with a single instance running the import which DOES
> properly distribute the documents to multiple shards.
> 
> On Thu, Mar 31, 2022, 6:38 AM Jan Høydahl <jan....@cominvent.com> wrote:
> 
>> DIH is deprecated and removed from Solr 9.0.
>> DIH did not support SolrCloud very well, as it runs on one local core, not
>> distributed.
>> Please seek support from its new 3rd party plugin home in GitHub:
>> https://github.com/rohitbemax/dataimporthandler <
>> https://github.com/rohitbemax/dataimporthandler>
>> Or consider using a different way of indexing your content.
>> 
>> Jan
>> 
>>> 31. mar. 2022 kl. 06:38 skrev James Greene <ja...@jamesaustingreene.com
>>> :
>>> 
>>> Are there any working examples of using the DataImportHandler's delta
>>> import with SolrCloid?
>>> 
>>> I have a single zookeeper instance with four solr instances (using
>>> docker-compose).
>>> 
>>> Once all services are online I use the zk upload tool to upload my conf
>>> configuration directory to zookeeper. From there I create a new
>> collection
>>> using the uploaded config.
>>> 
>>> I'm able to run a DIH full import with no issues.
>>> 
>>> When I run a DIH delta import the data gets imported and I have a "import
>>> successful" in the solr logs right before a null pointer exception thrown
>>> while trying to close the DIH properties writer.
>>> 
>>> Checking zookeeper I see the dataimport.properties file but it has 0
>>> content and never updates.  I've confirmed my dih config specifies using
>>> the ZKPropertiesWriter
>>> 
>>> Anyone running DIH delta imports while using aolrcloud?
>>> 
>>> Cheers,
>>> JAG
>> 
>> 

Reply via email to