hi James, Yes, we're using DIH with SolrCloud. We have a cron job on each host that interrogates the Collections API's overseerstatus and clusterstatus commands to figure out where to run deltas. It first determines if the current host is the overseer, and if so tells the shard1 leader for each collection to run delta-import via e.g. /solr/mycollection_shard1_replica_n52/dataimport.
The dataimport.properties files tend to look empty in the admin UI, but fetching them using e.g. Solr's zkcli.sh shows they contain the expected datestamps. (We're aware that DIH itself is deprecated and have been exploring alternative approaches.) hope that helps! Andy On Fri, 1 Apr 2022 at 00:36, James Greene <ja...@jamesaustingreene.com> wrote: > Sure a redirect was expected but this solr users right? Not solr team > itself... does anyone have dataimport.properties being maintained with > zookeeper? I'm okay with a single instance running the import which DOES > properly distribute the documents to multiple shards. > > On Thu, Mar 31, 2022, 6:38 AM Jan Høydahl <jan....@cominvent.com> wrote: > > > DIH is deprecated and removed from Solr 9.0. > > DIH did not support SolrCloud very well, as it runs on one local core, > not > > distributed. > > Please seek support from its new 3rd party plugin home in GitHub: > > https://github.com/rohitbemax/dataimporthandler < > > https://github.com/rohitbemax/dataimporthandler> > > Or consider using a different way of indexing your content. > > > > Jan > > > > > 31. mar. 2022 kl. 06:38 skrev James Greene < > ja...@jamesaustingreene.com > > >: > > > > > > Are there any working examples of using the DataImportHandler's delta > > > import with SolrCloid? > > > > > > I have a single zookeeper instance with four solr instances (using > > > docker-compose). > > > > > > Once all services are online I use the zk upload tool to upload my conf > > > configuration directory to zookeeper. From there I create a new > > collection > > > using the uploaded config. > > > > > > I'm able to run a DIH full import with no issues. > > > > > > When I run a DIH delta import the data gets imported and I have a > "import > > > successful" in the solr logs right before a null pointer exception > thrown > > > while trying to close the DIH properties writer. > > > > > > Checking zookeeper I see the dataimport.properties file but it has 0 > > > content and never updates. I've confirmed my dih config specifies > using > > > the ZKPropertiesWriter > > > > > > Anyone running DIH delta imports while using aolrcloud? > > > > > > Cheers, > > > JAG > > > > >
