Solr 7.3.1 and Red Hat Hypervisor 4.4 Performance Problems

2021-03-29 Thread Johannes Riedl
Hi all, we were running VuFind-System with Solr 7.3.1 on OpenJDK 1.8.0_275 in a VM hosted on a HP BL460 G9 with Haswell CPUs for quite a while. When the data center upgraded the  Red Hat Hypervisor to Version 4.4 (RHEL 8 based) we observed a massive performance degradation on import with Solr

Fuzzy matching with

2021-03-29 Thread Luca Foppiano
Hi all, I’ve followed the tutorial on how to set up the SolrTextTagger [1] using biomedical ontology instead of the geotag. I can send a request and get a response that capture all the exact terms: curl -X POST 'http://localhost:8983/solr/bao_ontology/tag?overlaps=NO_SUB&tagsLimit=5000&f

Running out of 16GB heap during indexing

2021-03-29 Thread Walter Underwood
We have a cluster that is running out of heap during indexing. Our older cluster does not have this problem. Both clusters have 8 shards and 3 replica sets, for a total of 24 hosts. Both use the same G1GC settings. Both have the same indexing feed of 57 million documents. Old cluster: Solr 6.6.

Failure to create collection: Lock Held

2021-03-29 Thread Karl Stoney
Hi, I’ve got an odd problem where I’m unable to create a collection as it’s claiming a lock is held at /solr/solr-data/data/tech-data-001/index/write.lock, but that location (/solr/solr-data/data/tech-data-001) doesn’t exist on any of the nodes on the cluster. Does anyone know what might be cau

Missing one record in Streaming gather nodes expression

2021-03-29 Thread Deepu
Hi All, We are using solr streaming expressions to join to collections, we have product and similar product indexes, joining these two collections based on product id like below. gatherNodes(relatedproduct, search(product,q="related_product_count_l:[1 TO *]", fl="id_l", qt="/export", sort="id_l

Re: Failure to create collection: Lock Held

2021-03-29 Thread Karl Stoney
To add to this, the request succeeds on 7/9 nodes, but 2/9 fail with this error From: Karl Stoney Date: Monday, 29 March 2021 at 20:07 To: "solr-u...@lucene.apache.org" Subject: Failure to create collection: Lock Held Hi, I’ve got an odd problem where I’m unable to create a collection as it’s

Re: Failure to create collection: Lock Held

2021-03-29 Thread Karl Stoney
Looking at the stack trace the error is being thrown from here: https://github.com/apache/lucene-solr/blob/branch_8_8/lucene/core/src/java/org/apache/lucene/store/NativeFSLockFactory.java#L139 Which is an in memory set. Feels like that set is (incorrectly) populated with the relevant path on two o

Re: Running out of 16GB heap during indexing

2021-03-29 Thread Walter Underwood
Does this fix need changes on both the client and server side of SolrJ? Because of some older clusters, we are using SolrJ 4.4.10. We can upgrade to 6.6.2, but that predates this fix. https://issues.apache.org/jira/browse/SOLR-14013 wunder Walter Underwood wun...@wunderwood.org http://observer.

Replaying - sending updates to another collection

2021-03-29 Thread ufuk yılmaz
Hi all, I have two collections which indexes the same data, but with a very different schema and different update processors to index them in a different way. I can modify my indexer application to send the same documents to two collections but I wondered if there’s a built-in way to do this in

Lost solr collections when restarting zoo and solr

2021-03-29 Thread yaswanth kumar
Hi Team, Solr version: 8.2 Zookeeper: 3.4.14 Java: Open JDK 11 Two solr nodes with 1 zookeeper *Issue*: We are trying to degrade java version from 11.0.7 to 11, so part of this change (as there are couple of known issues with java 11.0.7), after a system reboot, and with zookeeper restart follow