Hi All, I'm currently facing a significant performance challenge with Apache Solr 9.x and would greatly appreciate any insights or suggestions you might have.
Context: In my Solr setup, I have a custom post filter that is critical to our search process. This filter needs to read a specific stored field from each document during the search. The field in question contains access control information that's essential for the filter's logic. Problem: Since upgrading to Solr 9.x, I've observed a drastic decrease in performance – approximately 10 to 20 times slower than before. And this stems from the fact that stored fields in Solr 9.x are now compressed. Decompressing these fields during each search query has introduced a substantial performance overhead. One potential solution for me is to use Binary Field instead of string - since binary data is not compressed in Lucene. But the issue with this guy is that I will have to load the entire document to read my binary field. And since I have a large number of stored fields, this could kill my search performance. I'm reaching out to see if anyone in the community has encountered a similar issue or has suggestions on how to handle this scenario? Is there a way for me to force Lucene to keep a field uncompressed? Thanks, Seez
