On Fri, Jan 26, 2024 at 11:14 PM Srijan <shree...@gmail.com> wrote:
> Regarding binary field, Solr doesn't allow docvalues for binary field (btw > Lucene does). https://solr.apache.org/guide/solr/latest/indexing-guide/field-types-included-with-solr.html mentions BinaryField FWIW BinaryDocValues has no compression anymore https://issues.apache.org/jira/browse/LUCENE-9843 > So I tried using stored binary field but now I have to load > the entire document to read this one stored field (and I have tons of > stored fields) > Well intentions for docValues was to read a single field, in contrast to a stored field which always reads the whole record (document) despite the "filter". Presumably some Solr logic might somehow impact it, but that is what I expect with docvalues - read a certain field only. > > > On Fri, Jan 26, 2024, 2:44 PM Mikhail Khludnev <m...@apache.org> wrote: > > > Hello. > > Agreed. By default it's BEST_SPEED which is LZ4. So, it can't be faster > > or less compressive. Binary DocValues Field should be an answer. > > > > On Fri, Jan 26, 2024 at 9:41 PM Shawn Heisey > <elyog...@elyograg.org.invalid > > > > > wrote: > > > > > On 1/26/24 03:38, Srijan wrote: > > > > Since upgrading to Solr 9.x, I've observed a drastic decrease in > > > > performance – approximately 10 to 20 times slower than before. And > this > > > > stems from the fact that stored fields in Solr 9.x are now > compressed. > > > > Decompressing these fields during each search query has introduced a > > > > substantial performance overhead. > > > > > > Stored fields have been compressed since Solr 4.1.0. Unless you > > > upgraded from a VERY old version, stored field compression is unlikely > > > to be the source of your performance issue. > > > > > > You can have the source of the data uncompressed if you set stored to > > > false, docValues to true, and useDocValuesAsStored to true. Not all > > > fieldtype classes support docValues, though -- in particular TextField > > > does not. > > > > > > Thanks, > > > Shawn > > > > > > > > > > -- > > Sincerely yours > > Mikhail Khludnev > > > -- Sincerely yours Mikhail Khludnev
