Make sure to set up the ExternalFileFieldReloader described here: https://solr.apache.org/guide/6_6/working-with-external-files-and-processes.html#WorkingwithExternalFilesandProcesses-ReloadinganExternalFile. This caches the file values in solr so that you don't do a read everytime. Also make sure that the file contents are sorted by id otherwise the lookup can be very slow.
On Tue, Mar 29, 2022 at 4:33 AM Sidharth Negi <sidharth.negi...@gmail.com> wrote: > Are you aware about how this external file is integrated with the index? > > My index consists of ~25 million docs and I'm asking this because I'm > concerned about whether or not a disk lookup from a separate file will > cause increased latency in my Solr query (which uses a few of such daily > updating fields within boost function query). > > On Tue, Mar 29, 2022 at 9:37 AM Walter Underwood <wun...@wunderwood.org> > wrote: > > > You could put the view counts in an external file field. That is what > that > > was designed for. > > > > Making it work in a Solr Cloud cluster isn’t very clean. You’ll need to > > update the file on each node. But it should work. It has been a while > since > > I’ve used it. > > > > > > > https://solr.apache.org/guide/8_11/working-with-external-files-and-processes.html > > > > wunder > > Walter Underwood > > wun...@wunderwood.org > > http://observer.wunderwood.org/ (my blog) > > > > > On Mar 28, 2022, at 7:25 PM, gnandre <arnoldbron...@gmail.com> wrote: > > > > > > I have a search interface that searches for videos. There is a filter > > there > > > that can sort the results based on views for last hour, last day, > > > last week, last month and last year. Is there a way to achieve this > > sorting > > > without always needing to update the index? E.g. After each specific > > > duration expires, all documents need to be indexed again for newly > > > calculated values.This is too much indexing overload. (p.s I am doing > > > atomic indexing for these fields already) > > > > > -- *Geren White | Senior Director, Engineering* *(e)* ge...@1stdibs.com
