Hi Walter, We've been doing many AI integrations with Solr and we drafted a roadmap to get some funding to implement it directly in Solr:
https://sease.io/2023/10/apache-lucene-solr-ai-roadmap-do-you-want-to-make-it-happen.html We made little progress so far but hopefully will attract some more attention. In terms of what you saw, as Koji correctly mentioned, it's very likely it was Retrieval Augmented Generation: Doing it is extra easy for a quick prototype, to just showcase some cherry picked magic. But bringing it to production offers many challenges: - the retrieval phase is still an open problem, you can do lexical (traditional keyword search), you can do vector or hybrid, but it's far from being easy. You may need to chunk if you go with most embedding models. - the LLM choice is quite challenging as well, you can go quickly with the latest GPT-X but more likely you need some days to assess the best commercial/open solution for your use case and domain - the way you prompt the LLM is also challenging, depending if you just want a generated answer, citations etc We presented already some talks and tutorials around, we should have something recorded in our training section. We'll also speak soon on these topics at upcoming conferences: https://eu.communityovercode.org/schedule/ https://2024.berlinbuzzwords.de/sessions?id=7VSFFK https://2024.berlinbuzzwords.de/sessions?id=NCPYUH Hope it helps! On Wed, 24 Apr 2024, 22:56 , <s...@cid.is> wrote: > Hi all, > > is anybody already using AI to support searching with Solr/Lucene? > I just had an interesting demo from a german start-up. > I gave them plain text data, which I usually feed into Solr, and they > did some AI magic with these data, so that we could ask > human-language-questions and got human-language-answers. > This can take information retrieval to the next level. > But I'd prefer to have a common production line for this. > And I'm looking for software stacks which would allow standard > production procedures. > > Thank you for *every* hint on this. > Walter Claassen >
