About Using Hadoop in SolrCloud

Hi, I read at many places about using Hadoop in solrCloud. I try to find the reason why to use Hadoop in place of a local file system. Can someone briefly explain why to use Hadoop with SolrCloud when solr is just using Hadoop for indexing and storing logs in Hadoop. Is there any compelling reason

Re: About Using Hadoop in SolrCloud

I am replying, but just to the users mailing list, as it’s not appropriate for dev@. I think the short answer is that if you are already super into the Hadoop ecosystem, then you already have strong reasons why, and you can answer all of your questions listed already ;-). You then look at Solr

Solr copyfield error

Hi All, Getting errors on Solr such as "copyfield dest: 'fred_str' is not an explicit field and doesn't match a dynamic field" The solrconfig has an entry *_str 256 This seems to be relation to Guessing field types The schema does not contain an dynamic field entry for _str

RE: Solr copyfield error

Should have said, this is Solr 8.1.1 running under Sitecore managed_schema... -Original Message- From: Paul Ryder Sent: 23 February 2023 13:55 To: users@solr.apache.org Subject: Solr copyfield error Hi All, Getting errors on Solr such as "copyfield dest: 'fred_str' is not an explicit

Re: About Using Hadoop in SolrCloud

I think I was looking for someone to tell me, hey don't do something fancy unless you must have. I am somehow at ease now. Now I will leave Hadoop for some other project. On Thu, Feb 23, 2023 at 6:16 PM Eric Pugh wrote: > I am replying, but just to the users mailing list, as it’s not appropriate

Re: Return field aliasing for id field does not work

Hello, Rajani. I build and launched fresh [main] branch. fl aliasing works there, here's the proof pic https://pasteboard.co/KNFAyGPzBKFP.png On Thu, Feb 23, 2023 at 5:06 AM Rajani Maski wrote: > Hi, > > Solr 9.x, aliasing "id" field in return fields list with a different field > value does no

Re: About Using Hadoop in SolrCloud

;-). > On Feb 23, 2023, at 9:34 AM, Zara Parst wrote: > > I think I was looking for someone to tell me, hey don't do something fancy > unless you must have. I am somehow at ease now. Now I will leave Hadoop for > some other project. > > On Thu, Feb 23, 2023 at 6:16 PM Eric Pugh

Re: About Using Hadoop in SolrCloud

I agree with Eric, but wish to add one point: Separation of compute from storage to get: better redundancy (HDFS or S3 will do it better, maybe cheaper), better elasticity (since Solr nodes become stateless; easy to add more nodes), better cost? Sacrifice indexing performance and a bit of query.

using dense vector search with Solr

Hi, I've been playing with "neural" / dense vector search in Solr 9 a bit and find it very promising. Currently I am calculating the vectors outside of Solr at indexing and search time with a bunch of scripts using NLP models (text in, vectors out...). Especially at search time, that's not exa

Re: using dense vector search with Solr

Hi Till & all, We are using KNN search in a SOLR cloud 9.0.0 cluster. We had played around with Spotify's Annoy but, apart from obviously # of documents vs memory size issues, the really big thing about KNN in SOLR is that we can mix queries (I'm still not 100% on how this really works because we

Re: About Using Hadoop in SolrCloud

David, you made a point. Is it true we can keep indexes to S3? I mean index under use not the backup ? On Fri, Feb 24, 2023 at 1:11 AM David Smiley wrote: > I agree with Eric, but wish to add one point: Separation of compute from > storage to get: better redundancy (HDFS or S3 will do it better