Re: Solr indexing errors trying to index a dense vector

Thanks Chris! Great tip that! On Tue, Oct 22, 2024, 11:15 AM Guillaume wrote: > Excellent ! > Thanks ! > > Le mar. 22 oct. 2024 à 20:10, Chris Hostetter a > écrit : > > > > > : Thanks!. That worked. I also wanted to still keep the deduping > mechanism > > : for everything except the knn vectors

Re: Solr indexing errors trying to index a dense vector

Excellent ! Thanks ! Le mar. 22 oct. 2024 à 20:10, Chris Hostetter a écrit : > > : Thanks!. That worked. I also wanted to still keep the deduping mechanism > : for everything except the knn vectors. SoI ended up excluding the > embedding > : fields (whichc were all named embedding_*) from the de

Re: Solr indexing errors trying to index a dense vector

: Thanks!. That worked. I also wanted to still keep the deduping mechanism : for everything except the knn vectors. SoI ended up excluding the embedding : fields (whichc were all named embedding_*) from the de-duping mechanism. : : : (?!.*embedding).* : You can save yourself some CPU cycles (

Re: Solr indexing errors trying to index a dense vector

Glad to hear your problem is solved! Le mar. 22 oct. 2024 à 19:08, Arun Sudhir a écrit : > Thanks!. That worked. I also wanted to still keep the deduping mechanism > for everything except the knn vectors. SoI ended up excluding the embedding > fields (whichc were all named embedding_*) from the

Re: Solr indexing errors trying to index a dense vector

Thanks!. That worked. I also wanted to still keep the deduping mechanism for everything except the knn vectors. SoI ended up excluding the embedding fields (whichc were all named embedding_*) from the de-duping mechanism. (?!.*embedding).* Arun On Mon, Oct 21, 2024 at 2:51 PM Guillaume wrot

Re: Solr indexing errors trying to index a dense vector

Hello, I've had the same issue a few weeks ago. Turns out it was due to "UniqFiledsUpdateProcessorFactory". You should check out your "solrconfig.xml" and verify if this update processor is involved. It typically removes duplicates (in vectors too !). https://issues.apache.org/jira/browse/SOLR-174

Solr indexing errors trying to index a dense vector

Hello, I'm using Solr 9.1 to index a dense vector field and running into indexing errors where i see that if there are values that are exactly the same in my vector, they are all collapsed into one value in the vector and hence the length of my vector decreases. My field called "embedding_vec" is