hi,
I am planning to use DenseVectorField feature in solr 9.6.1, but I don't
know how to define it properly.
for example, I have 1000 documents, I try to generate embedding for each
document from openAI, but the length is different for each document.
when I try to save it to Solr, I will get an error message, please help
org.apache.solr.common.SolrException: incorrect vector dimension. The
vector value has size 50688 while it is expected a vector with size 46080
at
org.apache.solr.util.vector.DenseVectorParser.checkVectorDimension(DenseVectorParser.java:104)
~[?:?]
at
org.apache.solr.util.vector.DenseVectorParser.parseIndexVector(DenseVectorParser.java:59)
~[?:?]
at
org.apache.solr.util.vector.DenseVectorParser.parseVector(DenseVectorParser.java:45)
~[?:?]
at
org.apache.solr.util.vector.FloatDenseVectorParser.getFloatVector(FloatDenseVectorParser.java:34)
~[?:?]
at
org.apache.solr.schema.DenseVectorField.createField(DenseVectorField.java:266)
~[?:?]
at
org.apache.solr.schema.DenseVectorField.createFields(DenseVectorField.java:230)
~[?:?]
at
org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:67)
~[?:?]
at
org.apache.solr.update.DocumentBuilder.addOriginalField(DocumentBuilder.java:304)
~[?:?]
at
org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:193)
~[?:?]
--
Regards,
Derrick Cui
Email: derrick...@gmail.com
