It sounds like enabling the JDK's vector preview api could significantly
improve Vector search. I haven't verified this myself, but it might be
worth trying Java 17 + this flag:
--add-modules jdk.incubator.vector
I'd love to hear how much of a difference this makes.
Jon
On Fri, Nov 8, 2024 at
Hey Joe,
I think you are running into a limitation we found in JVector 1 and
the use of HNSW. This is where release timing sucks. Jonathan
continued work on JVector after merging the initial version into
Cassandra 5 trunk before the code freeze. There was JVector 2 and then
3 which is in the JVect
Found my issue, it was with the primary key being a combination of uuid
and type. With that fixed, I now have a table with 1.5 million vectors
(768 dimensions) on a 16 node cluster. While I can now execute a CQL
query that includes fields and the order by ANN, it runs too slow. No
query compl
