Re: Vector search demo, and query syntax

2023-05-24 Thread DuyHai Doan
Hello all Sorry to disturb the discussion but there is an official announcement from Microsoft about CosmosDB supporting Vector Search https://devblogs.microsoft.com/cosmosdb/introducing-vector-search-in-azure-cosmos-db-for-mongodb-vcore/ Looks like Jonathan is spot on about this feature, it's q

Re: Vector search demo, and query syntax

2023-05-24 Thread Josh McKenzie
+1 to the flow of: 1: ORDER BY? 2: Oh. Yeah. That *does *makes sense. ;) (sending from fastmail in the hopes the image doesn't get stripped. Thanks ASF smtp server...) ~Josh On Wed, May 24, 2023, at 1:00 AM, Jeremiah D Jordan wrote: > At first I wasn’t sure about using ORDER BY, but the mor

Re: Vector search demo, and query syntax

2023-05-23 Thread Jeremiah D Jordan
At first I wasn’t sure about using ORDER BY, but the more I think about what is actually going on, I think it does make sense. This also matches up with some ideas that have been floating around about being able to ORDER BY a sorted SAI index. -Jeremiah > On May 22, 2023, at 2:28 PM, Jonathan

Re: Vector search demo, and query syntax

2023-05-23 Thread Patrick McFadin
| I first stumbled a bit with "there's no where clause and no filtering allowed…" | But I doubt that reaction from any experienced cql user will last more than a moment. I was also wondering about that, but this syntax looks good. More importantly, it will be easy to explain to end users. Patrick

Re: Vector search demo, and query syntax

2023-05-23 Thread Jonathan Ellis
Yes, that's totally reasonable syntactically, but I'd prefer not to open the can of worms of ordering by some functions but not others (and I definitely don't want to try to tackle ordering by all functions). "You can order by expressions involving SAI columns" is a pretty easy rule to explain. O

Re: Vector search demo, and query syntax

2023-05-23 Thread David Capwell
I am ok with the syntax, but wondering if a function maybe better than a CQL change? SELECT id, start, end, text FROM {self.keyspace}.{self.table} ORDER BY ANN(embedding, ?) LIMIT ? Not really a common syntax, but could be useful down the line > On May 23, 2023, at 12:37 AM, Mick Semb Wever wr

Re: Vector search demo, and query syntax

2023-05-23 Thread Mick Semb Wever
> > > *I propose that we adopt `ORDER BY` syntax, supporting it for vector > indexes first and eventually for all SAI indexes. So this query would > becomeSELECT id, start, end, text FROM > {self.keyspace}.{self.table} ORDER BY embedding ANN OF %s LIMIT %s* > LGTM. I first stumb

Vector search demo, and query syntax

2023-05-22 Thread Jonathan Ellis
*Hi all,I have a branch of vector search based on cep-7-sai at https://github.com/datastax/cassandra/tree/cep-vsearch . Compared to the original POC branch, this one is based on the SAI code that will be mainline soon, and handles distributed