Re: Unexplained stuck memtable flush

2024-11-06 Thread Bowen Song via user
Sorry, I mistaken CassandraTableWriteHandler for CassandraKeyspaceWriteHandler, and thought the code has changed. I was wrong, the code has not changed, they are two different files. Your read-hotness-tracker thread dump is: "read-hotness-tracker:1" - Thread t@113 java.lang.Thread.State: WAITI

Re: Unexplained stuck memtable flush

2024-11-06 Thread Bowen Song via user
I can see some similarities and some differences between your thread dump and ours. In your thread dump: * no MemtableFlushWriter thread * the MemtablePostFlush thread is idle * the MemtableReclaimMemory thread is waiting for a barrier, possibly stuck * the read-hotness-tracker thread is

Re: Unexplained stuck memtable flush

2024-11-06 Thread Jaydeep Chovatia
We have also seen this issue a few times in our production (4.1). My teammates added a thread dump here . One of my theories is

vector search question - 5.02

2024-11-06 Thread Joe Obernberger
Hi All - have a table in Cassandra 5.02 that has several columns and a vector column. I'm trying to do a hybrid query that includes a column and the ordering using ANN.  Such as: select textdata from doc.google_gtr_t5_large where type='type1' order by embeddings ANN of [-0.005542, 0.000996,

Re: Unexplained stuck memtable flush

2024-11-06 Thread Bowen Song via user
I think I'm getting really close now. This seems to have something to do with the "read-hotness-tracker:1" thread. The thread dump is: "read-hotness-tracker:1" daemon prio=5 tid=93 WAITING     at jdk.internal.misc.Unsafe.park(Native Method)     at java.util.concurrent.locks.LockSupport.park(Lock