Re: Tombstone passed GC period causes un-repairable inconsistent data

2018-06-19 Thread kurt greaves
We've seen this before but couldn't tie it to GCGS so we ended up forgetting about it. Now with a reproducible test case things make much more sense and we should be able to fix this. Seems that it's most certainly a bug with partition deletions and handling of GC grace seconds. It seems that the r

Real time bad query logging framework in C*

2018-06-19 Thread Jaydeep Chovatia
Hi, We have worked on developing some common framework to detect/log anti-patterns/bad queries in Cassandra. Target for this effort would be to reduce burden on ops to handle Cassandra at large scale, as well as help beginners to quickly identify performance problems with the Cassandra. Initially

Tombstone passed GC period causes un-repairable inconsistent data

2018-06-19 Thread Jay Zhuang
Hi, We know that the deleted data may re-appear if repair is not run within gc_grace_seconds. When the tombstone is not propagated to all nodes, the data will re-appear. But it's also causing following 2 issues before the tombstone is compacted away: a. inconsistent query result With consistency