Re: [External] Re: Understanding when Cassandra drops expired time series data

2016-06-17 Thread jerome
@cassandra.apache.org Subject: Re: [External] Re: Understanding when Cassandra drops expired time series data Got it. Thanks again! But in versions of Cassandra after 2.0.15 getFullyExpiredSSTables is more in line with what people would consider to be fully expired (i.e. any SSTable whose newest value

Re: [External] Re: Understanding when Cassandra drops expired time series data

2016-06-17 Thread jerome
: Friday, June 17, 2016 4:21:02 PM To: user@cassandra.apache.org Subject: Re: [External] Re: Understanding when Cassandra drops expired time series data Correcting myself - https://issues.apache.org/jira/browse/CASSANDRA-9882 made it check for fully expired tables no more than once every 10 minutes

Re: [External] Re: Understanding when Cassandra drops expired time series data

2016-06-17 Thread Jeff Jirsa
: Friday, June 17, 2016 at 1:05 PM To: "user@cassandra.apache.org" Subject: [External] Re: Understanding when Cassandra drops expired time series data Anytime the memtable is flushed to disk, the compaction strategy will look for tables to compact. If there exists fully expired sstab

Re: Understanding when Cassandra drops expired time series data

2016-06-17 Thread Jeff Jirsa
. From: jerome Reply-To: "user@cassandra.apache.org" Date: Friday, June 17, 2016 at 1:02 PM To: "user@cassandra.apache.org" Subject: Re: Understanding when Cassandra drops expired time series data Hi Jeff, Thanks for the information! That helps clear up a

Re: Understanding when Cassandra drops expired time series data

2016-06-17 Thread Jeff Jirsa
.apache.org" Subject: Re: Understanding when Cassandra drops expired time series data Hey Jeff, Do most of those behaviors apply to TWCS too? -J On Fri, Jun 17, 2016 at 1:25 PM, Jeff Jirsa wrote: First, DTCS in 2.0.15 has some weird behaviors - https://issues.apache.

Re: Understanding when Cassandra drops expired time series data

2016-06-17 Thread jerome
016 3:25:07 PM To: user@cassandra.apache.org Subject: Re: Understanding when Cassandra drops expired time series data First, DTCS in 2.0.15 has some weird behaviors - https://issues.apache.org/jira/browse/CASSANDRA-9572 . That said, some other general notes: Data deleted by TTL isn’t the sa

Re: Understanding when Cassandra drops expired time series data

2016-06-17 Thread Jason J. W. Williams
Hey Jeff, Do most of those behaviors apply to TWCS too? -J On Fri, Jun 17, 2016 at 1:25 PM, Jeff Jirsa wrote: > First, DTCS in 2.0.15 has some weird behaviors - > https://issues.apache.org/jira/browse/CASSANDRA-9572 . > > > > That said, some other general notes: > > > Data deleted by TTL isn’t

Re: Understanding when Cassandra drops expired time series data

2016-06-17 Thread Jeff Jirsa
First, DTCS in 2.0.15 has some weird behaviors - https://issues.apache.org/jira/browse/CASSANDRA-9572 . That said, some other general notes: Data deleted by TTL isn’t the same as issuing a delete – each expiring cell internally has a ttl/timestamp at which it will be converted into a tombs