do Cassandra generate a event or log containing key value of column when a column expires due to TTL

2014-08-22 Thread Gaurav Bhatnagar
Hi, I have stored following data structure in cassandra RowKey: 119551747098 => (name=c:per:@batchId, value=ad1, timestamp=1408345109805011, ttl=1436489) => (name=c:per:@currency, value=USD, timestamp=1408345109805009, ttl=1436489) => (name=c:per:@decimalValue, value=2, timestamp=1408345109

Re: do Cassandra generate a event or log containing key value of column when a column expires due to TTL

2014-08-22 Thread Chris Lohfink
Few options I can think of, probably some better ideas out there. These mostly depending on size of data and how frequently updated. 1) a map reduce or spark job to filter out non-empty rows 2) add some logging and do a custom build of cassandra (ie in "removeDeletedCF" of ColumnFamilyStore) an

Secondary index or dedicated CF?

2014-08-22 Thread Leleu Eric
Hi, I'm new with Cassandra and I wondering what is the best design for my case. I have a set of buckets that contain one or thousands of contents. Here is my Content CF : CREATE TABLE IF NOT EXISTS contents (tenantID varchar, key varchar, type varchar, bucket varchar, owne

Re: Secondary index or dedicated CF?

2014-08-22 Thread DuyHai Doan
Hello Eric "Under the hood what is the difference of the both solutions?" 1. Cassandra secondary index: distributed index, supports better high volume of data, the index itself is distributed so there is no bottleneck. The tradeoff is that depending on the cardinality of data having the same " b

Re: Secondary index or dedicated CF?

2014-08-22 Thread Mark Reddy
Hi, As a general rule of thumb I would steer clear of secondary indexes, this is also the official stand that DataStax take (see p5 of their best practices doc: http://www.datastax.com/wp-content/uploads/2014/04/WP-DataStax-Enterprise-Best-Practices.pdf). “It is best to avoid using Cassandra's

RE: Secondary index or dedicated CF?

2014-08-22 Thread Leleu Eric
Thanks you for your feedbacks. De : Mark Reddy [mailto:mark.l.re...@gmail.com] Envoyé : vendredi 22 août 2014 17:08 À : user@cassandra.apache.org Objet : Re: Secondary index or dedicated CF? Hi, As a general rule of thumb I would steer clear of secondary indexes, this is also the official stand

.TombstoneOverwhelmingException

2014-08-22 Thread Aravindan T
Dear All, COuld you please help on how to resolve the below issue? 1. Only insertion of records are done since the cassandra started. But, when looked into the system.log messages, i see this following error. ERROR [HintedHandoff:15] 2014-08-22 22:35:17,629 SliceQueryFilter.java (line 200) Sca

Re: .TombstoneOverwhelmingException

2014-08-22 Thread Robert Coli
On Fri, Aug 22, 2014 at 2:47 PM, Aravindan T wrote: > 1. Only insertion of records are done since the cassandra started. But, > when looked into the system.log messages, i see this following error. > ... > Now, could you please tell how the tombstone got created when there are no > deletes execu