Re: Which compaction strategy when modeling a dumb set

2017-02-27 Thread Benjamin Roth
queuing table is anti pattern. > > From: Vincent Rischmann > Sent: Friday, February 24, 2017 06:24 > To: user@cassandra.apache.org > Subject: Which compaction strategy when modeling a dumb set > > Hello, > > I'm using a table

Re: Which compaction strategy when modeling a dumb set

2017-02-27 Thread Rakesh Kumar
cent Rischmann Sent: Friday, February 24, 2017 06:24 To: user@cassandra.apache.org Subject: Which compaction strategy when modeling a dumb set Hello, I'm using a table like this: CREATE TABLE myset (id uuid PRIMARY KEY) which is basically a set I use for deduplication, id is a unique id for

Re: Which compaction strategy when modeling a dumb set

2017-02-27 Thread Rakesh Kumar
: user@cassandra.apache.org Subject: Which compaction strategy when modeling a dumb set Hello, I'm using a table like this: CREATE TABLE myset (id uuid PRIMARY KEY) which is basically a set I use for deduplication, id is a unique id for an event, when I process the event I insert the id

Re: Which compaction strategy when modeling a dumb set

2017-02-27 Thread Vincent Rischmann
No I don't store events in Cassandra. The real thing I'm doing is couting stuff: each event has a type, a user associated with it, some other metadata. When I process an event I need to increment those counters only if the event hasn't already been processed. Our input event stream is Kafka and

Re: Which compaction strategy when modeling a dumb set

2017-02-27 Thread Vladimir Yudovin
Do you also store events in Cassandra? If yes, why not to add "processed" flag to existing table(s), and fetch non-processed events with single SELECT? Best regards, Vladimir Yudovin, Winguzone - Cloud Cassandra Hosting On Fri, 24 Feb 2017 06:24:09 -0500 Vincent Rischmann

Re: Which compaction strategy when modeling a dumb set

2017-02-24 Thread kurt greaves
Probably LCS although what you're implying (read before write) is an anti-pattern in Cassandra. Something like this is a good indicator that you should review your model. ​

Which compaction strategy when modeling a dumb set

2017-02-24 Thread Vincent Rischmann
Hello, I'm using a table like this: CREATE TABLE myset (id uuid PRIMARY KEY) which is basically a set I use for deduplication, id is a unique id for an event, when I process the event I insert the id, and before processing I check if it has already been processed for deduplication. It