Re: cassandra increment counters, Jira #1072

+1M , We need this too. Lenin Gali Dir, Infrastructure and BI Cell:513.382.3371 le...@sharethis.com 1883 Landings Drive, Mountain View CA 94043 Contact Me [image: Linkedin] [image: Twitter] --- @ WiseStamp Signature

Re: cassandra increment counters, Jira #1072

If anyone on the thread hasn't read Helland's Building on Quicksand paper, yet, it discusses the abstract strategy behind #1072's distributed counter implementation. It's here: http://blogs.msdn.com/b/pathelland/archive/2008/12/12/building-on-quicksand-paper-for-cidr-conference-on-innovative-datab

Re: cassandra increment counters, Jira #1072

On Fri, Aug 13, 2010 at 6:24 AM, Jonathan Ellis wrote: >> >> This is simply not an acceptable alternative and just can't be called >> handling it "well". > > What part is it handling poorly, at a technical level?  This is almost > exactly what 1072 does internally -- we are concerned here with the

Re: cassandra increment counters, Jira #1072

On Fri, Aug 13, 2010 at 1:11 AM, Benjamin Black wrote: > On Thu, Aug 12, 2010 at 8:54 PM, Jonathan Ellis wrote: >> There are two concerns that give me pause. >> >> The first is that 1072 is tackling a use case that Cassandra already >> handles well: high volume of writes to a counter, with low vo

Re: cassandra increment counters, Jira #1072

On Thu, Aug 12, 2010 at 8:54 PM, Jonathan Ellis wrote: > There are two concerns that give me pause. > > The first is that 1072 is tackling a use case that Cassandra already > handles well: high volume of writes to a counter, with low volume > reads.  (This can be done by inserting uuids into a cou

Re: cassandra increment counters, Jira #1072

Interesting idea with the counter row approach. I think it puts a dubious responsibility on the Cassandra user. Sure, Cassandra users are expected to maintain the size of a row, but asking Cassandra users to constantly aggregate counts of uuids in a situation where the rows are growing rapidly to

Re: cassandra increment counters, Jira #1072

There are two concerns that give me pause. The first is that 1072 is tackling a use case that Cassandra already handles well: high volume of writes to a counter, with low volume reads. (This can be done by inserting uuids into a counter row, and aggregating them either in the background or at rea

Re: cassandra increment counters, Jira #1072

For what it's worth, my team would very much like to see counters in trunk. Right now we're trying to think of ways to implement counters by inserting columns and counting the sizes of slices, and it seems difficult to do it quickly and correctly at scale, even with low consistency. -Dave On Thu

Re: cassandra increment counters, Jira #1072

Would it help prioritizing if silent majority chimed in if keen on this functionality which is so key to large scale analytical apps? in which case : +1 Although perhaps I should encourage signing up on jira and vote there. https://issues.apache.org/jira/secure/Signup!default.jspa https://issu

Re: cassandra increment counters, Jira #1072

On Thu, Aug 12, 2010 at 10:23 AM, Kelvin Kakugawa wrote: > > I think the underlying unanswered question is whether #1072 is a niche > feature or whether it should be brought into trunk. > This should not be an unanswered question! #1072 should be considered essential, as it enables numerous use

Re: cassandra increment counters, Jira #1072

On 12/08/10 19:21, Jesse McConnell wrote: > out of curiosity are you shooting for incrementing these counters 10k > times a second for sustained periods of time? Jesse, Our traffic pattern varies between 5.5k and 10k connections/hits per second. We currently process the hits and log to MySQL (par

Re: cassandra increment counters, Jira #1072

On Thu, Aug 12, 2010 at 11:21 AM, Jesse McConnell wrote: > out of curiosity are you shooting for incrementing these counters 10k > times a second for sustained periods of time? Our use cases include 100,000's of increments a second but most of the values will only be incremented for a relatively

RE: cassandra increment counters, Jira #1072

andra increment counters, Jira #1072 out of curiosity are you shooting for incrementing these counters 10k times a second for sustained periods of time? cheers, jesse -- jesse mcconnell jesse.mcconn...@gmail.com On Thu, Aug 12, 2010 at 03:28, Robin Bowes wrote: > Hi Jonathan, > > I&#x

Re: cassandra increment counters, Jira #1072

out of curiosity are you shooting for incrementing these counters 10k times a second for sustained periods of time? cheers, jesse -- jesse mcconnell jesse.mcconn...@gmail.com On Thu, Aug 12, 2010 at 03:28, Robin Bowes wrote: > Hi Jonathan, > > I'm contacting you in your capacity as project le

Re: cassandra increment counters, Jira #1072

Hi Robin, Johan and I have brought the code up to trunk. It's ready to be reviewed. However, in Jonathan's defense, it does require separate code paths. Since, we're aggregating commutative operations, not updating a value. I think the underlying unanswered question is whether #1072 is a niche