Re: Data Model Question

2012-01-22 Thread Tamar Fraenkel
Hi! Thank you very much for your response!   I have couple of questions regarding it, some are just to make sure I understood you:   1. regarding time slicing, ifat any point of time I am interested in what happened in the last T minutes, then I will need to query more than one row of the Dimention

Re: Cassandra x MySQL Sharded - Insert Comparison

2012-01-22 Thread Gustavo Gustavo
Ok guys, thank you for the valuable hints you gave me. For sure, things will perform much better on a real hardware. But my object maybe isn't really to see what't the max throughput that the datastores have. It is more or less like, given an equal condition, which one would perform better. But I'l

Re: Cassandra x MySQL Sharded - Insert Comparison

2012-01-22 Thread David Allsopp
When I did some performance testing on Cassandra 0.7.6, I was getting 10,000 - 20,000 inserts per second on a *single *Cassandra node, on real hardware (a consumer desktop PC with 4 GB RAM). Cassandra has got substantially faster since then. I was inserting 1KB columns each on a new row, if I remem

Re: Playing around with Cassandra ... how did the value changed?

2012-01-22 Thread Ruben Rubio Rey
Thanks for the response! On Mon, Jan 23, 2012 at 12:18 AM, Tristan Seligmann wrote: > On Sun, Jan 22, 2012 at 10:11 AM, Eric Czech > wrote: > > That's likely because there wasn't previously a validation class for the > > "age" column before you added that index. In other words, the CLI > doesn

Re: Data Model Question

2012-01-22 Thread aaron morton
In general if you are collecting data over time you should consider partitioning the row's to avoid creating very large rows. Also if you have a common request you want to support consider modeling it directly rather than using secondary indexes. Assuming my understanding of the problem is in

Re: Cassandra x MySQL Sharded - Insert Comparison

2012-01-22 Thread Chris Gerken
Edward (and Maxim), I agree. I was just recalling previous performance bake-offs (for other technologies, long time ago, galaxy far far away) in which the customer had put together a mockup of the high throughput expected in production and wanted to make a decision against that one set of numb

Re: Cassandra x MySQL Sharded - Insert Comparison

2012-01-22 Thread Maxim Potekhin
Hello, I have some experience in benchmarking Cassandra against Oracle and in running on a VM cluster. While the VM solution will work for many applications, it simply won't cut it for all. In particular, I observed a large difference in insert performance when I moved from VM to real hardwar

Re: Cassandra to Oracle?

2012-01-22 Thread Brian O'Neill
Good point Milind. (RE: Client-side AOP) I was thinking server-side to stay with the trigger concept, but we could just as easily intercept on the client-side. We'd just need to make sure that all clients got the AOP code injected. (including all of our map/reduce jobs) If we get the point-cu

Re: Cassandra to Oracle?

2012-01-22 Thread Colin Clark
You don't have to use oracle and pay money, you can use postgresql for example. Triggers aren't that hard to implement. We actually do.all of our mutations now via triggers and we did it inside by effectivley overriding the mutate logic itself. On Jan 20, 2012 11:42 AM, "Zach Richardson" wrote:

Re: Cassandra x MySQL Sharded - Insert Comparison

2012-01-22 Thread Edward Capriolo
In some sense 1 for one performance "almost" does not matter. Thou I bet you can get Cassandra better (I remember old school ycsb white paper benches against a sharded mysql). One of the main bullet points of Cassandra is if you want to grow from 4 nodes, to 8 nodes, to 14 nodes, and so on, Cassan

Re: Cassandra to Oracle?

2012-01-22 Thread Milind Parikh
My bad ~s/X:X-Value/Y:Y-Value/ after rereading the SELECT. /*** sent from my android...please pardon occasional typos as I respond @ the speed of thought / On Jan 22, 2012 6:40 AM, "Milind Parikh" wrote: The composite-key approach with counters would

Re: Cassandra to Oracle?

2012-01-22 Thread Milind Parikh
The composite-key approach with counters would work very well in this case. It will also obviate the concern of not knowing the exact column names apriori...although for efficiencies, you might to look at maintaining a secondary cachelike cf for lookup Depending on your data patterns(not to hi

Re: Cassandra x MySQL Sharded - Insert Comparison

2012-01-22 Thread Chris Gerken
Howdy Gustavo, One thing that jumped out at me is your having put two cassandra images on the same box. There may be enough CPU and memory for the two images combined but you may be seeing some other resource not being shared so nicely - network card bandwidth, for example. More generally, th

CQL jdbc

2012-01-22 Thread Tamar Fraenkel
Hi! I have cassandra-clientutil, cassandra-jdbc and cassandra-thrift in my libs, but I get   java.lang.NoClassDefFoundError: Could not initialize class org.apache.cassandra.cql.jdbc.CassandraDriver when running Class.forName("org.apache.cassandra.cql.jdbc.CassandraDriver").newInstance();   Cassandr

Re: Playing around with Cassandra ... how did the value changed?

2012-01-22 Thread Tristan Seligmann
On Sun, Jan 22, 2012 at 10:11 AM, Eric Czech wrote: > That's likely because there wasn't previously a validation class for the > "age" column before you added that index.  In other words, the CLI doesn't > display values in a UTF8 format until you tell it to so I think the value > "8" is correct a

Cassandra x MySQL Sharded - Insert Comparison

2012-01-22 Thread Gustavo Gustavo
Hello, I've set up a testing evironment for Cassandra and MySQL, to compare both, regarding *performance only*. And I must admit that I was expecting Cassandra to beat MySQL. But I've not seen this happening up to now. My application/use case is INSERT intensive, since I'm not updating anything, j

Re: Cassandra to Oracle?

2012-01-22 Thread Brian O'Neill
Eric, Thinking even a little bit more about this... We could go the distributed counter approach with additional column families to support the ad hoc queries, but use triggers to implement it. That would allow us to keep the client-side code thin, but achieve the same result... without nece

Re: Cassandra to Oracle?

2012-01-22 Thread Brian O'Neill
Thanks for all the ideas... Since we can't predict all the values, we actually cut to Oracle today via a map/reduce job. Oracle is able to support all the ad hoc queries the users want (via Indexes), but the extract job takes a long time (hours). The users need more "real-time", which is dri

Cassandra x MySQL Sharded

2012-01-22 Thread Gustavo Gustavo
Hello, I

Re: Playing around with Cassandra ... how did the value changed?

2012-01-22 Thread Eric Czech
That's likely because there wasn't previously a validation class for the "age" column before you added that index. In other words, the CLI doesn't display values in a UTF8 format until you tell it to so I think the value "8" is correct and you could check that by running the CLI command "assume Us

Playing around with Cassandra ... how did the value changed?

2012-01-22 Thread Ruben Rubio Rey
Hi Everyone, I am getting started with Cassandra and I decided to play around with the Example at 'getting started'. The thing is that something happened that it does not make sense to me, it looks like the value one value just changed from 38 to 8 after adding an index. [default@Twissandra] ge