Re: Cassandra high heap utilization under heavy reads and writes.

2013-11-27 Thread srmore
So, I did a lot of dial turning and heap tuning (came across this nice writeup about JVM tuning http://blog.mikiobraun.de/2010/08/cassandra-gc-tuning.html) still no luck with 1.2.9. I gave up and upgraded to 1.2.12 and since then things are much much better. I don't run into the heap issue that I u

Re: Cassandra high heap utilization under heavy reads and writes.

2013-11-25 Thread Christopher J. Bottaro
Yes, we saw this same behavior. A couple of months ago, we moved a large portion of our data out of Postgres and into Cassandra. The initial migration was done in a "distributed" manner: we had 600 (or 800, can't remember) processes reading from Postgres and writing to Cassandra in tight loops.

Cassandra high heap utilization under heavy reads and writes.

2013-11-23 Thread srmore
Hello, We moved to cassandra 1.2.9 from 1.0.11 to take advantage of the off-heap bloom filters and other improvements. We see a lot of messages dropped under high load conditions. We noticed that when we do heavy read AND write simultaneously (we read first and check whether the key exists if not