Re: READ messages dropped

2012-10-12 Thread Tyler Hobbs
On Fri, Oct 12, 2012 at 2:24 AM, Tamar Fraenkel wrote: > > Thanks for the response. My cluster is in a bad state those recent days. > > I have 29 CFs, and my disk is 5% full... So I guess the VMs still have > more space to go, and I am not sure this is considered many CFs. > That's not too many

Re: READ messages dropped

2012-10-12 Thread Tamar Fraenkel
Hi! Thanks for the response. My cluster is in a bad state those recent days. I have 29 CFs, and my disk is 5% full... So I guess the VMs still have more space to go, and I am not sure this is considered many CFs. But maybe I have memory issues. I enlarge cassandra memory from about ~2G to ~4G (ou

Re: READ messages dropped

2012-10-11 Thread Tyler Hobbs
On Wed, Oct 10, 2012 at 3:10 PM, Tamar Fraenkel wrote: > > What I did noticed while looking at the logs (which are also running > OpsCenter), is that there is some correlation between the dropped reads and > flushes of OpsCenter column families to disk and or compactions. What are > the rollups C

Re: READ messages dropped

2012-10-10 Thread Tamar Fraenkel
Hi! Thanks for the answer. I don't see much change in the load this Cassandra cluster is under, so why is the sudden surge of such messages? What I did noticed while looking at the logs (which are also running OpsCenter), is that there is some correlation between the dropped reads and flushes of Op

Re: READ messages dropped

2012-10-09 Thread aaron morton
> or how to solve it? Simple solution is move to m1.xlarge :) > In the last 3 days I see many messages of "READ messages dropped in last > 5000ms" on one of my 3 nodes cluster. The node is not able to keep up with the load. Possible causes include excessive GC, aggressive compaction, or simply