compaction needs some disk I/O. Slowing down our compaction will improve overall system performance. Of course, you don't want to go too slow and fall behind too much.
-Wei ----- Original Message ----- From: "Dane Miller" <d...@optimalsocial.com> To: user@cassandra.apache.org Cc: "Wei Zhu" <wz1...@yahoo.com> Sent: Friday, March 22, 2013 4:12:56 PM Subject: Re: Stream fails during repair, two nodes out-of-memory On Thu, Mar 21, 2013 at 10:28 AM, aaron morton <aa...@thelastpickle.com> wrote: > heap of 1867M is kind of small. According to the discussion on this list, > it's advisable to have m1.xlarge. > > +1 > > In cassadrea-env.sh set the MAX_HEAP_SIZE to 4GB, and the NEW_HEAP_SIZE to > 400M > > In the yaml file set > > in_memory_compaction_limit_in_mb to 32 > compaction_throughput_mb_per_sec to 8 > concurrent_compactors to 2 > > This will slow down compaction a lot. You may want to restore some of these > settings once you have things stable. > > You have an under powered box for what you are trying to do. Thanks very much for the info. Have made the changes and am retrying. I'd like to understand, why does it help to slow compaction? It does seem like the cluster is under powered to handle our application's full write load plus repairs, but it operates fine otherwise. On Wed, Mar 20, 2013 at 8:47 PM, Wei Zhu <wz1...@yahoo.com> wrote: > It's clear you are out of memory. How big is your data size? 120 GB per node, of which 50% is actively written/updated, and 50% is read-mostly. Dane
