RE: Newbie question on Cassandra mem usage

2010-11-26 Thread Dr. Andrew Perella
Sorry - just realised this is now a parameter on the CFDef From: Dr. Andrew Perella [mailto:a...@eutechnyx.com] Sent: 26 November 2010 14:17 To: user@cassandra.apache.org Subject: RE: Newbie question on Cassandra mem usage How can I set these per CF when I create them dynamically? Regards

RE: Newbie question on Cassandra mem usage

2010-11-26 Thread Dr. Andrew Perella
How can I set these per CF when I create them dynamically? Regards, Andrew From: Aaron Morton [mailto:aa...@thelastpickle.com] Sent: 22 November 2010 21:40 To: user@cassandra.apache.org Subject: Re: Newbie question on Cassandra mem usage They are memtable_throughput_in_mb

Re: Newbie question on Cassandra mem usage

2010-11-22 Thread Aaron Morton
They are memtable_throughput_in_mb, memtable_flush_after_mins, memtable_operations_in_millions. Under 0.7 these are per CF settings, in 0.6 these are cluster wide. To start with try  mb one down to something like 64 or 128, ops to 0.5 and mins to 60 . What version are you using ? AaronOn 23 Nov, 20

Re: Newbie question on Cassandra mem usage

2010-11-22 Thread Trung Tran
Hi, Is it the min_compaction_threshold and max_compaction_threshold? Do i need to lower the memtable setting also? Thanks, Trung. On Mon, Nov 22, 2010 at 12:02 PM, Jonathan Ellis wrote: > Set your columnfamily thresholds lower. > > On Mon, Nov 22, 2010 at 12:45 PM, Trung Tran wrote: >> Hi, >>

Re: Newbie question on Cassandra mem usage

2010-11-22 Thread Jonathan Ellis
Set your columnfamily thresholds lower. On Mon, Nov 22, 2010 at 12:45 PM, Trung Tran wrote: > Hi, > > I have a test cluster of 3 nodes, 14Gb of mem in each node, > replication factor = 3. With default -Xms and Xmx, my nodes are set to > have max-heap-size = 7Gb. After initial load with about 200M

Re: Newbie question on Cassandra mem usage

2010-11-22 Thread Trung Tran
Hi, Thanks for the guideline. I did not turn up any memory setting, the nodes are configured with all default settings (except for disk-access is using nmap). I have 3 nodes with 1 client using hector, 8 writing threads. There are 3 CF, 1 standard and 2 super. Thanks, Trung. On Mon, Nov 22, 2010

Re: Newbie question on Cassandra mem usage

2010-11-22 Thread Aaron Morton
The higher memory usage for the java process may be because of memory mapped file access, take a look at the disk_access_mode in cassandra.yaml WRT going OutOfMemory:- what are your Memtable thresholds in cassandra.yaml ? - how many Column Families do you have? - What are your row and key cache set