Re: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-21 Thread Terje Marthinussen
e.l.poziom...@intel.com] > Sent: Wednesday, June 13, 2012 10:53 AM > To: user@cassandra.apache.org > Subject: RE: Much more native memory used by Cassandra then the configured > JVM heap size > > Seems like my only recourse is to remove jna.jar and just take the > perform

RE: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-21 Thread Poziombka, Wade L
AM To: user@cassandra.apache.org Subject: RE: Much more native memory used by Cassandra then the configured JVM heap size Seems like my only recourse is to remove jna.jar and just take the performance/swapping pain? Obviously can't have the entire box lock up. I can provide a pmap et

Re: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-13 Thread Al Tobey
bka, Wade L > *Sent:* Wednesday, June 13, 2012 10:53 AM > *To:* user@cassandra.apache.org > *Subject:* RE: Much more native memory used by Cassandra then the > configured JVM heap size > > ** ** > > Seems like my only recourse is to remove jna.jar and just take the > p

RE: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-13 Thread Poziombka, Wade L
actually, this is without jna.jar. I will add and see if still have same issue From: Poziombka, Wade L Sent: Wednesday, June 13, 2012 10:53 AM To: user@cassandra.apache.org Subject: RE: Much more native memory used by Cassandra then the configured JVM heap size Seems like my only recourse is

RE: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-13 Thread Poziombka, Wade L
user@cassandra.apache.org Subject: RE: Much more native memory used by Cassandra then the configured JVM heap size I have experienced the same issue. The Java heap seems fine but eventually the OS runs out of heap. In my case it renders the entire box unusable without a hard reboot. Console shows

RE: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-13 Thread Poziombka, Wade L
0 32320 32320 Node 0 Normal free:16136kB min:16272kB low:20340kB high:24408kB active:3255624 From: aaron morton [mailto:aa...@thelastpickle.com] Sent: Tuesday, June 12, 2012 4:08 AM To: user@cassandra.apache.org Subject: Re: Much more native memory used by Cassandra then the configured JVM heap

Re: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-13 Thread aaron morton
> Low OS memory Low OS memory is not the same as low JVM memory. Normally the JVM allocates and locks all the memory is needs at start up. > impact by our configuration: memtable_flush_writers=32, > memtable_flush_queue_size=12 increasing flush writers will impact on IO, increasing the queue siz

Re: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-13 Thread Jason Tang
We suppose the cached memory will be released by OS, but from /proc/meminfo , the cached memory is in "Active" status, so I am not sure if it will be release by OS. And for low memory, because we found "Unable to reduce heap usage since there are no dirty column families" in system.log, and then C

Re: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-12 Thread aaron morton
see http://wiki.apache.org/cassandra/FAQ#mmap > which cause the OS low memory. If the memory is used for mmapped access the os can get it back later. Is the low free memory causing a problem ? Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com

Re: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-11 Thread Jason Tang
Hi I found some information of this issue And seems we can have other strategy for data access to reduce mmap usage, in order to use less memory. But I didn't find the document to describe the parameters for Cassandra 1.x, is it a good way to use this parameter to reduce shared memory usage and w

Re: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-11 Thread Jason Tang
See my post, I limit the HVM heap 6G, but actually Cassandra will use more memory which is not calculated in JVM heap. I use top to monitor total memory used by Cassandra. = -Xms6G -Xmx6G -Xmn1600M 2012/6/12 Jeffrey Kesselman > Btw. I suggest you spin up JConsole a

Re: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-11 Thread Jeffrey Kesselman
Btw. I suggest you spin up JConsole as it will give you much more detai kon what your VM is actually doing. On Mon, Jun 11, 2012 at 9:14 PM, Jason Tang wrote: > Hi > > We have some problem with Cassandra memory usage, we configure the JVM > HEAP 6G, but after runing Cassandra for several hour

Re: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-11 Thread Jeffrey Kesselman
What is your Native heap size? And how are you measuring memory usage? It woudl also hep to see the commandlien you are using to launch the JVM On Mon, Jun 11, 2012 at 9:14 PM, Jason Tang wrote: > Hi > > We have some problem with Cassandra memory usage, we configure the JVM > HEAP 6G, but after