On 02/09/2011 11:15 AM, Huy Le wrote: > There is already an email thread on memory issue on this email list, but I > creating a new thread as we are experiencing a different memory consumption > issue. > > We are 12-server cluster. We use random partitioner with manually generated > server tokens. Memory usage on one server keeps growing out of control. We > ran flush and cleared key and row caches but and ran GC but heap memory > usage won't go down. The only way to heap memory usage to go down is the > restart cassandra. We have to do this one a day. All other servers have > heap memory usage less than 500MB. This issue happened on both Cassandra > 0.6.6 and 0.6.11. >
If the heap usages continues to grow an OOM will eventually be thrown. Are you experiencing OOMs on these boxes? If you are not OOMing, then what problem are you experiencing (excessive CPU use garbage collection for one example)? > Our JVM info: > > java version "1.6.0_21" > Java(TM) SE Runtime Environment (build 1.6.0_21-b06) > Java HotSpot(TM) 64-Bit Server VM (build 17.0-b16, mixed mode) > > And JVM memory allocation: -Xms3G -Xmx3G > > Non-heap memory usage is 138MB. > > Any recommendation where should look to see why memory usage keep growing? > > Thanks! > > Huy Are you using standard, mmap_index_only, or mmap io? Are you using JNA?
