Re: High Memory Utilization

2012-07-31 Thread Reid Draper
It sounds like the cache_size hasn't changed at all, if you just explicitly set it to the default. I would try lowering it to something like 1, 2 or 4MB. Reid On Jul 30, 2012, at 11:03 AM, Antonio Ye wrote: > So I set cache_size to 8388608 or 8 MB which according to the > documentation is the d

Re: High Memory Utilization

2012-07-30 Thread Antonio Ye
So I set cache_size to 8388608 or 8 MB which according to the documentation is the default but Riak still uses 4.1 GB of RAM. I loaded 20 million records this time instead of the original 10 million. Does anyone know if replicas are also cached in elevelDB? On Mon, Jul 30, 2012 at 7:49 AM, Reid D

Re: High Memory Utilization

2012-07-30 Thread Reid Draper
I'd recommend lowering some of the leveldb configuration defaults [1]. I'd start with the cache size. You'll notice that most of these settings are _per_ _vnode_, which means for your single-node cluster with 64 partitions (vnodes), the defaults are likely a bit high for 10MM values. It's also wor

Re: High Memory Utilization

2012-07-29 Thread Antonio Ye
this is on a single node and my ring_creation_size is 64. ring_num_partitions : 64 ring_ownership : <<"[{'riak@127.0.0.1',64}]">> ring_creation_size : 64 Thanks, Tony On Sun, Jul 29, 2012 at 9:12 AM, Reid Draper wrote: > Hi Antonio, > > How many nodes do you have in your cluster? What is > the

Re: High Memory Utilization

2012-07-29 Thread Reid Draper
Hi Antonio, How many nodes do you have in your cluster? What is the ring size ({ring_creation_size, N} in app.config)? Are you seeing 3.6GB of memory used _per_ machine, or total across the cluster? Reid On Jul 29, 2012, at 2:37 AM, Antonio Ye wrote: > I am using Riak as the persistence data s