RE: riak bitcask calculation

2016-07-22 Thread Travis Kirstine
Thanks Luke for your help! -Original Message- From: Luke Bakken [mailto:lbak...@basho.com] Sent: July-21-16 1:55 PM To: Travis Kirstine Cc: riak-users@lists.basho.com; ac...@jdbarnes.com Subject: Re: riak bitcask calculation Hi Travis, The memory used by Riak (beam.smp) is for more

Re: riak bitcask calculation

2016-07-21 Thread Luke Bakken
> Sent: July-18-16 11:35 AM > To: Travis Kirstine > Cc: riak-users@lists.basho.com; ac...@jdbarnes.com > Subject: Re: riak bitcask calculation > > Hi Travis - > > The calculation provided for bitcask memory consumption is only a rough > guideline. Using more memory than th

RE: riak bitcask calculation

2016-07-18 Thread Travis Kirstine
@lists.basho.com; ac...@jdbarnes.com Subject: Re: riak bitcask calculation Hi Travis - The calculation provided for bitcask memory consumption is only a rough guideline. Using more memory than the calculation suggests is normal and expected with Riak. As you increase load on this cluster memory use m

RE: riak bitcask calculation

2016-07-18 Thread Travis Kirstine
:lbak...@basho.com] Sent: July-18-16 11:14 AM To: Travis Kirstine Cc: riak-users@lists.basho.com; ac...@jdbarnes.com Subject: Re: riak bitcask calculation Hi Travis, Could you go into detail about how you're coming up with 9GiB per node? Is this from the output of the "free" co

Re: riak bitcask calculation

2016-07-18 Thread Luke Bakken
Hi Travis - The calculation provided for bitcask memory consumption is only a rough guideline. Using more memory than the calculation suggests is normal and expected with Riak. As you increase load on this cluster memory use may go up further as the operating system manges disk operations and buff

Re: riak bitcask calculation

2016-07-18 Thread Luke Bakken
Hi Travis, Could you go into detail about how you're coming up with 9GiB per node? Is this from the output of the "free" command? Bitcask uses the operating system's buffers for file operations, and will happily use as much free ram as it can get to speed up operations. However, the OS will use t

riak bitcask calculation

2016-07-16 Thread Travis Kirstine
I've put ~74 million objects in my riak cluster with a bucket size of 9 bytes and keys size of 21 bytes. According the riak capacity calculator this should require ~4 GiB of RAM per node. Right now my servers are showing ~ 9 GiB used per node. Is this caused by hashing or something else..