[ANN] Yokozuna 0.11.0

Riak Users, Today I'm happy to announce the 0.11.0 release of Yokozuna. This release brings Riak Java Client support as well as authentication and security for the HTTP and protocol buffer transports. An access control list (ACL) may be created to control administration and access to indexes. All

Re: LevelDB tuning questions.

I am reading through http://docs.basho.com/riak/latest/ops/advanced/backends/leveldb/ I am a little confused when I read 'cache size' section, where the calculation of cache size is based on 50% of physical memory and the sentence here also seems to indicate to allocate 50% of memory to block cach

Re: LevelDB tuning questions.

The 50% recommendation is to ensure there is memory available if this node has to take over vnodes from a failing node. leveldb in Riak 1.4 has a static memory allocation for each vnode. If you suddenly add a bunch of vnodes in a failure scenario, this machine could run out of memory and also

Re: LevelDB tuning questions.

Hmm, no. I double checked the link. It has the spreadsheet for 1.2 (bad basho, bad bad basho). Attached is the 1.4 spreadsheet. Note there is a secondary column that computes sizing when anti_entropy is on (default). Matthew leveldb_sizing_1.4.xls Description: Binary data On Nov 7, 2013

Re: LevelDB tuning questions.

Thanks for the reply! So to properly size leveldb memory for riak 1.4, should I just use the 'memory model spreadsheet' attached in the article (http://docs.basho.com/riak/latest/ops/advanced/backends/leveldb/)? -- View this message in context: http://riak-users.197444.n3.nabble.com/LevelDB-t

Re: LevelDB tuning questions.

Thanks again! I have a few questions regarding the new spreadsheet. 'percent reserved', in the spreadsheet, it is set at 10%, we should really use 50%? 'vnode count', it is 'vnode count per server'? E11 (max_open_file, with AAE), shows as a static value '10*4*1024*1024', whereas D11(max_open_fi

Re: LevelDB tuning questions.

inserting replies in original text On Nov 7, 2013, at 12:49 PM, kzhang wrote: > Thanks again! > > I have a few questions regarding the new spreadsheet. > > 'percent reserved', in the spreadsheet, it is set at 10%, we should really > use 50%? > > 'vnode count', it is 'vnode count per server'?

Re: LevelDB tuning questions.

I am attaching my calculation based on our environment. Since I am getting negative remainders, so my best bet is to change the number of max_open_file? should I tweak cache_size at all? Copy_of_leveldb_sizing_1_4_(2).xls

Re: LevelDB tuning questions.

Kathleen, This is a tricky question. On a new database, the cache_size will help performance. As your database grows, the file cache (max_open_files) becomes more important than the cache_size because a miss in the file cache is much more expensive (disk activity) than a miss in the block cac

IRiakClient and fetchMeta

Hi - I am using the java client library for Riak and trying to determine if there is an equivalent way to query only for metadata with IRiakClient in the same manner one can with the older RiakClient? RiakClient has the following method: fetchMeta(String bucket, String key) Thanks in advance!

Re: IRiakClient and fetchMeta

Hi John - You're looking for headOnly() in the FetchObject. Simplest example: bucket.fetch("key").headOnly().execute(); Thanks, -Roach On Thu, Nov 7, 2013 at 5:05 PM, JohnP wrote: > Hi - > > I am using the java client library for Riak and trying to determine if there > is an equivalent way to

Re: LevelDB tuning questions.

Thanks! The cluster has been in production for 4 months. I found this in leveldb log file: 013/10/25-12:43:10.678239 7fb895781700 compacted to: files[ 0 1 5 31 51 0 0 ] 2013/10/29-16:57:26.280633 7fb895781700 compacted to: files[ 0 2 5 31 51 0 0 ] 2013/11/03-11:46:15.935006 7fb895781700 compacted

Re: LevelDB tuning questions.

Agreed Matthew Von-Maszewski On Nov 7, 2013, at 19:44, kzhang wrote: > Thanks! > > The cluster has been in production for 4 months. I found this in leveldb log > file: > 013/10/25-12:43:10.678239 7fb895781700 compacted to: files[ 0 1 5 31 51 0 0 > ] > 2013/10/29-16:57:26.280633 7fb895781700 c

Re: LevelDB tuning questions.

Interesting thread! I had used the old 1.2 spreadsheet to calculate cache_size and max_files - and having used the 1.4 spreadsheet, it looks like I should change my config :) However, I'm not seeing anything like the below in my log files. Which log file should I be looking in? Cheers Matt On

Yokozuna Search On Counters

Evening Everyone, I’m curious if it’s possible operate against values in distributed counters via Yokozuna. Here’s an example result I get from performing a query, but I don’t see what field the value is getting set to. The value should be 80840. curl 'http://localhost:8098/search/stats?rows=

Re: Yokozuna Search On Counters

Weston, We don't yet have an extractor written for Yokozuna to support Riak 1.4's Counter Data Type. We hope (but obviously can't guarantee) to have extractors for all the Data Types we release with Riak 2.0. Sam -- Sam Elliott Engineer sam.elli...@basho.com -- On Thursday, 7 November 2013

Re: Yokozuna Search On Counters

Thanks Sam (and Eric who PM’d me). Well, I’ll put in my 2cents that I’d love that feature. We’re already using counters, and adding yokozuna on top of it would be really useful. -Wes On Nov 7, 2013, at 10:47 PM, Sam Elliott wrote: > Weston, > > We don't yet have an extractor written for Yok

Re: Yokozuna Search On Counters

Hi Wes, On Thu, Nov 7, 2013 at 7:50 PM, Weston Jossey wrote: > Thanks Sam (and Eric who PM’d me). > > Well, I’ll put in my 2cents that I’d love that feature. We’re already > using counters, and adding yokozuna on top of it would be really useful. > > Can you elaborate on what you're doing with

Advice on commit hooks

Good morning. First I would like to introduce myself as the FNG. Hi there. In attempting to solve a problem with a particular relational database, I realized that the solution was simply to avoid the problem. Long story short, research led me to Riak, and I'm quite glad that it did. I ha