Java MR

2014-11-22 Thread Mohan Radhakrishnan
Hi, I am looking for documentation that describes how something like matrix multiplication can be done using Riak MR using Java. This is to try some algorithms for mining big pagerank matrices but with smaller examples. Is this usecase applicable for Riak ? I plan to install Riak on my lapt

Re: Yokozuna setup with many buckets

2014-11-22 Thread Eric Redmond
Oleksiy, Indexes have some overhead of their own, but they also have a reasonable limit on doc count (hundreds of millions per node). To answer you question requires a bit more knowledge of your use-case. One index can be more efficient, as long as you're not creating hundreds of thousands of b

Re: Yokozuna setup with many buckets

2014-11-22 Thread Oleksiy Krivoshey
Hi Eric, I think I will be running with a 10-30 thousands buckets, with some of them almost empty (<10 keys) but some with hundreds of thousands of keys. I'm pretty sure I can stay away from hundreds of millions docs per node limit. Does it mean that I can simply grow my Riak cluster to split the

Re: Riak Search queries

2014-11-22 Thread Eric Redmond
You can check if your object has siblings by performing a key get, and see if two values return. If not, then it may be the index. Can you paste the response where you get two values? Thanks, Eric On Nov 13, 2014, at 9:46 AM, Jason Ryan wrote: > Thanks Eric - I don't see the _yz_vtag returne

Re: Yokozuna performance: single large index vs many smaller indexes

2014-11-22 Thread Eric Redmond
Geoff, comments inline. On Nov 13, 2014, at 3:13 PM, Geoff Garbers wrote: > Hi all. > > I've been looking around for a bit with some sort of guidelines as to how > best to structure search indexes within Riak 2.0 - and have yet to come up > with anything that satisfies my questions. > > I ca

Re: Yokozuna error during indexing

2014-11-22 Thread Eric Redmond
Go ahead and submit an issue. We'll take a look at it, but it could be months before a fix ends up in a release. I'd take Ryan's suggestion for now and replace spaces with another char like underscore (_). Eric On Nov 21, 2014, at 11:20 PM, Oleksiy Krivoshey wrote: > Bucket backend is elevel

Re: Yokozuna error during indexing

2014-11-22 Thread Oleksiy Krivoshey
Thanks, Unfortunately I have few millions of keys in a live application and its almost impossible to update them all without stopping the service. And it can't be as simple as whitespace<->underscore replacement (what if there will be a real underscore in the name?). On 22 November 2014 at 16:15,

Re: Yokozuna performance: single large index vs many smaller indexes

2014-11-22 Thread Geoff Garbers
Hey Eric. Awesome! Thanks so much for the feedback. I really appreciate the help. I guess I'll have to test each method on our infrastructure to really know for myself. Cheers, Geoff Eric Redmond wrote: >Geoff, comments inline. > > >On Nov 13, 2014, at 3:13 PM, Geoff Garbers wrote: > > >Hi