Hello Fred

Thank you very much for your explanation. I'm trying to understand how this
scheme can work, but need some time... Let me come back to you after some
time.
Also you're referring to Ryan Zezeski slides, but i can't find it. Could
you please share me link if you have it? Thank you.


2017-05-19 19:00 GMT+03:00 <riak-users-requ...@lists.basho.com>:

> Message: 5
> Date: Fri, 19 May 2017 09:35:11 -0400
> From: Fred Dushin <f...@dushin.net>
> To: riak-users <riak-users@lists.basho.com>
> Subject: Re: Search index partitioning in Riak-KV
> Message-ID: <9507f1b1-9b19-4c2b-948e-cd55a1f74...@dushin.net>
> Content-Type: text/plain; charset="us-ascii"
>
> There is a Solr instance per Riak node, and each Solr instance contains a
> Solr core for the Riak index created.  Every replica of a Riak k/v pair has
> a corresponding document in the Solr instance on the same node as the vnode
> that stores the replica (in fact for each sibling, if your objects admit
> siblings).  Each document in Solr contains not only the bucket and key as
> indexed fields, but also the Riak partition (well, the partition ordinal,
> actually).  All of these fields are indexed, IIRC.
>
> When a query executed through Riak, a coverage plan is used to generate a
> filter query (based on the node and partition in the cover set) that is
> used with shard parameters on the local Solr instance in which the query
> was executed.  So technically every query is using (legacy) Solr
> distributed query; it's just that all the shard parameters and Solr
> deployment topology is hidden from the user and done internally by Riak.
> It's really quite elegant and clever (IMO), but it can run into scaling
> issues, as Solr/Lucene is quite a bit more demanding than Riak, in some
> real-world use-cases.
>
> I made an attempt to explain how a lot of how this works at
> https://www.youtube.com/watch?v=e1yVJqRuLSg <https://www.youtube.com/
> watch?v=e1yVJqRuLSg>
>
> There are far better presentations on the topic by Ryan Zezeski and other
> pioneers who did the initial implementation.
>
> -Fred
>
_______________________________________________
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Reply via email to