Re: Link Walking and Security

> On Jan 21, 2015, at 4:43 PM, José Ghislain Quenum > wrote: > > great! > thanks a bunch > José Anytime. - Chris ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Link Walking and Security

great! thanks a bunch José On Wed, Jan 21, 2015 at 5:42 PM, Christopher Meiklejohn < cmeiklej...@basho.com> wrote: > > > On Jan 21, 2015, at 4:41 PM, José Ghislain Quenum < > jose.que...@googlemail.com> wrote: > > > > thanks again for your clarifications and pointers. I will take a look at > them

Re: Link Walking and Security

> On Jan 21, 2015, at 4:41 PM, José Ghislain Quenum > wrote: > > thanks again for your clarifications and pointers. I will take a look at > them. There is just one point that you left out. Will there still be the > links entry in the object meta so that I can store links and walk them > manu

Re: Link Walking and Security

thanks again for your clarifications and pointers. I will take a look at them. There is just one point that you left out. Will there still be the links entry in the object meta so that I can store links and walk them manually (using MR)? Or will this functionality completely disappear with link wal

Re: Link Walking and Security

> On Jan 21, 2015, at 1:23 PM, José Ghislain Quenum > wrote: > > Thanks Chris for your email. MR is the way I do my link walking actually. > However, I was assuming that the links entry in the meta part of an object > was going to disappear. Please correct me on that if I am wrong. Otherwise

Re: Link Walking and Security

Thanks Chris for your email. MR is the way I do my link walking actually. However, I was assuming that the links entry in the meta part of an object was going to disappear. Please correct me on that if I am wrong. Otherwise I should be just fine then. On the other hand I did consider using the new

Re: Link Walking and Security

> On Jan 21, 2015, at 12:21 PM, José Ghislain Quenum > wrote: > > well the application I am developing is Collaboration support tool. You have > a bunch of concepts (organization, project, collaboration activities, events, > etc). Some of these concepts are connected. So, I could have modeled

Re: Link Walking and Security

well the application I am developing is Collaboration support tool. You have a bunch of concepts (organization, project, collaboration activities, events, etc). Some of these concepts are connected. So, I could have modeled them with a Relational DB. But I really wanted to take advantage of Riak's

Re: Link Walking and Security

On Wed, Jan 21, 2015 at 12:07 PM, José Ghislain Quenum wrote: > Then, > where can one find pointers or documentation about alternative design to > link walking? Hi Jose, I personally like to think of link walking as one solution that could be used to solve many different problems. Can you clari

Re: Link Walking and Security

Then, where can one find pointers or documentation about alternative design to link walking? Regards, José On Wed, Jan 21, 2015 at 11:30 AM, Cosmin Marginean wrote: > Thank you Brian! > > On Tuesday, 20 January 2015 at 17:45, Brian Roach wrote: > > Cosmin - > > Link walking is deprecated as of R

Re: Link Walking and Security

Thank you Brian! On Tuesday, 20 January 2015 at 17:45, Brian Roach wrote: > Cosmin - > > Link walking is deprecated as of Riak 2.0 and will be removed in a > future version. > > As to whether something similar will replace it, as of now I do not > believe we have anything on the roadmap, no.

Re: Link Walking and Security

Cosmin - Link walking is deprecated as of Riak 2.0 and will be removed in a future version. As to whether something similar will replace it, as of now I do not believe we have anything on the roadmap, no. Thanks, - Roach On Tue, Jan 20, 2015 at 10:24 AM, Cosmin Marginean wrote: > (Apologies

Re: link walking in the Riak 2.0 Ruby client?

On 25 Mar 2014, at 11:05, Paul Walk wrote: > I presume Riak::Links are being retained - it's just the link-walking > functionality which is being deprecated? Link-walking itself has been removed from the 2.0 ruby-client. We still store and retrieve the metadata, and you can access it, but we do

Re: link walking in the Riak 2.0 Ruby client?

Thanks Casey. I had started to come to this realisation, although I am considering a slightly different approach of storing the links (as simple structured strings) in a set in a CRDT map object. Thanks for the very useful response. Cheers, Paul On 25 Mar 2014, at 16:08, Casey Rosenthal wro

Re: link walking in the Riak 2.0 Ruby client?

Hi Paul, You would actually get the most predictable performance simply storing the edges as k/v pairs and 'following' the links client-side. This is especially helpful if you have a wide trees or a high crossing number, for example. In such cases, you can retrieve multiple edges simultaneously

Re: link walking in the Riak 2.0 Ruby client?

Hi Christian, thanks for the quick response! I should point out that that page is not listed in the sidebar of the docs website which is why I didn't know this from reading the docs. I presume Riak::Links are being retained - it's just the link-walking functionality which is being deprecated?

Re: link walking in the Riak 2.0 Ruby client?

Thanks - this is somewhat reassuring (the ability to do some basic graph-like operations is one reason I have been using Riak). I have so far not had cause to use MapReduce. I wonder if you know of any examples/docs for using MapReduce to perform an operation similar to link_walking that I coul

Re: link walking in the Riak 2.0 Ruby client?

Hi Paul, Link walking is being deprecated as Christian notes. We removed it from the official 2.0 clients for that reason, and also that the new clients only use protocol buffers which on the Riak PB API side never had that functionality directly. It is still possible to perform the operation, y

Re: link walking in the Riak 2.0 Ruby client?

Hi Paul, Link walking is being deprecated as per the following note in the 2.0 documentation: http://docs.basho.com/riak/2.0.0pre11/dev/using/link-walking/ Best regards, Christian On Tue, Mar 25, 2014 at 2:56 PM, Paul Walk wrote: > I'm gradually getting up to speed with the technical releas

Re: Link walking

On 04.11.2013 19:46, Tom Santero wrote: Hi Georgi, Did you receive a 204 response back when persisting the hb/first object; can you GET that object without receiving a 404? Yes i receive 204 response when storing objects. I can fetch the objects too. Tom On Thu, Oct 31, 2013 at 10:22 AM,

Re: Link walking

Hi Georgi, Did you receive a 204 response back when persisting the hb/first object; can you GET that object without receiving a 404? Tom On Thu, Oct 31, 2013 at 10:22 AM, Georgi Ivanov wrote: > Hello, > I am trying to make Link walking work . > > I am using this as example : > > http://basho.c

Re: link walking- get a single object from 1000 objects with tag 'city'

On Mon, Jun 25, 2012 at 6:06 AM, Venki Yedidha wrote: >   I have a document in which my Riak object is linked with > tag name 'city' to nearly 1000 other objects. >   However, If I use /bucketname/keyname/_,city,1 >                        It lists me all cities link

Re: Link walking with Erlang riak client

Actually this is what I'm doing… A as an unique ID, lets call it A-UID A and B are stored in the bucket with keys A-UID and B-UID The link in B for A will be named A-UID And link in A for B will be named B-UID Thanks, Morgan. Le 20 juin 2012 à 15:28, Bryan Fink a écrit : > On Wed, Jun 20, 20

Re: Link walking with Erlang riak client

On Wed, Jun 20, 2012 at 8:00 AM, Morgan Segalis wrote: > Why would you think that fetch both user and look through the links is > fastest than A -> B -> A ? Are links really that slow ? It's not that links are that slow, but that they're not that focused. Unless you're using B's key as the tag o

Re: Link walking with Erlang riak client

Hi Bryan, Thank you for your answer, that is what I was looking for at first ! Why would you think that fetch both user and look through the links is fastest than A -> B -> A ? Are links really that slow ? Thanks, Morgan. Le 20 juin 2012 à 13:41, Bryan Fink a écrit : > On Tue, Jun 19, 2012

Re: Link walking with Erlang riak client

Hi Eric, Thank you for your answer. Yeah apparently, Links are not the Eldorado I though it was. In my head it was a pointer to another record, and accessing it would be faster than regular requests… I'm not really looking for more than 100 friends in one user's list really. (Except the rare u

Re: Link walking with Erlang riak client

On Tue, Jun 19, 2012 at 12:35 PM, Morgan Segalis wrote: > Hi everyone ! Hi, Morgan. > 1 - Are Link walking in Erlang fast & easy ? Link-walking in the Erlang client is provided via the MapReduce interface. Instead of a 'map' or 'reduce' phase, specify a 'link' phase like: {link, Bucket, Ta

Re: Link walking with Erlang riak client

Links may not be the most appropriate way to model a set of associated users. They have a limited length and both the user data and the links have to be saved at the same time. What you can do is emulate a set using a separate bucket and secondary indexes. So basically the bucket would look like

Re: Link walking with a java client

Created bug 1341 to track this. Can you help me with the questions below ? I am trying to gauge how expensive linking is in comparison to using a secondary index to track a node. Thanks Deepak On Wed, May 30, 2012 at 9:42 AM, Deepak Balasubramanyam

Re: Link walking with a java client

Brian, Yes I read about the hack somewhere in your documentation. My understanding is that the link walking operation will cease to work via HTTP after links to a node grow beyond a particular number. This happens because a HTTP header is used to send link related data and there are limits around

Re: Link walking with a java client

Deepak - I'll take a look at it this week, but more than likely it's a bug. Link walking is a REST only operation as far as Riak’s interfaces are concerned. Link Walking in the protocol buffers Java client is a hack that issues two m/r jobs to the protocol buffers interface (the first construct

Re: Link walking with a java client

This looks like a bug. The code to walk links via a HTTP client works perfectly. The same code fails when the PB client is used. The POJO attached in this email reproduces the problem. I searched the email archives and existing issues and found no trace of this problem. Please run the POJO by swap

Re: Link walking and keep field

Hi, Thank you for your response. Ok, so I'll use URL-syntax for link walking. Another problem here. I'm using riak-js as client library. And in this library for link walking (method "walk") M/R style used internally: https://github.com/frank06/riak-js/blob/master/src/http_client.coffee#L79 What s

Re: Link walking and keep field

Anton, Sorry for the delay. Yes you can use MapReduce link-phases in a similar way, but unlike the link-walking resource, the objects pointed to in each phase will not be returned. The way link-walking does its work is to split the URL into segments for each phase that has keep=true (1), then iss

Re: Link Walking with PB-Client.

On 15 Sep 2011, at 14:26, vijayakumar wrote: > Thanks Rusell. I compiled the master code base but still I couldn't find the > way to link way in pb. Have a look at this test[1]. It is exactly the same for both HTTP and PB, it uses subclasses to create the clients, but codes to the interface.

Re: Link Walking with PB-Client.

Thanks Rusell. I compiled the master code base but still I couldn't find the way to link way in pb. On Thu, Sep 15, 2011 at 3:21 PM, Russell Brown wrote: > > On 15 Sep 2011, at 10:46, vijayakumar wrote: > > > I learnt from the mailing list that there is no direct way to link walk > on PBClient

Re: Link Walking with PB-Client.

On 15 Sep 2011, at 10:46, vijayakumar wrote: > I learnt from the mailing list that there is no direct way to link walk on > PBClient as we do with HttpClient. > Has any one implemented it on their own. If so, kindly share me the patch. You can with the 0-15-SNAPSHOT riak-java-client from master

Re: Link Walking via Map Reduce

Hello, I created a feature request for compression of values about a year ago (https://issues.basho.com/show_bug.cgi?id=412), but unfortunately it seems there was no interest in that. For the time being we have to patch Riak to enable compression, though we do it in the riak_kv_vnode module by cha

Re: Link Walking via Map Reduce

Has there been any talk of using compression, maybe something like Snappy (http://code.google.com/p/snappy/) since it's fast and shouldn't affect performance too much? On Fri, Jun 24, 2011 at 3:29 PM, Aphyr wrote: > Nope. > > On 06/24/2011 03:24 PM, Andrew Berman wrote: >> >> And related, does Bi

Re: Link Walking via Map Reduce

And related, does Bitcask have any sort of compression built into it? On Fri, Jun 24, 2011 at 2:58 PM, Andrew Berman wrote: > Mathias, > > I took the BERT encoding and then encoded that as Base64 which should > pass the test of valid UTF-8 characters.  However, now I'm starting to > think that ma

Re: Link Walking via Map Reduce

Mathias, I took the BERT encoding and then encoded that as Base64 which should pass the test of valid UTF-8 characters. However, now I'm starting to think that maybe doing two encodings and storing that for the purpose of saving space is not worth the trade-off in performance vs just storing the

Re: Link Walking via Map Reduce

Yes, I am able to do that, but I feel like this completely defeats the purpose of a link by having to do two different calls. I might as well just store the user id in the data for user_email instead and not use a link at all with your method. What advantage does a link offer at that point? On T

Re: Link Walking via Map Reduce

On 23 Jun 2011, at 16:55, Jeremiah Peschka wrote: > HTTP link walking will get you back the data in the way that you'd expect. > > It's a two-step process using PBC. MR link phases will give you a list of > [bucket, key, tag] that you can then use to pull back the records from Riak. > The new

Re: Link Walking via Map Reduce

HTTP link walking will get you back the data in the way that you'd expect. It's a two-step process using PBC. MR link phases will give you a list of [bucket, key, tag] that you can then use to pull back the records from Riak. --- Jeremiah Peschka Founder, Brent Ozar PLF, LLC On Thursday, Jun

Re: Link Walking via Map Reduce

Ah, ok, that makes sense. One more question, when I use the HTTP link walking, I do get the data back as expected, so is there a way to replicate this in a Map-Reduce job or using the Erlang PBC (which I forgot to mention is what I'm using and the reason I'm not using the HTTP link walking method)

Re: Link Walking via Map Reduce

Andrew, the data looks like JSON, but it's not valid JSON. Have a look at the list that's in the data section (which is your BERT encoded data), the first character in that list is 131, which is not a valid UTF-8 character, and JSON only allows valid UTF-8 characters. With a binary-encoded form

Re: Link Walking via Map Reduce

But isn't the value itself JSON? Meaning this part: {struct, [{<<"bucket">>,<<"user">>}, {<<"key">>,<<"LikiWUPJSFuxtrhCYpsPfg">>}, {<<"vclock">>, <<"a85hYGBgzGDKBVIsLKaZdzOYEhnzWBmes6Yd58sCAA==">>},

Re: Link Walking via Map Reduce

The object has to be JSON-encoded to be marshalled into the Javascript VM, and also on the way out if the Accept header indicates application/json. So you have two places where it needs to be encodable into JSON. On Thu, Jun 23, 2011 at 11:14 AM, Andrew Berman wrote: > Mathias, > > I thought Ri

Re: Link Walking via Map Reduce

Mathias, I thought Riak was content agnostic when it came to the data being stored? The map phase is not running Riak.mapValuesJson, so why is the data itself going through the JSON parser? The JSON value returned by v with all the info is valid and I see the struct atom in there so mochijson2 c

Re: Link Walking via Map Reduce

Andrew, you're indeed hitting a JSON encoding problem here. BERT is binary data, and won't make the JSON parser happy when trying to deserialize it, before handing it into the map phase. You have two options here, and none of them will involve JavaScript as the MapReduce language. 1.) Use the

Re: Link Walking via Map Reduce

That looks just like the json of death I was experiencing. Can you try doing a get on that key and using a json validator on it? Riak will let you put invalid json in, but the map/reduce parser will break on it. On Wed, Jun 22, 2011 at 10:59 PM, Andrew Berman wrote: > Hey Ryan, > > Here is the e

Re: Link Walking via Map Reduce

Hey Ryan, Here is the error from the sasl log.  It looks like some sort of encoding error.  Any thoughts on how to fix this?  I am storing the data as BERT encoded binary and I set the content-type as application/octet-stream. Thanks for your help! Andrew ERROR REPORT 9-Jun-2011::21:37:05 =

Re: Link Walking via Map Reduce

Andrew, Maybe you could elaborate on the error? I tested this against master (commit below) just now with success. 2b1a474f836d962fa035f48c05452e22fc6c2193 Change dependency to allow for R14B03 as well as R14B02 -Ryan On Wed, Jun 22, 2011 at 7:03 PM, Andrew Berman wrote: > Hello, > > I'm hav

Re: Link-Walking + Replication Factor

Okay got it. Thanks for your help ;) Regards, André Silva On Friday, May 20, 2011 at 5:30 PM, Dan Reverri wrote: > Hi André, > > You are correct; there is an issue with link walking when N=1. Bug #975 has > been filed to address this issue: > https://issues.basho.com/show_bug.cgi?id=975 > > Th

Re: Link-Walking + Replication Factor

Hi André, You are correct; there is an issue with link walking when N=1. Bug #975 has been filed to address this issue: https://issues.basho.com/show_bug.cgi?id=975 Thanks, Dan Daniel Reverri Developer Advocate Basho Technologies, Inc. d...@basho.com On Fri, May 20, 2011 at 4:12 AM, André Silv

Re: Link walking

The results from one phase get passed on to the next phase, so if you want both data sets you need to run two different map-reduce queries. If you want the results from the link phase you need to run a link phase in addition to a map phase (link first and then you can do the map phase with Riak.ma

Re: Link walking

I don't totally understand what you're doing in your code, but it looks like you have the map phase before the link phase which doesn't make sense since you want the data from the link phase passed on to the map phase, not the other way around. On Fri, May 6, 2011 at 9:37 AM, Joshua Hanson wrote: