Re: Loading links after a map phase in a map reduce query

2010-10-07 Thread Mark Phillips
Hey Jan, I went ahead and filed a ticket to have this code pulled into our java client. Thanks for sending this over! You can track it here ---> https://issues.basho.com/show_bug.cgi?id=792 Feel free to make changes or add additional information I may have missed. Mark Community Manager Basho

Re: Loading links after a map phase in a map reduce query

2010-10-07 Thread Jan Metzner
Patching the java client did the job. For anyone who is interesed in the patch here are the links: http://github.com/jmetzner/riak-java-client/commit/61aa7df0a7314a673ca18f286a39108ad2d7 http://github.com/jmetzner/riak-java-client/commit/2910f6f39479866bb7d0e7065257f268a7af35dc Jan 2010/10/7

Re: Loading links after a map phase in a map reduce query

2010-10-07 Thread Sean Cribbs
300,000 links is probably too large (at least for HTTP). At that scale, I would consider building tree-like structure where target objects are only linked off of the leaves of the tree. Sean Cribbs Developer Advocate Basho Technologies, Inc. http://basho.com/ On Oct 7, 2010, at 9:06 AM, Robin

Re: Loading links after a map phase in a map reduce query

2010-10-07 Thread Sean Cribbs
Jan, It is possible to do a link phase after a map phase, if your map phase outputs lists of [bucket,key] pairs. However, the semantics of the link phase will be to load those specified objects and follow *their* links. If you just want to extract the links from the body of your first object

Re: Loading links after a map phase in a map reduce query

2010-10-07 Thread Robin Edwards
What is the hard limit on links, through the REST API? Would it be possible to have an object with say 300,000 links? Or is this a terrible idea, R On 7 October 2010 13:50, Jan Metzner wrote: > Hi folks, > > i am experimenting with riak and have a problem with too many links in a > riak objec

Loading links after a map phase in a map reduce query

2010-10-07 Thread Jan Metzner
Hi folks, i am experimenting with riak and have a problem with too many links in a riak object. If i store the object the server send 400 Bad Request. This is caused from the link header which is too long. As workaround i thought about storing the links inside the riak object and fetch them in a m