Re: Riak 0.14.* and Erlang 14B03

Hi Andrew On Wed, Jun 29, 2011 at 5:52 PM, Andrew Thompson wrote: > On Wed, Jun 29, 2011 at 05:23:36PM -0400, Gregory Haskins wrote: > > On 6/29/11 1:19 PM, Jared Morrow wrote: > > > Greg, > > > > > > At this time there are no plans for a 0.14.3 release. > > > > Just to be clear: are there any p

NIO-based, async Riak Java client

Thanks to Oleg from the Grizzly users mailing list, the problem with the protobuf handling code now seems fixed. The non-blocking, Grizzly (and thus NIO) based Java client I'm experimenting with seems to work quite well. https://github.com/jbrisbin/riak-async-java-client It doesn't do link wa

Re: Riak 0.14.* and Erlang 14B03

Hi Greg, Can you start the Riak console (riak console) and let us know what it outputs? Thanks, Dan Daniel Reverri Developer Advocate Basho Technologies, Inc. d...@basho.com On Thu, Jun 30, 2011 at 3:57 AM, Gregory Haskins wrote: > Hi Andrew > > On Wed, Jun 29, 2011 at 5:52 PM, Andrew Thompso

Key alias pattern

Hi all, I was wondering if there's an established pattern where the value of one key can consistently be accessed via a different key. I'm thinking of something analogous to an HTTP 303 See Other. I imagine I could achieve this via link walking, but that suggests applying a level of indirectio

Re: Riak 0.14.* and Erlang 14B03

On 6/30/11 12:12 PM, Dan Reverri wrote: > Hi Greg, > > Can you start the Riak console (riak console) and let us know what it > outputs? Not a whole heck of a lot ;) linux-mp:~ # riak console Attempting to restart script through sudo -u riak linux-mp:~ # -Greg signature.asc Description: Open

Re: Key alias pattern

Adam, It seems totally reasonable to add an additional key after authentication from some other social network; that key being named with a unique identifier from the external social network and linking to or otherwise referencing your internal user profile information. You could then choose to e

Re: mr_queue gone wild

So I backrev'd everything to: Erlang R13B04, Riak 0.14.2 (no riak search) and got rid of any functionality using search. After importing the 7k objects the bitcask dir is ~41MB. Starting up our app everything works fine until a worker starts updating objects with new values at the rate of about 1-2

Re: mr_queue gone wild

The mr_queue is a bitcask, so you should expect it to grow monotonically until compaction. The file size is not an indication of the number of pending jobs. You can read the contents using any bitcask utility. For example, using https://github.com/aphyr/bitcask-ruby: $ bitcask --no-riak /var/l

riak_core data handoff/rebalance

I'm trying to understand when and how data handoff between nodes is triggered in riak_core. I was under the impression that data would be shuffled when a new node joined the cluster or an existing node left the cluster, but maybe that's not the case? It looks like joining a cluster is accomplished

Re: riak_core data handoff/rebalance

The code you're looking for is the "should_handoff" fun in riak_core_vnode.erl: https://github.com/basho/riak_core/blob/riak_core-0.14.2/src/riak_core_vnode.erl There is a timer in the vnodes that fires periodically, and the vnode will check it's current ring to determine if it is still the owner

Re: riak_core data handoff/rebalance

On Thu, Jun 30, 2011 at 2:27 PM, Joseph Blomstedt < joseph.blomst...@gmail.com> wrote: > The code you're looking for is the "should_handoff" fun in > riak_core_vnode.erl: > > https://github.com/basho/riak_core/blob/riak_core-0.14.2/src/riak_core_vnode.erl Thanks, Joe - much appreciated. Joel

Re: Riaksearch backup/recovery

Fyodor, This is correct. If you want to restore the index you must first install the Search precommit hook, install the extractor, and then perform the restore. This is because currently backup/restore is only aware of the raw data, not the index. As part of our continuing work on integrating S

Re: Concurrency hazard when updating links

How is this handled on requests where the the server does the link insertion and walking for you? That is, you have some existing links and simultaneously add multiple new items that add themselves to the same links, then ask the server to return the values from link walking. Does the client

Re: Concurrency hazard when updating links

I've written this little link index kit that can be used to manage external "link objects" https://github.com/krestenkrab/riak_link_index Which uses vectorclocks on individual links (they are contained in a riak_link_set) so link updates are done

With Ruby Client, How to Test for Server Availability or Clear All Data?

All - I have some test procedures that require that I start with an empty data store and end with the data exactly as it was before the test. The brute force approach I'm taking now is to: * shut down riak * rename the data/bitcask directory * start riak * run my test and validate the results i

Future plans

Hello! I know that Riak development is moving really fast right now (Riak Pipe, secondary indexes, Riak Search integration, LevelDB backend, etc) and Basho engineers are having a lot of work to do but I would like to know if there are any plans on implementing these 3 things: * Distributed counte

Re: riak-search numFound incorrect

Hi Ryan, 1) I *think *so. 2) Not that I can remember. -Greg On Wed, Jun 22, 2011 at 5:32 PM, Ryan Zezeski wrote: > Hi Greg, > > Two questions: > > 1. Was this count normally correct _before_ upgrading to 14.2? > > 2. Have you performed a direct delete (e.g. via curl) of any keys under > your

Lots of bitcask files for a vnode, unable to merge

One of the vnodes on one of my hosts has a *lot* of bitcask data/hint files, and makes a new one every 3 minutes. In the logs, I get =ERROR REPORT 30-Jun-2011::20:24:14 === Failed to merge ["/var/lib/riak/bitcask/794976964837219653749465284983368790965189869568", [], ...HUGE LIST OF DATA

Re: With Ruby Client, How to Test for Server Availability or Clear All Data?

On Thu, Jun 30, 2011 at 06:43:40PM -0400, Keith Bennett wrote: > My problem is that it takes a little time after running riak start or stop > for the operation to complete, and so I have to insert a sleep afterwards so > that the next step in the code is not performed prematurely. Is there a way

Re: Lots of bitcask files for a vnode, unable to merge

The fix is quite easy -- you can safely delete any zero-length files (while the node is down!). How it got to that state is less clear. The "every three minutes" suggests that the vnode triggers a merge only to find there is nothing to actually merge. It is odd, however, that it doesn't clean up t

Riak Recap Blog Now Operational!

Hey All, A few weeks back we decided to turn the Riak Recap into a blog [1]. I'm happy to report that the Recap blog is online an operational! Here's the inaugural post: http://recap.basho.com/2011/06/30/Welcome-to-the-Riak-Recap-Blog/ As promised, I'll be posting the Recaps to the blog (in addi