Waiting for riak to handoff ?

2014-08-20 Thread Marcel Koopman
Hello, It seems that adding new nodes does not have any effect. Why it Riak waiting for transfers? When does it start handoff the new nodes? riak-admin member-status = Membership == Status RingPendingNode ---

Re: Bitcask Key Listing

2014-08-20 Thread Kelly McLaughlin
Jason, For key listing requests the bitcask in-memory key directory is scanned for each vnode participating in the covering set. The data structure is a hash table which is ideal for direct accesses, but there is no way to guarantee ordering when the entires are hashed into the table so bitcas

Partial Key Search

2014-08-20 Thread Nirav Shah
Hi everyone, I am new to RIAK and am using Riak 2.0.0. I have a need to do a partial key search to look up data from a bucket. I am using BucketMapReduce to do that right now. Can someone having similar requirement let me know, what is the best way to do a partial key search? Regards, Nirav__

ID generation techniques

2014-08-20 Thread Shailesh Mangal
Hi, I wanted to ask what are popular, scalable ID generation techniques for storing data in RIAK. Some ideas that we are toying with: 1. ID Generation server (like Flikr ticket server) - Numeric 2. Twitter's Snowflake like implementation- Alphanumeric 3. Riak's auto ID generation- Alpha

Re: ID generation techniques

2014-08-20 Thread Sargun Dhillon
I have questions for your question. 1. What are you using your keys for? Do they get passed around in to clients in Javascript? This is important because Javascript only reliably implements IEEE 754 floating point, which is limited to 53 bits of precision. 2. What backend are you using? In Bitcas

Re: Riak Search VS other query systems

2014-08-20 Thread Alex De la rosa
Any thoughts about this? One thing it worries me about Riak Search is that if one index has several millions of object to search for maybe it becomes slow? 2i might be faster then? Thanks! Alex On Tue, Aug 19, 2014 at 8:47 AM, Alex De la rosa wrote: > Hi there, > > I had been seeing lately Ri

Re: Riak Search VS other query systems

2014-08-20 Thread John Daily
I don't have benchmarks to discuss query performance for different tools at different sizes, but I'd like to point out that the ultimate search tool for Riak is to not search at all. Riak Search, 2i, MapReduce are all capable tools, but they don't scale nearly as well as straight key/value request

Re: How to call riak_core_ring:remove_member/3 from erlang shell?

2014-08-20 Thread bryan hunt
Hi Sebastian, Wow that’s a really old version, I know with modern versions the ring file can be nuked at the expense of a ton of transfer activity when you join the nodes back into a single cluster, shouldn’t lose data though. Anyone want to chime in with an opinion on this version ? Bryan O

Re: ID generation techniques

2014-08-20 Thread Shailesh Mangal
Thanks Sargun, 1. Keys do get exposed to client. We recently learnt about this limitation of javascript and we will convert the keys to String when they get to javascript. 2. Considering Bitcask as storage choice due to its performance, but we are open for levelDB as well. BTW, We already have te

RE: How to call riak_core_ring:remove_member/3 from erlang shell?

2014-08-20 Thread Sebastian Wittenkamp
Yeah, I know it's a pretty ancient version. I just spoke to John Kaiser on the phone and I've also been in touch with Tyler Hannan via Twitter. If we need to get you guys on a WebEx maybe that's the best route to take. In the meantime I was looking at the erlang shell as a possible way to clean

RE: How to call riak_core_ring:remove_member/3 from erlang shell?

2014-08-20 Thread Sebastian Wittenkamp
One other thing worth mentioning is that we are running 1.0.0 since we are still using luwak. From: bryan hunt Sent: Wednesday, August 20, 2014 2:43 PM To: Riak Users Mailing List Cc: Sebastian Wittenkamp Subject: Re: How to call riak_core_ring:remove_member/3 fr

Re: ID generation techniques

2014-08-20 Thread Sargun Dhillon
My recommendation would be to use GUIDs. Since they are in hex, it's more difficult to accidentally make the mistake of turning them into a number due to the nature of Javascript's type system. They do not rely on an external system, and it is fairly cheap to generate them. If you want to them to b

Re: Riak Search VS other query systems

2014-08-20 Thread Sargun Dhillon
I second John's opinions. Generally, I would have have one key which is the secondary index, being an observe-remove OR-Set (or a relevant type for your application, be a register, g-set, or a plain old OR-set) pointing to back to the keys. Unfortunately, this mechanism can become quite unwieldy in

Re: ID generation techniques

2014-08-20 Thread Alexander Sicular
This just showed up on HN: Show HN: Decentralized, k-ordered unique IDs in Clojure https://news.ycombinator.com/item?id=8202284 On Wed, Aug 20, 2014 at 1:23 PM, Shailesh Mangal < shailesh.man...@getzephyr.com> wrote: > Hi, > > I wanted to ask what are

Luwak External - Was: How to call riak_core_ring:remove_member/3 from erlang shell?

2014-08-20 Thread Bryan Fink
On Wed Aug 20, 2014, at 15:29:56 PDT, Sebastian Wittenkamp wrote: > we are running 1.0.0 since we are still using luwak. I don't think I've mentioned this on this list before, because it was mostly an experiment, and has never seen production use anywhere, but on the off chance it helps you dig ou