Riak Recap for January 29 - February 10

2013-02-12 Thread Mark Phillips
Evening, Morning, Afternoon to All - Long overdue Recap coming your way. Code, blogs, meetups, and more. Heres another reminder about RICON | EAST happening this May in New York City. I would love to see all of you there. Also, Basho is paying travel and hotel expenses for all speakers, so I expe

Storing objects during MapReduce phase.

2013-02-12 Thread ttt
Hi everyone! Is it possible to store data into Riak during a Map or Reduce phase? This is my scenario: - I have a simple MapReduce job, with 1 map followed with 1 reduce. - I am using the Ruby library and JavaScript to code the phase functions. - In the map phase, some properties of the input ob

Re: ListKeys or MapReduce

2013-02-12 Thread Jeremiah Peschka
They're both pretty crappy in terms of performance - they read all data off of disk. If you're using LevelDB you can use the $keys index to pull back just the keys that in a single bucket. A better approach is to maintain a separate bucket - e.g. DocumentCount - that is used for counting documents

RE: ListKeys or MapReduce

2013-02-12 Thread Kevin Burton
I will read the other URLs that you mentioned. Thank you. Would you mind giving a short example (preferably using CI) of the $keys index? From: Jeremiah Peschka [mailto:jeremiah.pesc...@gmail.com] Sent: Tuesday, February 12, 2013 8:52 AM To: Kevin Burton Cc: riak-users Subject: Re: ListKey

Re: ListKeys or MapReduce

2013-02-12 Thread Jeremiah Peschka
It would be queried like any other index as an MR input. I'll create an issue and will try to get this in some time in the next few days - no promises, though. --- Jeremiah Peschka - Founder, Brent Ozar Unlimited MCITP: SQL Server 2008, MVP Cloudera Certified Developer for Apache Hadoop On Tue,

RE: ListKeys or MapReduce

2013-02-12 Thread Kevin Burton
The name is "$keys"? Something like: using (IRiakEndPoint cluster = RiakCluster.FromConfig("riakConfig")) { IRiakClient riakClient = cluster.CreateClient(); RiakBucketKeyInput bucketKeyInput = new RiakBucketKeyInput();

Re: Node unreachable even though the nodes are pingable

2013-02-12 Thread Richard Shaw
Hi Shrikar, I'd like to confirm there isn't underlying network weirdness going on. You said in your mail that "During this time the latency increases to 1 second or more than that." can you elaborate, was that from running ping $node manually that you saw the latency increase? What network monit

Re: Node unreachable even though the nodes are pingable

2013-02-12 Thread Shrikar archak
Hi Richard, Thanks for getting back. Yes the nodes which were not able to see each other in my case riak4 and riak6 showed increased latency. Other node latency was fine.Yes I will start running mtr[0] and will update if this thing happens again. Thanks, Shrikar On Tue, Feb 12, 2013 at 7:54 AM,

RE: ListKeys or MapReduce

2013-02-12 Thread Kevin Burton
I forgot to mention that when I execute this code I get the error: {not_found, {<<"products">>, <<"$keys">>}, undefined}}}:[{moc

Re: ListKeys or MapReduce

2013-02-12 Thread Jeremiah Peschka
Good news! You've found a bug in CorrugatedIron. Because of index naming, we muck index names to have a suffix of _bin or _int, depending on the index type. This shouldn't be happening on $key, but it is. I'll create a github issue and get that taken care of. --- Jeremiah Peschka - Founder, Brent

find() Suddenly Works on Quorum Change

2013-02-12 Thread Ian Ha
Via the Ripple client library for Ruby, we were doing a User.find() call to our riak cluster and received the following error: Riak::ProtobuffsFailedRequest: Expected success from Riak but received 0. {r_val_unsatisfied,3,0} As a guess, we changed the read quorum to 2 from 3 and left the write qu

Re: ListKeys or MapReduce

2013-02-12 Thread Jeremiah Peschka
...and fixed! You can get this right now if you're adventurous and want to build CorrugatedIron from source by grabbing the develop branch [1]. We have several other issues to clean up and verify before we release CI 1.1.1 in the next day or so. Or you can download it from [2] if you don't want to

RE: ListKeys or MapReduce

2013-02-12 Thread Kevin Burton
Is there a reason why you selected a range and not just the bucket and key (in the example)? My concern is that I don't want to hard-code any dependencies or fore-knowledge in the code if possible. Using a range assumes that all of the keys are in the range. As I see it if you just specify the buck

Re: ListKeys or MapReduce

2013-02-12 Thread Jeremiah Peschka
Oh, and an example can be found https://gist.github.com/peschkaj/4772825 --- Jeremiah Peschka - Founder, Brent Ozar Unlimited MCITP: SQL Server 2008, MVP Cloudera Certified Developer for Apache Hadoop On Tue, Feb 12, 2013 at 11:44 AM, Jeremiah Peschka < jeremiah.pesc...@gmail.com> wrote: > ...a

Tune Riak for fast inserts - populate DB

2013-02-12 Thread Bogdan Flueras
Hello all, I've got a 5 node cluster with Riak 1.2.1, all machines are multicore, with min 4GB RAM. I want to insert something like 50 million records in Riak with the java client (Protobuf used) with default settings. I've tried also with HTTP protocol and set w = 1 but got some problems. Howev