Re: building on FreeBSD?

2011-04-13 Thread Andrew Thompson
I actually have a couple pull requests open to add support for all the BSDs for riak. You're welcome to contribute to the effort. https://github.com/basho/erlang_js/pull/11 https://github.com/basho/skerl/pull/5 Piotr actually has a better fix for skerl on OpenBSD here https://github.com/basho/s

Re: building on FreeBSD?

2011-04-13 Thread David Leimbach
Also yes, I did see this: http://blog.harperdog.com/2010/12/17/riak-on-freebsd/ Seems like the right way to fix this is not to make a port with a bunch of patches but to make the build more portable... Dave On Wed, Apr 13, 2011 at 5:20 PM, David Leimbach wrote: > I realize this might not be s

building on FreeBSD?

2011-04-13 Thread David Leimbach
I realize this might not be supported at this point, however I am trying to build on FreeBSD and I think I'm running into cases where Makefiles are referring to GNUmake as "make" instead of "$(MAKE)". Shall I file a bug? Dave ___ riak-users mailing list

Riak Recap for April 11 - 12

2011-04-13 Thread Mark Phillips
Afternoon, Evening, Morning to All - For today's Recap: New code, talks, blog posts, tweets, Gists and more. Enjoy. Mark Community Manager Basho Technologies wiki.basho.com twitter.com/pharkmillups --- Riak Recap for April 11 - 12 = 1) One

Re: "Failed to compact" in RiakSearch

2011-04-13 Thread Rusty Klophaus
Thanks Morten, having the logs (including the numbers) will help us debug what's going on. On Wed, Apr 13, 2011 at 5:14 PM, Morten Siebuhr wrote: > On Wed, Apr 13, 2011 at 5:42 PM, Andrew Thompson > wrote: > > On Wed, Apr 13, 2011 at 05:06:58PM +0200, Morten Siebuhr wrote: > >> Any ideas about

Re: "Failed to compact" in RiakSearch

2011-04-13 Thread Morten Siebuhr
On Wed, Apr 13, 2011 at 5:42 PM, Andrew Thompson wrote: > On Wed, Apr 13, 2011 at 05:06:58PM +0200, Morten Siebuhr wrote: >> Any ideas about what's going on? >> >> (We're running on a four-node cluster with NFS-based storage.) >> > > I just have to know.. why is NFS involved? My company's standar

Re: Large ring_creation_size

2011-04-13 Thread Greg Nelson
Ok, how about in this case I described? It runs out of memory with a single pair of nodes... (Or did you mean there's a connection between each pair of vnodes?) On Wednesday, April 13, 2011 at 1:56 PM, Jon Meredith wrote: Hi Greg et al, > > As you say largest known is not largest possible. Inter

Re: Large ring_creation_size

2011-04-13 Thread Jon Meredith
Hi Greg et al, As you say largest known is not largest possible. Internally within Basho, the largest cluster we've experimented with so far had 50 nodes. Going beyond that it's speculation from me about pain points. 1) It is true that you need enough file descriptors to start up all partitions

Re: Large ring_creation_size

2011-04-13 Thread Anthony Molinaro
My understanding is that it's not riak which ultimately limits the size of the cluster but erlang distribution protocol. By default erlang nodes are fully connected, so if you have 1000 nodes you have about 999 outgoing connections from each node, and with the net tick, they start to receive a lot

Re: Large ring_creation_size

2011-04-13 Thread Greg Nelson
The largest known riak cluster != the largest possible riak cluster. ;-) The inter node communication of the cluster depends on the data set and usage pattern, doesn't it? Or is there some constant overhead that tops out at a few hundred nodes? I should point out that we'll have big data, but no

Re: Large ring_creation_size

2011-04-13 Thread siculars
Ill just chime in and say that this is not practical for a few reasons. The largest known riak cluster has like 50 or 60 nodes. Afaik, inter node communication of erlang clusters top out at a few hundred nodes. I'm also under the impression that each physical node has to have enough file descrip

Re: RiakSearch question

2011-04-13 Thread Rusty Klophaus
Hi Muhammad, If you have './bin/riak', it means you have downloaded Riak KV, not Riak Search. Riak Search would have the './bin/riaksearch' executable. You can download Riak Search (including src code) from here: http://downloads.basho.com/riak-search/CURRENT/

Large ring_creation_size

2011-04-13 Thread Greg Nelson
Hello, I am experimenting with different ring sizes for a Riak cluster that will initially be 3-5 nodes but will grow to a large number of nodes, like 1000 or more. I'm also using the multiple disks per node setup discussed in other thread on this list. Because of that, we'll need to have at l

RE:RiakSearch question

2011-04-13 Thread Muhammad Yousaf
I already have that repo. I think i am doing something wrong. Let me explain you again in detailI have separte Riak and Riak_Search repo I was using Riak_Search to setup my schema and i have inserted and retrieve values in my bucket using erlang client like {ok,Client} =riakc_pb_socket:s

Re: RiakSearch question

2011-04-13 Thread Rusty Klophaus
I'd recommend that you download a pre-built binary or a code tarball from http://downloads.basho.com/riak-search/CURRENT/ rather than pulling code from github directly. The code on github is the latest development version of our software, and so it may have bugs or build problem that we haven't fo

Re: RiakSearch question

2011-04-13 Thread Les Mikesell
On 4/13/2011 11:29 AM, Dan Reverri wrote: You need to use the Riak Search repo in place of the Riak repo if you are going to following those instructions: https://github.com/basho/riak_search Is there some simple example that can be used with curl to test/demonstrate that riak_search is workin

Re: RiakSearch question

2011-04-13 Thread Dan Reverri
You need to use the Riak Search repo in place of the Riak repo if you are going to following those instructions: https://github.com/basho/riak_search Daniel Reverri Developer Advocate Basho Technologies, Inc. d...@basho.com On Wed, Apr 13, 2011 at 9:25 AM,

RE: RiakSearch question

2011-04-13 Thread Muhammad Yousaf
Dan, I build it by following the instruction from the following link http://wiki.basho.com/Building-a-Development-Environment.html Regards, Muhammad Yousaf Date: Wed, 13 Apr 2011 09:09:27 -0700 Subject: Re: RiakSearch question From: d...@basho.com To: muhammad.you...@live.com CC: riak-users@l

Re: RiakSearch question

2011-04-13 Thread Dan Reverri
Hi Muhammad, How did you build the three node cluster? What repo did you use? Thanks, Dan Daniel Reverri Developer Advocate Basho Technologies, Inc. d...@basho.com On Wed, Apr 13, 2011 at 9:04 AM, Muhammad Yousaf wrote: > > Hi, > > I have set my schema using riak search. Now i want to test it

RiakSearch question

2011-04-13 Thread Muhammad Yousaf
Hi, I have set my schema using riak search. Now i want to test it on multiple node on local machine . I have setup three nodes and they are all connected now why cannot i access my riaksearch bucket? and how can i do that ? Only reason i think is previously i was runing node as "riaksearch st

Re: "Failed to compact" in RiakSearch

2011-04-13 Thread Andrew Thompson
On Wed, Apr 13, 2011 at 05:06:58PM +0200, Morten Siebuhr wrote: > Any ideas about what's going on? > > (We're running on a four-node cluster with NFS-based storage.) > I just have to know.. why is NFS involved? Andrew ___ riak-users mailing list riak

Re: [newbie] riak performance - basics

2011-04-13 Thread Dan Reverri
Hi MH, Are there any errors in the Riak logs? I am wondering if some of those requests are failing, possibly due to an open file handle limit: https://wiki.basho.com/Open-Files-Limit.html Thanks, Dan Daniel Reverri Developer Advocate Basho Technologies, Inc. d...@basho.com On Wed, Apr 13, 2011

"Failed to compact" in RiakSearch

2011-04-13 Thread Morten Siebuhr
Hi all, I'm benchmarking RiakSearch, (through a Node.js / riak-js front-end), and we're getting occasional timeouts: Error: ETIMEDOUT, Connection timed out at Socket._onConnect (net.js:599:18) at IOWatcher.onWritable [as callback] (net.js:186:12) The RiakSearch log says: =ERROR REPORT 13-Ap

Re: [newbie] riak performance - basics

2011-04-13 Thread Kelly McLaughlin
MH, Riak may not seem as fast in a single node configuration compared to things like mongodb or others, but keep in mind the strengths of Riak are its performance at scale and the ease with which it does scale. Nobody runs a single node configuration in an actual production environment so keep tha

SV: [newbie] riak performance - basics

2011-04-13 Thread Jens Rantil
Hi M H, The default Riak configuration has N=3 [1], which means that it is configured to run on a 3-node environment. This also means that every PUT you do must write 3 values to your local machine! Changing n_val for your Riak bucket to 1 will make more sense for a 1-node environment. [1] htt

[newbie] riak performance - basics

2011-04-13 Thread M H
Hi, I am new to Riak - just compiled it and trying it out. I have some questions about performance. I am running a single riak node with default configuration (only changed the IPs) on a core i7 machine (Ubuntu). I run a very simple JMeter test (RESTful calls):  1 .PUT a simple json object into r

Re: SV: VB: SV: Slow inserts

2011-04-13 Thread Sean Cribbs
Jens, That's great to hear! Also, if you still want to use HTTP, setting the "disable_http_nagle" option to true in app.config should improve request latency. See http://wiki.basho.com/Configuration-Files.html#disable_http_nagle Sean Cribbs Developer Advocate Basho Technologies, Inc. http://

SV: VB: SV: Slow inserts

2011-04-13 Thread Jens Rantil
Sean, The problem seems to have been HTTP overhead, even though I was running 11 processes. Using procotol buffers yielded a much better (and realistic) performance around ~2900 inserts/second. Please see my previous response in this same thread for more info. Thank you, Jens Från: Sean Cribb

riakpool in production

2011-04-13 Thread Ryan Zezeski
Dave, First off, I want to say that I think it's awesome that you've started a riakc pool implementation and shared it with everyone! It's certainly a missing piece and we could all benefit from having a canonical implementation. That said, I have a few comments: 1) Growth of the pool: Since th

Re: Python feature suggestion - load (binary) content from file

2011-04-13 Thread Mathias Meyer
I took the liberty of wrapping this into a pull request. The API corresponds to Ana's original suggestion, allowing bucket.new_binary_from_file(key, filename) Thanks for contributing! Mathias Meyer Developer Advocate, Basho Technologies On Dienstag, 12. April 2011 at 23:21, Ana Nelson wrote:

Re: QUERY: riaksearch

2011-04-13 Thread Mathias Meyer
Hi, Riak Search somewhat denormalizes nested structures in a JSON-ish structure, which the PHP client creates from the associative array, unless you specify a different content type. The dot notation below actually dereferences a Riak Search index called contact1, not the nested property contac

QUERY: riaksearch

2011-04-13 Thread khyqo
good day everyone.. i am new to riak.. while i am doing some testing, i encountered a problem when retrieving data using riaksearch.. i am not sure if im doing it the right way.. i am using php (from https://github.com/basho/riak-php-client) to test.. sample data: array( "fname"=>"test",