Re: Supporting Riak on FreeBSD
Excellent! We've never had any major issues getting Riak to build on FreeBSD but it's great to see an official package. Thank you! TJ On Jun 11, 2012, at 4:54 PM, Jared Morrow wrote: > Riak Users, > > As some of you have noticed we have been committing small changes here and > there to help support building Riak on BSD's. We have now gone taken the > next step to officially support a BSD with packages in a release. I wrote up > a short blog post about our coming support for FreeBSD in the next major Riak > release here > http://basho.com/blog/technical/2012/06/11/Supporting-Riak-on-BSD/ > > Please send any comments, suggestions, hate mail my way. > > Thanks, > Jared > > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Anyone running Riak on FreeBSD?
> If no-one else steps forward, I'll attempt a FreeBSD build this weekend. > FreeBSD used to be my primary server OS (until Ubuntu Server won me over), so > I've got some familiarity there. I'd also be willing to help out with this. We've been running Riak on FreeBSD in production since the 0.12 release. I had put together some instructions here: http://blog.harperdog.com/2010/12/17/riak-on-freebsd/ It's a bit outdated but it's still the process we use here. I could re-write it to be a bit more "wiki-ish". > The scripts don't have any bashisms in them though, they work just fine under > /bin/sh. Andrew is right, bash isn't a requirement anymore so that's something I would also change. Also, we have had trouble with R14 and have continued to use R13...but that's a challenge I could take on again. TJ ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Riak Problem w/ Python Client "No JSON object could be decoded"
> > Thanks alot... this seems to be the problem. When i navigate to JSON files > under 127.0.0.1 i get prompted to download. > > How did you fix this? It depends on your browser you are using. By default Firefox will attempt to download JSON encoded data to a file while Safari and Chrome will just display it in the browser. TJ ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Riak Problem w/ Python Client "No JSON object could be decoded"
> Well i don't really care if it opens in a browser properly or not. The python > Riak client is returning this error so something is wrong. When I run it in > the command line it returns a json object but im still getting that error. I would play around with this using the python interpreter. Instead of calling my_bucket.get(key), I would use my_bucket.get_binary(key). This will give you the raw string stored in Riak instead of auto-decoding it. Inspect the result; make sure it does indeed look like valid json. If it does, I'd run it through the stdlib json.loads and see what happens. > Where do you set the application type header, are you talking about the > bucket object, the object itself or is it something that is set on the riak > server itself? It's an attribute of the object itself. It's set by default to "application/json" as long as you are creating standard Riak objects and not Riak binaries. See http://basho.github.com/riak-python-client/tutorial.html#storing-keys-values for more detail. TJ ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Riak Recap for August 19 - 21
> 2) Q --- Is there some way to remove an empty bucket? (via #riak) >A --- If it's empty, it doesn't exist. Buckets are just namespaces > + properties. Hopefully I'm not asking a question already answered but... Out of curiosity, where are the bucket properties stored? I can set custom bucket properties BEFORE I add any keys so they have to be somewhere. Are those left orphaned when all the keys of a given namespace are removed? Thanks! TJ ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Riak Recap for August 19 - 21
> The bucket properties are stored in the ring. The bucket properties stay in > the ring even if the bucket is empty. There is no way at the moment to remove > custom bucket properties from the ring. That answers my question...Thanks!!! TJ ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
pre3 and pre4 build issue
Hello, I'm having issues building a release of pre3 or pre4 on RHEL 6. I simply get: [root@lainie riak-1.0.0pre4]# make rel fatal: Not a git repository (or any of the parent directories): .git ./rebar get-deps fatal: Not a git repository (or any of the parent directories): .git fatal: Not a git repository (or any of the parent directories): .git fatal: Not a git repository (or any of the parent directories): .git ==> cluster_info (get-deps) ==> skerl (get-deps) ERROR: git describe --always --tags `git log -n 1 --pretty=format:%h .` failed with error: 128 and output: fatal: Not a git repository (or any of the parent directories): .git fatal: Not a git repository (or any of the parent directories): .git make: *** [deps] Error 1 [root@lainie riak-1.0.0pre4]# Pre2 and earlier build perfectly. Any ideas of how I can determine the real error? Thanks! TJ uname: Linux lainie 2.6.32-131.12.1.el6.x86_64 #1 SMP Sun Jul 31 16:44:56 EDT 2011 x86_64 x86_64 x86_64 GNU/Linux ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: pre3 and pre4 build issue
On Sep 20, 2011, at 11:50 AM, David Smith wrote: > A quickfix for this issue is to simply copy: > > deps/sext/priv/git.vsn -> deps/sext/priv/vsn.git > > We'll fix this for the next build. Fantastic; thank you, thank you, thank you! TJ ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
System Limit Question
On our RHEL servers I've been noticing a lot of:
Failed to merge ...
{{badmatch,{error,system_limit}},[{bitcask,scan_key_files,3},{bitcask,'merge1',3},{bitcask_merge_worker,do_merge,1}]}
This is a RHEL 6 / Riak 1.0 test cluster which has Riak running as root. I
have not noticed this at all on our production 0.14.2 FreeBSD cluster.
My ulimit -a output is as follows:
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 127400
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 40560
pipe size(512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 10240
cpu time (seconds, -t) unlimited
max user processes (-u) 1024
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
An lsof -p shows open files of around 3 - 5k during the merge and about 1,300
post fail. Anybody have an idea what system limit I may be hitting?
Thanks!
TJ
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: System Limit Question
On Sep 20, 2011, at 3:21 PM, Jon Meredith wrote: > When you hit the issue, could you run these two commands on the riak console > (if riak is running as a daemon 'riak attach' to get to the console then ^D > to get out) > > length(erlang:ports()). > length(erlang:processes()). > > If ports is close to 4096 or ports to 32767 you'll need to up the limit in > vm.args. Funny, I was just running those myself. Here are the results: erlang:length(erlang:ports()). 893 erlang:length(erlang:processes()). 1394 Ports sits very close to that number when things are quiet but I do notice that immediately during a failed merge (if I run the statement at the exact right moment) it can go up into the 3 thousands. Presumably this number could certainly be breaking 4096. I'll up that number in vm.args and see what happens. Thanks! TJ ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Riak & FreeBSD
> I'm still valiantly trying to get all my BSD patches merged, which add > support for Free/Net/Open/DragonFlyBSD to riak. This is fantastic and I can't wait until all your hard work pays off. Until then, this hack has continued to work to build Riak on FreeBSD: http://blog.harperdog.com/2010/12/17/riak-on-freebsd/ TJ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: building riak on FreeBSD9
> http://blog.harperdog.com/2010/12/17/riak-on-freebsd/ Those instructions on there will work for Riak < 1.1. All Riak 1.1 dependancies (with the exception of leveldb) build without any modification. I'll post a followup post on that blog detailing the short instructions. Glad to see FreeBSD and Riak getting along so well! TJ ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: basic question: initial server connection failover?
Les, > I've just glanced over the riak design overview and I think I am missing > something basic in the failover technique. The docs explain that any node > can process any query and that adding nodes will re-balance the storage. My > question is, how does the client know which server node to contact initially > and what happens if that node is the one that has failed - particularly for > the rest interface where you don't have a special client? Do you typically > put server nodes on the same host as the clients so they can use a localhost > connection, use round robin DNS, put them behind a load balancer or is there > some unique way of handling this? This really depends on your architecture. You could elect to use a reverse proxy such as Nginx to automatically handle request failover and load balancing. Even as fast and reliable as Nginx is, you still need to be careful not to induce a bottle neck or single point of failure. More simply, you could create some sort of a simple connection object which manages a pool of connections. In this I don't mean a pool of persistent HTTP keep-alive connections but rather just a simple list of possible servers which can be used one after another. Depending on your app you could simply randomize list on each request or keep the object around globally to round-robin the requests. TJ ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: basic question: initial server connection failover?
> I can't imagine a circumstance where nginx would block before riak. I was thinking more in terms of 1 commodity nginx server load balancing a cluster of 50 riak servers. :) TJ ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Riak Search
I second that. I'm giddy just thinking about it. TJ On Aug 17, 2010, at 12:46 PM, Nickolay Platonov wrote: > Hello, > > Any information when the Riak Search will be publicly available? > > Thanks, Nickolay > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: no riak on FreeBSD
On Dec 14, 2010, at 10:41 AM, Vladimir Marchenko wrote: > Has anyone managed to compile or otherwise install riak on FreeBSD? I've been running Riak in production on FreeBSD for about 3 months now under heavy use without any issues. I've actually been thinking of creating and submitting an official port for it. It's been a bit so I'll have to run through my notes but I'd be willing to post the process I undertook if you would like. TJ ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: no riak on FreeBSD
> Has anyone managed to compile or otherwise install riak on FreeBSD? Here is the link to my FreeBSD install procedure: http://blog.harperdog.com/2010/12/17/riak-on-freebsd/ TJ ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Python Client Now In FreeBSD Ports Tree
Hello all, Just letting everyone know that the Python Riak client is now available in the FreeBSD ports tree in databases/py-riak. http://www.freshports.org/databases/py-riak/ TJ ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
