Riak Search index repair and

Hi, I've been reading up on Riak search and am very pleased to see the new index repair command in 1.2. However, it seems that in order to use it you must be able to somehow detect when there are inconsistencies in your search indexes across vnodes. While it's likely the inconsistencies would be s

predictable latency

Is there any way to tune Riak to produce predictable latency? I have been experimenting with a three node cluster and tuning the frag_merge_trigger and frag_threshold bitcask parameters but no matter what I set them to, I get very inconsistente latency numbers. Latency seems to increase quite signi

Re: preflist_exhausted

It turned out this was caused by my using the wrong port in my code. I had two ways of initiating the connection to riak in my python code. One using the HTTP interface, and one using the protocol buffers interface, and the port being used for protocol buffers was incorrectly hitting the system ri

Re: riak is not starting but no error is logged

ok, so setting cookie to something different than riak and also setting the name to something more unique helped. anyway I dont know if name had anything to do with the error as I had only one machine running with riak. maybe someone can update http://wiki.basho.com/Basic-Cluster-Setup.html and add

stats

Hello, after a 4 nodes Riak installation running on Ubuntu 12.04, i wanted to check the stats with : curl -H "Accept: text/plain" http://127.0.0.1:8091/stats I got the following trace : 500 Internal Server Error Internal Server Error The server encountered an error while processing this request:{e

Re: transfers failing lookup_timeout

More information ... These errors come about a minute before the errors below: 2012-09-24 12:45:15.607 [info] <0.6099.0>@riak_core_handoff_sender:start_fold:126 Starting ownership_handoff transfer of riak_search_vnode from ' r...@sylvester.soiq.net' 10961262279981771886527636245372122647419494072

Re: HTTP Client bug

Yes I noticed that it is a work around. I can bump the version beyond 4.2.x and re-compile the riak-client, but can riak make a note of this as a known-issue through a Github-Issue or buzilla (or whatever it is that you use to track tasks) so you can get around to it later when you find the time ?

Re: HTTP Client bug

The pull request doesn't fix the HttpClient issue, it is more like a workaround the issue in the code, if you notice, even if they didn't upgrade the POM, the issue won't be reproduced by the riak java client. On 24/09/12 20:13, Deepak Balasubramanyam wrote: Guido, Reading the comments on tha

Re: HTTP Client bug

I forgot to mention that in our company we are using a different POM, for example, Jackson at version 1.9.9 and HttpClient at version 4.1.3, you could force your POM file to overwrite those versions, you could also try to get the source from github, upgrade the POM dependencies to your needs, d

Re: HTTP Client bug

Guido, Reading the comments on that pull request, I get the feeling that pcl is suggesting that upgrading to 4.2.2 is another way to solve the problem. I dont think that route was taken to resolve the issue. Quoting his comment... upgrading your dependency to 4.2.2 once it becomes available will

transfers failing lookup_timeout

Hi, I've got a two node riak cluster set up for testing. After joining the second node to the cluster, I've got some failing transfers. Restarts on both nodes don't resolve the situation. Any ideas? >From error.log on transferrer node (sylvester.soiq.net): 2012-09-24 12:06:35.598 [error] <0.3

Re: HTTP Client bug

Deepak, I think that was fixed on the following pull request but, you would have to compile your own client from github which is easy; or, did you get the new 1.0.6? I'm not sure if it is already available at maven repos, anyways, there is a lot going on in the riak client in java, I would

HTTP Client bug

Hi, My servers complain about a leaky apache DateUtils class during hot deployments. This is a known bugin http 4.1.x and has been fixed in 4.2.x. Can the next version of riak-client be updated to include the newer HTTP client (the current ver

Re: "exception exit: disconnected" when reading old 0.13.0 riak data with protobuf client

Yeah, it's a known issue for old Riak versions. We've been using this patch until the upgrade: https://gist.github.com/3777546 Note that you should patch both Riak and client modules. Speaking of riakclient_pb.erl, I'm not completely sure, but guess it's generated by protobuffs from a PB spec. On

"exception exit: disconnected" when reading old 0.13.0 riak data with protobuf client

Hi, I have a cluster with old 0.13.0 riak nodes installed. Erlang native API client is used to get/put data to/from the cluster. Now I'm trying to start using protobuf client (riakc_pb_socket). The problem is that the pb client can't read data saved with old native riak_client. Steps to reproduce:

Re: Changing pb ip and http ip causes startup error

Geoff, You can just delete the contents of the ring directory and restart with the modified vm.args and you should be fine. You can find it at ./rel/riak/data/ring/ if you built a release from source or /var/lib/riak/ring/ if you installed a package. Kelly On Sep 24, 2012, at 7:40 AM, Geoff

Changing pb ip and http ip causes startup error

I modifed app.config by changing the pb_ip and http ip to the ip of the local machine. I then modified the vm.args by changing the name property to be the ip of the machine. When I start riak I get the following error and the server doesn't start: 2012-09-24 09:32:45.464 [error] <0.159.0> gen

Re: riak is not starting but no error is logged

ok as for double name I already look at that before writing here and I really couldnt find another machine running riak with same name within my subnet. I guess if I change default riak@my_ip to something like riak12345@my_ip it should be fine and part before @ has nothing to do with system user,

Re: Riak 1.2 Ubuntu Precise .deb

Matt, The 32-bit deb is only listed under Lucid, because that is the platform it is built and tested on. We don't support 32-bit on every platform, but test it on one just-in-case someone needs 32-bit. We encourage users to use 64-bit instead when it is possible for them. Thanks, Jared On Sun,

Re: Ripple, search, and newbie, oh, my!

Hello Martin, There are some documentation resources which might help you get up to speed on Riak Search, and which definitely answer some of your questions: 1. http://wiki.basho.com/Riak-Search.html 2. http://wiki.basho.com/Riak-Search---Schema.html 3. http://wiki.basho.com/Riak-Search---Indexi

Re: riak is not starting but no error is logged

You got two errors. 1. "too short cookie", try deleting your ~/.erlang.cookie and retry. Perhaps if you edited your etc/vm.args -setcookie parameter, you can try to change that. 2. duplicate_name is because you have two erlang instances running with the same -name parameter, each erlang vm is r

Re: Specified w/dw/pw values invalid for bucket n value of 1

On 24 Sep 2012, at 13:38, Ingo Rockel wrote: > Hi, > > I finally found the reason for this message: Although the bucket was > initialized with r=1, the java client silently appended a "r=2" to all > fetches which caused this message. I've found the code that does this. It is deep in the legac

Re: Specified w/dw/pw values invalid for bucket n value of 1

Hi, I finally found the reason for this message: Although the bucket was initialized with r=1, the java client silently appended a "r=2" to all fetches which caused this message. The combination of two things really cost me a lot of time to find the reason for this: * the error message from

Re: riak is not starting but no error is logged

hej, I would really appreciate any feedback on this. maybe im missing something in official tutorials. google search result shows very basic scenarios. I had no problem running pre-configured 4 nodes on one machine. pozdrawiam Paweł Kamiński kami...@gmail.com pkaminski@gmail.com ___

Re: HTTP or PB cluster client issue

Agreed. Unfortunately there's a number of issues with the ClusterClient that are not easily solved; what you've discovered is one of them. As Guido notes, HAProxy is a far better solution at the moment. I'm looking at what I can do to address these issues but it's going to take some fairly large

Re: data modeling question

Looks good! A couple of observations: The relation from PlayerMessage to Message introduces the possibility of inconsistency by either dead references to Message or orphan Messages. Thats managable - just an inconvinience. If you need to read PlayerMessage and corresponding Messages in one go,

indexing precommit hooks and the maximum number of buckets

Hi All, Does the Search indexing precommit hook adversely affects the maximum number of buckets a Riak cluster can handle? More specifically: as long as we don't change their properties, buckets are namespaces for our keys and, theoretically, there is no limit to their number [1,2]. At the same t

Re: riakc_pb_socket client & poolboy

My main concern about poolboy is the fact that it wraps another gen_server process around the actual worker process. This makes you send an extra message every time you query the database, which is quite an overhead when you have a lot of concurrent users. Since you guys are fighting for performanc

Re: riakc_pb_socket client & poolboy

Hi Dmitry, ;) Yes, thank you. I'm also thinking about this approach. I just wanted to know how people use poolboy for that (It seems they do). But even considering your case, imagine that you have quite a big cluster and quite a big amount of rps. In this case you may want to have more than one lo

Re: riakc_pb_socket client & poolboy

Why not use load balancer on top of Riak cluster, independently from clients? If load balancing is sophisticated enough, it can even do a greater job than just uniformly spreading requests between machines. Consider the following situation. You happen to send several requests for a huge piece of d

Riak Python Bindings 1.5.0

Hey list, I'm upgrading to Riak 1.2 and moving over to the latest Python bindings at the same time. What's the current recommended install process for this? I'd (obviously) like to use pip for simplicity - but it seems that's not currently working (details below). I recall manually installing prot

riakc_pb_socket client & poolboy

Hi, I'm trying to use poolboy to organize a pool of connections to riak nodes with protobuf client. This has come from the suggestion here: http://lists.basho.com/pipermail/riak-users_lists.basho.com/2012-September/009346.html The quote: "Using Poolboy is convenient because it comes as a depende