Re: Query on Riak Search in a cluster of 3 nodes behind ELB is giving different result everytime

2015-03-04 Thread Santi Kumar
But in our case we didnt have spaces in keys. All our keys are UUID's so I wouldn't suspect that. AAE I haven't verified . On Thu, Mar 5, 2015 at 7:16 AM, John O'Brien wrote: > I'd lean towards AAE issues on Yokozuna... Same problems we were having > with our 'spaces-in-keys' issue... Once we cl

Re: Query on Riak Search in a cluster of 3 nodes behind ELB is giving different result everytime

2015-03-04 Thread John O'Brien
I'd lean towards AAE issues on Yokozuna... Same problems we were having with our 'spaces-in-keys' issue... Once we cleaned those up, things were great again. On Wed, Mar 4, 2015 at 8:36 PM, Santi Kumar wrote: > Raik 2.0.0 > On Mar 5, 2015 12:31 AM, "Christopher Meiklejohn" > wrote: > >> >> > On

Re: Query on Riak Search in a cluster of 3 nodes behind ELB is giving different result everytime

2015-03-04 Thread Santi Kumar
Raik 2.0.0 On Mar 5, 2015 12:31 AM, "Christopher Meiklejohn" wrote: > > > On Mar 4, 2015, at 1:15 PM, Santi Kumar wrote: > > > > Hi, > > We are running into a strange issue with Riak Search. Our setup is with > 3 nodes of Riak (with search enabled) in 3 different ec2 instances behind > ELB. App

Re: Client get 503 response from riak server

2015-03-04 Thread Bora Kou
Thank you for the suggestion Chris. I will try increasing zdbbl, but it seems like we might have to move to Riak CS. -Bora On Wed, Mar 4, 2015 at 12:30 PM, Christopher Meiklejohn < cmeiklej...@basho.com> wrote: > > > On Mar 4, 2015, at 2:22 PM, Bora Kou wrote: > > > > Hi, > > > > We have a 6 n

Re: Client get 503 response from riak server

2015-03-04 Thread Christopher Meiklejohn
> On Mar 4, 2015, at 2:22 PM, Bora Kou wrote: > > Hi, > > We have a 6 nodes riak cluster configured with 256 size. We are using > versions 1.4.8. Occasionally, we see the server return 503 response. Looking > at the log, it seems that we have a lot of warning about reading large object > a

Client get 503 response from riak server

2015-03-04 Thread Bora Kou
Hi, We have a 6 nodes riak cluster configured with 256 size. We are using versions 1.4.8. Occasionally, we see the server return 503 response. Looking at the log, it seems that we have a lot of warning about reading large object and busy_dist_port. The majority of the objects are less than 2MB b

Re: Riak 2.0 Search Issues

2015-03-04 Thread Zeeshan Lakhani
Hey Steve, Sorry to see you’re having new issues. We’ll have the fix for “space in the key” out soon; it’s currently under review. And, I know that this issue is unrelated. I have a few different routes/thoughts for you, but are you seeing anything related to `yz_events,handle_info` in your cr

Re: Query on Riak Search in a cluster of 3 nodes behind ELB is giving different result everytime

2015-03-04 Thread Christopher Meiklejohn
> On Mar 4, 2015, at 1:15 PM, Santi Kumar wrote: > > Hi, > We are running into a strange issue with Riak Search. Our setup is with 3 > nodes of Riak (with search enabled) in 3 different ec2 instances behind ELB. > App server talks to the cluster through ELB. We are querying for list of > obj

Which operating system?

2015-03-04 Thread j.halifax2
Hi All, Could you please recommend which operating system  (or distribution) is the best (or most widely used) for riak? Note: Explanation "why" would be most welcome. Thank u so much.. jh ___ riak-users mailing list riak-users@lists.basho

Query on Riak Search in a cluster of 3 nodes behind ELB is giving different result everytime

2015-03-04 Thread Santi Kumar
Hi, We are running into a strange issue with Riak Search. Our setup is with 3 nodes of Riak (with search enabled) in 3 different ec2 instances behind ELB. App server talks to the cluster through ELB. We are querying for list of objects through *:* query instead of list bucket keys and every time t

Re: Crash Error

2015-03-04 Thread Jason Ryan
Hi Sean - yes we are using HAProxy - and there are health checks. [image: photo] *Jason Ryan* VP Engineering Trustev Real Time, Online Identity Verification email: jason.r...@trustev.com skype: jason_j_ryan web: www.trustev.com Trustev Ltd, 2100 Cork Airport Business Park, Cork, Ireland. On 4

Re: Crash Error

2015-03-04 Thread Jason Ryan
We're seeing regular errors around indexes trying to be created - but they already exist - indexes are only ever created manually, and no new indexes have been created in quite a while. We have however added new nodes and removed other nodes due to some node failures. We also have large object war

Re: Crash Error

2015-03-04 Thread Sean Cribbs
Are there any other significant error messages in the logs? I find it hard to believe that that specific crash would make your cluster unusable. On Wed, Mar 4, 2015 at 10:07 AM, Jason Ryan wrote: > This is what we have on our haproxy right now: > > backend riak_rest_backend > mode

Re: Crash Error

2015-03-04 Thread Jason Ryan
This is what we have on our haproxy right now: backend riak_rest_backend mode http option httplog balanceroundrobin option httpchk GET /ping server EU-RIAK-5 10.0.4.12:8098 weight 1 maxconn 1024 check

Re: Crash Error

2015-03-04 Thread Jason Ryan
We actually use /ping already for the health check [image: photo] *Jason Ryan* VP Engineering Trustev Real Time, Online Identity Verification email: jason.r...@trustev.com skype: jason_j_ryan web: www.trustev.com Trustev Ltd, 2100 Cork Airport Business Park, Cork, Ireland. On 4 March 2015 at 1

Re: Crash Error

2015-03-04 Thread Sean Cribbs
We recently saw this on the PB interface as well and have mitigated it [1], but we have not addressed it on HTTP. In the meantime, I would recommend changing your health check to use a regular request, for example: option httpchk /ping [1] https://github.com/basho/riak_api/pull/54 On Wed, Mar 4,

Re: Crash Error

2015-03-04 Thread Sean Cribbs
Are you using a load balancer in front of Riak, like HAProxy, with health checks turned on? On Wed, Mar 4, 2015 at 7:24 AM, Jason Ryan wrote: > Hi all, > > We're getting the following crash report messages in the log very > regularly in the last day - it renders our Riak Cluster pretty much > un

Riak 2.0 Search Issues

2015-03-04 Thread Steve Garon
Hey all, We were having the "space in the key" bug in our cluster so we went through the whole dataset, backing it up to json file and removing the spaces in the keys. Then we trashed our whole cluster and restart from scratch reimporting the whole data. Everything worked like a charm for two week

Re: measuring gossip bandwidth

2015-03-04 Thread Matthew Brender
Hi Damien, This one flew by unanswered. After speaking with a friend internally, I hear that the boundary plugin [1] picks this up and shows it nicely. I would use that with a basho bench run (How to here [2]) to get a sense of what the network traffic profile looks like. It is usually quite a b

Re: Using Riak for Data with many Entities and Relationships

2015-03-04 Thread Christopher Meiklejohn
> On Feb 26, 2015, at 5:41 PM, Matt Brooks wrote: > > I am designing a web application that, for the purpose of this conversation, > deals with three main entities: > • Users > • Groups > • Tasks > Users are members of groups, and tasks belong to groups. > > Early in the de

Crash Error

2015-03-04 Thread Jason Ryan
Hi all, We're getting the following crash report messages in the log very regularly in the last day - it renders our Riak Cluster pretty much unusable - until we restart Riak on each node. All nodes report the same type of error. 2015-03-04 13:17:43.106 [error] <0.31063.9> CRASH REPORT Process <0