Re: Searching

2015-03-07 Thread Jason Ryan
Just as some FYI - we've just had another crash as of 15mins ago. [image: photo] *Jason Ryan* VP Engineering Trustev Real Time, Online Identity Verification email: jason.r...@trustev.com skype: jason_j_ryan web: www.trustev.com Trustev Ltd, 2100 Cork Airport Business Park, Cork, Ireland.

Re: Searching

2015-03-07 Thread Jason Ryan
false and last_write_wins true, so we don't expect any siblings. We had a health done by yourselves also, the main change, which we have not yet applied is switching AAE from active to passive and setting erlang buffer to 128MB [image: photo] *Jason Ryan* VP Engineering Trustev Real Time,

Searching

2015-03-07 Thread Jason Ryan
Hi all, We're having real trouble with Riak Search. We are seeing an awful lot of errors, which leads to alot of logging for solr and the disk IO reaching 95% + which is causing lots of issues. - We consistently see errors around Riak trying to create indexes which already exist - only a restart

Re: Crash Error

2015-03-04 Thread Jason Ryan
Hi Sean - yes we are using HAProxy - and there are health checks. [image: photo] *Jason Ryan* VP Engineering Trustev Real Time, Online Identity Verification email: jason.r...@trustev.com skype: jason_j_ryan web: www.trustev.com Trustev Ltd, 2100 Cork Airport Business Park, Cork, Ireland. On 4

Re: Crash Error

2015-03-04 Thread Jason Ryan
bject warnings, >5MB (generally around 7MB) - which we address each time we see them and mitigate the errors for the future... Other than that we don't see many other errors, so we're unsure why the cluster tends to fail. [image: photo] *Jason Ryan* VP Engineering Trustev Real Tim

Re: Crash Error

2015-03-04 Thread Jason Ryan
ell and have mitigated it > [1], but we have not addressed it on HTTP. In the meantime, I would > recommend changing your health check to use a regular request, for example: > > option httpchk /ping > > [1] https://github.com/basho/riak_api/pull/54 > > On Wed, Mar 4, 2015 at

Re: Crash Error

2015-03-04 Thread Jason Ryan
We actually use /ping already for the health check [image: photo] *Jason Ryan* VP Engineering Trustev Real Time, Online Identity Verification email: jason.r...@trustev.com skype: jason_j_ryan web: www.trustev.com Trustev Ltd, 2100 Cork Airport Business Park, Cork, Ireland. On 4 March 2015 at

Crash Error

2015-03-04 Thread Jason Ryan
this before, know what the cause might be? Thanks, Jason [image: photo] *Jason Ryan* VP Engineering Trustev Real Time, Online Identity Verification email: jason.r...@trustev.com skype: jason_j_ryan web: www.trustev.com Trustev Ltd, 2100 Cork Airport Business Park, Cork, Ireland. -- This

Re: Random timeouts on Riak

2014-12-30 Thread Jason Ryan
ld that large key be manifesting an issue down the line on accessing other keys? The large key would be fetched as part of our test scenario, but maybe the issue isn't bubbling up until one of the smaller keys is accessed? On 30 December 2014 at 11:19, Russell Brown wrote: > > On 30

Re: Random timeouts on Riak

2014-12-30 Thread Jason Ryan
chash_keyfun: {riak_core_util,chash_std_keyfun} big_vclock: 50 basic_quorum: false allow_mult: false active: true claimant: 'n1@10.2.4.5' Jason [image: photo] *Jason Ryan* VP Engineering Trustev Real Time, Online Identity Verification email: jason.r...@trustev.com skype: jason_

Re: Random timeouts on Riak

2014-12-29 Thread Jason Ryan
t started On 29 December 2014 at 12:08, Sargun Dhillon wrote: > The bucket (type) that you're working with -- what are your > allow_mult, and last_write_wins settings? > > On Mon, Dec 29, 2014 at 4:05 AM, Jason Ryan > wrote: > > It seems to move between 4 keys i

Re: Random timeouts on Riak

2014-12-29 Thread Jason Ryan
at 12:19, Russell Brown wrote: > > On 29 Dec 2014, at 12:09, Jason Ryan wrote: > > All types/buckets we use are set to allow_mult: false - > last_write_wins:true > > > Did you change to this setting after these keys were written? > > Looks like a bug in Riak, so I’m g

Re: Random timeouts on Riak

2014-12-29 Thread Jason Ryan
All types/buckets we use are set to allow_mult: false - last_write_wins:true [image: photo] *Jason Ryan* VP Engineering Trustev Real Time, Online Identity Verification email: jason.r...@trustev.com skype: jason_j_ryan web: www.trustev.com Trustev Ltd, 2100 Cork Airport Business Park, Cork

Re: Random timeouts on Riak

2014-12-29 Thread Jason Ryan
What version of Riak are you using? >> 3) What backend(s) are you using? >> 4) What's the size of your keyspace? >> 5) Are you actively rewriting keys, or writing keys to the cluster? >> 6) Do you know how much I/O the cluster is currently doing? >> >> On Mon

Re: Random timeouts on Riak

2014-12-29 Thread Jason Ryan
REPORT Process <0.14490.1> with 0 neighbours exited with reason: bad argument in call to erlang:hd([]) in riak_object:most_recent_content/1 line 228 in gen_fsm:terminate/7 line 622 Thanks, Jason [image: photo] *Jason Ryan* VP Engineering Trustev Real Time, Online Identity Verification emai

Random timeouts on Riak

2014-12-29 Thread Jason Ryan
Hi, We are getting random timeouts from our application (>60seconds) when we try to retrieve a key from our Riak cluster (4 nodes with a load balancer in front of them). Our application just uses the standard REST API to query Riak. We are pretty new to Riak - so would like to understand how best

Bucket type - change of properties

2014-12-01 Thread Jason Ryan
Hi all, I have a simple riak 1 node install on a VM for development - I created a new bucket type, activated it and was using it, and then noticed I was getting siblings back, I'd forgotten to set allow_mult:false and last_write_wins:true I did an update on the bucket-type, restarted Riak and che

Re: Riak Search queries

2014-11-24 Thread Jason Ryan
/v2.0/decision/e12f7e34-cdd0-4138-b0e4-88d906aba391", " RequestMessageType": "application/json", "RequestMethodType": "GET", "_yz_id": "1*Trunk*ApiEvents*20141124091329-GET-200*35", "_yz_rk": "20141124091329-GET-200", &q

Re: Riak Search queries

2014-11-13 Thread Jason Ryan
Thanks Eric - I don't see the _yz_vtag returned in the search result set - so not sure how to tell that? [image: photo] *Jason Ryan* VP Engineering Trustev Real Time, Online Identity Verification email: jason.r...@trustev.com skype: jason_j_ryan web: www.trustev.com Trustev Ltd, 2100

Riak Search queries

2014-11-11 Thread Jason Ryan
Hi all, I have some quick (hopefully!) questions around Riak search. 1. I'm getting multiple documents returned in the search results for a query - which I assume is based on the n_val of my bucket as I tried to change the search index to have a n_val of 1 but got an error that it needed to match