Re: occasional timeout when deleting key on multi-node Riak 1.4

2014-10-02 Thread Igor Senderovich
Indeed, in app.config, I have: {riak_kv, [ ... {delete_mode, "immediate"} ]} Why does this lead to these kinds of random errors, I am curious. Thank you for your help On Thu, Oct 2, 2014 at 1:09 PM, Russell Brown wrote: > > On 2 Oct 2014, at 17:59, Igor Senderovich > wrote: > > There are no

Re: occasional timeout when deleting key on multi-node Riak 1.4

2014-10-02 Thread Russell Brown
On 2 Oct 2014, at 17:59, Igor Senderovich wrote: > There are no other errors in any of the logs at exactly the same time but > there are periodic errors in error.log and console.log of the following form > (and these occurred seconds before and after the crash): > > > ** Reason for terminati

Re: occasional timeout when deleting key on multi-node Riak 1.4

2014-10-02 Thread Igor Senderovich
There are no other errors in any of the logs at exactly the same time but there are periodic errors in error.log and console.log of the following form (and these occurred seconds before and after the crash): 2014-10-02 12:07:57.623 [error] <0.30125.18> CRASH REPORT Process <0.30125.18> with 10 nei

Re: occasional timeout when deleting key on multi-node Riak 1.4

2014-10-02 Thread Dmitri Zagidulin
Thanks. Are there entries in any of the other logs? (like the crash dump). Can you also provide more info on the nodes themselves. What size AWS instances are you running? Is the delete timeout happening while load testing? On Thu, Oct 2, 2014 at 12:11 PM, Igor Senderovich < isenderov...@esperdyn

Re: occasional timeout when deleting key on multi-node Riak 1.4

2014-10-02 Thread Igor Senderovich
Thanks for your help, Dmitri, I get the following in error.log: 2014-10-02 12:05:45.037 [error] <0.6359.19> Webmachine error at path "/buckets/imc/keys/5134a18660494ea5553d2c90ef9eea2f" : "Service Unavailable" And no, there is no load balancer on our cluster. Thank you On Thu, Oct 2, 2014 at 11

Re: occasional timeout when deleting key on multi-node Riak 1.4

2014-10-02 Thread Dmitri Zagidulin
One other question - are you using a load balancer for your cluster (like HAProxy or the like). In which case, take a look at its logs, also. On Thu, Oct 2, 2014 at 11:51 AM, Dmitri Zagidulin wrote: > Igor, > Can you look in the riak log directory, in the error.log (and console log > and crash d

Re: occasional timeout when deleting key on multi-node Riak 1.4

2014-10-02 Thread Dmitri Zagidulin
Igor, Can you look in the riak log directory, in the error.log (and console log and crash dump file) to see if there's any entries, around the time of the delete operation? And post them here? On Thu, Oct 2, 2014 at 11:45 AM, Igor Senderovich < isenderov...@esperdyne.com> wrote: > Hi, > > I get