Re: block not found

2014-07-25 Thread Zack Schlag
Hi Charles, This is likely the result of heavy load on Riak; how much have you tuned Riak & your OS? Please make sure to review our tuning documentation. Thought it's not clear in our CS documentation, make sure you have the leveldb backend properly tuned: LevelDB backend: http://docs.basho

block not found

2014-07-22 Thread Charles Bijon
Since 4 days we have an issue on our cluster and we don't know how correct this problem. We have this problem after migrating 38 old node to 45 new nodes cluster. Someone have an idea about this ? 2014-07-22 14:41:11 =CRASH REPORT crasher: initial call: mochiweb_acceptor:init/3

Re: Random Block Not Found Issues with Riak/Riak CS

2014-07-22 Thread Charles Bijon
Hi Dave, Humm it's not really the same issue. [error] <0.13320.0>@riak_cs_get_fsm:waiting_chunks:311 riak_cs_get_fsm: Cannot get S3 <<"independent-print-limited">> <<"independent/independent/2014-07-22/cover/cover.ppm">> block# {<<94,144,214,192,123,131,68,132,142,55,30,108,189,81,242,106>>,0

Re: Random Block Not Found Issues with Riak/Riak CS

2014-07-22 Thread Dave Finster
Hi Charles We have a slightly different issue to yours in the majority of our requests succeed and only the odd one fails - or is that what you are observing on your cluster? I’ve been talking about the issue off-list with Luke and Kelly. Luke took a look at some of our debug logs for Riak and

Re: Random Block Not Found Issues with Riak/Riak CS

2014-07-22 Thread Charles Bijon
Hi, We have the same issue there. But we have 45 riak/riak-cs nodes in production. Do you have any idea to correct it ? Regards, Charles Le 17/07/2014 23:21, Dave Finster a écrit : Hi Kelly 1.4.5 - Riak CS 1.4.8 - Riak Anti Entropy is on (all nodes) Deactivating n_val_1_get_requests stil

Re: Random Block Not Found Issues with Riak/Riak CS

2014-07-17 Thread Dave Finster
Hi Kelly 1.4.5 - Riak CS 1.4.8 - Riak Anti Entropy is on (all nodes) Deactivating n_val_1_get_requests still allows me to cause the issue (with less occurrence), however a different error has cropped up now: 2014-07-17 21:15:38 =ERROR REPORT webmachine error: path="/buckets//objects/bf15f98

Re: Random Block Not Found Issues with Riak/Riak CS

2014-07-17 Thread Kelly McLaughlin
Dave, Can you tell me what versions of Riak and Riak CS you have installed? Do you have AAE enabled or disabled? It’s tough to come up with an explanation without more information, but I would try setting n_val_1_get_requests to false and see if you continue to experience the problem. My guess

Random Block Not Found Issues with Riak/Riak CS

2014-07-17 Thread Dave Finster
Hi Everyone Spent a bit of time trying to debug this one and not sure were to from here. The use case that appears to cause this breakage is a web page that links to 8 x 10MB images and it attempts to fetch them simultaneously. Occasionally, one or two of the images will just fail to load, whi