Re: mr_queue gone wild

2011-07-12 Thread Sylvain Niles
Thanks again for all the pointers. After much digging I found the issue. We have UTF8 validation on the most data we put into riak (our events bucket), but weren't validating UTF8 on some objects that are linked to by many other objects (group bucket). Consequently some malformed UTF8 (that display

Re: mr_queue gone wild

2011-07-05 Thread Bryan Fink
On Thu, Jun 30, 2011 at 4:52 PM, Sylvain Niles wrote: > Is there a way to list the m/r jobs in the queue in case there's > something else going on? Is there a reason they never get removed? Hi, Sylvain. As Aphyr noted, the mr_queue is a bitcask. Because bitcask is append-only storage, its size

Re: mr_queue gone wild

2011-06-30 Thread Aphyr
The mr_queue is a bitcask, so you should expect it to grow monotonically until compaction. The file size is not an indication of the number of pending jobs. You can read the contents using any bitcask utility. For example, using https://github.com/aphyr/bitcask-ruby: $ bitcask --no-riak /var/l

Re: mr_queue gone wild

2011-06-30 Thread Sylvain Niles
So I backrev'd everything to: Erlang R13B04, Riak 0.14.2 (no riak search) and got rid of any functionality using search. After importing the 7k objects the bitcask dir is ~41MB. Starting up our app everything works fine until a worker starts updating objects with new values at the rate of about 1-2

Re: mr_queue gone wild

2011-06-29 Thread Mathias Meyer
Sylvain, you should not be using riak HEAD for anything that's close to your production environment. Development in Riak is in big flux right now, and it'll be hard for us to help you find the specific problem. Could you please install Riak Search 0.14.2, best with a fresh installation, and tr