Is Riak a good solution for this problem?

2012-02-12 Thread Marco Monteiro
Hello! I'm considering Riak for the statistics of a site that is approaching a billion page views per month. The plan is to log a little information about each the page view and then to query that data. I'm very new to Riak. I've gone over the documentation on the wiki, and I know about map-red

Re: Is Riak a good solution for this problem?

2012-02-20 Thread Marco Monteiro
code is even > executed. It's still fast, but maybe not fast enough. CouchDB views make a > tradeoff to gain performance at the cost of disk space, and you can use > secondary indices the same way. If you give all your page count objects a > 2i index field, you can then pas

Problems writing objects to an half full bucket

2012-03-05 Thread Marco Monteiro
Hello! I have a riak cluster and I'm seeing a write fail rate of 10% to 30% (varies with the nodes). At the moment I am writing about 300 new objects per second to the same bucket. If I direct the write to a new (empty) bucket the problem goes away and I don't see any failure. The non-empty buck

Re: Problems writing objects to an half full bucket

2012-03-05 Thread Marco Monteiro
Hi, David! On 6 March 2012 04:37, David Smith wrote: > 1. What sort of error are you getting when a write fails? > I'm using riak-js and the error I get is: { [Error: socket hang up] code: 'ECONNRESET' } > 2. What backend are you using? (I'm guessing LevelDB) > LevelDB. The documentation sa

Re: Problems writing objects to an half full bucket

2012-03-06 Thread Marco Monteiro
It makes sense, David. I'm going to give it a try. Hopefully this will make it usable for the next month until the issue is addressed. I'll let you know how it goes. Thanks, Marco On 6 March 2012 15:19, David Smith wrote: > On Mon, Mar 5, 2012 at 9:55 PM, Marco Monteiro >

Re: Problems writing objects to an half full bucket

2012-03-07 Thread Marco Monteiro
Having the keys prefixed with the seconds since epoch solved the problem. Thanks, Marco On 6 March 2012 15:47, Marco Monteiro wrote: > It makes sense, David. I'm going to give it a try. > Hopefully this will make it usable for the next month > until the issue is addressed. &g