Deleting data from bitcask backend

2013-09-16 Thread Charl Matthee
Hi, We have a 8-node riak v1.4.0 cluster writing data to bitcask backends. We've recently started running out of disk across all nodes and so implemented a 30-day sliding window data retention policy. This policy is enforced by a go app that concurrently deletes documents outside the window. The

Re: Secondary indexes in ruby (using riak-ruby-client)

2013-09-17 Thread Charl Matthee
Hi, On 17 September 2013 23:43, Wagner Camarao wrote: > bucket.get_index 'bars_bin', 'foo' > > But am failing with: > > Zlib::DataError: incorrect header check > from > /Users/wagner/.rbenv/versions/2.0.0-p195/lib/ruby/2.0.0/net/http/response.rb:357:in > `finish' I think the Zlib error is obscu

Debugging mapreduce

2013-09-23 Thread Charl Matthee
Hi, I am trying to run the following mapreduce query across my cluster: # curl -XPOST http://10.179.229.209:8098/mapred -H "Content-Type: application/json" -d '{"inputs":"tweets", "query":[{"map":{"language":"javascript", "source":"function(value, keyData, arg) {t = JSON.parse(value.values[0].dat

Debugging mapreduce

2013-09-24 Thread Charl Matthee
Hi, I am trying to run the following mapreduce query across my cluster: # curl -XPOST http://10.179.229.209:8098/mapred -H "Content-Type: application/json" -d '{"inputs":"tweets", "query":[{"map":{"language":"javascript", "source":"function(value, keyData, arg) {t = JSON.parse(value.values[0].dat

Re: Debugging mapreduce

2013-09-24 Thread Charl Matthee
Hi, On 25 September 2013 03:44, Toby Corkindale wrote: > Have you tried executing your javascript outside of Riak? > ie. paste the function into the Chrome debugger, then call it with a > Riak-like data structure. The problem with this approach is I need to make some assumptions on what the dat