Re: Maps with multiple buckets

2013-12-18 Thread John Daily
Alex Moore and I provided some general time series advice and links on StackOverflow recently: http://stackoverflow.com/questions/19384686/what-is-the-most-efficient-way-to-store-time-series-in-riak-with-heavy-reads Broadly speaking, issuing dynamic queries via MapReduce is going to be less des

Re: Maps with multiple buckets

2013-12-18 Thread Bryce Verdier
So in playing with things a little bit, I don't think that this list of bucket-key pairs is going to work for me. I'm using riak counters to keep tabs of various customers ID's as they travel through our system. So when Bob first shows up, he's seen by one set of servers. Adding 1 to the count

Re: Maps with multiple buckets

2013-12-17 Thread Bryce
Upon thinking about things a little more, if anyone has information on how to do time series with counters(current, 5 seconds ago, 10 seconds ago, and 30 seconds ago), that would be a great thing to have for the project I'm doing. Thanks again for the help! Bryce On 12/17/13 17:09, Jeremiah

Re: Maps with multiple buckets

2013-12-17 Thread Bryce Verdier
Thank you for the quick response Jeremiah. I didn't know that inputs could accept a list of buckets. I do believe that will solve my problem. I'm currently using MR to grab a list all keys/counters and use the reduce phase to sort the keys by highest count. Because I'm using counters the bac

Re: Maps with multiple buckets

2013-12-17 Thread Jeremiah Peschka
The allowable inputs to an MR map phase include a list of bucket key pairs. If you know your keys in advance the problem is solved. Can you describe a bit more about how you're using MR? Is this an ad hoc query? A predictable report? Time based? --- sent from a tiny portion of the hive mind... in

Maps with multiple buckets

2013-12-17 Thread Bryce Verdier
Hi All, I have a question concerning map-reduce. I have two buckets with counters enabled that have similar keys to track two different metrics. At the moment in order to combine these two datasets together I have to make 2 different map-reduce queries and combine the data within the client.