Re: Riak newbie, need to know if I can switch from Cassandra for a messageQueue For Erlang

2012-05-11 Thread Eric Moritz
I am guessing that in Cassandra that each user's mailbox has a single row key and each message has a lexicographic or timestamp for a column key to preserve order. This can be emulated by using a bucket name as the row key, something like "mailbox-{user-key}" for the bucket and the lexicographic k

Re: How do I improve Level DB performance?

2012-05-11 Thread Tim Haines
David, I ran the benchmark again for 9 hours overnight, just doing puts. Performance fell steadily from 400 puts/s to 250 puts/s. Graph: http://twitpic.com/9jtjmu/full Cheers, Tim. On Thu, May 10, 2012 at 3:01 PM, David Smith wrote: > On Thu, May 10, 2012 at 2:33 PM, Tim Haines wrote: > >

Re: How do I improve Level DB performance?

2012-05-11 Thread Ryan Zezeski
On Thu, May 10, 2012 at 11:14 PM, Tim Haines wrote: > > > > With the adjusted ring size and settings, and adjusted to only do puts (so > no missed reads), my cluster is doing about 400 puts per second: > http://twitpic.com/9jnhlm/full > Actually, every put (put from a riak API level) does a read

Re: How do I improve Level DB performance?

2012-05-11 Thread Ryan Zezeski
On Fri, May 11, 2012 at 11:00 AM, Tim Haines wrote: > > > I ran the benchmark again for 9 hours overnight, just doing puts. > Performance fell steadily from 400 puts/s to 250 puts/s. > > Graph: http://twitpic.com/9jtjmu/full > > 1> Secs = 9 * 60 * 60. 32400 2> Secs * 400. 1296 Given your wri

Re: How do I improve Level DB performance?

2012-05-11 Thread Tim Haines
On Fri, May 11, 2012 at 9:13 AM, Ryan Zezeski wrote: > > > On Thu, May 10, 2012 at 11:14 PM, Tim Haines wrote: >> >> >> >> With the adjusted ring size and settings, and adjusted to only do puts >> (so no missed reads), my cluster is doing about 400 puts per second: >> http://twitpic.com/9jnhlm/f

Re: How do I improve Level DB performance?

2012-05-11 Thread Tim Haines
On Fri, May 11, 2012 at 9:20 AM, Tim Haines wrote: > > > On Fri, May 11, 2012 at 9:13 AM, Ryan Zezeski wrote: > >> >> >> On Thu, May 10, 2012 at 11:14 PM, Tim Haines wrote: >>> >>> >>> >>> With the adjusted ring size and settings, and adjusted to only do puts >>> (so no missed reads), my cluste

Re: How do I improve Level DB performance?

2012-05-11 Thread Ryan Zezeski
On Fri, May 11, 2012 at 12:42 PM, Tim Haines wrote: > > I guess I was hoping that someone could look at these results and say > "Given the use case and the hardware, Riak should be performing 10x what > you're seeing, so something is configured wrong." I'm not hearing that > though. What I'm he

Re: How do I improve Level DB performance?

2012-05-11 Thread Tim Haines
On Fri, May 11, 2012 at 10:05 AM, Ryan Zezeski wrote: > > > On Fri, May 11, 2012 at 12:42 PM, Tim Haines wrote: > >> >> I guess I was hoping that someone could look at these results and say >> "Given the use case and the hardware, Riak should be performing 10x what >> you're seeing, so something

Re: erlang-http-client and riak::search

2012-05-11 Thread Ryan Zezeski
On Thu, May 10, 2012 at 8:15 PM, Gregory Haskins wrote: > Hi All, > > I'm working on an erlang client of the riak::search functionality built > into riak-1.1.2. While I do see the support for querying data that is > already indexed (rhc:search), I do not see how to index and/or remove data > from

Re: erlang-http-client and riak::search

2012-05-11 Thread Greg
On May 11, 2012, at 1:20 PM, Ryan Zezeski wrote: > > The best way to use Search is for indexing KV data by installing the > precommit hook. There are APIs to write docs that don't go through KV but > IMO they never should have been added to Search and I plan to focus it on > indexing KV data

Re: Questions about Riak Enterprise

2012-05-11 Thread Andrew Thompson
On Thu, May 10, 2012 at 11:09:36AM -0700, Ahmed Bashir wrote: > Hey Andrew, > > Can you elaborate on how EDS replication does this mirroring? Does > each vnode have the ability to connect to the other cluster, or is > there a coordinator that sends data to the other cluster, etc? There is a coor

Re: Questions about Riak Enterprise

2012-05-11 Thread Andrew Thompson
On Wed, May 09, 2012 at 04:35:06PM +, Elias Levy wrote: > That's problematic. We will be rolling out an EDS implementation in the > near future. One cluster will be in metal, but we are likely to place the > other on EC2, and we'd use elastic IPs and split horizon DNS. > > When is this expec