Most efficient way to determine if 1000 specific keys exist?

2012-05-02 Thread Tim Haines
Hey guys, Still a relative newbie here. I was hoping to be able to setup a MapReduce job that I could feed 1000 keys to, and have it tell me of the 1000, which keys exist in the bucket. I was hoping this could use the key index (such a thing exists right?) without having to read the objects. Th

How do I improve Level DB performance?

2012-05-10 Thread Tim Haines
che_size, 168430088} I've set it running on another 8 hour benchmark to see what it turns up. Cheers, Tim Haines. ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: How do I improve Level DB performance?

2012-05-10 Thread Tim Haines
Hi David, I think I saw your name as one of the creators of the benchmarking tool - thanks - compared to the efforts required to benchmark other systems, it's been great. On Thu, May 10, 2012 at 3:01 PM, David Smith wrote: > On Thu, May 10, 2012 at 2:33 PM, Tim Haines wrote: > &

Re: How do I improve Level DB performance?

2012-05-10 Thread Tim Haines
On Thu, May 10, 2012 at 3:01 PM, David Smith wrote: > On Thu, May 10, 2012 at 2:33 PM, Tim Haines wrote: > > > I've set up a new cluster, and have been doing pre-deployment benchmarks > on > > it. The benchmark I was running slowly sunk from 1000 TPS to 250 TPS over &g

Re: How do I improve Level DB performance?

2012-05-11 Thread Tim Haines
David, I ran the benchmark again for 9 hours overnight, just doing puts. Performance fell steadily from 400 puts/s to 250 puts/s. Graph: http://twitpic.com/9jtjmu/full Cheers, Tim. On Thu, May 10, 2012 at 3:01 PM, David Smith wrote: > On Thu, May 10, 2012 at 2:33 PM, Tim Haines wr

Re: How do I improve Level DB performance?

2012-05-11 Thread Tim Haines
On Fri, May 11, 2012 at 9:13 AM, Ryan Zezeski wrote: > > > On Thu, May 10, 2012 at 11:14 PM, Tim Haines wrote: >> >> >> >> With the adjusted ring size and settings, and adjusted to only do puts >> (so no missed reads), my cluster is doing about 400 puts p

Re: How do I improve Level DB performance?

2012-05-11 Thread Tim Haines
On Fri, May 11, 2012 at 9:20 AM, Tim Haines wrote: > > > On Fri, May 11, 2012 at 9:13 AM, Ryan Zezeski wrote: > >> >> >> On Thu, May 10, 2012 at 11:14 PM, Tim Haines wrote: >>> >>> >>> >>> With the adjusted ring size and s

Re: How do I improve Level DB performance?

2012-05-11 Thread Tim Haines
On Fri, May 11, 2012 at 10:05 AM, Ryan Zezeski wrote: > > > On Fri, May 11, 2012 at 12:42 PM, Tim Haines wrote: > >> >> I guess I was hoping that someone could look at these results and say >> "Given the use case and the hardware, Riak should be perfo