Re: LMDB Backend for Riak

2013-05-21 Thread Howard Chu
Date: Tue, 21 May 2013 07:28:46 -0400 From: Greg Burd Matthew's right, and I should have been more clear on a few points: * My "tests" were smoke-tests at best. Far too short and far too basic to really determine anything. That's clear from the results and Matthew's points are all valid.

Re: LMDB Backend for Riak

2013-05-21 Thread Greg Burd
Matthew's right, and I should have been more clear on a few points: * My "tests" were smoke-tests at best. Far too short and far too basic to really determine anything. That's clear from the results and Matthew's points are all valid. When bitcask and LevelDB look similar in a test, the test is

Re: LMDB Backend for Riak

2013-05-21 Thread Matthew Von-Maszewski
Greg, Wait. Couple serious environmental issues here: - " results are close enough to LevelDB, Bitcask, …": Bitcask is always 1.5x to 2x the performance of LevelDB. Bitcask has a constant throughput until its first merge. Your comment states all the databases are close. Bitcask and Leveld

Re: LMDB Backend for Riak

2013-05-04 Thread Kresten Krab Thorup
Thanks for your comments. Sent from my iPhone On 04/05/2013, at 03.55, "Howard Chu" wrote: >>> Date: Fri, 3 May 2013 14:43:33 EDT >>> From: Kresten Krab Thorup krab at trifork.com >>> To: Brian Hong > >> I tried lmdb in an iOS project recently and while it is indeed fast i also > did run int

Re: LMDB Backend for Riak

2013-05-03 Thread Howard Chu
Date: Fri, 3 May 2013 14:43:33 EDT From: Kresten Krab Thorup krab at trifork.com To: Brian Hong I tried lmdb in an iOS project recently and while it is indeed fast i also did run into several issues. I needed something seriously faster than SQLite and after some experimentation ended up embed

Re: LMDB Backend for Riak

2013-05-03 Thread Howard Chu
Date: Fri, 3 May 2013 12:05:14 -0600 From: Jon Meredith To: Brian Hong Hi Brian, Experimental backends for Riak are always exciting. I haven't played with it personally, and Basho has no current plans to support it as a leveldb alternative. It's worth adding two notes of caution. First, s

Re: LMDB Backend for Riak

2013-05-03 Thread Matthew Von-Maszewski
Brian The comments in the ycombinator.com link are correct about leveldb stalling during writes. That is an unacceptable trait for Riak. We have a custom branch available to everyone at github.com: "basho/leveldb". The branch contains all code changes through 1.9 of Google's code. It also

Re: LMDB Backend for Riak

2013-05-03 Thread Kresten Krab Thorup
I tried lmdb in an iOS project recently and while it is indeed fast i also did run into several issues. I needed something seriously faster than SQLite and after some experimentation ended up embedding leveldb in stead. 1. When storing objects larger than the page size (default is 4k) then those

Re: LMDB Backend for Riak

2013-05-03 Thread Jon Meredith
Hi Brian, Experimental backends for Riak are always exciting. I haven't played with it personally, and Basho has no current plans to support it as a leveldb alternative. It's worth adding two notes of caution. First, stores that use mmap for persistence can suffer from problems around dirty pag

LMDB Backend for Riak

2013-05-01 Thread Brian Hong
OpenLDAP Lightning Memory-Mapped Database seems to be getting traction for it's high performance and similar query (iteration) functionality with leveldb: http://symas.com/mdb/ There seems to be an experimental backend for Riak: https://github.com/alepharchives/emdb Does anybody know of it's use