Re: Large numbers of keys

2012-06-27 Thread Dietrich Featherston
LevelDB is a nice option with a key space that will not fit in memory. Whether or not bitcask will work for you depends on total memory capacity of the cluster and N value. Recommend using the bitcask capacity planner to see if it is a suitable backed for your hardware+data combination. http://

Large numbers of keys

2012-06-27 Thread Eric Anderson
Hi all, I did a quick computation, and figured that I need to be able to manage a minimum 5 billion keys roughly 80bytes each. Since Bitcask needs all keys in memory, that's a lot of memory. How does it handle swapping? I typically only need a portion of those keys available at a given time,