We can assume that this record has only one key->value mapping. Value will be updated every minute. Currently we have 1 Million these ( key->value ) pairs but I have to make sure that we can scale it upto 10 million of these ( key-> value ) pairs.
Every 10 minute I will be updating all of these value using their keys. This is the reason I cannot go for database as a solution. I was thinking about going with memcache pool. In the mean-time I heard about hadoop and wanted to get advice from this mailing list regarding memcache pool vs hadoop for this specific problem. Thanks, Aakash. --- On Mon, 12/22/08, Steve Loughran <[email protected]> wrote: From: Steve Loughran <[email protected]> Subject: Re: Architecture question. To: [email protected] Date: Monday, December 22, 2008, 5:36 AM aakash_j j_shah wrote: > Hello Edwin, > Thanks for the answer. Records are very small usually key is about 64 bytes ( ascii ) and updates are for 10 integer values. So I would say that record size including key is about 104 bytes. Phone numbers? and device IDs? And you want do number->ID or ID->number mappings? this is more of a database problem than a filesystem one
