On Thu, Jun 25, 2009 at 9:24 AM, erik quanstrom<quans...@quanstro.net> wrote: >> > does venti even keep scores on the bloom filter blocks and the icache? >> >> no, but those are soft data and can be reconstructed. > > being the paranoid type, i worry about this. does the > rebuild rate on a large (say, 1tb) venti make this a > practical strategy?
there's no question that a better strategy is to use a 100% reliable underlying storage device. if that's not available and one must cope with disk failures some other way, it is very nice that venti can use the sha1 checksums to check the integrity of the core data and rebuild the rest. this is what i do when a disk fails on the mit venti backup server, which has about 5tb of data right now. it takes about an hour to rebuild everything with venti/buildindex. russ