Re: Use case for storage expansion

2021-11-02 Thread Jack Vanlightly
Hi Hang, The thing is that the BookKeeper replication protocol doesn't tolerate bookies losing entries that it says it has stored safely. Ledger recovery can end-up truncating ledgers leading to unrecoverable data loss that not even the auditor check can recover. So this shrink and expand is funda

Re: Use case for storage expansion

2021-11-01 Thread Hang Chen
Hi Jack, Currently, if we use multi directories for journal or ledger in one bookie, it will store specific ledger into target directory by `ledgerId % numberOfLedgers`. If we expand or shrink the ledgers or journal directories, it will break hash result value, which will lead to some ledgers