Re: BP-46 running without journal PR ready for review

2021-12-22 Thread Sijie Guo
Jack, Awesome! Glad to know the PR is finally out for review. Sijie On Fri, Dec 17, 2021 at 10:48 AM Jack Vanlightly wrote: > Hi all, > > The BP-46 running without the journal changes are ready for review. > > https://github.com/apache/bookkeeper/pull/2936 > > You can view the BP PR here: > ht

BP-46 running without journal PR ready for review

2021-12-17 Thread Jack Vanlightly
Hi all, The BP-46 running without the journal changes are ready for review. https://github.com/apache/bookkeeper/pull/2936 You can view the BP PR here: https://github.com/apache/bookkeeper/pull/2706 Also Ivan and I did a talk about it which might help describe some of the context around the jou

Re: Running without journal

2021-05-05 Thread Jack Vanlightly
I have created BP-44 for this proposal. Regarding Flavio's questions, we can address those during the review process and Ivan can chip in regarding the performance aspects. https://github.com/apache/bookkeeper/issues/2705 https://github.com/apache/bookkeeper/pull/2706 Jack On Wed, May 5, 2021 a

Re: Running without journal

2021-05-05 Thread Lothruin Mirwen
Great news! I'm so excited to see it at work :) Diego Il giorno mar 4 mag 2021 alle ore 20:38 Venkateswara Rao Jujjuri < jujj...@gmail.com> ha scritto: > > how you justify removing the ledger as opposed to removing the ledger > storage and preserving the journal > > I will be waiting for the BP

Re: Running without journal

2021-05-04 Thread Venkateswara Rao Jujjuri
> how you justify removing the ledger as opposed to removing the ledger storage and preserving the journal I will be waiting for the BP on this point too. :) But glad to see that we are working to avoid double writes. :) With the EntryLogPerLedger (ELPL) feature, it is a more-or-less journal per l

Re: Running without journal

2021-05-03 Thread Anup Ghatage
HI! I know we are interested in this for sure. (cc @Venkateswara Rao Jujjuri ) Is this similar to Matteo Merli's PR which I found was simple and still got the job done: https://github.com/apache/bookkeeper/pull/2401/files Regards, Anup On Mon, May 3, 2021 at 8:04 AM Flavio Junqueira wrote: > +

Re: Running without journal

2021-05-03 Thread Flavio Junqueira
+1, it makes sense to enable bookies to run without duplicating IOs for entry data. I'm curious to see how you justify removing the ledger as opposed to removing the ledger storage and preserving the journal. I suspect that the random reads against the ledger storage matter more to you than the

Re: Running without journal

2021-05-03 Thread Enrico Olivelli
Il giorno lun 3 mag 2021 alle ore 16:30 Jack Vanlightly ha scritto: > > Hi all, > > At Splunk we have defined and implemented changes to BookKeeper to allow > bookies to run without the journal. The motivation for this work is to > allow BookKeeper to be run with lower operating costs while still

Running without journal

2021-05-03 Thread Jack Vanlightly
Hi all, At Splunk we have defined and implemented changes to BookKeeper to allow bookies to run without the journal. The motivation for this work is to allow BookKeeper to be run with lower operating costs while still offering decent data safety guarantees. Before submitting the work as a PR we'd