Re: BP-44: direct io entry logging

2021-12-16 Thread Enrico Olivelli
+1 very interesting. I have been running with DIRECT_IO in Java for a couple of projects and I saw good results on some Linux kernels. looking forward to adopting your implementation Enrico Il giorno ven 17 dic 2021 alle ore 05:40 Sijie Guo ha scritto: > +1 Looks very promising > > On Wed, D

Re: BP-44: direct io entry logging

2021-12-16 Thread Sijie Guo
+1 Looks very promising On Wed, Dec 15, 2021 at 9:36 AM Maurice Barnum wrote: > In order to improve IO utilization, Splunk developed support for logging > entries bypassing the kernel's buffer cache via O_DIRECT. The code has > been in production for several months, running on Linux, with an >

Re: BP-44: direct io entry logging

2021-12-15 Thread Andrey Yegorov
Hi Maurice, This is an interesting addition to the Bookkeeper! Thank you for contributing it back to the community. Can you share some performance data/charts to highlight benefits of this feature? Also, is your workload write-heavy with reads mostly from the cold data? I imagine this option will

BP-47 Re: BP-44: direct io entry logging

2021-12-15 Thread Maurice Barnum
updated BP number. how is https://bookkeeper.apache.org/community/bookkeeper_proposals/ updated? On Wed, Dec 15, 2021 at 9:35 AM Maurice Barnum wrote: > In order to improve IO utilization, Splunk developed support for logging > entries bypassing the kernel's buffer cache via O_DIRECT. The code

BP-44: direct io entry logging

2021-12-15 Thread Maurice Barnum
In order to improve IO utilization, Splunk developed support for logging entries bypassing the kernel's buffer cache via O_DIRECT. The code has been in production for several months, running on Linux, with an implementation for MacOS also included. BP-44 proposes to merge the code into the mainst