Hi Maurice, This is an interesting addition to the Bookkeeper! Thank you for contributing it back to the community. Can you share some performance data/charts to highlight benefits of this feature?
Also, is your workload write-heavy with reads mostly from the cold data? I imagine this option will increase latency of tailing reads (short delay, after the data made it to the disk). On Wed, Dec 15, 2021 at 9:36 AM Maurice Barnum <mbar...@splunk.com.invalid> wrote: > In order to improve IO utilization, Splunk developed support for logging > entries bypassing the kernel's buffer cache via O_DIRECT. The code has > been in production for several months, running on Linux, with an > implementation for MacOS also included. > > BP-44 proposes to merge the code into the mainstream code base. > > https://github.com/apache/bookkeeper/pull/2932 is mostly complete merge of > the code base to the Bookkeeper master branch. Some unit tests fail, most > likely due to merge errors that need to be resolved. > > Comments appreciated. > -- Andrey Yegorov