Re: BP-44: direct io entry logging

2021-12-15 Thread Andrey Yegorov
Hi Maurice, This is an interesting addition to the Bookkeeper! Thank you for contributing it back to the community. Can you share some performance data/charts to highlight benefits of this feature? Also, is your workload write-heavy with reads mostly from the cold data? I imagine this option will

BP-47 Re: BP-44: direct io entry logging

2021-12-15 Thread Maurice Barnum
updated BP number. how is https://bookkeeper.apache.org/community/bookkeeper_proposals/ updated? On Wed, Dec 15, 2021 at 9:35 AM Maurice Barnum wrote: > In order to improve IO utilization, Splunk developed support for logging > entries bypassing the kernel's buffer cache via O_DIRECT. The code

BP-44: direct io entry logging

2021-12-15 Thread Maurice Barnum
In order to improve IO utilization, Splunk developed support for logging entries bypassing the kernel's buffer cache via O_DIRECT. The code has been in production for several months, running on Linux, with an implementation for MacOS also included. BP-44 proposes to merge the code into the mainst