[ceph-users] Re: ceph-osd/bluestore using page cache

2025-03-19 Thread Frédéric Nass
Hi Brian, TL;DR: bluefs_buffered_io = true and SWAP-enabled OSD nodes do not work well together. Please review these two PRs [1] and [2] to understand the rationale behind bluefs_buffered_io and why its default value has changed over time and Ceph releases (from true to false, then back to tr

[ceph-users] Re: ceph-osd/bluestore using page cache

2025-03-19 Thread Anthony D'Atri
> On Mar 19, 2025, at 4:44 AM, Frédéric Nass > wrote: > > > Hi Brian, > > TL;DR: bluefs_buffered_io = true and SWAP-enabled OSD nodes do not work well > together. > > Please review these two PRs [1] and [2] to understand the rationale behind > bluefs_buffered_io and why its default value

[ceph-users] Re: ceph-osd/bluestore using page cache

2025-03-18 Thread Brian Marcotte
> The setting you're looking for is bluefs_buffered_io. This is very > much a YMMV setting, so it's best to test with both modes, but I > usually recommend turning it off for all but omap-intensive workloads > (e.g. RGW index) ... We're not using RGW, only RBD. Currently I find it hard to prevent

[ceph-users] Re: ceph-osd/bluestore using page cache

2025-03-17 Thread Janne Johansson
Den mån 17 mars 2025 kl 14:48 skrev Joshua Baergen : > Hey Brian, > > The setting you're looking for is bluefs_buffered_io. This is very > much a YMMV setting, so it's best to test with both modes, but I > usually recommend turning it off for all but omap-intensive workloads > (e.g. RGW index) due

[ceph-users] Re: ceph-osd/bluestore using page cache

2025-03-17 Thread Joshua Baergen
Hey Brian, The setting you're looking for is bluefs_buffered_io. This is very much a YMMV setting, so it's best to test with both modes, but I usually recommend turning it off for all but omap-intensive workloads (e.g. RGW index) due to it causing writes to tend to be split up into smaller pieces.