Re: [ceph-users] Ceph FS Random Write 4KB block size only 2MB/s?!

Many thanks, Yan! I’ll switch to other io engines for fio testing. On Jun 29, 2018, at 10:23 AM, Yan, Zheng mailto:uker...@gmail.com>> wrote: kernel ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ce

Re: [ceph-users] Ceph FS (kernel driver) - Unable to set extended file attributed

Problem solved. Seems like I can’t set stripe_unit to a value larger than object_size. I should increase object_size attribute before increasing stripe_unit attribute. Hope this would help someone. :) On Jun 29, 2018, at 12:20 PM, Yu Haiyang mailto:haiya...@moqi.ai>> wrote: Hi, I w

[ceph-users] Ceph FS (kernel driver) - Unable to set extended file attributed

Hi, I want to play around with my ceph.file.layout attributes such as stripe_unit and object_size to see how it affected my Ceph FS performance. However I’ve been unable to set any attribute with below error. $ setfattr -n ceph.file.layout.stripe_unit -v 41943040 file1 setfattr: file1: Invalid a

Re: [ceph-users] Ceph FS Random Write 4KB block size only 2MB/s?!

e: On Thu, Jun 28, 2018 at 10:30 AM Yu Haiyang mailto:haiya...@moqi.ai>> wrote: Hi Yan, Thanks for your suggestion. No, I didn’t run fio on ceph-fuse. I mounted my Ceph FS in kernel mode. command option of fio ? Regards, Haiyang On Jun 27, 2018, at 9:45 PM, Yan, Zheng mailto:uker.

[ceph-users] Luminous BlueStore OSD - Still a way to pinpoint an object?

Hi All, Previously I read this article about how to locate an object on the OSD disk. Apparently it was on a FileStore-back disk partition. Now I have upgraded my Ceph to Luminous and hosted my OSDs on BlueStore partition, the OSD directory structure has completely changed. The data is mapped to

Re: [ceph-users] Ceph FS Random Write 4KB block size only 2MB/s?!

Hi Yan, Thanks for your suggestion. No, I didn’t run fio on ceph-fuse. I mounted my Ceph FS in kernel mode. Regards, Haiyang > On Jun 27, 2018, at 9:45 PM, Yan, Zheng wrote: > > On Wed, Jun 27, 2018 at 8:04 PM Yu Haiyang wrote: >> >> Hi All, >> >> Using f

[ceph-users] Ceph FS Random Write 4KB block size only 2MB/s?!

Hi All, Using fio with job number ranging from 1 to 128, the random write speed for 4KB block size has been consistently around 1MB/s to 2MB/s. Random read of the same block size can reach 60MB/s with 32 jobs. Our ceph cluster consists of 4 OSDs all running on SSD connected through a switch wit

[ceph-users] What is the theoretical upper bandwidth of my Ceph cluster?

Hi All, I have a Ceph cluster that consists of 3 OSDs (each on a different server’s SSD disk partition with 500MB/s maximum read/write speed). The 3 OSDs are connected through a switch which provides a maximum 10 Gbits/sec bandwidth between each pair of servers. My Ceph version is Luminous 12.2.