[ceph-users] Re: osd bench with or without a separate WAL device deployed

2020-07-15 Thread Zhenshi Zhou
root@stor-mgt01:~# ceph tell osd.30 bench 196608000 65536 > { > "bytes_written": 196608000, > "blocksize": 65536, > "elapsed_sec": 1.081617, > "bytes_per_sec": 181772360.338257, > "iops": 2773.626104 > } > root@stor-mgt01:~#

[ceph-users] ??????Re: osd bench with or without a separate WAL device deployed

2020-07-15 Thread rainning
I tested osd bench with different block size: 1MB, 512KB, 256KB, 128KB, 64KB, and 32KB. osd.2 is one from the cluster where osds have better 4KB osd bench, and osd.30 is from the cluster where osds have lower 4KB osd bench.  Before 32KB, osd.30 was better than osd.2, however, there was a big dro

[ceph-users] ??????Re: osd bench with or without a separate WAL device deployed

2020-07-15 Thread rainning
Hi Zhenshi, I did try with bigger block size. Interestingly, the one whose 4KB osd bench was lower performed slightly better in 4MB osd bench. Let me try some other bigger block sizes, e.g. 16K, 64K, 128K, 1M etc, to see if there is any pattern. Moreover, I did compare two SSDs, they respec

[ceph-users] Re: osd bench with or without a separate WAL device deployed

2020-07-15 Thread Zhenshi Zhou
rence, but I am not sure if it can make two times difference. > > ---Original--- > *From:* "Zhenshi Zhou" > *Date:* Wed, Jul 15, 2020 18:39 PM > *To:* "rainning"; > *Cc:* "ceph-users"; > *Subject:* [ceph-users] Re: osd bench with or without a separ

[ceph-users] Re: osd bench with or without a separate WAL device deployed

2020-07-15 Thread rainning
one more thing it seems that WAL does have more impact on small write.  ---Original--- From: "Zhenshi Zhou"

[ceph-users] Re: osd bench with or without a separate WAL device deployed

2020-07-15 Thread rainning
Hi Zhenshi, thanks very much for the reply. Yes I know it is ood that the bluestore is deployed only with a separate db device  but no a WAL device. The cluster was deployed in k8s using rook. I was told it was because the rook we used didn't support that. Moreover, the comparison was made on

[ceph-users] Re: osd bench with or without a separate WAL device deployed

2020-07-15 Thread Zhenshi Zhou
I deployed the cluster either with separate db/wal or put db/wal/data together. Never tried to have only a seperate db. AFAIK wal does have an effect on writing but I'm not sure if it could be two times of the bench value. Hardware and network environment are also important factors. rainning 于202