Hi Maged,
I haven't met this problem, but I think I did have  read the bug report you 
provide.
I just want to know what is the best practice to remove a journal,db,wal 
partition if there are some other partitions in the same ssd for other osd and 
don't effect other osds.
I had used the ceph-disk zap a lot before but I just zap the whole 
disk(journal,db,wal collocated with data in the same disk) so I think I need to 
it maually if I only want to "zap" a certain partition.
Thanks.

2018-02-01 


lin.yunfan



发件人:Maged Mokhtar <mmokh...@petasan.org>
发送时间:2018-02-01 22:15
主题:Re: [ceph-users] How to clean data of osd with ssd journal(wal, db if it is 
bluestore) ?
收件人:"shadow_lin"<shadow_...@163.com>
抄送:"ceph-users"<ceph-users@lists.ceph.com>

Hi Lin,
We do the extra dd after zapping the disk. ceph-disk has a zap function that 
uses wipefs to wipe fs traces, dd  to zero 10MB at partition starts, then 
sgdisk to remove partition table, i believe ceph-volume does the same. After 
this zap for each data or db block that will be created on this device we use 
the dd command to zero 500MB, this may be a bit overboard but other users have 
had similar issues:
http://tracker.ceph.com/issues/22354
Also the initial zap will wipe out the the disk and zeros the start of 
partitions as they used to be, it is possible the new disk will have db block 
with a different size so the start of partitioning has changed.
I am not sure if your question was because you hit this issue or you just want 
to skip the extra dd function or you are facing issues cleaning disks, if it is 
the later we can send you some patch that does this.
Maged
On 2018-02-01 15:04, shadow_lin wrote:
Hi Maged,
The problem you met beacuse of the left over of older cluster.Did you remove 
the db partition or you just use the old partition?
I thought Wido suggest to remove the partition then use the dd to be safe.Is it 
safe I don't remove the partition and just use dd the try to destory the data 
on that partition?
How would ceph-disk or ceph-volume do to the existing partition of 
journal,db,wal?Will it clean it or it just uses it without any action?

2018-02-01

 
lin.yunfan



发件人:Maged Mokhtar <mmokh...@petasan.org>
发送时间:2018-02-01 14:22
主题:Re: [ceph-users] How to clean data of osd with ssd journal(wal, db if it is 
bluestore) ?
收件人:"David Turner"<drakonst...@gmail.com>
抄送:"shadow_lin"<shadow_...@163.com>,"ceph-users"<ceph-users@lists.ceph.com>

I would recommend as Wido to use the dd command. block db device holds the 
metada/allocation of objects stored in data block, not cleaning this is asking 
for problems, besides it does not take any time.  In our testing building new 
custer on top of older installation, we did see many cases where osds will not 
start and report an error such as fsid of cluster and/or OSD does not match 
metada in BlueFS superblock...these errors do not appear if we use the dd 
command. 
On 2018-02-01 06:06, David Turner wrote:
I know that for filestore journals that is fine.  I think it is also safe for 
bluestore.  Doing Wido's recommendation of writing 100MB would be a good idea, 
but not necessary.


On Wed, Jan 31, 2018, 10:10 PM shadow_lin <shadow_...@163.com> wrote:
Hi David,
Thanks for your reply.
I am wondering what if I don't remove the journal(wal,db for bluestore) partion 
on the ssd and only zap the data disk.Then I assign the journal(wal,db for 
bluestore) partion to a new osd.What would happen?

2018-02-01

 
lin.yunfan



发件人:David Turner <drakonst...@gmail.com>
发送时间:2018-01-31 17:24
主题:Re: [ceph-users] How to clean data of osd with ssd journal(wal, db if it is 
bluestore) ?
收件人:"shadow_lin"<shadow_...@163.com>
抄送:"ceph-users"<ceph-users@lists.ceph.com>

I use gdisk to remove the partition and partprobe for the OS to see the new 
partition table. You can script it with sgdisk.


On Wed, Jan 31, 2018, 4:10 AM shadow_lin <shadow_...@163.com> wrote:
Hi list,
if I create an osd with journal(wal,db if it is bluestore) in the same hdd, I 
use ceph-disk zap to clean the disk when I want to remove the osd and clean the 
data on the disk.
But if I use a ssd partition as the journal(wal,db if it is bluestore) , how 
should I clean the journal (wal,db if it is bluestore) of the osd I want to 
remove?Especially when there are other osds are using other partition of the 
same ssd  as journals(wal,db if it is bluestore) .


2018-01-31


shadow_lin
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Reply via email to