Re: [ceph-users] Replace journals disk

2014-05-11 Thread Indra Pramana
Hi Gandalf and all, FYI, I checked sgdisk's man page and it seems that the correct command to restore should be: sgdisk --load-backup=/tmp/journal_table /dev/sdg Will try this next weekend and update again. Thank you. On Sat, May 10, 2014 at 10:58 PM, Indra Pramana wrote: > Hi Gandalf, >

Re: [ceph-users] Replace journals disk

2014-05-10 Thread Indra Pramana
Hi Gandalf, I tried to dump journal partition scheme from the old SSD: sgdisk --backup=/tmp/journal_table /dev/sdg and then restore the journal partition scheme to the new SSD after it's replaced: sgdisk --restore-backup=/tmp/journal_table /dev/sdg and it doesn't work. :( parted -l doesn't sho

Re: [ceph-users] Replace journals disk

2014-05-09 Thread Gandalf Corvotempesta
2014-05-09 15:55 GMT+02:00 Sage Weil : > This looks correct to me! Some command to automate this in ceph would be nice. For example, skipping the "mkjournal" step: ceph-osd -i 30 --mkjournal ceph-osd -i 31 --mkjournal ceph should be smarth enough to automatically make journals if missing so that

Re: [ceph-users] Replace journals disk

2014-05-09 Thread Sage Weil
On Fri, 9 May 2014, Indra Pramana wrote: > Hi Gandalf and Sage, > > Just would like to confirm if my steps below to replace a journal disk are > correct? Presuming the journal disk to be replaced is /dev/sdg and the two > affected OSDs using the disk as journals are osd.30 and osd.31: > > - ceph

Re: [ceph-users] Replace journals disk

2014-05-08 Thread Indra Pramana
Hi Gandalf and Sage, Just would like to confirm if my steps below to replace a journal disk are correct? Presuming the journal disk to be replaced is /dev/sdg and the two affected OSDs using the disk as journals are osd.30 and osd.31: - ceph osd set noout - stop affected OSDs sudo stop ceph-osd

Re: [ceph-users] Replace journals disk

2014-05-08 Thread Indra Pramana
Hi Gandalf and Sage, Many thanks! Will try this and share the outcome. Cheers. On Fri, May 9, 2014 at 12:55 AM, Gandalf Corvotempesta < gandalf.corvotempe...@gmail.com> wrote: > 2014-05-08 18:43 GMT+02:00 Indra Pramana : > > Since we don't use ceph.conf to indicate the data and journal paths,

Re: [ceph-users] Replace journals disk

2014-05-08 Thread Gandalf Corvotempesta
2014-05-08 18:43 GMT+02:00 Indra Pramana : > Since we don't use ceph.conf to indicate the data and journal paths, how can > I recreate the journal partitions? 1. Dump the partition scheme: sgdisk --backup=/tmp/journal_table /dev/sdd 2. Replace the journal disk device 3. Restore the old partition

Re: [ceph-users] Replace journals disk

2014-05-08 Thread Indra Pramana
Hi Sage, On Fri, May 9, 2014 at 12:32 AM, Sage Weil wrote: > > > On Fri, 9 May 2014, Indra Pramana wrote: > > > Hi Sage, > > Thanks for your reply! > > > > Actually what I want is to replace the journal disk only, while I want > to keep the OSD FS > > intact. > > > > I have 4 OSDs on a node of 4

Re: [ceph-users] Replace journals disk

2014-05-08 Thread Sage Weil
On Fri, 9 May 2014, Indra Pramana wrote: > Hi Sage, > Thanks for your reply! > > Actually what I want is to replace the journal disk only, while I want to > keep the OSD FS > intact. > > I have 4 OSDs on a node of 4 spinning disks (sdb, sdc, sdd, sde) and 2 SSDs > (sdf and sdg) > > osd.28 o

Re: [ceph-users] Replace journals disk

2014-05-08 Thread Indra Pramana
Hi Sage, Thanks for your reply! Actually what I want is to replace the journal disk only, while I want to keep the OSD FS intact. I have 4 OSDs on a node of 4 spinning disks (sdb, sdc, sdd, sde) and 2 SSDs (sdf and sdg) osd.28 on /dev/sdb, journal on /dev/sdf1 osd.29 on /dev/sdc, journal on /de

Re: [ceph-users] Replace journals disk

2014-05-08 Thread Sage Weil
Hi Indra, The simplest way to do the fs and journal creation is to use the ceph-disk tool: ceph-disk prepare FSDDISK JOURNALDISK For example, ceph-disk prepare /dev/sdb # put fs and journal on same disk, or ceph-disk prepare /dev/sdb /dev/sdc # fs on sdb, journal on (a new part o

Re: [ceph-users] Replace journals disk

2014-05-08 Thread Indra Pramana
Hi Sage, Sorry to chip you in, do you have any comments on this? Since I noted you advised Tim Snider on similar situation before. :) http://www.spinics.net/lists/ceph-users/msg05142.html Looking forward to your reply, thank you. Cheers. On Wed, May 7, 2014 at 11:31 AM, Indra Pramana wrote:

Re: [ceph-users] Replace journals disk

2014-05-06 Thread Indra Pramana
Hi Craig and all, I checked Sébastien Han's blog post, it seems that the way how the journal was mounted is a bit different, is it because the article was based on older version of Ceph? $ sudo mount /dev/sdc /journal $ ceph-osd -i 2 --mkjournal 2012-08-16 13:29:58.735095 7ff0c4b58780 -1 cr

Re: [ceph-users] Replace journals disk

2014-05-06 Thread Gandalf Corvotempesta
2014-05-06 19:40 GMT+02:00 Craig Lewis : > I haven't tried this yet, but I imagine that the process is similar to > moving your journal from the spinning disk to an SSD. My journals are on SSD. I have to replace that SSD. ___ ceph-users mailing list ceph

Re: [ceph-users] Replace journals disk

2014-05-06 Thread Craig Lewis
On 5/6/14 03:34 , Gandalf Corvotempesta wrote: Hi to all, I would like to replace a disk used as journal (one partition for each OSD) Which is the safest method to do so? ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listi

Re: [ceph-users] Replace journals disk

2014-05-06 Thread Gandalf Corvotempesta
2014-05-06 16:33 GMT+02:00 Gandalf Corvotempesta : > Symlink are pointing to partition UUID this prevent the replacement > without manual intervetion: > > journal -> /dev/disk/by-partuuid/b234da10-dcad-40c7-aa97-92d35099e5a4 > > is not possible to create symlink pointing to a device ? > My new disk

Re: [ceph-users] Replace journals disk

2014-05-06 Thread Gandalf Corvotempesta
2014-05-06 14:09 GMT+02:00 Fred Yang : > The journal location is not in ceph.conf, check > /var/lib/ceph/osd/ceph-X/journal, which is a symlink to the osd's journal > device. Symlink are pointing to partition UUID this prevent the replacement without manual intervetion: journal -> /dev/disk/by-pa

Re: [ceph-users] Replace journals disk

2014-05-06 Thread Pavel V. Kaygorodov
Hi! I'm not a specialist, but I think it will be better to move journals to other place first (stopping each OSD, moving it journal file to a HDD, and starting again), replace SSD and move journals to a new drive, again, one-by-one. The "no-out" mode can help. Pavel. 06 мая 2014 г., в 14:34

Re: [ceph-users] Replace journals disk

2014-05-06 Thread Fred Yang
On May 6, 2014 7:12 AM, "Gandalf Corvotempesta" < gandalf.corvotempe...@gmail.com> wrote: > > 2014-05-06 13:08 GMT+02:00 Dan Van Der Ster : > > I've followed this recipe successfully in the past: > > > > http://wiki.skytech.dk/index.php/Ceph_-_howto,_rbd,_lvm,_cluster#Add.2Fmove_journal_in_running_

Re: [ceph-users] Replace journals disk

2014-05-06 Thread Gandalf Corvotempesta
2014-05-06 13:08 GMT+02:00 Dan Van Der Ster : > I've followed this recipe successfully in the past: > > http://wiki.skytech.dk/index.php/Ceph_-_howto,_rbd,_lvm,_cluster#Add.2Fmove_journal_in_running_cluster I'll try but my ceph.conf doesn't have any "osd journal" setting set (i'm using ceph-ansibl

Re: [ceph-users] Replace journals disk

2014-05-06 Thread Dan Van Der Ster
I've followed this recipe successfully in the past: http://wiki.skytech.dk/index.php/Ceph_-_howto,_rbd,_lvm,_cluster#Add.2Fmove_journal_in_running_cluster On May 6, 2014 12:34 PM, Gandalf Corvotempesta wrote: > > Hi to all, > I would like to replace a disk used as journal (one partition for eac

Re: [ceph-users] Replace journals disk

2014-05-06 Thread Andrija Panic
If you have dedicated disk for Journal, that you want to replace - consider (this may be not optimal, but crosses my mind...) stoping OSD (if that is possible), maybe with "no-out" etc, then DD old disk to new one, and just resize file system and partitions if needed... I guess there is more elega

Re: [ceph-users] Replace journals disk

2014-05-06 Thread Gandalf Corvotempesta
2014-05-06 12:39 GMT+02:00 Andrija Panic : > Good question - I'm also interested. Do you want to movejournal to dedicated > disk/partition i.e. on SSD or just replace (failed) disk with new/bigger one > ? I would like to replace the disk with a bigger one (in fact, my new disk is smaller, but this

Re: [ceph-users] Replace journals disk

2014-05-06 Thread Andrija Panic
Good question - I'm also interested. Do you want to movejournal to dedicated disk/partition i.e. on SSD or just replace (failed) disk with new/bigger one ? I was thinking (for moving jorunal to dedicated disk) about changing symbolic links or similar, on /var/lib/ceph/osd/osd-x/journal... ? Regar

[ceph-users] Replace journals disk

2014-05-06 Thread Gandalf Corvotempesta
Hi to all, I would like to replace a disk used as journal (one partition for each OSD) Which is the safest method to do so? ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com