Double-check that you did it right. Does 'ls -lL /var/lib/ceph/osd/ceph-33/journal' resolve to a block-special device?
On Mon Oct 27 2014 at 12:12:20 PM Steve Anthony <sma...@lehigh.edu> wrote: > Nice. Thanks all, I'll adjust my scripts to call ceph-deploy using > /dev/disk/by-id for future ODSs. > > I tried stopping an existing OSD on another node (which is working - > osd.33 in this case), changing /var/lib/ceph/osd/ceph-33/journal to point > to the same partition using /dev/disk/by-id, and starting the OSD again, > but it fails to start with: > > 2014-10-27 11:03:31.607060 7fa65018e780 -1 > filestore(/var/lib/ceph/osd/ceph-33) mount failed to open journal > /var/lib/ceph/osd/ceph-33/journal: (2) No such file or directory > 2014-10-27 11:03:31.617262 7fa65018e780 -1 ** ERROR: error converting > store /var/lib/ceph/osd/ceph-33: (2) No such file or directory > > The journal symlink exists and points to the same partition as before when > it was /dev/sde1. Can I not change these existing symlinks manually to > point to the same partition using /dev/disk/by-id? > > > -Steve > > > On 10/27/2014 12:44 PM, Mariusz Gronczewski wrote: > > * /dev/disk/by-id > > > > by-path will change if you connect it to different controller, or > > replace your controller with other model, or put it in different pci > > slot > > > > On Sat, 25 Oct 2014 17:20:58 +0000, Scott Laird <sc...@sigkill.org> > <sc...@sigkill.org> > > wrote: > > > >> You'd be best off using /dev/disk/by-path/ or similar links; that way > they > >> follow the disks if they're renamed again. > >> > >> On Fri, Oct 24, 2014, 9:40 PM Steve Anthony <sma...@lehigh.edu> > <sma...@lehigh.edu> wrote: > >> > >>> Hello, > >>> > >>> I was having problems with a node in my cluster (Ceph v0.80.7/Debian > >>> Wheezy/Kernel 3.12), so I rebooted it and the disks were relabled when > >>> it came back up. Now all the symlinks to the journals are broken. The > >>> SSDs are now sda, sdb, and sdc but the journals were sdc, sdd, and sde: > >>> > >>> root@ceph17:~# ls -l /var/lib/ceph/osd/ceph-*/journal > >>> lrwxrwxrwx 1 root root 9 Oct 20 16:47 > /var/lib/ceph/osd/ceph-150/journal > >>> -> /dev/sde1 > >>> lrwxrwxrwx 1 root root 9 Oct 20 16:53 > /var/lib/ceph/osd/ceph-157/journal > >>> -> /dev/sdd1 > >>> lrwxrwxrwx 1 root root 9 Oct 21 08:31 > /var/lib/ceph/osd/ceph-164/journal > >>> -> /dev/sdc1 > >>> lrwxrwxrwx 1 root root 9 Oct 21 16:33 > /var/lib/ceph/osd/ceph-171/journal > >>> -> /dev/sde2 > >>> lrwxrwxrwx 1 root root 9 Oct 22 10:50 > /var/lib/ceph/osd/ceph-178/journal > >>> -> /dev/sdc2 > >>> lrwxrwxrwx 1 root root 9 Oct 22 15:48 > /var/lib/ceph/osd/ceph-184/journal > >>> -> /dev/sdd2 > >>> lrwxrwxrwx 1 root root 9 Oct 23 10:46 > /var/lib/ceph/osd/ceph-191/journal > >>> -> /dev/sde3 > >>> lrwxrwxrwx 1 root root 9 Oct 23 15:22 > /var/lib/ceph/osd/ceph-195/journal > >>> -> /dev/sdc3 > >>> lrwxrwxrwx 1 root root 9 Oct 23 16:59 > /var/lib/ceph/osd/ceph-201/journal > >>> -> /dev/sdd3 > >>> lrwxrwxrwx 1 root root 9 Oct 24 21:32 > /var/lib/ceph/osd/ceph-214/journal > >>> -> /dev/sde4 > >>> lrwxrwxrwx 1 root root 9 Oct 24 21:33 > /var/lib/ceph/osd/ceph-215/journal > >>> -> /dev/sdd4 > >>> > >>> Any way to fix this without just removing all the OSDs and re-adding > >>> them? I thought about recreating the symlinks to point at the new SSD > >>> labels, but I figured I'd check here first. Thanks! > >>> > >>> -Steve > >>> > >>> -- > >>> Steve Anthony > >>> LTS HPC Support Specialist > >>> Lehigh University > >>> sma...@lehigh.edu > >>> > >>> _______________________________________________ > >>> ceph-users mailing list > >>> ceph-users@lists.ceph.com > >>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > >>> > > > > > > > > -- > Steve Anthony > LTS HPC Support Specialist > Lehigh University > sma...@lehigh.edu > >
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
