Check if keyring is belong to OSD.

One more thing I saw in the lab: number of allowed opened files is not enough. After I raised it via ulimit, this type of bug disappear.


On 07/06/2016 06:28 PM, RJ Nowling wrote:
Assuming I did this correctly :) :

[root@et32 ceph-1]# cat keyring
[osd.1]
key = AQBm03tXlowFIhAA5CjVax00bNhFyhvUcOkchA==

[root@et32 ceph-1]# ceph auth list
installed auth entries:

osd.0
key: AQBl03tXFG9oHxAAG5FmlDCcoGgVp3ewCgRVSQ==
caps: [mon] allow profile osd
caps: [osd] allow *
osd.1
key: AQBm03tXlowFIhAA5CjVax00bNhFyhvUcOkchA==
caps: [mon] allow profile osd
caps: [osd] allow *

On Wed, Jul 6, 2016 at 10:22 AM, George Shuklin <george.shuk...@gmail.com <mailto:george.shuk...@gmail.com>> wrote:


    In my expirience, 50% of 'permission denied' for OSD were coming
    not from filesystem, but from monitors:

    check if key in ceph auth list matches to osd_dir/keyring.


    On 07/06/2016 06:08 PM, Samuel Just wrote:

        Try strace.
        -Sam

        On Wed, Jul 6, 2016 at 7:53 AM, RJ Nowling
        <rnowl...@redhat.com <mailto:rnowl...@redhat.com>> wrote:

            Hi all,

            I'm trying to use the ceph-ansible playbooks to deploy
            onto baremetal.  I'm
            currently testing with the approach that uses an existing
            filesystem rather
            than giving raw access to the disks.

            The OSDs are failing to start:

            2016-07-06 10:48:50.249976 7fa410aef800  0 set uid:gid to
            167:167
            (ceph:ceph)
            2016-07-06 10:48:50.250021 7fa410aef800  0 ceph version 10.2.2
            (45107e21c568dd033c2f0a3107dec8f0b0e58374), process
            ceph-osd, pid 19104
            2016-07-06 10:48:50.250221 7fa410aef800 -1  ** ERROR:
            unable to open OSD
            superblock on /var/lib/ceph/osd/ceph-1: (13) Permission denied

            The directories seem to be owned by the ceph user and
            group.  That said, I'm
            putting my data under /home/ceph-data (owned by ceph:ceph)
            which is on a
            different filesystem with /var/lib/ceph/osd/ceph-1 being a
            symlink (owned by
            ceph:ceph) .

            Any suggestions as to where the permission denied might be
            coming from?

            Thanks!
            RJ

            _______________________________________________
            ceph-users mailing list
            ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com>
            http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

        _______________________________________________
        ceph-users mailing list
        ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com>
        http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


    _______________________________________________
    ceph-users mailing list
    ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com>
    http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Reply via email to