On Mon, Jul 29, 2013 at 11:36 AM, Don Talton (dotalton) <dotal...@cisco.com> wrote: > Hello, > > I have a small test cluster that I deploy using puppet-ceph. Both the MON and > the OSDs deploy properly, and appear to have all of the correct > configurations. However, the OSDs are never marked as up. Any input is > appreciated. The daemons are running on each OSD server, the OSDs are listed > in the crushmap, and I can see them successfully authenticate with the MON eg. > > 2013-07-29 18:34:19.231905 7fbfeaaa5700 1 -- 2.4.1.7:0/14269 <== mon.0 > 2.4.1.4:6789/0 8 ==== > mon_command_ack([osd,crush,create-or-move,0,0.91,root=default,host=ceph-osd0]=0 > create-or-move updated item id 0 name 'osd.0' weight 0.91 at location > {host=ceph-osd0,root=default} to crush map v8) v1 ==== 223+0+0 (1170550300 0 > 0) 0x7fbfe00016d0 con 0x16b1770create-or-move updated item id 0 name 'osd.0' > weight 0.91 at location {host=ceph-osd0,root=default} to crush map
This is actually not the OSDs doing this, but the ceph admin tool using the bootstrap-osd key. Do you have anything that's from the OSDs? There might be something helpful in the OSD logs; if not you can add "debug ms = 1" and restart them and there certainly will be. -Greg Software Engineer #42 @ http://inktank.com | http://ceph.com > > > My ceph.conf > > [global] > auth cluster required = cephx > auth service required = cephx > auth client required = cephx > keyring = /etc/ceph/keyring > > fsid = e80afa94-a64c-486c-9e34-d55e85f26406 > debug ms = 1/5 > > [mon] > mon data = /var/lib/ceph/mon/mon.$id > debug mon = 20 > debug paxos = 1/5 > debug auth = 2 > > [osd] > osd journal size = 4096 > cluster network = 2.4.1.0/24 > public network = 2.4.1.0/24 > filestore flusher = false > osd data = /var/lib/ceph/osd/osd.$id > osd journal = /var/lib/ceph/osd/osd.$id/journal > osd mkfs type = xfs > keyring = /var/lib/ceph/osd/osd.$id/keyring > debug osd = 1/5 > debug filestore = 1/5 > debug journal = 1 > debug monc = 5/20 > > [mds] > mds data = /var/lib/ceph/mds/mds.$id > keyring = /var/lib/ceph/mds/mds.$id/keyring > > [mon.0] > host = ceph-mon0 > mon addr = 2.4.1.4:6789 > _______________________________________________ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com