[ceph-users] Deploying ceph by hand: a few omissions

2016-05-01 Thread Stuart Longland
Hi all, This evening I was in the process of deploying a ceph cluster by hand. I did it by hand because to my knowledge, ceph-deploy doesn't support Gentoo, and my cluster here runs that. The instructions I followed are these ones: http://docs.ceph.com/docs/master/install/manual-deployment and I'

Re: [ceph-users] Deploying ceph by hand: a few omissions

2016-05-01 Thread Henrik Korkuc
mons generate these bootstrep keys. You can find them in /var/lib/ceph/bootstrap-*/ceph.keyring on pre-infernalis there were created automagically (I guess by init). Infernalis and jewel have ceph-create-keys@.service systemd job for that. Just place that dir with file in same location on OSD

[ceph-users] snaps & consistency group

2016-05-01 Thread Yair Magnezi
Hello Guys . I'm a little bit confused about ceph's capability to take a a consistency snapshots ( more then one rbd image ) is there a way to do this ( we're running hammer right now ) Thanks -- This e-mail, as well as any attached document, may contain material which is confidential and pr

[ceph-users] Change MDS's mode from active to standby

2016-05-01 Thread Jevon Qiao
Hi, Currently, I'm testing the functionality of multiple MDS in Jewel 10.2.0. I know increasing the value of max_mds can make the standby MDS become active(I have two MDSes and max_mds=1). But I'm wondering if there is a way to change the mode back. I tried to decrease max_mds, but it did not

Re: [ceph-users] Deploying ceph by hand: a few omissions

2016-05-01 Thread Bill Sharer
Actually you didn't need to do a udev rule for raw journals. Disk devices in gentoo have their group ownership set to 'disk'. I only needed to drop ceph into that in /etc/group when going from hammer to infernalis. Did you poke around any of the ceph howto's on the gentoo wiki? It's been a

Re: [ceph-users] Deploying ceph by hand: a few omissions

2016-05-01 Thread Stuart Longland
Hi Bill, On 02/05/16 04:37, Bill Sharer wrote: > Actually you didn't need to do a udev rule for raw journals. Disk > devices in gentoo have their group ownership set to 'disk'. I only > needed to drop ceph into that in /etc/group when going from hammer to > infernalis. Yeah, I recall trying that

Re: [ceph-users] Deploying ceph by hand: a few omissions

2016-05-01 Thread Stuart Longland
On 02/05/16 00:32, Henrik Korkuc wrote: > mons generate these bootstrep keys. You can find them in > /var/lib/ceph/bootstrap-*/ceph.keyring > > on pre-infernalis there were created automagically (I guess by init). > Infernalis and jewel have ceph-create-keys@.service systemd job for that. > > Jus

Re: [ceph-users] Deploying ceph by hand: a few omissions

2016-05-01 Thread Robin H. Johnson
On Sun, May 01, 2016 at 08:46:36PM +1000, Stuart Longland wrote: > Hi all, > > This evening I was in the process of deploying a ceph cluster by hand. > I did it by hand because to my knowledge, ceph-deploy doesn't support > Gentoo, and my cluster here runs that. You'll want the ceph-disk & ceph-de

[ceph-users] jewel, cephfs and selinux

2016-05-01 Thread Andrus, Brian Contractor
All, I thought there was a way to mount CephFS using the kernel driver and be able to honor selinux labeling. Right now, if I do 'ls -lZ' on a mounted cephfs, I get question marks instead of any contexts. When I mount it, I see in dmesg: [858946.554719] SELinux: initialized (dev ceph, type ceph

Re: [ceph-users] Deploying ceph by hand: a few omissions

2016-05-01 Thread Bill Sharer
I have an active and a standby setup. The faillover takes less than a minute if you manually stop the active service. Add whatever the timeout is for the faillover to happen if things go pear shaped for the box. Things are back to letters now for mds servers. I had started with letters on fi

Re: [ceph-users] Deploying ceph by hand: a few omissions

2016-05-01 Thread Henrik Korkuc
On 16-05-02 02:14, Stuart Longland wrote: On 02/05/16 00:32, Henrik Korkuc wrote: mons generate these bootstrep keys. You can find them in /var/lib/ceph/bootstrap-*/ceph.keyring on pre-infernalis there were created automagically (I guess by init). Infernalis and jewel have ceph-create-keys@.ser