Re: [ceph-users] My experience with ceph now documentted

2013-12-17 Thread Sebastien Han
The ceph doc is currently being updated. See https://github.com/ceph/ceph/pull/906 Sébastien Han Cloud Engineer "Always give 100%. Unless you're giving blood.” Phone: +33 (0)1 49 70 99 72 Mail: sebastien@enovance.com Address : 10, rue de la Victoire - 75009 Paris Web : www.enova

Re: [ceph-users] Ceph not responding after trying to add a new MON

2013-12-17 Thread Joao Eduardo Luis
Was this resolved? If so, can you please share with the list? -Joao On 12/13/2013 06:35 PM, German Anders wrote: Thanks Karan, I'm on the IRC now. Thanks. *German Anders* --- Original message --- *Asunto:* Re: [ceph-users] Ceph not responding after trying to add a new MON *De:*

Re: [ceph-users] After reboot nothing worked

2013-12-17 Thread Karan Singh
Umar Ceph is stable for production , there are a large number of ceph clusters deployed and running smoothly in PRODUCTIONS and countless in testing / pre-production. Since you are facing problems with your ceph testing , it does not mean CEPH is unstable. I would suggest put some time tro

Re: [ceph-users] After reboot nothing worked

2013-12-17 Thread Matthew Walster
On 17 December 2013 06:51, Umar Draz wrote: > Hello, > > I have 2 node ceph cluster, I just rebooted both of the host just for > testing that after rebooting the cluster remain work or not, and the result > was cluster unable to start. > Did you use ceph-deploy? If so, are you using whole disks,

Re: [ceph-users] USB pendrive as boot disk

2013-12-17 Thread Gandalf Corvotempesta
2013/12/16 Gregory Farnum : > There are log_to_syslog and err_to_syslog config options that will > send the ceph log output there. I don't remember all the config stuff > you need to set up properly and be aware of, but you should be able to > find it by searching the list archives or the docs. Th

Re: [ceph-users] After reboot nothing worked

2013-12-17 Thread Umar Draz
Hi Karan, Thanks for your reply, OK I have spent some time on it and finally found a problem regarding this issue 1) If I reboot any of the node, and when its back then the OSD service are not start due to unmount of /var/lib/ceph/osd/ceph-0 then I manually edit /etc/fstab and add the mount p

Re: [ceph-users] After reboot nothing worked

2013-12-17 Thread Michael
The clocks on your two nodes are not aligned, you'll need to set up an ntp daemon and either sync them to a remote system or sync them to an internal system. Either way you just need to get them the same. -Michael On 17/12/2013 10:39, Umar Draz wrote: 2) After fixing the above issue I again

Re: [ceph-users] After reboot nothing worked

2013-12-17 Thread Umar Draz
Hi Micheal, time is synced on both end, ntp is running I had enabled cron for syncing time e.g *ntpdate -s time.apple.com * Br. Umar On Tue, Dec 17, 2013 at 3:50 PM, Michael wrote: > The clocks on your two nodes are not aligned, you'll need to set up an > ntp daemon

Re: [ceph-users] After reboot nothing worked

2013-12-17 Thread Joao Eduardo Luis
On 12/17/2013 11:38 AM, Umar Draz wrote: Hi Micheal, time is synced on both end, ntp is running I had enabled cron for syncing time e.g *ntpdate -s time.apple.com * The monitors are noticing the clocks out of sync nonetheless. Try running 'ceph health detail' to obtain

Re: [ceph-users] After reboot nothing worked

2013-12-17 Thread Joao Eduardo Luis
On 12/17/2013 09:54 AM, Karan Singh wrote: Umar *Ceph is stable for production* , there are a large number of ceph clusters deployed and running smoothly in PRODUCTIONS and countless in testing / pre-production. Since you are facing problems with your ceph testing , it does not mean CEPH is uns

Re: [ceph-users] Ceph not responding after trying to add a new MON

2013-12-17 Thread German Anders
___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] After reboot nothing worked

2013-12-17 Thread Karan Singh
Thanks Joao for information. Many Thanks Karan Singh - Original Message - From: "Joao Eduardo Luis" To: ceph-users@lists.ceph.com Sent: Tuesday, 17 December, 2013 2:56:23 PM Subject: Re: [ceph-users] After reboot nothing worked On 12/17/2013 09:54 AM, Karan Singh wrote: > Umar > > *Ce

Re: [ceph-users] After reboot nothing worked

2013-12-17 Thread Umar Draz
Hi Joao, Thanks for this valuable information. Ok another problem, I want to remove the mon host from the cluster here is my mon dump output root@vms2:~# ceph mon dump dumped monmap epoch 1 epoch 1 fsid 6ce085b5-1747-46f6-9fda-a3f1e8c75beb last_changed 0.00 created 0.00 0: 192.168.1.128:6

Re: [ceph-users] After reboot nothing worked

2013-12-17 Thread Joao Eduardo Luis
On 17/12/13 13:36, Umar Draz wrote: Hi Joao, Thanks for this valuable information. Ok another problem, I want to remove the mon host from the cluster here is my mon dump output root@vms2:~# ceph mon dump dumped monmap epoch 1 epoch 1 fsid 6ce085b5-1747-46f6-9fda-a3f1e8c75beb last_changed 0.

[ceph-users] radosgw setup - not working

2013-12-17 Thread raj kumar
Hi, I followed inst mentioned in ceph radosgw setup. I used swift python script to access it. I'm getting error like, Traceback (most recent call last): File "a.py", line 8, in authurl='http://192.168.211.70/auth', File "/usr/lib/python2.6/site-packages/cloudfiles/__init__.py", line 98,

Re: [ceph-users] ulimit max user processes (-u) and non-root ceph clients

2013-12-17 Thread Dan van der Ster
On Mon, Dec 16, 2013 at 8:36 PM, Dan Van Der Ster wrote: > > On Dec 16, 2013 8:26 PM, Gregory Farnum wrote: >> >> On Mon, Dec 16, 2013 at 11:08 AM, Dan van der Ster >> wrote: >> > Hi, >> > >> > Sorry to revive this old thread, but I wanted to update you on the current >> > pains we're going thro

Re: [ceph-users] mon add problem

2013-12-17 Thread Alfredo Deza
On Mon, Dec 16, 2013 at 10:57 PM, Umar Draz wrote: > HI Don, > > Well the result is same even after > > ceph-deploy new kvm2 > How is it the same? ceph-deploy will want to run from the same directory where that ceph.conf gets created. Can you share some logs to show us what is going on? It defi

[ceph-users] ceph-deploy: cluster network and admin node

2013-12-17 Thread Gandalf Corvotempesta
Hi to all I'm playing with ceph-deploy for the first time. Some questions: 1. how can I set a cluster network to be used by OSDs? Should I set it manually? 2. does admin node need to be reachable from each other server or can I use a natted workstation ? __

Re: [ceph-users] After reboot nothing worked

2013-12-17 Thread Joao Eduardo Luis
On 12/17/2013 11:38 AM, Umar Draz wrote: Hi Micheal, time is synced on both end, ntp is running I had enabled cron for syncing time e.g *ntpdate -s time.apple.com * Also, you might consider getting an NTP server local to your network instead of using a remote locate n

Re: [ceph-users] radosgw setup - not working

2013-12-17 Thread Yehuda Sadeh
On Tue, Dec 17, 2013 at 6:27 AM, raj kumar wrote: > Hi, > > I followed inst mentioned in ceph radosgw setup. > > I used swift python script to access it. I'm getting error like, > > Traceback (most recent call last): > File "a.py", line 8, in > authurl='http://192.168.211.70/auth', > File

Re: [ceph-users] mon add problem

2013-12-17 Thread Umar Draz
Hi Alfredo this was fixed by adding these lines in ceph.conf public network = 192.168.1.0/24 cluster network = 192.168.1.0/24 Br. Umar On Tue, Dec 17, 2013 at 8:05 PM, Alfredo Deza wrote: > On Mon, Dec 16, 2013 at 10:57 PM, Umar Draz wrote: > > HI Don, > > > > Well t

Re: [ceph-users] Sanity check of deploying Ceph very unconventionally (on top of RAID6, with very few nodes and OSDs)

2013-12-17 Thread Mike Dawson
Christian, I think you are going to suffer the effects of spindle contention with this type of setup. Based on your email and my assumptions, I will use the following inputs: - 4 OSDs, each backed by a 12-disk RAID 6 set - 75iops for each 7200rpm 3TB drive - RAID 6 write penalty of 6 - OSD Jo

Re: [ceph-users] ceph-deploy: cluster network and admin node

2013-12-17 Thread Alfredo Deza
On Tue, Dec 17, 2013 at 10:07 AM, Gandalf Corvotempesta wrote: > Hi to all > I'm playing with ceph-deploy for the first time. > > Some questions: > > 1. how can I set a cluster network to be used by OSDs? Should I set it > manually? The docs have a quick section to do this with ceph-deploy (http

Re: [ceph-users] ceph-deploy: cluster network and admin node

2013-12-17 Thread Gandalf Corvotempesta
2013/12/17 Alfredo Deza : > The docs have a quick section to do this with ceph-deploy > (http://ceph.com/docs/master/start/quick-ceph-deploy/) > Have you seen that before? Or do you need something that covers a > cluster in more detail? There isnt' anything about how to define a cluster network fo

Re: [ceph-users] Sanity check of deploying Ceph very unconventionally (on top of RAID6, with very few nodes and OSDs)

2013-12-17 Thread Christian Balzer
Hello Mike, On Tue, 17 Dec 2013 12:32:35 -0500 Mike Dawson wrote: > Christian, > > I think you are going to suffer the effects of spindle contention with > this type of setup. Based on your email and my assumptions, I will use > the following inputs: > > - 4 OSDs, each backed by a 12-disk RA

[ceph-users] Help with Installation (Quick) - not all keyrings found

2013-12-17 Thread Yuri Weinstein
Hello all, I am a new Ceph user and trying to use ceph-deploy going thru all steps on this page - http://ceph.com/docs/master/start/quick-ceph-deploy/#operating-your-cluster Everything looks OK until I run ceph-deploy gatherkeys ceph-node1 -> I see only ceph.client.admin.keyring and ceph.mon.keyr

Re: [ceph-users] Sanity check of deploying Ceph very unconventionally (on top of RAID6, with very few nodes and OSDs)

2013-12-17 Thread Christian Balzer
Hello, Quick update, one more data point. On a currently inactive cluster (DRBD) with a 7 disk (7200rpm SATA) RAID6 backing storage (crappy Adaptec controller with slower RAID6 engine than the proposed Areca and just 512MB cache) I just installed fio and ran the iometer compatible script on the m