On Thu, 16 May 2013, ian_m_por...@dell.com wrote: > Hi Sage, > > Looks like the ceph-deploy config push HOST command does work, however it > doesn't copy over comments (which is what caused me to question if it was > working as I was using comments to test if the config was changing) > > For example, the config file on the admin node > > [global] > fsid = b9567fe7-8f5e-4757-b54f-6547f06ae1fb > mon_initial_members = ceph-server1 > mon_host = 192.168.13.154 > auth_supported = cephx > osd_journal_size = 1024 > filestore_xattr_use_omap = true > osd_crush_chooseleaf_type = 1 > # A test comment to see if it gets pushed to nodes > > [osd.1] > #another comment > > Gets pushed as.... > > [global] > fsid = b9567fe7-8f5e-4757-b54f-6547f06ae1fb > mon_initial_members = ceph-server1 > mon_host = 192.168.13.154 > auth_supported = cephx > osd_journal_size = 1024 > filestore_xattr_use_omap = true > osd_crush_chooseleaf_type = 1 > > [osd.1]
Ah! Okay, we should make that behavior less weird. :) Opened http://tracker.ceph.com/issues/5083 Thanks! sage > > Regards, > Ian > > -----Original Message----- > From: Sage Weil [mailto > Sent: 16 May 2013 17:27 > To: Porter, Ian M > Cc: ceph-us...@ceph.com > Subject: Re: [ceph-users] Ceph-deploy OSD Prepare error > > On Thu, 16 May 2013, ian_m_por...@dell.com wrote: > > Yeah that's what I did, created another server and I got HEALTH_OK :) > > > > I guess I was a bit confused with the osd_crush_chooseleaf_type > > setting in the ceph.conf file. I had this set to 0 which, according > > to the documentation, it should peer with my 2 OSDs on the single node > > (clearly it didn't or I've misunderstood what this does). > > Note that that setting only has an effect when teh cluster is first created > (when you deploy the first monitor(s)). After that, the CRUSH rules are > already created, and need to be modified. > > > On a side note, can someone point me to the documentation (if any) > > that describes how you can configure ceph-deploy to add/change the conf > > file. > > At the moment, I have a vanilla set of items but I can't seem to add > > new values. I had tried updating the ceph.conf file on my cep-deploy > > admin node and calling a ceph-deploy config push, but the config file > > that was deployed to the OSD nodes, didn't contain the changes. I > > suspect the file is being generated by the ceph-deploy software, is this > > correct? > > ceph-deploy config push HOST > > should copy the ceph.conf in teh local directory to the remote node. If you > can confirm that that isn't working, let us know! > > Thanks- > sage > > > > Ian > > > > > > > > -----Original Message----- > > From: Travis Rhoden [mailto:trho...@gmail.com] > > Sent: 16 May 2013 14:54 > > To: Porter, Ian M > > Cc: igor.lask...@gmail.com; ceph-users > > Subject: Re: [ceph-users] Ceph-deploy OSD Prepare error > > > > Ian, > > > > If you are only running one server (with 2 OSDs), you should probably take > > a look at your CRUSH map. I haven't used ceph-deploy myself yet, but with > > mkcephfs the default CRUSH map is constructed such that the 2 replicas must > > be on different hosts, not just on different OSDs. This is so that if you > > lose that one host, you don't lose access to both copies of your data. If > > this is indeed your setup, the PGs will be stuck forever. > > > > While not recommended for a production setup, if you want to play around > > and get things to HEALTH_OK, you could modify your CRUSH map to just choose > > two OSDs instead of two hosts. > > > > - Travis > > > > On Wed, May 15, 2013 at 1:07 PM, <ian_m_por...@dell.com> wrote: > > > Hi Igor, > > > > > > > > > > > > I've tried that plus some other combinations and each time I get the > > > "ValueError: need more than 3 values to unpack" message > > > > > > > > > > > > I seem to have partial success, for instance I can run the > > > ceph-deploy activate command and that returns successfully, however > > > if I check the health of the cluster I get > > > > > > > > > > > > HEALTH_WARN 192 pgs degraded; 192 pgs stuck unclean; recovery 21/42 > > > degraded (50.000%), so somethings clearly not right > > > > > > > > > > > > My setup is very simple with my ceph admin node and ceph server node > > > running Ubuntu 12.04 within VMWare workstation. The ceph server > > > node has 2 additional disks, sdb and sdc, on which I am attempting to > > > create the OSDs. > > > > > > > > > > > > Also my ceph.conf is vanilla, so using the defaults. > > > > > > > > > > > > Regards, > > > > > > > > > > > > Ian > > > > > > > > > > > > From: Igor Laskovy [mailto:igor.lask...@gmail.com] > > > Sent: 15 May 2013 15:37 > > > To: Porter, Ian M > > > Cc: ceph-users > > > Subject: Re: [ceph-users] Ceph-deploy OSD Prepare error > > > > > > > > > > > > Hi, Ian, > > > > > > > > > > > > try "ceph-deploy osd prepare ceph-server:sdc1" > > > > > > If you have used "ceph-deploy disk zap" it creates single partition. > > > > > > > > > > > > On Wed, May 15, 2013 at 4:51 PM, <ian_m_por...@dell.com> wrote: > > > > > > Hi, > > > > > > > > > > > > I am deploying using ceph-deploy (following quickstart guide) and > > > getting the following error on > > > > > > > > > > > > ceph-deploy osd prepare ceph-server:sdc > > > > > > > > > > > > > > > > > >> ValueError: need more than 3 values to unpack > > > > > >> > Traceback (most recent call last): > > > > > >> File "/home/user/ceph-deploy/ceph_deploy/osd.py", line 426, in > > >> osd > > > > > >> > File "/home/user/ceph-deploy/ceph-deploy", line 9, in <module> > > > > > >> > load_entry_point('ceph-deploy==0.1', 'console_scripts', > > >> > 'ceph-deploy')() > > > > > >> > File "/home/user/ceph-deploy/ceph_deploy/cli.py", line 112, in > > >> > main > > > > > >> > return args.func(args) > > > > > >> > File "/home/user/ceph-deploy/ceph_deploy/osd.py", line 426, in > > >> > osd > > > > > >> > prepare(args, cfg, activate_prepared_disk=False) > > > > > >> > File "/home/user/ceph-deploy/ceph_deploy/osd.py", line 269, in > > >> > prepare > > > > > >> > dmcrypt_dir=args.dmcrypt_key_dir, > > > > > >> > ValueError: need more than 3 values to unpack > > > > > > > > > > > > Any suggestions? > > > > > > > > > > > > Regards > > > > > > > > > > > > Ian > > > > > > > > > > > > Dell Corporation Limited is registered in England and Wales. Company > > > Registration Number: 2081369 Registered address: Dell House, The > > > Boulevard, Cain Road, Bracknell, Berkshire, RG12 1LF, UK. > > > Company details for other Dell UK entities can be found on > > > www.dell.co.uk. > > > > > > > > > _______________________________________________ > > > ceph-users mailing list > > > ceph-users@lists.ceph.com > > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > > > > > > > > > > > > > > > > -- > > > > > > Igor Laskovy > > > facebook.com/igor.laskovy > > > > > > studiogrizzly.com > > > > > > Dell Corporation Limited is registered in England and Wales. Company > > > Registration Number: 2081369 Registered address: Dell House, The > > > Boulevard, Cain Road, Bracknell, Berkshire, RG12 1LF, UK. > > > Company details for other Dell UK entities can be found on > > > www.dell.co.uk. > > > > > > > > > _______________________________________________ > > > ceph-users mailing list > > > ceph-users@lists.ceph.com > > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > > > Dell Corporation Limited is registered in England and Wales. Company > > Registration Number: 2081369 Registered address: Dell House, The Boulevard, > > Cain Road, Bracknell, Berkshire, RG12 1LF, UK. > > Company details for other Dell UK entities can be found on www.dell.co.uk. > > > > _______________________________________________ > > ceph-users mailing list > > ceph-users@lists.ceph.com > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > > > Dell Corporation Limited is registered in England and Wales. Company > Registration Number: 2081369 > Registered address: Dell House, The Boulevard, Cain Road, Bracknell, > Berkshire, RG12 1LF, UK. > Company details for other Dell UK entities can be found on www.dell.co.uk. > > _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
