From: Trivedi, Narendra [mailto:narendra.triv...@savvis.com] Sent: Tuesday, October 29, 2013 5:33 PM To: Whittle, Alistair: Investment Bank (LDN); joseph.r.gru...@intel.com; ceph-users@lists.ceph.com Subject: RE: ceph-deploy problems on CentOS-6.4
Thanks a lot Joseph and Alistair... I have the following questions based on your inputs: 1) Do I need to make changes to all the nodes or just the admin node? I guess all the nodes since ceph-deploy issues commands via ssh on all nodes... AW:: I found I needed to make the changes to ALL nodes. It helps if they are pretty much identical in this regards prior to setting off. Remember too that it's not just wget that needs the proxy settings. You may want to check your yum proxy settings as well. I went one step further and set both http and https proxy settings in my default user shell script (both ceph and root). 2) The installation guide recommends using ceph user to communicate with other nodes. Do I login to the admin node as root user or ceph user? AW:: Initially used root from the admin node, but found that to not work. I eventually created a ceph user, logged in as that and did all my ceph related work as that user on all nodes. The guide mentions not to run ceph-deploy as root or with sudo and I found to my frustration that is advice worth heeding. From: alistair.whit...@barclays.com<mailto:alistair.whit...@barclays.com> [mailto:alistair.whit...@barclays.com] Sent: Tuesday, October 29, 2013 12:08 PM To: joseph.r.gru...@intel.com<mailto:joseph.r.gru...@intel.com>; Trivedi, Narendra; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> Subject: RE: ceph-deploy problems on CentOS-6.4 You also want to make sure that if you are using a proxy your proxy settings are maintained through sudo. With my deployment I had to add a line to my sudoers file to specify that the https_proxy and http_proxy settings are maintained. Didn't work otherwise. Defaults env_keep += "http_proxy https_proxy" From: ceph-users-boun...@lists.ceph.com<mailto:ceph-users-boun...@lists.ceph.com> [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Gruher, Joseph R Sent: Tuesday, October 29, 2013 4:55 PM To: Trivedi, Narendra; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> Subject: Re: [ceph-users] ceph-deploy problems on CentOS-6.4 If you are behind a proxy try configuring the wget proxy through /etc/wgetrc. I had a similar problem where I could complete wget commands manually but they would fail in ceph-deploy until I configured the wget proxy in that manner. From: ceph-users-boun...@lists.ceph.com<mailto:ceph-users-boun...@lists.ceph.com> [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Trivedi, Narendra Sent: Tuesday, October 29, 2013 9:51 AM To: ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> Subject: [ceph-users] ceph-deploy problems on CentOS-6.4 Hi All, I am a newbie to ceph. I am installing ceph (dumpling release) using ceph-deploy (issued from my admin node) on one monitor and two OSD nodes running CentOS 6.4 (64-bit) using followed instructions in the link below: http://ceph.com/docs/master/start/quick-ceph-deploy/ My setup looks exactly like the diagram. I followed pre-flight instructions exacty as outlined in the link below: http://ceph.com/docs/master/start/quick-start-preflight/ The ceph-deploy takes forever and then throws up the following error: 2013-10-28 17:32:35,903 [ceph_deploy.cli][INFO ] Invoked (1.2.7): /usr/bin/ceph-deploy new ceph-node1-mon-centos-6-4 2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Creating new cluster named ceph 2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Resolving host ceph-node1-mon-centos-6-4 2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Monitor ceph-node1-mon-centos-6-4 at 10.12.0.70 2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Monitor initial members are ['ceph-node1-mon-centos-6-4'] 2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Monitor addrs are ['10.12.0.70'] 2013-10-28 17:32:35,905 [ceph_deploy.new][DEBUG ] Creating a random mon key... 2013-10-28 17:32:35,905 [ceph_deploy.new][DEBUG ] Writing initial config to ceph.conf... 2013-10-28 17:32:35,905 [ceph_deploy.new][DEBUG ] Writing monitor keyring to ceph.mon.keyring... 2013-10-28 17:33:10,287 [ceph_deploy.cli][INFO ] Invoked (1.2.7): /usr/bin/ceph-deploy install ceph-node1-mon-centos-6-4 ceph-node2-osd0-centos-6-4 ceph-admin-node-centos-6-4 2013-10-28 17:33:10,287 [ceph_deploy.install][DEBUG ] Installing stable version dumpling on cluster ceph hosts ceph-node1-mon-centos-6-4 ceph-node2-osd0-centos-6-4 ceph-admin-node-centos-6-4 2013-10-28 17:33:10,288 [ceph_deploy.install][DEBUG ] Detecting platform for host ceph-node1-mon-centos-6-4 ... 2013-10-28 17:33:10,288 [ceph_deploy.sudo_pushy][DEBUG ] will use a remote connection without sudo 2013-10-28 17:33:10,626 [ceph_deploy.install][INFO ] Distro info: CentOS 6.4 Final 2013-10-28 17:33:10,626 [ceph-node1-mon-centos-6-4][INFO ] installing ceph on ceph-node1-mon-centos-6-4 2013-10-28 17:33:10,633 [ceph-node1-mon-centos-6-4][INFO ] adding EPEL repository 2013-10-28 17:33:10,633 [ceph-node1-mon-centos-6-4][INFO ] Running command: wget http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm 2013-10-28 19:20:35,893 [ceph-node1-mon-centos-6-4][ERROR ] Traceback (most recent call last): 2013-10-28 19:20:35,894 [ceph-node1-mon-centos-6-4][ERROR ] File "/usr/lib/python2.6/site-packages/ceph_deploy/hosts/centos/install.py", line 77, in install_epel 2013-10-28 19:20:35,899 [ceph-node1-mon-centos-6-4][ERROR ] File "/usr/lib/python2.6/site-packages/ceph_deploy/util/decorators.py", line 10, in inner 2013-10-28 19:20:35,900 [ceph-node1-mon-centos-6-4][ERROR ] File "/usr/lib/python2.6/site-packages/ceph_deploy/util/wrappers.py", line 6, in remote_call 2013-10-28 19:20:35,902 [ceph-node1-mon-centos-6-4][ERROR ] File "/usr/lib64/python2.6/subprocess.py", line 502, in check_call 2013-10-28 19:20:35,903 [ceph-node1-mon-centos-6-4][ERROR ] raise CalledProcessError(retcode, cmd) 2013-10-28 19:20:35,904 [ceph-node1-mon-centos-6-4][ERROR ] CalledProcessError: Command '['wget', 'http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm']' returned non-zero exit status 4 2013-10-28 19:20:35,911 [ceph-node1-mon-centos-6-4][ERROR ] --2013-10-28 17:33:10-- http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm 2013-10-28 19:20:35,911 [ceph-node1-mon-centos-6-4][ERROR ] Resolving dl.fedoraproject.org... 209.132.181.25, 209.132.181.26, 209.132.181.27, ... 2013-10-28 19:20:35,912 [ceph-node1-mon-centos-6-4][ERROR ] Connecting to dl.fedoraproject.org<http://dl.fedoraproject.org/>|209.132.181.25|:80... failed: Connection timed out. 2013-10-28 19:20:35,912 [ceph-node1-mon-centos-6-4][ERROR ] Connecting to dl.fedoraproject.org<http://dl.fedoraproject.org/>|209.132.181.26|:80... failed: Connection timed out. Interestingly, "wget http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm"; on each nodes (1 mon and 2 OSDs) succeeds without any problem. I have tried everything many times with root user, ceph user etc. but it fails every time! It is very frustrating! Has anyone else experienced the same or similar problem? Thanks a lot in advance! Nar This message contains information which may be confidential and/or privileged. Unless you are the intended recipient (or authorized to receive for the intended recipient), you may not read, use, copy or disclose to anyone the message or any information contained in the message. If you have received the message in error, please advise the sender by reply e-mail and delete the message and any attachment(s) thereto without retaining any copies. _______________________________________________ This message is for information purposes only, it is not a recommendation, advice, offer or solicitation to buy or sell a product or service nor an official confirmation of any transaction. It is directed at persons who are professionals and is not intended for retail customer use. Intended for recipient only. This message is subject to the terms at: www.barclays.com/emaildisclaimer<http://www.barclays.com/emaildisclaimer>. For important disclosures, please see: www.barclays.com/salesandtradingdisclaimer<http://www.barclays.com/salesandtradingdisclaimer> regarding market commentary from Barclays Sales and/or Trading, who are active market participants; and in respect of Barclays Research, including disclosures relating to specific issuers, please see http://publicresearch.barclays.com. _______________________________________________ This message contains information which may be confidential and/or privileged. Unless you are the intended recipient (or authorized to receive for the intended recipient), you may not read, use, copy or disclose to anyone the message or any information contained in the message. If you have received the message in error, please advise the sender by reply e-mail and delete the message and any attachment(s) thereto without retaining any copies. _______________________________________________ This message is for information purposes only, it is not a recommendation, advice, offer or solicitation to buy or sell a product or service nor an official confirmation of any transaction. It is directed at persons who are professionals and is not intended for retail customer use. Intended for recipient only. This message is subject to the terms at: www.barclays.com/emaildisclaimer. For important disclosures, please see: www.barclays.com/salesandtradingdisclaimer regarding market commentary from Barclays Sales and/or Trading, who are active market participants; and in respect of Barclays Research, including disclosures relating to specific issuers, please see http://publicresearch.barclays.com. _______________________________________________
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
