hi Wade,

Yes firewalld is disabled on all nodes.

[ceph@ceph-mon1 ~]$ systemctl status firewalld
firewalld.service - firewalld - dynamic firewall daemon
   Loaded: loaded (/usr/lib/systemd/system/firewalld.service; disabled)
   Active: inactive (dead)

thanks,
Maruthi.

On Fri, Jan 1, 2016 at 7:46 AM, Wade Holler <wade.hol...@gmail.com> wrote:

> I assume you have tested with firewalld disabled ?
>
> Best Regards
> Wade
> On Thu, Dec 31, 2015 at 9:13 PM Maruthi Seshidhar <
> maruthi.seshid...@gmail.com> wrote:
>
>> hi fellow users,
>>
>> I am setting up a ceph cluster with 3 monitors, 4 osds on CentOS 7.1
>>
>> Each of the nodes have 2 NICs.
>> 10.31.141.0/23 is the public n/w and 192.168.10.0/24 is the cluster n/w.
>>
>> Completed the "Preflight Checklist"
>> <http://docs.ceph.com/docs/master/start/quick-start-preflight/>.
>> But in the "Storage Cluster Quick Start"
>> <http://docs.ceph.com/docs/master/start/quick-ceph-deploy/>, while doing
>> "ceph-deploy create-initial" I see  error "Some monitors have still not
>> reached quorum".
>>
>> [ceph@ceph-mgmt ceph-cluster]$ ceph-deploy --overwrite-conf mon
>> create-initial
>> [ceph_deploy.conf][DEBUG ] found configuration file at:
>> /home/ceph/.cephdeploy.conf
>> [ceph_deploy.cli][INFO  ] Invoked (1.5.30): /usr/bin/ceph-deploy
>> --overwrite-conf mon create-initial
>> [ceph_deploy.cli][INFO  ] ceph-deploy options:
>> [ceph_deploy.cli][INFO  ]  username                      : None
>> [ceph_deploy.cli][INFO  ]  verbose                       : False
>> [ceph_deploy.cli][INFO  ]  overwrite_conf                : True
>> [ceph_deploy.cli][INFO  ]  subcommand                    : create-initial
>> [ceph_deploy.cli][INFO  ]  quiet                         : False
>> [ceph_deploy.cli][INFO  ]  cd_conf                       :
>> <ceph_deploy.conf.cephdeploy.Conf instance at 0x1fe7488>
>> [ceph_deploy.cli][INFO  ]  cluster                       : ceph
>> [ceph_deploy.cli][INFO  ]  func                          : <function mon
>> at 0x1fd6e60>
>> [ceph_deploy.cli][INFO  ]  ceph_conf                     : None
>> [ceph_deploy.cli][INFO  ]  default_release               : False
>> [ceph_deploy.cli][INFO  ]  keyrings                      : None
>> [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts ceph-mon1
>> ceph-mon2 ceph-mon3
>> [ceph_deploy.mon][DEBUG ] detecting platform for host ceph-mon1 ...
>> [ceph-mon1][DEBUG ] connection detected need for sudo
>> [ceph-mon1][DEBUG ] connected to host: ceph-mon1
>> [ceph-mon1][DEBUG ] detect platform information from remote host
>> [ceph-mon1][DEBUG ] detect machine type
>> [ceph-mon1][DEBUG ] find the location of an executable
>> [ceph_deploy.mon][INFO  ] distro info: CentOS Linux 7.1.1503 Core
>> [ceph-mon1][DEBUG ] determining if provided host has same hostname in
>> remote
>> [ceph-mon1][DEBUG ] get remote short hostname
>> [ceph-mon1][DEBUG ] deploying mon to ceph-mon1
>> [ceph-mon1][DEBUG ] get remote short hostname
>> [ceph-mon1][DEBUG ] remote hostname: ceph-mon1
>> [ceph-mon1][DEBUG ] write cluster configuration to
>> /etc/ceph/{cluster}.conf
>> [ceph-mon1][DEBUG ] create the mon path if it does not exist
>> [ceph-mon1][DEBUG ] checking for done path:
>> /var/lib/ceph/mon/ceph-ceph-mon1/done
>> [ceph-mon1][DEBUG ] create a done file to avoid re-doing the mon
>> deployment
>> [ceph-mon1][DEBUG ] create the init path if it does not exist
>> [ceph-mon1][INFO  ] Running command: sudo systemctl enable ceph.target
>> [ceph-mon1][INFO  ] Running command: sudo systemctl enable
>> ceph-mon@ceph-mon1
>> [ceph-mon1][INFO  ] Running command: sudo systemctl start
>> ceph-mon@ceph-mon1
>> [ceph-mon1][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon1.asok mon_status
>> [ceph-mon1][DEBUG ]
>> ********************************************************************************
>> [ceph-mon1][DEBUG ] status for monitor: mon.ceph-mon1
>> [ceph-mon1][DEBUG ] {
>> [ceph-mon1][DEBUG ]   "election_epoch": 0,
>> [ceph-mon1][DEBUG ]   "extra_probe_peers": [
>> [ceph-mon1][DEBUG ]     "192.168.10.3:6789/0",
>> [ceph-mon1][DEBUG ]     "192.168.10.4:6789/0",
>> [ceph-mon1][DEBUG ]     "192.168.10.5:6789/0"
>> [ceph-mon1][DEBUG ]   ],
>> [ceph-mon1][DEBUG ]   "monmap": {
>> [ceph-mon1][DEBUG ]     "created": "0.000000",
>> [ceph-mon1][DEBUG ]     "epoch": 0,
>> [ceph-mon1][DEBUG ]     "fsid": "d6ca9ac6-bfb9-4464-a128-459068637924",
>> [ceph-mon1][DEBUG ]     "modified": "0.000000",
>> [ceph-mon1][DEBUG ]     "mons": [
>> [ceph-mon1][DEBUG ]       {
>> [ceph-mon1][DEBUG ]         "addr": "10.31.141.76:6789/0",
>> [ceph-mon1][DEBUG ]         "name": "ceph-mon1",
>> [ceph-mon1][DEBUG ]         "rank": 0
>> [ceph-mon1][DEBUG ]       },
>> [ceph-mon1][DEBUG ]       {
>> [ceph-mon1][DEBUG ]         "addr": "0.0.0.0:0/1",
>> [ceph-mon1][DEBUG ]         "name": "ceph-mon2",
>> [ceph-mon1][DEBUG ]         "rank": 1
>> [ceph-mon1][DEBUG ]       },
>> [ceph-mon1][DEBUG ]       {
>> [ceph-mon1][DEBUG ]         "addr": "0.0.0.0:0/2",
>> [ceph-mon1][DEBUG ]         "name": "ceph-mon3",
>> [ceph-mon1][DEBUG ]         "rank": 2
>> [ceph-mon1][DEBUG ]       }
>> [ceph-mon1][DEBUG ]     ]
>> [ceph-mon1][DEBUG ]   },
>> [ceph-mon1][DEBUG ]   "name": "ceph-mon1",
>> [ceph-mon1][DEBUG ]   "outside_quorum": [
>> [ceph-mon1][DEBUG ]     "ceph-mon1"
>> [ceph-mon1][DEBUG ]   ],
>> [ceph-mon1][DEBUG ]   "quorum": [],
>> [ceph-mon1][DEBUG ]   "rank": 0,
>> [ceph-mon1][DEBUG ]   "state": "probing",
>> [ceph-mon1][DEBUG ]   "sync_provider": []
>> [ceph-mon1][DEBUG ] }
>> [ceph-mon1][DEBUG ]
>> ********************************************************************************
>> [ceph-mon1][INFO  ] monitor: mon.ceph-mon1 is running
>> [ceph-mon1][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon1.asok mon_status
>> [ceph_deploy.mon][DEBUG ] detecting platform for host ceph-mon2 ...
>> Warning: Permanently added the ECDSA host key for IP address
>> '10.31.141.77' to the list of known hosts.
>> [ceph-mon2][DEBUG ] connection detected need for sudo
>> [ceph-mon2][DEBUG ] connected to host: ceph-mon2
>> [ceph-mon2][DEBUG ] detect platform information from remote host
>> [ceph-mon2][DEBUG ] detect machine type
>> [ceph-mon2][DEBUG ] find the location of an executable
>> [ceph_deploy.mon][INFO  ] distro info: CentOS Linux 7.1.1503 Core
>> [ceph-mon2][DEBUG ] determining if provided host has same hostname in
>> remote
>> [ceph-mon2][DEBUG ] get remote short hostname
>> [ceph-mon2][DEBUG ] deploying mon to ceph-mon2
>> [ceph-mon2][DEBUG ] get remote short hostname
>> [ceph-mon2][DEBUG ] remote hostname: ceph-mon2
>> [ceph-mon2][DEBUG ] write cluster configuration to
>> /etc/ceph/{cluster}.conf
>> [ceph-mon2][DEBUG ] create the mon path if it does not exist
>> [ceph-mon2][DEBUG ] checking for done path:
>> /var/lib/ceph/mon/ceph-ceph-mon2/done
>> [ceph-mon2][DEBUG ] create a done file to avoid re-doing the mon
>> deployment
>> [ceph-mon2][DEBUG ] create the init path if it does not exist
>> [ceph-mon2][INFO  ] Running command: sudo systemctl enable ceph.target
>> [ceph-mon2][INFO  ] Running command: sudo systemctl enable
>> ceph-mon@ceph-mon2
>> [ceph-mon2][INFO  ] Running command: sudo systemctl start
>> ceph-mon@ceph-mon2
>> [ceph-mon2][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon2.asok mon_status
>> [ceph-mon2][DEBUG ]
>> ********************************************************************************
>> [ceph-mon2][DEBUG ] status for monitor: mon.ceph-mon2
>> [ceph-mon2][DEBUG ] {
>> [ceph-mon2][DEBUG ]   "election_epoch": 0,
>> [ceph-mon2][DEBUG ]   "extra_probe_peers": [
>> [ceph-mon2][DEBUG ]     "192.168.10.3:6789/0",
>> [ceph-mon2][DEBUG ]     "192.168.10.4:6789/0",
>> [ceph-mon2][DEBUG ]     "192.168.10.5:6789/0"
>> [ceph-mon2][DEBUG ]   ],
>> [ceph-mon2][DEBUG ]   "monmap": {
>> [ceph-mon2][DEBUG ]     "created": "0.000000",
>> [ceph-mon2][DEBUG ]     "epoch": 0,
>> [ceph-mon2][DEBUG ]     "fsid": "d6ca9ac6-bfb9-4464-a128-459068637924",
>> [ceph-mon2][DEBUG ]     "modified": "0.000000",
>> [ceph-mon2][DEBUG ]     "mons": [
>> [ceph-mon2][DEBUG ]       {
>> [ceph-mon2][DEBUG ]         "addr": "10.31.141.77:6789/0",
>> [ceph-mon2][DEBUG ]         "name": "ceph-mon2",
>> [ceph-mon2][DEBUG ]         "rank": 0
>> [ceph-mon2][DEBUG ]       },
>> [ceph-mon2][DEBUG ]       {
>> [ceph-mon2][DEBUG ]         "addr": "0.0.0.0:0/1",
>> [ceph-mon2][DEBUG ]         "name": "ceph-mon1",
>> [ceph-mon2][DEBUG ]         "rank": 1
>> [ceph-mon2][DEBUG ]       },
>> [ceph-mon2][DEBUG ]       {
>> [ceph-mon2][DEBUG ]         "addr": "0.0.0.0:0/2",
>> [ceph-mon2][DEBUG ]         "name": "ceph-mon3",
>> [ceph-mon2][DEBUG ]         "rank": 2
>> [ceph-mon2][DEBUG ]       }
>> [ceph-mon2][DEBUG ]     ]
>> [ceph-mon2][DEBUG ]   },
>> [ceph-mon2][DEBUG ]   "name": "ceph-mon2",
>> [ceph-mon2][DEBUG ]   "outside_quorum": [
>> [ceph-mon2][DEBUG ]     "ceph-mon2"
>> [ceph-mon2][DEBUG ]   ],
>> [ceph-mon2][DEBUG ]   "quorum": [],
>> [ceph-mon2][DEBUG ]   "rank": 0,
>> [ceph-mon2][DEBUG ]   "state": "probing",
>> [ceph-mon2][DEBUG ]   "sync_provider": []
>> [ceph-mon2][DEBUG ] }
>> [ceph-mon2][DEBUG ]
>> ********************************************************************************
>> [ceph-mon2][INFO  ] monitor: mon.ceph-mon2 is running
>> [ceph-mon2][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon2.asok mon_status
>> [ceph_deploy.mon][DEBUG ] detecting platform for host ceph-mon3 ...
>> Warning: Permanently added the ECDSA host key for IP address
>> '10.31.141.78' to the list of known hosts.
>> [ceph-mon3][DEBUG ] connection detected need for sudo
>> [ceph-mon3][DEBUG ] connected to host: ceph-mon3
>> [ceph-mon3][DEBUG ] detect platform information from remote host
>> [ceph-mon3][DEBUG ] detect machine type
>> [ceph-mon3][DEBUG ] find the location of an executable
>> [ceph_deploy.mon][INFO  ] distro info: CentOS Linux 7.1.1503 Core
>> [ceph-mon3][DEBUG ] determining if provided host has same hostname in
>> remote
>> [ceph-mon3][DEBUG ] get remote short hostname
>> [ceph-mon3][DEBUG ] deploying mon to ceph-mon3
>> [ceph-mon3][DEBUG ] get remote short hostname
>> [ceph-mon3][DEBUG ] remote hostname: ceph-mon3
>> [ceph-mon3][DEBUG ] write cluster configuration to
>> /etc/ceph/{cluster}.conf
>> [ceph-mon3][DEBUG ] create the mon path if it does not exist
>> [ceph-mon3][DEBUG ] checking for done path:
>> /var/lib/ceph/mon/ceph-ceph-mon3/done
>> [ceph-mon3][DEBUG ] create a done file to avoid re-doing the mon
>> deployment
>> [ceph-mon3][DEBUG ] create the init path if it does not exist
>> [ceph-mon3][INFO  ] Running command: sudo systemctl enable ceph.target
>> [ceph-mon3][INFO  ] Running command: sudo systemctl enable
>> ceph-mon@ceph-mon3
>> [ceph-mon3][INFO  ] Running command: sudo systemctl start
>> ceph-mon@ceph-mon3
>> [ceph-mon3][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon3.asok mon_status
>> [ceph-mon3][DEBUG ]
>> ********************************************************************************
>> [ceph-mon3][DEBUG ] status for monitor: mon.ceph-mon3
>> [ceph-mon3][DEBUG ] {
>> [ceph-mon3][DEBUG ]   "election_epoch": 0,
>> [ceph-mon3][DEBUG ]   "extra_probe_peers": [
>> [ceph-mon3][DEBUG ]     "192.168.10.3:6789/0",
>> [ceph-mon3][DEBUG ]     "192.168.10.4:6789/0",
>> [ceph-mon3][DEBUG ]     "192.168.10.5:6789/0"
>> [ceph-mon3][DEBUG ]   ],
>> [ceph-mon3][DEBUG ]   "monmap": {
>> [ceph-mon3][DEBUG ]     "created": "0.000000",
>> [ceph-mon3][DEBUG ]     "epoch": 0,
>> [ceph-mon3][DEBUG ]     "fsid": "d6ca9ac6-bfb9-4464-a128-459068637924",
>> [ceph-mon3][DEBUG ]     "modified": "0.000000",
>> [ceph-mon3][DEBUG ]     "mons": [
>> [ceph-mon3][DEBUG ]       {
>> [ceph-mon3][DEBUG ]         "addr": "10.31.141.78:6789/0",
>> [ceph-mon3][DEBUG ]         "name": "ceph-mon3",
>> [ceph-mon3][DEBUG ]         "rank": 0
>> [ceph-mon3][DEBUG ]       },
>> [ceph-mon3][DEBUG ]       {
>> [ceph-mon3][DEBUG ]         "addr": "0.0.0.0:0/1",
>> [ceph-mon3][DEBUG ]         "name": "ceph-mon1",
>> [ceph-mon3][DEBUG ]         "rank": 1
>> [ceph-mon3][DEBUG ]       },
>> [ceph-mon3][DEBUG ]       {
>> [ceph-mon3][DEBUG ]         "addr": "0.0.0.0:0/2",
>> [ceph-mon3][DEBUG ]         "name": "ceph-mon2",
>> [ceph-mon3][DEBUG ]         "rank": 2
>> [ceph-mon3][DEBUG ]       }
>> [ceph-mon3][DEBUG ]     ]
>> [ceph-mon3][DEBUG ]   },
>> [ceph-mon3][DEBUG ]   "name": "ceph-mon3",
>> [ceph-mon3][DEBUG ]   "outside_quorum": [
>> [ceph-mon3][DEBUG ]     "ceph-mon3"
>> [ceph-mon3][DEBUG ]   ],
>> [ceph-mon3][DEBUG ]   "quorum": [],
>> [ceph-mon3][DEBUG ]   "rank": 0,
>> [ceph-mon3][DEBUG ]   "state": "probing",
>> [ceph-mon3][DEBUG ]   "sync_provider": []
>> [ceph-mon3][DEBUG ] }
>> [ceph-mon3][DEBUG ]
>> ********************************************************************************
>> [ceph-mon3][INFO  ] monitor: mon.ceph-mon3 is running
>> [ceph-mon3][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon3.asok mon_status
>> [ceph_deploy.mon][INFO  ] processing monitor mon.ceph-mon1
>> [ceph-mon1][DEBUG ] connection detected need for sudo
>> [ceph-mon1][DEBUG ] connected to host: ceph-mon1
>> [ceph-mon1][DEBUG ] detect platform information from remote host
>> [ceph-mon1][DEBUG ] detect machine type
>> [ceph-mon1][DEBUG ] find the location of an executable
>> [ceph-mon1][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon1.asok mon_status
>> [ceph_deploy.mon][WARNIN] mon.ceph-mon1 monitor is not yet in quorum,
>> tries left: 5
>> [ceph_deploy.mon][WARNIN] waiting 5 seconds before retrying
>> [ceph-mon1][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon1.asok mon_status
>> [ceph_deploy.mon][WARNIN] mon.ceph-mon1 monitor is not yet in quorum,
>> tries left: 4
>> [ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
>> [ceph-mon1][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon1.asok mon_status
>> [ceph_deploy.mon][WARNIN] mon.ceph-mon1 monitor is not yet in quorum,
>> tries left: 3
>> [ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
>> [ceph-mon1][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon1.asok mon_status
>> [ceph_deploy.mon][WARNIN] mon.ceph-mon1 monitor is not yet in quorum,
>> tries left: 2
>> [ceph_deploy.mon][WARNIN] waiting 15 seconds before retrying
>> [ceph-mon1][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon1.asok mon_status
>> [ceph_deploy.mon][WARNIN] mon.ceph-mon1 monitor is not yet in quorum,
>> tries left: 1
>> [ceph_deploy.mon][WARNIN] waiting 20 seconds before retrying
>> [ceph_deploy.mon][INFO  ] processing monitor mon.ceph-mon2
>> [ceph-mon2][DEBUG ] connection detected need for sudo
>> [ceph-mon2][DEBUG ] connected to host: ceph-mon2
>> [ceph-mon2][DEBUG ] detect platform information from remote host
>> [ceph-mon2][DEBUG ] detect machine type
>> [ceph-mon2][DEBUG ] find the location of an executable
>> [ceph-mon2][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon2.asok mon_status
>> [ceph_deploy.mon][WARNIN] mon.ceph-mon2 monitor is not yet in quorum,
>> tries left: 5
>> [ceph_deploy.mon][WARNIN] waiting 5 seconds before retrying
>> [ceph-mon2][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon2.asok mon_status
>> [ceph_deploy.mon][WARNIN] mon.ceph-mon2 monitor is not yet in quorum,
>> tries left: 4
>> [ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
>> [ceph-mon2][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon2.asok mon_status
>> [ceph_deploy.mon][WARNIN] mon.ceph-mon2 monitor is not yet in quorum,
>> tries left: 3
>> [ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
>> [ceph-mon2][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon2.asok mon_status
>> [ceph_deploy.mon][WARNIN] mon.ceph-mon2 monitor is not yet in quorum,
>> tries left: 2
>> [ceph_deploy.mon][WARNIN] waiting 15 seconds before retrying
>> [ceph-mon2][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon2.asok mon_status
>> [ceph_deploy.mon][WARNIN] mon.ceph-mon2 monitor is not yet in quorum,
>> tries left: 1
>> [ceph_deploy.mon][WARNIN] waiting 20 seconds before retrying
>> [ceph_deploy.mon][INFO  ] processing monitor mon.ceph-mon3
>> [ceph-mon3][DEBUG ] connection detected need for sudo
>> [ceph-mon3][DEBUG ] connected to host: ceph-mon3
>> [ceph-mon3][DEBUG ] detect platform information from remote host
>> [ceph-mon3][DEBUG ] detect machine type
>> [ceph-mon3][DEBUG ] find the location of an executable
>> [ceph-mon3][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon3.asok mon_status
>> [ceph_deploy.mon][WARNIN] mon.ceph-mon3 monitor is not yet in quorum,
>> tries left: 5
>> [ceph_deploy.mon][WARNIN] waiting 5 seconds before retrying
>> [ceph-mon3][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon3.asok mon_status
>> [ceph_deploy.mon][WARNIN] mon.ceph-mon3 monitor is not yet in quorum,
>> tries left: 4
>> [ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
>> [ceph-mon3][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon3.asok mon_status
>> [ceph_deploy.mon][WARNIN] mon.ceph-mon3 monitor is not yet in quorum,
>> tries left: 3
>> [ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
>> [ceph-mon3][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon3.asok mon_status
>> [ceph_deploy.mon][WARNIN] mon.ceph-mon3 monitor is not yet in quorum,
>> tries left: 2
>> [ceph_deploy.mon][WARNIN] waiting 15 seconds before retrying
>> [ceph-mon3][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon3.asok mon_status
>> [ceph_deploy.mon][WARNIN] mon.ceph-mon3 monitor is not yet in quorum,
>> tries left: 1
>> [ceph_deploy.mon][WARNIN] waiting 20 seconds before retrying
>> [ceph_deploy.mon][ERROR ] Some monitors have still not reached quorum:
>> [ceph_deploy.mon][ERROR ] ceph-mon2
>> [ceph_deploy.mon][ERROR ] ceph-mon3
>> [ceph_deploy.mon][ERROR ] ceph-mon1
>>
>> I tried enlisting 192168.10.x IPs for mon_host in the ceph.conf file, but
>> still monitors are not joining the quorum.
>>
>> On all nodes the /etc/hosts file is
>>
>> $ cat /etc/hosts
>> 127.0.0.1   localhost localhost.localdomain localhost4
>> localhost4.localdomain4
>> ::1         localhost localhost.localdomain localhost6
>> localhost6.localdomain6
>> 10.31.141.75 ceph-mgmt
>> 10.31.141.76 ceph-mon1
>> 10.31.141.77 ceph-mon2
>> 10.31.141.78 ceph-mon3
>> #192.168.10.2 ceph-mgmt
>> #192.168.10.3 ceph-mon1
>> #192.168.10.4 ceph-mon2
>> #192.168.10.5 ceph-mon3
>> 192.168.10.6 ceph-node1
>> 192.168.10.7 ceph-node2
>> 192.168.10.8 ceph-node3
>> 192.168.10.9 ceph-node4
>>
>>
>> [ceph@ceph-mgmt ceph-cluster]$ cat ceph.conf
>> [global]
>> fsid = 5448338e-aa85-4251-9e27-e38f35bd4b34
>> mon_initial_members = ceph-mon1, ceph-mon2, ceph-mon3
>> #mon_host = 192.168.10.3,192.168.10.4,192.168.10.5
>> mon_host = 10.31.141.76, 10.31.141.77, 10.31.141.78
>> auth_cluster_required = none
>> auth_service_required = none
>> auth_client_required = none
>> #auth_cluster_required = cephx
>> #auth_service_required = cephx
>> #auth_client_required = cephx
>> filestore_xattr_use_omap = true
>> public network = 10.31.141.0/23
>> cluster network = 192.168.10.0/24
>>
>> Thanks,
>> Maruthi Seshidhar
>> _______________________________________________
>> ceph-users mailing list
>> ceph-users@lists.ceph.com
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
>
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Reply via email to