Re: [ceph-users] cephx authentication issue

2014-06-17 Thread Gregory Farnum
It's unlikely to be the issue, but you might check the times on your OSDs. cephx is clock-sensitive if you're off by more than an hour or two. -Greg Software Engineer #42 @ http://inktank.com | http://ceph.com On Tue, Jun 17, 2014 at 8:30 AM, Fred Yang wrote: > What's strange is OSD rebalance

Re: [ceph-users] cephx authentication issue

2014-06-17 Thread Fred Yang
What's strange is OSD rebalance obviously has no problem, it's just new object can't be written since the new segments can't be distributed to new OSDs. Here is the error from radosgw.log: 2014-06-17 10:34:01.568754 7fc7e83f4700 0 cephx: verify_reply couldn't decrypt with error: error decoding b

Re: [ceph-users] cephx authentication issue

2014-06-16 Thread John Wilkins
Did you run ceph-deploy in the directory where you ran ceph-deploy new and ceph-deploy gatherkeys? That's where the monitor bootstrap key should be. On Mon, Jun 16, 2014 at 8:49 AM, Fred Yang wrote: > I'm adding three OSD nodes(36 osds in total) to existing 3-node cluster(35 > osds) using ceph-

[ceph-users] cephx authentication issue

2014-06-16 Thread Fred Yang
I'm adding three OSD nodes(36 osds in total) to existing 3-node cluster(35 osds) using ceph-deploy, after disks prepared and OSDs activated, the cluster re-balanced and shows all pgs active+clean: osdmap e820: 72 osds: 71 up, 71 in pgmap v173328: 15920 pgs, 17 pools, 12538 MB data, 3903