Re: [ceph-users] Force an OSD to try to peer

2015-04-14 Thread Scott Laird
Things *mostly* work if hosts on the same network have different MTUs, at least with TCP, because the hosts will negotiate the MSS for each connection. UDP will still break, but large UDP packets are less common. You don't want to run that way for very long, but there's no need for an atomic MTU s

Re: [ceph-users] Force an OSD to try to peer

2015-04-14 Thread Martin Millnert
On Tue, Mar 31, 2015 at 10:44:51PM +0300, koukou73gr wrote: > On 03/31/2015 09:23 PM, Sage Weil wrote: > > > >It's nothing specific to peering (or ceph). The symptom we've seen is > >just that byte stop passing across a TCP connection, usually when there is > >some largish messages being sent. Th

Re: [ceph-users] Force an OSD to try to peer

2015-03-31 Thread koukou73gr
On 03/31/2015 09:23 PM, Sage Weil wrote: It's nothing specific to peering (or ceph). The symptom we've seen is just that byte stop passing across a TCP connection, usually when there is some largish messages being sent. The ping/heartbeat messages get through because they are small and we disa

Re: [ceph-users] Force an OSD to try to peer

2015-03-31 Thread Sage Weil
t; > Thanks & Regards > Somnath > > -Original Message- > From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of > Robert LeBlanc > Sent: Tuesday, March 31, 2015 11:08 AM > To: Sage Weil > Cc: ceph-devel; Ceph-User > Subject: Re: [ceph-users] Force an OSD

Re: [ceph-users] Force an OSD to try to peer

2015-03-31 Thread Robert LeBlanc
nt: Tuesday, March 31, 2015 11:08 AM > To: Sage Weil > Cc: ceph-devel; Ceph-User > Subject: Re: [ceph-users] Force an OSD to try to peer > > I was desperate for anything after exhausting every other possibility I could > think of. Maybe I should put a checklist in the Ceph docs o

Re: [ceph-users] Force an OSD to try to peer

2015-03-31 Thread Somnath Roy
Of Robert LeBlanc Sent: Tuesday, March 31, 2015 11:08 AM To: Sage Weil Cc: ceph-devel; Ceph-User Subject: Re: [ceph-users] Force an OSD to try to peer I was desperate for anything after exhausting every other possibility I could think of. Maybe I should put a checklist in the Ceph docs of things to

Re: [ceph-users] Force an OSD to try to peer

2015-03-31 Thread Robert LeBlanc
I was desperate for anything after exhausting every other possibility I could think of. Maybe I should put a checklist in the Ceph docs of things to look for. Thanks, On Tue, Mar 31, 2015 at 11:36 AM, Sage Weil wrote: > On Tue, 31 Mar 2015, Robert LeBlanc wrote: >> Turns out jumbo frames was not

Re: [ceph-users] Force an OSD to try to peer

2015-03-31 Thread Sage Weil
On Tue, 31 Mar 2015, Robert LeBlanc wrote: > Turns out jumbo frames was not set on all the switch ports. Once that > was resolved the cluster quickly became healthy. I always hesitate to point the finger at the jumbo frames configuration but almost every time that is the culprit! Thanks for the

Re: [ceph-users] Force an OSD to try to peer

2015-03-31 Thread Robert LeBlanc
Turns out jumbo frames was not set on all the switch ports. Once that was resolved the cluster quickly became healthy. On Mon, Mar 30, 2015 at 8:15 PM, Robert LeBlanc wrote: > I've been working at this peering problem all day. I've done a lot of > testing at the network layer and I just don't bel

[ceph-users] Force an OSD to try to peer

2015-03-30 Thread Robert LeBlanc
I've been working at this peering problem all day. I've done a lot of testing at the network layer and I just don't believe that we have a problem that would prevent OSDs from peering. When looking though osd_debug 20/20 logs, it just doesn't look like the OSDs are trying to peer. I don't know if i