[ceph-users] Re: Ceph Nautius not working after setting MTU 9000

2020-05-24 Thread Martin Verges
Just save yourself the trouble. You won't have any real benefit from MTU 9000. It has some smallish, but it is not worth the effort, problems, and loss of reliability for most environments. Try it yourself and do some benchmarks, especially with your regular workload on the cluster (not the maximum

[ceph-users] Re: Ceph Nautius not working after setting MTU 9000

2020-05-24 Thread Suresh Rama
Ping with 9000 MTU won't get response as I said and it should be 8972. Glad it is working but you should know what happened to avoid this issue later. On Sun, May 24, 2020, 3:04 AM Amudhan P wrote: > No, ping with MTU size 9000 didn't work. > > On Sun, May 24, 2020 at 12:26 PM Khodayar Doustar

[ceph-users] Re: Ceph Nautius not working after setting MTU 9000

2020-05-24 Thread Amudhan P
I didn't do any changes but started working now with jumbo frames. On Sun, May 24, 2020 at 1:04 PM Khodayar Doustar wrote: > So this is your problem, it has nothing to do with Ceph. Just fix the > network or rollback all changes. > > On Sun, May 24, 2020 at 9:05 AM Amudhan P wrote: > >> No, pin

[ceph-users] Re: Ceph Nautius not working after setting MTU 9000

2020-05-24 Thread Khodayar Doustar
So this is your problem, it has nothing to do with Ceph. Just fix the network or rollback all changes. On Sun, May 24, 2020 at 9:05 AM Amudhan P wrote: > No, ping with MTU size 9000 didn't work. > > On Sun, May 24, 2020 at 12:26 PM Khodayar Doustar > wrote: > > > Does your ping work or not? > >

[ceph-users] Re: Ceph Nautius not working after setting MTU 9000

2020-05-24 Thread Amudhan P
it's a Dell S4048T-ON Switch using 10G Ethernet. On Sat, May 23, 2020 at 11:05 PM apely agamakou wrote: > Hi, > > Please check you MTU limit at the switch level, cand check other > ressources with icmp ping. > Try to add 14Byte for ethernet header at your switch level mean an MTU of > 9014 ? are

[ceph-users] Re: Ceph Nautius not working after setting MTU 9000

2020-05-24 Thread Amudhan P
No, ping with MTU size 9000 didn't work. On Sun, May 24, 2020 at 12:26 PM Khodayar Doustar wrote: > Does your ping work or not? > > > On Sun, May 24, 2020 at 6:53 AM Amudhan P wrote: > >> Yes, I have set setting on the switch side also. >> >> On Sat 23 May, 2020, 6:47 PM Khodayar Doustar, >> w

[ceph-users] Re: Ceph Nautius not working after setting MTU 9000

2020-05-23 Thread Khodayar Doustar
Does your ping work or not? On Sun, May 24, 2020 at 6:53 AM Amudhan P wrote: > Yes, I have set setting on the switch side also. > > On Sat 23 May, 2020, 6:47 PM Khodayar Doustar, > wrote: > >> Problem should be with network. When you change MTU it should be changed >> all over the network, any

[ceph-users] Re: Ceph Nautius not working after setting MTU 9000

2020-05-23 Thread Amudhan P
Yes, I have set setting on the switch side also. On Sat 23 May, 2020, 6:47 PM Khodayar Doustar, wrote: > Problem should be with network. When you change MTU it should be changed > all over the network, any single hup on your network should speak and > accept 9000 MTU packets. you can check it on

[ceph-users] Re: Ceph Nautius not working after setting MTU 9000

2020-05-23 Thread Suresh Rama
Hi, It should be ping -M do -s 8972 IP ADDRESS. You can't ping with 9000 size. If you can't ping with 8972 size, then somewhere in the path MTU config is wrong. Regards, Suresh On Sat, May 23, 2020, 1:35 PM apely agamakou wrote: > Hi, > > Please check you MTU limit at the switch level, cand

[ceph-users] Re: Ceph Nautius not working after setting MTU 9000

2020-05-23 Thread apely agamakou
Hi, Please check you MTU limit at the switch level, cand check other ressources with icmp ping. Try to add 14Byte for ethernet header at your switch level mean an MTU of 9014 ? are you using juniper ??? Exemple : ping -D -s 9 other_ip Le sam. 23 mai 2020 à 15:18, Khodayar Doustar a écrit

[ceph-users] Re: Ceph Nautius not working after setting MTU 9000

2020-05-23 Thread Khodayar Doustar
Problem should be with network. When you change MTU it should be changed all over the network, any single hup on your network should speak and accept 9000 MTU packets. you can check it on your hosts with "ifconfig" command and there is also equivalent commands for other network/security devices. I

[ceph-users] Re: Ceph Nautius not working after setting MTU 9000

2020-05-23 Thread si...@turka.nl
Can the servers/nodes ping eachother using large packet sizes? I guess not. Sinan Polat > Op 23 mei 2020 om 14:21 heeft Amudhan P het volgende > geschreven: > > In OSD logs "heartbeat_check: no reply from OSD" > >> On Sat, May 23, 2020 at 5:44 PM Amudhan P wrote: >> >> Hi, >> >> I have set

[ceph-users] Re: Ceph Nautius not working after setting MTU 9000

2020-05-23 Thread Amudhan P
In OSD logs "heartbeat_check: no reply from OSD" On Sat, May 23, 2020 at 5:44 PM Amudhan P wrote: > Hi, > > I have set Network switch with MTU size 9000 and also in my netplan > configuration. > > What else needs to be checked? > > > On Sat, May 23, 2020 at 3:39 PM Wido den Hollander wrote: > >

[ceph-users] Re: Ceph Nautius not working after setting MTU 9000

2020-05-23 Thread Amudhan P
Hi, I have set Network switch with MTU size 9000 and also in my netplan configuration. What else needs to be checked? On Sat, May 23, 2020 at 3:39 PM Wido den Hollander wrote: > > > On 5/23/20 12:02 PM, Amudhan P wrote: > > Hi, > > > > I am using ceph Nautilus in Ubuntu 18.04 working fine wit

[ceph-users] Re: Ceph Nautius not working after setting MTU 9000

2020-05-23 Thread Wido den Hollander
On 5/23/20 12:02 PM, Amudhan P wrote: > Hi, > > I am using ceph Nautilus in Ubuntu 18.04 working fine wit MTU size 1500 > (default) recently i tried to update MTU size to 9000. > After setting Jumbo frame running ceph -s is timing out. Ceph can run just fine with an MTU of 9000. But there is p