No, that was peer-to-peer, controlled testing. The results were different with different NIC chipsets, even on the same machines through the same switch. And even without a switch. I have to say some of these were cheaper NICs. With better ones there are less problems. But you don't know until you test. In our bigger production clusters everything is dual-100g without any problems at 9000.

On 25/03/2025 15:20, Marc wrote:
Sounds weird to me. Don't you have some element in the network that is just 
limited to 5140 and above it, it starts to fix fragmentation or so. I can 
remember asking the data center to enable 9000 and they never did and also were 
experimenting with some software defined network.
I will bet that peer to peer you should have no issues when testing mtu 9000.


For example, we found that many 10g NICs don't handle full-sized jumbo
frames (9000) without a performance hit. We got a huge performance
improvement by finding the exact optimal MTU (5139 on a cluster I am
looking at - at 5140 it falls off a cliff). Just one example.

_______________________________________________
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io
_______________________________________________
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io

Reply via email to