On Sun, Apr 7, 2019 at 5:21 PM Mark Schneider <m...@it-infrastrukturen.org> wrote:
> Short feedback: > > Just for the test I have checked the 10GBit network performance > between two FreeBSD 13.0 servers (both HP DL380g7 machines) > transfering data in both directions > > # --- > ironm@fbsdsrv2:~ $ scp ironm@200.0.0.10:/home/ironm/t2.iso t100.iso > Password for ironm@fbsdsrv1: > t2.iso 100% 3626MB 130.2MB/s 00:27 > > # --- > ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/t1.iso > Password for ironm@fbsdsrv1: > obsd2fbsd.iso 100% 3626MB 140.4MB/s 00:25 > # --- > > The ssh performance using 10GBit network connection on FreeBSD 13.0 > is approx 7 times higher than the one on OpenBSD 6.4. > > Is it the question of the "ix" NIC driver of OpenBSD 6.4? > (X520-DA2 NICs from Intel) > > Does one of you achieve good 10Gbit network performance with other > 10Gbit NICs? > > Thank you in advance for your hints. > > Kind regards > Mark > > -- > m...@it-infrastrukturen.org > > > Am 06.04.2019 22:52, schrieb Mark Schneider: > > Hi, > > > > Please allow me few questions regarding 10GBit network performance on > > OpenBSD 6.4. > > I face quite low network performance for the Intell X520-DA2 10GBit > > network card. > > > > Test configuration in OpenBSD-Linux-10GBit_net_performance.txt - > > http://paste.debian.net/1076461/ > > Low transfer rate for scp - OpenBSD-10GBit-perftest.txt - > > http://paste.debian.net/1076460/ > > > > Test configuration: > > # --- > > # OpenBSD 6.4 on HP DL380g7 > > # ------------------------- > > > > # 10GBit X520-DA2 NIC > > ix0: flags=208843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,AUTOCONF6> > > mtu 1500 > > media: Ethernet autoselect (10GbaseSR > > full-duplex,rxpause,txpause) > > inet6 fe80::d51e:1b74:17d7:8230%ix0 prefixlen 64 scopeid 0x1 > > inet 200.0.0.3 netmask 0xffffff00 broadcast 200.0.0.255 > > > > ix1: flags=208843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,AUTOCONF6> > > mtu 1500 > > media: Ethernet autoselect (10GbaseSR > > full-duplex,rxpause,txpause) > > inet 10.0.0.7 netmask 0xffffff00 broadcast 10.0.0.255 > > inet6 fe80::b488:caea:5d6f:9992%ix1 prefixlen 64 scopeid 0x2 > > # --- > > > > Compare to Linux the 10GBit transfer from/to OpenBSD is few times slower: > > > > # --- > > # OpenBSD to Linux (Asus P8BWS) > > # ----------------------------- > > srvob# iperf3 -c 10.0.0.2 > > ... > > - - - - - - - - - - - - - - - - - - - - - - - - - > > [ ID] Interval Transfer Bitrate > > [ 5] 0.00-10.00 sec 1.50 GBytes 1.29 Gbits/sec > > sender > > [ 5] 0.00-10.20 sec 1.50 GBytes 1.27 Gbits/sec > > receiver > > # --- > > > > > > # --- > > # Linux (DL380g7) to Linux (Asus P8BWS) > > # ------------------------------------- > > root@kali:~# iperf3 -c 100.0.0.2 > > ... > > - - - - - - - - - - - - - - - - - - - - - - - - - > > [ ID] Interval Transfer Bitrate Retr > > [ 5] 0.00-10.00 sec 10.9 GBytes 9.39 Gbits/sec 328 > > sender > > [ 5] 0.00-10.04 sec 10.9 GBytes 9.35 Gbits/sec > > receiver > > # --- > > > > The scp transfer rate is like 21MBytes/s only per ssh connection > > (OpenBSD <-> Linux): > > # --- > > root@kali:~# scp /re*/b*/ka*/kali-linux-kde-2019.1a-*.iso > > ironm@10.0.0.7:/home/ironm/t12.iso > > ironm@10.0.0.7's password: > > kali-linux-kde-2019.1a-amd64.iso 4% 173MB > > 21.5MB/s 02:40 ETA > > # --- > > > > > > The 1GBit cooper based NIC works also slower but reaching almost 40% > > of the max trasfer rate of 1 Gbit: > > > > # --- > > # OpenBSD 6.4 (DL380g7 1Gbit NIC) to Linux (DL380g7 1GBit NIC) > > # ------------------------------------------------------------ > > srvob# iperf3 -c 170.0.0.10 > > ... > > - - - - - - - - - - - - - - - - - - - - - - - - - > > [ ID] Interval Transfer Bitrate > > [ 5] 0.00-10.00 sec 471 MBytes 395 Mbits/sec > > sender > > [ 5] 0.00-10.20 sec 471 MBytes 388 Mbits/sec > > receiver > > # --- > > > > # --- > > # Linux (Asus P8BWS) to Linux (DL380g7) > > # ------------------------------------- > > root@kali:~# iperf3 -c 192.168.1.122 > > ... > > - - - - - - - - - - - - - - - - - - - - - - - - - > > [ ID] Interval Transfer Bitrate Retr > > [ 5] 0.00-10.00 sec 1.09 GBytes 939 Mbits/sec 183 > > sender > > [ 5] 0.00-10.04 sec 1.09 GBytes 934 Mbits/sec > > receiver > > # --- > > > > > > Thank you in advance for your hints what OpenBSD 6.4 settings do I miss. > > > > Best regards > > Mark > > > Whats your performance without scp? tcpbench / netcat, for example?