Hi
> Whats your performance without scp? tcpbench / netcat, for example?
Thank you very much for your hint. I did not run them yet (only iperf3
as listed below)
Further test details are in attached files.
Kind regards
Mark
--
m...@it-infrastrukturen.org
Am 08.04.2019 22:06, schrieb Abel Abraham Camarillo Ojeda:
On Sun, Apr 7, 2019 at 5:21 PM Mark Schneider <m...@it-infrastrukturen.org>
wrote:
Short feedback:
Just for the test I have checked the 10GBit network performance
between two FreeBSD 13.0 servers (both HP DL380g7 machines)
transfering data in both directions
# ---
ironm@fbsdsrv2:~ $ scp ironm@200.0.0.10:/home/ironm/t2.iso t100.iso
Password for ironm@fbsdsrv1:
t2.iso 100% 3626MB 130.2MB/s 00:27
# ---
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/t1.iso
Password for ironm@fbsdsrv1:
obsd2fbsd.iso 100% 3626MB 140.4MB/s 00:25
# ---
The ssh performance using 10GBit network connection on FreeBSD 13.0
is approx 7 times higher than the one on OpenBSD 6.4.
Is it the question of the "ix" NIC driver of OpenBSD 6.4?
(X520-DA2 NICs from Intel)
Does one of you achieve good 10Gbit network performance with other
10Gbit NICs?
Thank you in advance for your hints.
Kind regards
Mark
--
m...@it-infrastrukturen.org
Am 06.04.2019 22:52, schrieb Mark Schneider:
Hi,
Please allow me few questions regarding 10GBit network performance on
OpenBSD 6.4.
I face quite low network performance for the Intell X520-DA2 10GBit
network card.
Test configuration in OpenBSD-Linux-10GBit_net_performance.txt -
http://paste.debian.net/1076461/
Low transfer rate for scp - OpenBSD-10GBit-perftest.txt -
http://paste.debian.net/1076460/
Test configuration:
# ---
# OpenBSD 6.4 on HP DL380g7
# -------------------------
# 10GBit X520-DA2 NIC
ix0: flags=208843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,AUTOCONF6>
mtu 1500
media: Ethernet autoselect (10GbaseSR
full-duplex,rxpause,txpause)
inet6 fe80::d51e:1b74:17d7:8230%ix0 prefixlen 64 scopeid 0x1
inet 200.0.0.3 netmask 0xffffff00 broadcast 200.0.0.255
ix1: flags=208843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,AUTOCONF6>
mtu 1500
media: Ethernet autoselect (10GbaseSR
full-duplex,rxpause,txpause)
inet 10.0.0.7 netmask 0xffffff00 broadcast 10.0.0.255
inet6 fe80::b488:caea:5d6f:9992%ix1 prefixlen 64 scopeid 0x2
# ---
Compare to Linux the 10GBit transfer from/to OpenBSD is few times slower:
# ---
# OpenBSD to Linux (Asus P8BWS)
# -----------------------------
srvob# iperf3 -c 10.0.0.2
...
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.00 sec 1.50 GBytes 1.29 Gbits/sec
sender
[ 5] 0.00-10.20 sec 1.50 GBytes 1.27 Gbits/sec
receiver
# ---
# ---
# Linux (DL380g7) to Linux (Asus P8BWS)
# -------------------------------------
root@kali:~# iperf3 -c 100.0.0.2
...
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 10.9 GBytes 9.39 Gbits/sec 328
sender
[ 5] 0.00-10.04 sec 10.9 GBytes 9.35 Gbits/sec
receiver
# ---
The scp transfer rate is like 21MBytes/s only per ssh connection
(OpenBSD <-> Linux):
# ---
root@kali:~# scp /re*/b*/ka*/kali-linux-kde-2019.1a-*.iso
ironm@10.0.0.7:/home/ironm/t12.iso
ironm@10.0.0.7's password:
kali-linux-kde-2019.1a-amd64.iso 4% 173MB
21.5MB/s 02:40 ETA
# ---
The 1GBit cooper based NIC works also slower but reaching almost 40%
of the max trasfer rate of 1 Gbit:
# ---
# OpenBSD 6.4 (DL380g7 1Gbit NIC) to Linux (DL380g7 1GBit NIC)
# ------------------------------------------------------------
srvob# iperf3 -c 170.0.0.10
...
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.00 sec 471 MBytes 395 Mbits/sec
sender
[ 5] 0.00-10.20 sec 471 MBytes 388 Mbits/sec
receiver
# ---
# ---
# Linux (Asus P8BWS) to Linux (DL380g7)
# -------------------------------------
root@kali:~# iperf3 -c 192.168.1.122
...
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 1.09 GBytes 939 Mbits/sec 183
sender
[ 5] 0.00-10.04 sec 1.09 GBytes 934 Mbits/sec
receiver
# ---
Thank you in advance for your hints what OpenBSD 6.4 settings do I miss.
Best regards
Mark
Whats your performance without scp? tcpbench / netcat, for example?
ironm@wheezy:~$ time dd if=/dev/zero of=file1.tmp bs=1M count=4096 && sync
4096+0 Datensätze ein
4096+0 Datensätze aus
4294967296 Bytes (4.3 GB) kopiert, 1.0029 s, 4.3 GB/s
real 0m1.231s
user 0m0.000s
sys 0m1.224s
---
ironm@fbsdsrv8:~ $ time dd if=/dev/zero of=file1.tmp bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 8.432852 secs (509313755 bytes/sec)
8.79 real 0.01 user 3.36 sys
---
ironm@fbsdsrv1:~ $ time dd if=/dev/zero of=file1.tmp bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 5.947370 secs (722162508 bytes/sec)
6.41 real 0.00 user 4.65
---
ironm@fbsdsrv2:~ $ time dd if=/dev/zero of=file1.tmp bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 8.804378 secs (487821753 bytes/sec)
9.26 real 0.00 user 4.94 sys
--------------------------------------------------------------------------------
ronm@wheezy:~$ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 Datensätze ein
4096+0 Datensätze aus
4294967296 Bytes (4.3 GB) kopiert, 0.410687 s, 10.5 GB/s
real 0m0.412s
user 0m0.000s
sys 0m0.408s
ironm@wheezy:~$ time dd if=file1.tmp of=/dev/null bs=1M count=512 && sync
512+0 Datensätze ein
512+0 Datensätze aus
536870912 Bytes (537 MB) kopiert, 0.0558006 s, 9.6 GB/s
real 0m0.057s
user 0m0.000s
sys 0m0.056s
---
ironm@fbsdsrv8:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 1.338350 secs (3209151777 bytes/sec)
1.34 real 0.00 user 1.34 sys
ironm@fbsdsrv8:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=512 && sync
512+0 records in
512+0 records out
536870912 bytes transferred in 0.167219 secs (3210581655 bytes/sec)
0.17 real 0.00 user 0.17 sys
---
ironm@fbsdsrv1:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 1.173098 secs (3661217181 bytes/sec)
1.17 real 0.00 user 1.17 sys
ironm@fbsdsrv1:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=512 && sync
512+0 records in
512+0 records out
536870912 bytes transferred in 0.191353 secs (2805662938 bytes/sec)
0.19 real 0.00 user 0.18 sys
---
ironm@fbsdsrv2:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 1.159899 secs (3702879890 bytes/sec)
1.16 real 0.00 user 1.16 sys
ironm@fbsdsrv2:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=512 && sync
512+0 records in
512+0 records out
536870912 bytes transferred in 0.213278 secs (2517231248 bytes/sec)
0.21 real 0.00 user 0.21 sys
---------------------------------------------------------------------------
obsdsrv2$ time dd if=/dev/zero of=file1.tmp bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 9.136 secs (470078173 bytes/sec)
0m09.15s real 0m00.00s user 0m04.77s system
---
obsdsrv2$ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 11.280 secs (380734881 bytes/sec)
obsdsrv2$ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 10.167 secs (422400700 bytes/sec)
0m10.16s real 0m00.00s user 0m03.63s system
obsdsrv2$ time dd if=file1.tmp of=/dev/null bs=1M count=2048 && sync
2048+0 records in
2048+0 records out
2147483648 bytes transferred in 4.515 secs (475551520 bytes/sec)
0m04.51s real 0m00.00s user 0m01.85s system
obsdsrv2$ time dd if=file1.tmp of=/dev/null bs=1M count=1024 && sync
1024+0 records in
1024+0 records out
1073741824 bytes transferred in 1.728 secs (621203080 bytes/sec)
0m01.72s real 0m00.00s user 0m00.91s system
obsdsrv2$ time dd if=file1.tmp of=/dev/null bs=1M count=512 && sync
512+0 records in
512+0 records out
536870912 bytes transferred in 0.265 secs (2021821094 bytes/sec)
0m00.26s real 0m00.00s user 0m00.26s system
ironm@wheezy:~$ time dd if=/dev/zero of=file1.tmp bs=1M count=4096 && sync
4096+0 Datensätze ein
4096+0 Datensätze aus
4294967296 Bytes (4.3 GB) kopiert, 1.0029 s, 4.3 GB/s
real 0m1.231s
user 0m0.000s
sys 0m1.224s
---
ironm@fbsdsrv8:~ $ time dd if=/dev/zero of=file1.tmp bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 8.432852 secs (509313755 bytes/sec)
8.79 real 0.01 user 3.36 sys
---
ironm@fbsdsrv1:~ $ time dd if=/dev/zero of=file1.tmp bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 5.947370 secs (722162508 bytes/sec)
6.41 real 0.00 user 4.65
---
ironm@fbsdsrv2:~ $ time dd if=/dev/zero of=file1.tmp bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 8.804378 secs (487821753 bytes/sec)
9.26 real 0.00 user 4.94 sys
--------------------------------------------------------------------------------
ronm@wheezy:~$ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 Datensätze ein
4096+0 Datensätze aus
4294967296 Bytes (4.3 GB) kopiert, 0.410687 s, 10.5 GB/s
real 0m0.412s
user 0m0.000s
sys 0m0.408s
ironm@wheezy:~$ time dd if=file1.tmp of=/dev/null bs=1M count=512 && sync
512+0 Datensätze ein
512+0 Datensätze aus
536870912 Bytes (537 MB) kopiert, 0.0558006 s, 9.6 GB/s
real 0m0.057s
user 0m0.000s
sys 0m0.056s
---
ironm@fbsdsrv8:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 1.338350 secs (3209151777 bytes/sec)
1.34 real 0.00 user 1.34 sys
ironm@fbsdsrv8:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=512 && sync
512+0 records in
512+0 records out
536870912 bytes transferred in 0.167219 secs (3210581655 bytes/sec)
0.17 real 0.00 user 0.17 sys
---
ironm@fbsdsrv1:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 1.173098 secs (3661217181 bytes/sec)
1.17 real 0.00 user 1.17 sys
ironm@fbsdsrv1:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=512 && sync
512+0 records in
512+0 records out
536870912 bytes transferred in 0.191353 secs (2805662938 bytes/sec)
0.19 real 0.00 user 0.18 sys
---
ironm@fbsdsrv2:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 1.159899 secs (3702879890 bytes/sec)
1.16 real 0.00 user 1.16 sys
ironm@fbsdsrv2:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=512 && sync
512+0 records in
512+0 records out
536870912 bytes transferred in 0.213278 secs (2517231248 bytes/sec)
0.21 real 0.00 user 0.21 sys
---------------------------------------------------------------------------
obsdsrv2$ time dd if=/dev/zero of=file1.tmp bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 9.136 secs (470078173 bytes/sec)
0m09.15s real 0m00.00s user 0m04.77s system
---
obsdsrv2$ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 11.280 secs (380734881 bytes/sec)
obsdsrv2$ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 10.167 secs (422400700 bytes/sec)
0m10.16s real 0m00.00s user 0m03.63s system
obsdsrv2$ time dd if=file1.tmp of=/dev/null bs=1M count=2048 && sync
2048+0 records in
2048+0 records out
2147483648 bytes transferred in 4.515 secs (475551520 bytes/sec)
0m04.51s real 0m00.00s user 0m01.85s system
obsdsrv2$ time dd if=file1.tmp of=/dev/null bs=1M count=1024 && sync
1024+0 records in
1024+0 records out
1073741824 bytes transferred in 1.728 secs (621203080 bytes/sec)
0m01.72s real 0m00.00s user 0m00.91s system
obsdsrv2$ time dd if=file1.tmp of=/dev/null bs=1M count=512 && sync
512+0 records in
512+0 records out
536870912 bytes transferred in 0.265 secs (2021821094 bytes/sec)
0m00.26s real 0m00.00s user 0m00.26s system
ironm@wheezy:~$ scp fbsd2debian-send-conf_AMD_FX_4100_to_Xeon-E312700.iso
ironm@10.0.0.3:/home/ironm/debiani2obsd-send-conf_Xeon-E312700_to_AMD_FX_4100.iso
ironm@10.0.0.3's password:
fbsd2debian-send-conf_AMD_FX_4100_to_Xeon-E312700.iso 100% 3626MB 78.8MB/s
00:46
---
# OpenBSD
load averages: 0.74, 0.24, 0.09 obsdsrv2.born2b3.net
16:28:37
49 processes: 1 running, 47 idle, 1 on processor up
0:34
CPU0 states: 13.6% user, 0.0% nice, 37.9% sys, 7.8% spin, 9.0% intr, 31.7%
idle
CPU1 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU2 states: 16.2% user, 0.0% nice, 40.9% sys, 6.2% spin, 0.0% intr, 36.7%
idle
CPU3 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
Memory: Real: 71M/1028M act/tot Free: 30G Cache: 886M Swap: 0K/32G
PID USERNAME PRI NICE SIZE RES STATE WAIT TIME CPU COMMAND
87302 ironm 55 0 1204K 3052K run/0 - 0:14 44.92% sshd
30598 ironm 2 0 424K 1424K sleep/2 poll 0:04 14.21% scp
--------------------------------------------------------------------------------------
ironm@wheezy:~/netperf_BSDs$ scp
ironm@10.0.0.3:/home/ironm/debiani2obsd-send-conf_Xeon-E312700_to_AMD_FX_4100.iso
t99.iso
ironm@10.0.0.3's password:
debiani2obsd-send-conf_Xeon-E312700_to_AMD_FX_4100.iso 00% 3626MB
69.7MB/s 00:5
# OpenBSD
---
load averages: 0.84, 0.38, 0.17 obsdsrv2.born2b3.net
16:33:37
49 processes: 47 idle, 2 on processor up
0:39
CPU0 states: 14.0% user, 0.0% nice, 27.5% sys, 8.8% spin, 4.2% intr, 45.5%
idle
CPU1 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU2 states: 12.0% user, 0.0% nice, 31.7% sys, 9.8% spin, 0.0% intr, 46.5%
idle
CPU3 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
Memory: Real: 75M/1033M act/tot Free: 30G Cache: 886M Swap: 0K/32G
PID USERNAME PRI NICE SIZE RES STATE WAIT TIME CPU COMMAND
7977 ironm 51 0 4948K 6776K onproc/0 - 0:11 36.96% sshd
45910 ironm 2 0 424K 1452K sleep/2 poll 0:04 12.65% scp
# debian
---
top - 16:33:47 up 11:39, 14 users, load average: 0.62, 0.31, 0.18
Tasks: 149 total, 3 running, 146 sleeping, 0 stopped, 0 zombie
%Cpu(s): 12.0 us, 0.9 sy, 0.0 ni, 87.1 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st
KiB Mem: 32997232 total, 13803156 used, 19194076 free, 212128 buffers
KiB Swap: 0 total, 0 used, 0 free, 12965016 cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
7910 ironm 20 0 42536 4268 2396 R 99.9 0.0 0:24.70 ssh
7909 ironm 20 0 12532 764 632 S 3.0 0.0 0:00.80 scp
ironm@wheezy:~/netperf_BSDs$ scp ironm@10.0.0.3:/home/ironm/t1.iso
fbsd2debian-send-conf_AMD_FX_4100_to_Xeon-E312700.iso
Password for ironm@fbsdsrv8:
t1.iso 100% 3626MB 80.6MB/s 00:45
# FreeBSD
last pid: 1506; load averages: 0.34, 0.27, 0.21 up 0+03:16:34 15:13:34
35 processes: 2 running, 33 sleeping
CPU: 6.1% user, 0.0% nice, 10.6% system, 0.0% interrupt, 83.3% idle
Mem: 15M Active, 7056M Inact, 786M Wired, 468M Buf, 24G Free
Swap: 4034M Total, 4034M Free
PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND
1505 ironm 1 84 0 23M 12M CPU2 2 0:14 38.49% sshd
1506 ironm 1 23 0 16M 6284K select 2 0:02 6.31% scp
1481 ironm 1 20 0 13M 3624K CPU1 1 0:00 0.03% top
# ---
# debian
top - 15:12:00 up 10:18, 14 users, load average: 0.50, 0.18, 0.10
Tasks: 152 total, 2 running, 150 sleeping, 0 stopped, 0 zombie
%Cpu(s): 12.1 us, 1.3 sy, 0.0 ni, 86.3 id, 0.0 wa, 0.0 hi, 0.3 si, 0.0 st
KiB Mem: 32997232 total, 5599504 used, 27397728 free, 212088 buffers
KiB Swap: 0 total, 0 used, 0 free, 4759800 cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
7590 ironm 20 0 43564 5260 2412 R 99.5 0.0 0:41.43 ssh
7589 ironm 20 0 12532 764 632 S 4.3 0.0 0:01.82 scp
# ---------------------------------------------------------------------
ironm@wheezy:~/netperf_BSDs$ scp
fbsd2debian-send-conf_AMD_FX_4100_to_Xeon-E312700.iso
ironm@10.0.0.3:/home/ironm/debiani2fbsd-send-conf_Xeon-E312700_to_AMD_FX_4100.iso
Password for ironm@fbsdsrv8:
fbsd2debian-send-conf_AMD_FX_4100_to_Xeon-E312700.iso 100% 3626MB 74.0MB/s
00:49
# Debian
top - 15:18:01 up 10:24, 14 users, load average: 0.66, 0.32, 0.18
Tasks: 151 total, 2 running, 149 sleeping, 0 stopped, 0 zombie
%Cpu(s): 12.2 us, 1.2 sy, 0.0 ni, 86.5 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st
KiB Mem: 32997232 total, 5891576 used, 27105656 free, 212088 buffers
KiB Swap: 0 total, 0 used, 0 free, 5057692 cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
7618 ironm 20 0 41476 2956 2288 R 100.1 0.0 0:37.35 ssh
7617 ironm 20 0 12532 764 632 S 3.0 0.0 0:01.10 scp
# FreeBSD
last pid: 1513; load averages: 0.33, 0.23, 0.19
up 0+03:21:08 15:18:08
35 processes: 1 running, 34 sleeping
CPU: 6.3% user, 0.0% nice, 12.5% system, 0.2% interrupt, 81.0% idle
Mem: 12M Active, 10G Inact, 1015M Wired, 687M Buf, 20G Free
Swap: 4034M Total, 4034M Free
PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND
1512 ironm 1 52 0 20M 9192K select 1 0:21 41.77% sshd
1513 ironm 1 26 0 16M 6284K select 3 0:05 9.99% scp
1481 ironm 1 20 0 13M 3624K CPU2 2 0:00 0.04% top
# fbsdsrv1 kernel: CPU: Intel(R) Xeon(R) CPU X5690 @ 3.47GHz
(3465.76-MHz K8-class CPU)
# fbsdsrv1 kernel: FreeBSD/SMP: Multiprocessor System Detected: 24 CPUs
# fbsdsrv1 kernel: real memory = 103079215104 (98304 MB)
# fbsdsrv1 kernel: da0: <HP RAID ADG OK> Fixed Direct Access SPC-3 SCSI device
# fbsdsrv1 kernel: da0: Serial Number PACCRCN80ZL1RD7
# fbsdsrv1 kernel: da0: 135.168MB/s transfers
# fbsdsrv1 kernel: da0: Command Queueing enabled
# fbsdsrv1 kernel: da0: 839893MB (1720102192 512 byte sectors)
# fbsdsrv1 kernel: ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver> port
0x7000-0x701f mem 0xe9a80000-0xe9afffff,0xe9a70000-0xe9a73fff irq 26
# at device 0.0 on pci6
# fbsdsrv1 kernel: ix0: Using 2048 tx descriptors and 2048 rx descriptors
# fbsdsrv1 kernel: ix0: queue equality override not set, capping rx_queues at
12 and tx_queues at 12
# fbsdsrv1 kernel: ix0: Using 12 rx queues 12 tx queues
# fbsdsrv1 kernel: ix0: Using MSI-X interrupts with 13 vectors
# fbsdsrv1 kernel: ix0: allocated for 12 queues
# fbsdsrv1 kernel: ix0: allocated for 12 rx queues
# fbsdsrv1 kernel: ix0: Ethernet address: 90:e2:ba:16:20:a4
# fbsdsrv1 kernel: ix0: PCI Express Bus: Speed 5.0GT/s Width x4
# fbsdsrv1 kernel: ix0: netmap queues/slots: TX 12/2048, RX 12/2048
# fbsdsrv1 kernel: ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver> port
0x7020-0x703f mem 0xe9980000-0xe99fffff,0xe9970000-0xe9973fff irq 25
# at device 0.1 on pci6
# fbsdsrv1 kernel: ix1: Using 2048 tx descriptors and 2048 rx descriptors
# fbsdsrv1 kernel: ix1: queue equality override not set, capping rx_queues at
12 and tx_queues at 12
# fbsdsrv1 kernel: ix1: Using 12 rx queues 12 tx queues
# fbsdsrv1 kernel: ix1: Using MSI-X interrupts with 13 vectors
# fbsdsrv1 kernel: ix1: allocated for 12 queues
# fbsdsrv1 kernel: ix1: allocated for 12 rx queues
# fbsdsrv1 kernel: ix1: Ethernet address: 90:e2:ba:16:20:a5
# fbsdsrv1 kernel: ix1: PCI Express Bus: Speed 5.0GT/s Width x4
# fbsdsrv1 kernel: ix1: netmap queues/slots: TX 12/2048, RX 12/2048
# ---
ironm@fbsdsrv1:~ $ scp t1.iso
ironm@200.0.0.20:/home/ironm/fbsd2fbs-send-conf1.iso
Password for ironm@fbsdsrv2:
t1.iso 100% 3626MB 132.0MB/s
00:27
last pid: 1426; load averages: 0.62, 0.20, 0.07 up 0+00:38:00
13:09:34
20 processes: 2 running, 18 sleeping
CPU: 2.9% user, 0.0% nice, 3.8% system, 0.0% interrupt, 93.2% idle
Mem: 14M Active, 3628M Inact, 675M Wired, 245M Buf, 136G Free
Swap: 3897M Total, 3897M Free
PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND
1425 ironm 1 87 0 20M 9020K CPU7 7 0:07 99.34% sshd
1426 ironm 1 35 0 16M 6288K select 19 0:02 25.44% scp
1421 ironm 1 20 0 13M 3608K CPU17 17 0:00 0.03% top
# ------------------------------------------------------------------------------
# fbsdsrv2 kernel: CPU: Intel(R) Xeon(R) CPU X5680 @ 3.33GHz
(3332.45-MHz K8-class CPU)
# fbsdsrv2 kernel: FreeBSD/SMP: Multiprocessor System Detected: 24 CPUs
# fbsdsrv2 kernel: real memory = 154618822656 (147456 MB)
# fbsdsrv2 kernel: da0: <HP RAID ADG OK> Fixed Direct Access SPC-3 SCSI device
# fbsdsrv2 kernel: da0: Serial Number 500143801478FAF0
# fbsdsrv2 kernel: da0: 135.168MB/s transfers
# fbsdsrv2 kernel: da0: Command Queueing enabled
# fbsdsrv2 kernel: da0: 559929MB (1146734896 512 byte sectors
# fbsdsrv2 kernel: ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver> port
0x5000-0x501f mem 0xf1a80000-0xf1afffff,0xf1a70000-0xf1a73fff irq 26
# at device 0.0 on pci5
# fbsdsrv2 kernel: ix0: Using 2048 tx descriptors and 2048 rx descriptors
# fbsdsrv2 kernel: ix0: queue equality override not set, capping rx_queues at
12 and tx_queues at 12
# fbsdsrv2 kernel: ix0: Using 12 rx queues 12 tx queues
# fbsdsrv2 kernel: ix0: Using MSI-X interrupts with 13 vectors
# fbsdsrv2 kernel: ix0: allocated for 12 queues
# fbsdsrv2 kernel: ix0: allocated for 12 rx queues
# fbsdsrv2 kernel: ix0: Ethernet address: 90:e2:ba:16:16:70
# fbsdsrv2 kernel: ix0: PCI Express Bus: Speed 5.0GT/s Width x4
# fbsdsrv2 kernel: ix0: netmap queues/slots: TX 12/2048, RX 12/2048
# fbsdsrv2 kernel: ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver> port
0x5020-0x503f mem 0xf1980000-0xf19fffff,0xf1970000-0xf1973fff irq 25
# at device 0.1 on pci5
# fbsdsrv2 kernel: ix1: Using 2048 tx descriptors and 2048 rx descriptors
# fbsdsrv2 kernel: ix1: queue equality override not set, capping rx_queues at
12 and tx_queues at 12
# fbsdsrv2 kernel: ix1: Using 12 rx queues 12 tx queues
# fbsdsrv2 kernel: ix1: Using MSI-X interrupts with 13 vectors
# fbsdsrv2 kernel: ix1: allocated for 12 queues
# fbsdsrv2 kernel: ix1: allocated for 12 rx queues
# fbsdsrv2 kernel: ix1: Ethernet address: 90:e2:ba:16:16:71
# fbsdsrv2 kernel: ix1: PCI Express Bus: Speed 5.0GT/s Width x4
# fbsdsrv2 kernel: ix1: netmap queues/slots: TX 12/2048, RX 12/2048
# ---
ironm@fbsdsrv2:~ $ scp t100.iso
ironm@200.0.0.10:/home/ironm/fbsd2fbs-send-conf2.iso
Password for ironm@fbsdsrv1:
t100.iso 100% 3626MB 138.7MB/s
00:26
last pid: 2137; load averages: 0.30, 0.15, 0.08 up 0+00:43:37
13:15:10
21 processes: 2 running, 19 sleeping
CPU: 2.7% user, 0.0% nice, 4.9% system, 0.0% interrupt, 92.4% idle
Mem: 18M Active, 5123M Inact, 859M Wired, 469M Buf, 88G Free
Swap: 4096M Total, 4096M Free
PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND
2134 ironm 1 93 0 25M 13M CPU2 2 0:12 103.48% sshd
2135 ironm 1 39 0 16M 6288K select 17 0:03 30.70% scp
2130 ironm 1 20 0 13M 3616K CPU10 10 0:00 0.03% top
# ------------------------------------------------------------------------------
# fbsdsrv8 kernel: CPU: AMD FX(tm)-4100 Quad-Core Processor
(3612.06-MHz K8-class CPU)
# fbsdsrv8 kernel: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
# fbsdsrv8 kernel: real memory = 34359738368 (32768 MB)
# fbsdsrv8 kernel: ada0: <Samsung SSD 860 PRO 512GB RVM01B6Q> ACS-4 ATA SATA
3.x device
# fbsdsrv8 kernel: ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
# fbsdsrv8 kernel: ada0: Command Queueing enabled
# fbsdsrv8 kernel: ada0: 488386MB (1000215216 512 byte sectors
# fbsdsrv8 kernel: ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver> port
0xd020-0xd03f mem 0xfe200000-0xfe2fffff,0xfe404000-0xfe407fff irq 28
# at device 0.0 on pci2
# fbsdsrv8 kernel: ix0: Using 2048 tx descriptors and 2048 rx descriptors
# fbsdsrv8 kernel: ix0: Using 4 rx queues 4 tx queues
# fbsdsrv8 kernel: ix0: Using MSI-X interrupts with 5 vectors
# fbsdsrv8 kernel: ix0: allocated for 4 queues
# fbsdsrv8 kernel: ix0: allocated for 4 rx queues
# fbsdsrv8 kernel: ix0: Ethernet address: a0:36:9f:26:94:9c
# fbsdsrv8 kernel: ix0: PCI Express Bus: Speed 5.0GT/s Width x8
# fbsdsrv8 kernel: ix0: netmap queues/slots: TX 4/2048, RX 4/2048
# fbsdsrv8 kernel: ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver> port
0xd000-0xd01f mem 0xfe100000-0xfe1fffff,0xfe400000-0xfe403fff irq 29
# at device 0.1 on pci2
# fbsdsrv8 kernel: ix1: Using 2048 tx descriptors and 2048 rx descriptors
# fbsdsrv8 kernel: ix1: Using 4 rx queues 4 tx queues
# fbsdsrv8 kernel: ix1: Using MSI-X interrupts with 5 vectors
# fbsdsrv8 kernel: ix1: allocated for 4 queues
# fbsdsrv8 kernel: ix1: allocated for 4 rx queues
# fbsdsrv8 kernel: ix1: Ethernet address: a0:36:9f:26:94:9e
# fbsdsrv8 kernel: ix1: PCI Express Bus: Speed 5.0GT/s Width x8
# fbsdsrv8 kernel: ix1: netmap queues/slots: TX 4/2048, RX 4/2048
# ---
ironm@fbsdsrv8:~ $ scp t1.iso
ironm@30.0.0.20:/home/ironm/fbsd2fbs-send-conf_AMD_FX_4100_to_X5680.iso
Password for ironm@fbsdsrv2:
t1.iso 100% 3626MB 97.1MB/s
00:37
last pid: 1636; load averages: 0.16, 0.04, 0.01 up 0+02:23:23
14:54:57
20 processes: 2 running, 18 sleeping
CPU: 2.5% user, 0.0% nice, 3.4% system, 0.0% interrupt, 94.1% idle
Mem: 12M Active, 7930M Inact, 1156M Wired, 692M Buf, 132G Free
Swap: 3897M Total, 3897M Free
PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND
1635 ironm 1 90 0 24M 12M CPU7 7 0:10 89.67% sshd
1636 ironm 1 27 0 16M 6288K select 2 0:02 12.19% scp
1634 ironm 1 20 0 13M 3600K CPU11 11 0:00 0.04% top
# ---
ironm@fbsdsrv8:~ $ scp ironm@30.0.0.20:/home/ironm/t100.iso
fbsd2fbs-send-conf_X5680_to_AMD_FX_4100.iso
Password for ironm@fbsdsrv2:
t100.iso 100% 3626MB 91.9MB/s
00:3
last pid: 1675; load averages: 0.35, 0.15, 0.06 up 0+02:28:28
15:00:02
20 processes: 3 running, 17 sleeping
CPU: 2.8% user, 0.0% nice, 2.8% system, 0.0% interrupt, 94.4% idle
Mem: 11M Active, 10G Inact, 1169M Wired, 692M Buf, 129G Free
Swap: 3897M Total, 3897M Free
PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND
1657 ironm 1 95 0 22M 11M CPU8 8 0:17 91.00% sshd
1658 ironm 1 25 0 16M 6288K CPU14 14 0:02 10.93% scp
1653 ironm 1 20 0 13M 3608K CPU20 20 0:00 0.06% top
# ---
Xeon E31270 CPU Server
load averages: 0.00, 0.00, 0.03
obsdsrv1.born2b3.net 00:38:06
46 processes: 45 idle, 1 on processor
up 2:08
CPU0 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU1 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU2 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU3 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU4 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU5 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU6 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU7 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
Memory: Real: 69M/886M act/tot Free: 30G Cache: 712M Swap: 0K/32G
PID USERNAME PRI NICE SIZE RES STATE WAIT TIME CPU COMMAND
20673 root 2 0 1092K 3756K idle poll 10:50 0.00% sshd
18870 _slaacd 2 0 732K 788K idle kqread 0:05 0.00% slaacd
36852 _dhcp 2 0 772K 692K idle poll 0:05 0.00% dhclient
51148 root 18 0 964K 992K idle pause 0:04 0.00% ksh
67419 root 28 0 1104K 2964K onproc/0 - 0:01 0.00% top
AMD FX 4100 CPU Server
load averages: 0.06, 0.02, 0.04
obsdsrv2.born2b3.net 00:38:38
54 processes: 53 idle, 1 on processor
up 1:35
CPU0 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU1 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU2 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU3 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
Memory: Real: 109M/873M act/tot Free: 30G Cache: 658M Swap: 0K/32G
PID USERNAME PRI NICE SIZE RES STATE WAIT TIME CPU COMMAND
19929 _x11 2 0 27M 40M sleep/0 poll 0:12 0.00% Xorg
1 root 10 0 404K 456K idle wait 0:01 0.00% init
20145 ironm 2 0 920K 3456K sleep/2 select 0:01 0.00% fvwm
62507 ironm 2 0 7004K 11M sleep/0 select 0:00 0.00% xterm
# ------------------------------------------------------------------------------
# Single send
obsdsrv2$ scp 4GByte-random.bin ironm@10.0.0.2:/home/ironm/send4GByte-v1.bin
4GByte-random.bin 89% 3665MB
71.0MB/s 00:06 ETA
# ---
load averages: 0.30, 0.06, 0.04
obsdsrv1.born2b3.net 00:39:51
50 processes: 48 idle, 2 on processor
up 2:10
CPU0 states: 0.6% user, 0.0% nice, 1.0% sys, 0.2% spin, 3.6% intr, 94.6%
idle
CPU1 states: 20.2% user, 0.0% nice, 28.7% sys, 6.6% spin, 0.0% intr, 44.5%
idle
CPU2 states: 11.8% user, 0.0% nice, 25.7% sys, 4.8% spin, 0.0% intr, 57.7%
idle
CPU3 states: 9.6% user, 0.0% nice, 11.8% sys, 4.0% spin, 0.0% intr, 74.7%
idle
CPU4 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU5 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU6 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU7 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
Memory: Real: 71M/889M act/tot Free: 30G Cache: 712M Swap: 0K/32G
PID USERNAME PRI NICE SIZE RES STATE WAIT TIME CPU COMMAND
27857 ironm 39 0 1220K 3024K onproc/1 - 0:11 37.45% sshd
47712 ironm 2 0 428K 1456K sleep/2 poll 0:02 9.77% scp
20673 root 2 0 1092K 3756K idle poll 10:50 0.00% sshd
18870 _slaacd 2 0 732K 788K idle kqread 0:05 0.00% slaacd
load averages: 0.43, 0.10, 0.07
obsdsrv2.born2b3.net 00:39:58
56 processes: 54 idle, 2 on processor
up 1:37
CPU0 states: 33.7% user, 0.0% nice, 27.1% sys, 10.6% spin, 6.0% intr, 22.6%
idle
CPU1 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU2 states: 31.7% user, 0.0% nice, 34.9% sys, 10.0% spin, 0.0% intr, 23.4%
idle
CPU3 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
Memory: Real: 112M/877M act/tot Free: 30G Cache: 658M Swap: 0K/32G
PID USERNAME PRI NICE SIZE RES STATE WAIT TIME CPU COMMAND
35786 ironm 10 0 3108K 5888K onproc/2 - 0:20 61.82% ssh
21137 ironm 2 0 420K 1496K sleep/2 poll 0:05 13.53% scp
19929 _x11 2 0 27M 40M sleep/2 poll 0:12 1.37% Xorg
# ------------------------------------------------------------------------------
# Send and receive at once (two scp connections)
obsdsrv2$ scp 4GByte-random.bin ironm@10.0.0.2:/home/ironm/send4GByte-v1.bin
ironm@10.0.0.2's password:
4GByte-random.bin 50% 2050MB
47.7MB/s 00:42 ETA
obsdsrv2$ scp ironm@10.0.0.2:/home/ironm/4GByte-random.bin receive4GByte-v1.bin
ironm@10.0.0.2's password:
4GByte-random.bin 68% 2814MB 50.8MB/s
00:25 ETA
load averages: 1.33, 0.40, 0.18
obsdsrv1.born2b3.net 01:06:11
57 processes: 54 idle, 3 on processor
up 2:36
CPU0 states: 11.4% user, 0.0% nice, 15.4% sys, 9.8% spin, 10.0% intr, 53.5%
idle
CPU1 states: 30.1% user, 0.0% nice, 24.8% sys, 14.0% spin, 0.0% intr, 31.1%
idle
CPU2 states: 21.0% user, 0.0% nice, 31.1% sys, 11.8% spin, 0.0% intr, 36.1%
idle
CPU3 states: 21.6% user, 0.0% nice, 23.6% sys, 12.6% spin, 0.0% intr, 42.3%
idle
CPU4 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU5 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU6 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU7 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
Memory: Real: 84M/906M act/tot Free: 30G Cache: 712M Swap: 0K/32G
PID USERNAME PRI NICE SIZE RES STATE WAIT TIME CPU COMMAND
96628 ironm 10 0 1176K 3060K onproc/1 - 0:41 66.46% sshd
32758 ironm 64 0 4892K 6780K onproc/0 - 0:41 61.67% sshd
39950 ironm 2 0 432K 1440K sleep/3 poll 0:08 13.09% scp
90607 ironm 2 0 436K 1480K sleep/3 poll 0:09 12.84% scp
59276 root 2 0 1044K 3764K sleep/2 poll 0:34 0.00% sshd
13599 root 2 0 1044K 3752K sleep/3 poll 0:09 0.00% sshd
18870 _slaacd 2 0 732K 788K sleep/3 kqread 0:05 0.00% slaacd
load averages: 2.44, 0.76, 0.33
obsdsrv2.born2b3.net 01:06:14
60 processes: 3 running, 56 idle, 1 on processor
up 2:03
CPU0 states: 38.3% user, 0.0% nice, 42.7% sys, 13.6% spin, 5.4% intr, 0.0%
idle
CPU1 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU2 states: 40.9% user, 0.0% nice, 44.1% sys, 14.8% spin, 0.0% intr, 0.2%
idle
CPU3 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
Memory: Real: 120M/887M act/tot Free: 30G Cache: 658M Swap: 0K/32G
PID USERNAME PRI NICE SIZE RES STATE WAIT TIME CPU COMMAND
12350 ironm 64 0 1156K 3924K run/0 - 0:49 66.21% ssh
78915 ironm 64 0 4560K 7336K run/2 - 0:47 64.16% ssh
11917 ironm 48 0 424K 1512K run/2 - 0:09 13.53% scp
1584 ironm 2 0 440K 1528K sleep/2 poll 0:08 9.96% scp
19929 _x11 2 0 27M 40M sleep/2 poll 0:14 0.98% Xorg
1 root 10 0 404K 456K idle wait 0:01 0.00% init
# ---
obsdsrv2$ scp 4GByte-random.bin ironm@10.0.0.2:/home/ironm/send4GByte-v1.bin
4GByte-random.bin 100% 4096MB 49.4MB/s 01:22
obsdsrv2$ scp ironm@10.0.0.2:/home/ironm/4GByte-random.bin receive4GByte-v1.bin
4GByte-random.bin 100% 4096MB 51.2MB/s 01:19
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 140.5MB/s 00:25
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/t2.iso
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 124.5MB/s 00:29
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@170.0.0.10:/home/ironm/t172.iso
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 22.2MB/s 02:43
ironm@fbsdsrv2:~ $
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/t2.iso
Password for ironm@fbsdsrv1:
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 43.2MB/s 01:24
ironm@fbsdsrv2:~ $ scp ironm@200.0.0.10:/home/ironm/t2.iso t100.iso
Password for ironm@fbsdsrv1:
t2.iso
100% 3626MB 130.2MB/s 00:27
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/
The authenticity of host '200.0.0.10 (200.0.0.10)' can't be established.
ECDSA key fingerprint is SHA256:/4A6G7sn+LIXfmhN/UX92F8oL8YM/1PgmeN1VXJ0vkk.
No matching host key fingerprint found in DNS.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '200.0.0.10' (ECDSA) to the list of known hosts.
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 137.8MB/s 00:26
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
49% 1797MB 141.3MB/s 00:12 ETA^Cironm@fbsdsrv2:~ $ scp obsd2fbsd.iso
ironm@200.0.0.10:/home/ironm/t1.iso
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 119.7MB/s 00:30
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@170.0.0.10:/home/ironm/t1701.iso
The authenticity of host '170.0.0.10 (170.0.0.10)' can't be established.
ECDSA key fingerprint is SHA256:/4A6G7sn+LIXfmhN/UX92F8oL8YM/1PgmeN1VXJ0vkk.
No matching host key fingerprint found in DNS.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '170.0.0.10' (ECDSA) to the list of known hosts.
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 21.9MB/s 02:45
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/t1.iso
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 40.9MB/s 01:28
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/t1.iso
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 148.2MB/s 00:24
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/t1.iso
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 140.4MB/s 00:25
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/t5.iso
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 27.4MB/s 02:12
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/t6.iso
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 27.8MB/s 02:10
ironm@fbsdsrv2:~ $
sendmail_enable="NONE"
hostname="fbsdsrv2"
# ifconfig_bce0="DHCP"
ifconfig_bce0="inet 192.168.1.20 netmask 255.25.255.0"
ifconfig_bce2="inet 170.0.0.20 netmask 255.25.255.0"
ifconfig_ix0="inet 200.0.0.20 netmask 255.25.255.0"
ifconfig_ix1="inet 10.0.0.20 netmask 255.25.255.0"
sshd_enable="YES"
# Set dumpdev to "AUTO" to enable crash dumps, "NO" to disable
dumpdev="AUTO"
obsdsrv1: Asus P8B-WS Xeon CPU, 32GB ECC DDR3 RAM, 512GB Sasmung Pro 860 SSD
10GBit NIC (Intel X520-DA2) directly connected to the other 10GBit NIC
OpenBSD obsdsrv1.born2b3.net 6.4 GENERIC.MP#364 amd64
obsdsrv2: Asus MB AMD_FX_4100 CPU, 32GB ECC DDR3 RAM, 512GB Sasmung Pro 860 SSD
10GBit NIC (Intel X520-DA2) directly connected to the other 10GBit NIC
OpenBSD obsdsrv2.born2b3.net 6.4 GENERIC.MP#364 amd64
# Send or receive standalone (IPv4)
# -------------------------------------------------------------------------
obsdsrv2$ scp 4GByte-random-v2.bin ironm@10.0.0.2:/home/ironm/send4GByte-v2.bin
4GByte-random-v2.bin 100% 4096MB 69.0MB/s 00:59 0
# -------------------------------------------------------------------------
obsdsrv2$ scp ironm@10.0.0.2:/home/ironm/4GByte-random.bin receive4GByte-v1.bin
4GByte-random.bin 100% 4096MB 63.6MB/s 01:04
# -------------------------------------------------------------------------
# Send AND receive at once (IPv4)
# -------------------------------------------------------------------------
obsdsrv2$ scp 4GByte-random-v2.bin ironm@10.0.0.2:/home/ironm/send4GByte-v2.bin
4GByte-random-v2.bin 100% 4096MB 49.6MB/s 01:22
# -------------------------------------------------------------------------
obsdsrv2$ scp ironm@10.0.0.2:/home/ironm/4GByte-random.bin receive4GByte-v1.bin
4GByte-random.bin 100% 4096MB 49.4MB/s 01:22
# -------------------------------------------------------------------------
# Network configuration (10GBit X520-DA2 NICs)
# -------------------------------------------------------------------------
obsdsrv1# ifconfig -a
ix0: flags=208843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,AUTOCONF6> mtu 1500
lladdr 90:e2:ba:32:c4:34
index 1 priority 0 llprio 3
media: Ethernet autoselect (10GbaseSR full-duplex,rxpause,txpause)
status: active
inet 10.0.0.2 netmask 0xffffff00 broadcast 10.0.0.255
inet6 fe80::fd68:4835:ead2:86d9%ix0 prefixlen 64 scopeid 0x1
ix1: flags=208843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,AUTOCONF6> mtu 1500
lladdr 90:e2:ba:32:c4:35
index 2 priority 0 llprio 3
media: Ethernet autoselect
status: no carrier
inet 100.0.0.2 netmask 0xffffff00 broadcast 100.0.0.255
inet6 fe80::b3aa:3eb7:89ef:3b14%ix1 prefixlen 64 scopeid 0x2
obsdsrv2# ifconfig -a
ix0: flags=208843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,AUTOCONF6> mtu 1500
lladdr a0:36:9f:26:94:9c
index 1 priority 0 llprio 3
media: Ethernet autoselect
status: no carrier
inet 100.0.0.3 netmask 0xffffff00 broadcast 100.0.0.255
inet6 fe80::2981:1007:3f88:9d2d%ix0 prefixlen 64 scopeid 0x1
ix1: flags=208843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,AUTOCONF6> mtu 1500
lladdr a0:36:9f:26:94:9e
index 2 priority 0 llprio 3
media: Ethernet autoselect (10GbaseSR full-duplex,rxpause,txpause)
status: active
inet 10.0.0.3 netmask 0xffffff00 broadcast 10.0.0.255
inet6 fe80::efa1:94f9:d931:3ae9%ix1 prefixlen 64 scopeid 0x2
# Send or receive Xeon / AMD FX 4100 CPU, 32GByte ECC RAM, 10GBit NIC
(X520-DA2), SSD
# OpenBSD 6.4 "send to /receive from" FreeBSD 13.0 (SSD)
obsdsrv2$ scp 4GB-test.bin ironm@10.0.0.2:/home/ironm
Password for ironm@fbsdsrv7:
4GB-test.bin 100% 4096MB 70.6MB/s 00:58
-----------------------------------------------------------------------
obsdsrv2$ scp ironm@10.0.0.2:/home/ironm/4GB-test.bin hugo-received.iso
Password for ironm@fbsdsrv7:
4GB-test.bin 100% 4096MB 78.5MB/s 00:52
obsdsrv2$ ifconfig -a
ix0: flags=208843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,AUTOCONF6> mtu 1500
lladdr a0:36:9f:26:94:9c
index 1 priority 0 llprio 3
media: Ethernet autoselect (10GbaseSR full-duplex,rxpause,txpause)
status: active
inet 30.0.0.3 netmask 0xffffff00 broadcast 30.0.0.255
inet6 fe80::2981:1007:3f88:9d2d%ix0 prefixlen 64 scopeid 0x1
ix1: flags=208843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,AUTOCONF6> mtu 1500
lladdr a0:36:9f:26:94:9e
index 2 priority 0 llprio 3
media: Ethernet autoselect (10GbaseSR full-duplex,rxpause,txpause)
status: active
inet 10.0.0.3 netmask 0xffffff00 broadcast 10.0.0.255
inet6 fe80::efa1:94f9:d931:3ae9%ix1 prefixlen 64 scopeid 0x2
