Thanks,
Chbris

On Jul 22, 2020, at 11:32 AM, Benoit Ganne (bganne) via lists.fd.io <bganne=cisco....@lists.fd.io> wrote:

I tried setting that but didn't notice an issue, perhaps it's not an IO
bottleneck.

Could you share the output of:
- clear run/show run (it is important to clear 1st to capture "live" stats)
- show err
- show threads
- show buffers
- show pci
While traffic is flowing?
To give some ideas, a VPP user reported ~65Mpps with a CX5 on Epyc with 8 workers, but YMMV.

Best
ben


[15:50:04 cmf-tm-3:~]$ vppctl clear run; sleep 11; vppctl show run; vppctl show 
threads; vppctl show cpu; vppctl show buffers ; vppctl show pci
Thread 0 vpp_main (lcore 0)
Time 11.0, 10 sec internal node vector rate 0.00
  vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
api-rx-from-ring                any wait                 0               0      
         1          1.91e4            0.00       0
dpdk-process                    any wait                 0               0      
         4          4.84e6            0.00       0
fib-walk                        any wait                 0               0      
         5          3.49e3            0.00       0
ikev2-manager-process           any wait                 0               0      
        11          5.01e3            0.00       0
ip4-full-reassembly-expire-wal  any wait                 0               0      
         1          4.41e3            0.00       0
ip6-full-reassembly-expire-wal  any wait                 0               0      
         1          6.00e3            0.00       0
ip6-icmp-neighbor-discovery-ev  any wait                 0               0      
        11          2.89e3            0.00       0
statseg-collector-process       time wait                0               0      
         1          4.46e4            0.00       0
unix-cli-local:12                active                  1               0      
         2          3.41e9            0.00       0
unix-cli-new-session            any wait                 0               0      
         3          2.24e3            0.00       0
unix-epoll-input                 polling            306904               0      
         0          1.07e5            0.00       0
---------------
Thread 1 vpp_wk_0 (lcore 1)
Time 11.0, 10 sec internal node vector rate 1.94
  vector rates in 1.4592e6, out 7.2961e5, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
dpdk-crypto-input                polling          24469809               0      
         0          1.19e2            0.00     100
dpdk-input                       polling          24469809         8030066      
         0          1.07e3             .33     100
ethernet-input                   active            4149970         8030066      
         0          3.25e2            1.93       0
ip4-input-no-checksum            active            4149970         8030066      
         0          1.37e2            1.93       0
ip4-lookup                       active            4149970         8030066      
         0          1.33e2            1.93       0
ip4-midchain                     active            4149970         8030066      
         0          1.52e2            1.93       0
iptfs-encap4-tun                 active            4149970         8030066      
         0          8.18e2            1.93     102
iptfs-pacer                      polling          24469809         8030067      
         0          7.80e2             .33     100
---------------
Thread 2 vpp_wk_1 (lcore 2)
Time 11.0, 10 sec internal node vector rate 18.13
  vector rates in 1.4274e6, out 7.1372e5, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
dpdk-crypto-input                polling            433068         7855124      
         0          3.27e3           18.14     100
dpdk-esp4-decrypt                active             433068         7855134      
         0          1.39e2           18.14       0
dpdk-esp4-decrypt-post           active             433068         7855124      
         0          1.06e2           18.14       0
dpdk-input                       polling            433068         7855134      
         0          1.95e2           18.14     100
ethernet-input                   active             433068         7855134      
         0          7.64e1           18.14       0
ip4-input-no-checksum            active             433068         7855134      
         0          5.57e1           18.14       0
ip4-local                        active             433068         7855134      
         0          5.00e1           18.14       0
ip4-lookup                       active             433068         7855134      
         0          4.01e1           18.14       0
ipsec4-if-input                  active             433068         7855134      
         0          3.64e1           18.14       0
iptfs-decap-reorder              active             433068         7855124      
         0          2.29e2           18.14       2
---------------
Thread 3 vpp_wk_2 (lcore 3)
Time 11.0, 10 sec internal node vector rate 0.00
  vector rates in 2.6005e4, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
dpdk-crypto-input                polling         109003239               0      
         0          1.16e2            0.00     100
iptfs-zpool-poller               polling         109003239          286213      
         0          4.02e4            0.00       0
---------------
Thread 4 vpp_wk_3 (lcore 4)
Time 11.0, 10 sec internal node vector rate 18.09
  vector rates in 7.1372e5, out 6.8842e5, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
HundredGigabitEthernet21/0/1-o   active             419071         7576641      
         0          2.38e1           18.08       0
HundredGigabitEthernet21/0/1-t   active             419071         7576641      
         0          1.77e2           18.08       2
dpdk-crypto-input                polling         126816818               0      
         0          1.44e2            0.00     100
ip4-input-no-checksum            active             419071         7576641      
         0          7.59e1           18.08       0
ip4-load-balance                 active             419071         7576641      
         0          2.19e1           18.08       0
ip4-lookup                       active             419071         7576641      
         0          3.62e1           18.08       0
ip4-rewrite                      active             419071         7576641      
         0          3.62e1           18.08       0
iptfs-decap                      active             432650         7855124      
         0          1.99e2           18.16     110
---------------
Thread 5 vpp_wk_4 (lcore 5)
Time 11.0, 10 sec internal node vector rate 252.94
  vector rates in 1.5113e6, out 1.5113e6, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
HundredGigabitEthernet21/0/0-o   active              32883         8316355      
         0          1.05e1          252.91       0
HundredGigabitEthernet21/0/0-t   active              32883         8316355      
         0          5.97e1          252.91       2
dpdk-crypto-input                polling             32883         8316355      
         0          2.84e3          252.91     100
dpdk-esp4-encrypt                active              32883         8316355      
         0          9.89e2          252.91       2
ip4-lookup                       active              32883         8316355      
         0          3.08e1          252.91       0
ip4-rewrite                      active              32883         8316355      
         0          2.43e1          252.91       0
iptfs-output                     polling             32883         8316355      
         0          1.68e1          252.91     100
ID     Name                Type        LWP     Sched Policy (Priority)  lcore  
Core   Socket State
0      vpp_main                        126555  other (0)                0      
0      0
1      vpp_wk_0            workers     126560  other (0)                1      
1      0
2      vpp_wk_1            workers     126561  other (0)                2      
4      0
3      vpp_wk_2            workers     126562  other (0)                3      
5      0
4      vpp_wk_3            workers     126563  other (0)                4      
8      0
5      vpp_wk_4            workers     126564  other (0)                5      
9      0
Model name:               AMD EPYC 7302 16-Core Processor
Microarch model (family): unknown (family 0x0f model 0x31)
Flags:                    sse3 pclmulqdq ssse3 sse41 sse42 avx rdrand avx2 pqm 
pqe rdseed aes sha invariant_tsc
Base frequency:           2.99 GHz
Pool Name            Index NUMA  Size  Data Size  Total  Avail  Cached   Used
default-numa-0         0     0   10688   10240   100462  83342   1646    15474
default-numa-1         1     1   10688   10240   100462 100462     0       0
Address      Sock VID:PID     Link Speed   Driver          Product Name         
           Vital Product Data
0000:21:00.0   0  15b3:101b   unknown      mlx5_core       ConnectX-6 VPI 
adapter card, HDR PN: MCX653106A-HDAT
                                                                                
           EC: A8
                                                                                
           V2: 0x 4d 43 58 36 35 33 31 30 ...
                                                                                
           SN: MT1944K18413
                                                                                
           V3: 0x 64 34 36 36 30 30 32 64 ...
                                                                                
           VA: 0x 4d 4c 58 3a 4d 4e 3d 4d ...
                                                                                
           V0: 0x 50 43 49 65 47 65 6e 34 ...
                                                                                
           RV: 0x ef 00
0000:21:00.1   0  15b3:101b   unknown      mlx5_core       ConnectX-6 VPI 
adapter card, HDR PN: MCX653106A-HDAT
                                                                                
           EC: A8
                                                                                
           V2: 0x 4d 43 58 36 35 33 31 30 ...
                                                                                
           SN: MT1944K18413
                                                                                
           V3: 0x 64 34 36 36 30 30 32 64 ...
                                                                                
           VA: 0x 4d 4c 58 3a 4d 4e 3d 4d ...
                                                                                
           V0: 0x 50 43 49 65 47 65 6e 34 ...
                                                                                
           RV: 0x ef 00
0000:62:00.0   0  8086:1521   5.0 GT/s x2  igb
0000:62:00.1   0  8086:1521   5.0 GT/s x2  igb
(default) [16:04:27 cmf-xe-3:~]$ vppctl clear run; sleep 11; vppctl show run; 
vppctl show threads; vppctl show cpu; vppctl show buffers ; vppctl show pci
Thread 0 vpp_main (lcore 0)
Time 10.9, 10 sec internal node vector rate 0.00
  vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
api-rx-from-ring                any wait                 0               0      
         1          1.13e4            0.00       0
dpdk-process                    any wait                 0               0      
         3          5.05e6            0.00       0
fib-walk                        any wait                 0               0      
         5          8.18e3            0.00       0
ikev2-manager-process           any wait                 0               0      
        11          6.64e3            0.00       0
ip4-full-reassembly-expire-wal  any wait                 0               0      
         1          3.89e3            0.00       0
ip6-full-reassembly-expire-wal  any wait                 0               0      
         1          7.10e3            0.00       0
ip6-icmp-neighbor-discovery-ev  any wait                 0               0      
        11          2.91e3            0.00       0
statseg-collector-process       time wait                0               0      
         1          6.16e4            0.00       0
unix-cli-local:12                active                  1               0      
         2          6.58e8            0.00       0
unix-cli-new-session            any wait                 0               0      
         3          5.56e3            0.00       0
unix-epoll-input                 polling            112716               0      
         0          2.04e5            0.00       0
---------------
Thread 1 vpp_wk_0 (lcore 1)
Time 10.9, 10 sec internal node vector rate 2.70
  vector rates in 1.4609e6, out 7.3046e5, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
dpdk-crypto-input                polling          19142033               0      
         0          1.29e2            0.00     100
dpdk-input                       polling          19142033         8030345      
         0          7.96e2             .42     100
ethernet-input                   active            2966022         8030345      
         0          1.18e2            2.71       0
ip4-input-no-checksum            active            2966022         8030345      
         0          1.12e2            2.71       0
ip4-lookup                       active            2966022         8030345      
         0          9.83e1            2.71       0
ip4-midchain                     active            2966022         8030345      
         0          1.31e2            2.71       0
iptfs-encap4-tun                 active            2966022         8030345      
         0          5.38e2            2.71     102
iptfs-pacer                      polling          19142033         8030349      
         0          5.55e2             .42     100
---------------
Thread 2 vpp_wk_1 (lcore 2)
Time 10.9, 10 sec internal node vector rate 8.46
  vector rates in 1.4320e6, out 7.1602e5, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
dpdk-crypto-input                polling            929083         7871573      
         0          1.89e3            8.47     100
dpdk-esp4-decrypt                active             929083         7871571      
         0          1.65e2            8.47       0
dpdk-esp4-decrypt-post           active             929083         7871573      
         0          1.08e2            8.47       0
dpdk-input                       polling            929083         7871571      
         0          1.91e2            8.47     100
ethernet-input                   active             929083         7871571      
         0          7.18e1            8.47       0
ip4-input-no-checksum            active             929083         7871571      
         0          7.25e1            8.47       0
ip4-local                        active             929083         7871571      
         0          6.88e1            8.47       0
ip4-lookup                       active             929083         7871571      
         0          5.69e1            8.47       0
ipsec4-if-input                  active             929083         7871571      
         0          7.09e1            8.47       0
iptfs-decap-reorder              active             929083         7871573      
         0          2.22e2            8.47       2
---------------
Thread 3 vpp_wk_2 (lcore 3)
Time 10.9, 10 sec internal node vector rate 0.00
  vector rates in 8.1406e4, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
dpdk-crypto-input                polling          66921916               0      
         0          1.28e2            0.00     100
iptfs-zpool-poller               polling          66921916          894938      
         0          8.93e3             .01       0
---------------
Thread 4 vpp_wk_3 (lcore 4)
Time 10.9, 10 sec internal node vector rate 7.96
  vector rates in 7.1602e5, out 6.4541e5, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
HundredGigabitEthernet65/0/0-o   active             900822         7095289      
         0          5.38e1            7.88       0
HundredGigabitEthernet65/0/0-t   active             900822         7095289      
         0          2.07e2            7.88       2
dpdk-crypto-input                polling          51489840               0      
         0          2.27e2            0.00     100
ip4-input-no-checksum            active             900822         7095289      
         0          1.07e2            7.88       0
ip4-load-balance                 active             900822         7095289      
         0          4.35e1            7.88       0
ip4-lookup                       active             900822         7095289      
         0          6.48e1            7.88       0
ip4-rewrite                      active             900822         7095289      
         0          1.13e2            7.88       0
iptfs-decap                      active             926201         7871569      
         0          2.57e2            8.49     110
---------------
Thread 5 vpp_wk_4 (lcore 5)
Time 10.9, 10 sec internal node vector rate 11.53
  vector rates in 1.6238e6, out 1.6238e6, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
HundredGigabitEthernet65/0/1-o   active             776117         8925476      
         0          3.47e1           11.50       0
HundredGigabitEthernet65/0/1-t   active             776117         8925476      
         0          1.18e2           11.50       2
dpdk-crypto-input                polling            776117         8925476      
         0          1.68e3           11.50     100
dpdk-esp4-encrypt                active             776117         8925480      
         0          5.53e2           11.50       2
ip4-lookup                       active             776117         8925476      
         0          5.76e1           11.50       0
ip4-rewrite                      active             776117         8925476      
         0          4.49e1           11.50       0
iptfs-output                     polling            776117         8925480      
         0          8.39e1           11.50     100
ID     Name                Type        LWP     Sched Policy (Priority)  lcore  
Core   Socket State
0      vpp_main                        93315   other (0)                0      
0      0
1      vpp_wk_0            workers     93317   other (0)                1      
5      0
2      vpp_wk_1            workers     93318   other (0)                2      
1      0
3      vpp_wk_2            workers     93319   other (0)                3      
4      0
4      vpp_wk_3            workers     93320   other (0)                4      
2      0
5      vpp_wk_4            workers     93321   other (0)                5      
3      0
Model name:               Intel(R) Xeon(R) Silver 4116 CPU @ 2.10GHz
Microarch model (family): [0x6] Skylake ([0x55] Skylake X/SP) stepping 0x4
Flags:                    sse3 pclmulqdq ssse3 sse41 sse42 avx rdrand avx2 rtm 
pqm pqe avx512f rdseed aes invariant_tsc
Base frequency:           2.09 GHz
Pool Name            Index NUMA  Size  Data Size  Total  Avail  Cached   Used
default-numa-0         0     0   10688   10240   100462  84110   1782    14570
Address      Sock VID:PID     Link Speed   Driver          Product Name         
           Vital Product Data
0000:04:00.0   0  14e4:165f   5.0 GT/s x1  tg3             Broadcom NetXtreme 
Gigabit Ether PN: BCM95720
                                                                                
           MN: 1028
                                                                                
           V0: 0x 46 46 56 32 31 2e 34 30 ...
                                                                                
           V1: 0x 44 53 56 31 30 32 38 56 ...
                                                                                
           V2: 0x 4e 50 59 32
                                                                                
           V3: 0x 50 4d 54 31
                                                                                
           V4: 0x 4e 4d 56 42 72 6f 61 64 ...
                                                                                
           V5: 0x 44 54 49 4e 49 43
                                                                                
           V6: 0x 44 43 4d 31 30 30 31 30 ...
                                                                                
           RV: 0x ee 00 00 00 00 00 00 00 ...
0000:04:00.1   0  14e4:165f   5.0 GT/s x1  tg3             Broadcom NetXtreme 
Gigabit Ether PN: BCM95720
                                                                                
           MN: 1028
                                                                                
           V0: 0x 46 46 56 32 31 2e 34 30 ...
                                                                                
           V1: 0x 44 53 56 31 30 32 38 56 ...
                                                                                
           V2: 0x 4e 50 59 32
                                                                                
           V3: 0x 50 4d 54 31
                                                                                
           V4: 0x 4e 4d 56 42 72 6f 61 64 ...
                                                                                
           V5: 0x 44 54 49 4e 49 43
                                                                                
           V6: 0x 44 43 4d 31 30 30 31 30 ...
                                                                                
           RV: 0x ee 00 00 00 00 00 00 00 ...
0000:65:00.0   0  15b3:1017   8.0 GT/s x16 mlx5_core       CX516A - ConnectX-5 
QSFP28      PN: MCX516A-CCAT
                                                                                
           EC: AA
                                                                                
           V2: 0x 4d 43 58 35 31 36 41 2d ...
                                                                                
           SN: MT1934J09467
                                                                                
           V3: 0x 34 65 39 61 34 39 39 34 ...
                                                                                
           VA: 0x 4d 4c 58 3a 4d 4f 44 4c ...
                                                                                
           V0: 0x 50 43 49 65 47 65 6e 33 ...
                                                                                
           RV: 0x b5 00 00
0000:65:00.1   0  15b3:1017   8.0 GT/s x16 mlx5_core       CX516A - ConnectX-5 
QSFP28      PN: MCX516A-CCAT
                                                                                
           EC: AA
                                                                                
           V2: 0x 4d 43 58 35 31 36 41 2d ...
                                                                                
           SN: MT1934J09467
                                                                                
           V3: 0x 34 65 39 61 34 39 39 34 ...
                                                                                
           VA: 0x 4d 4c 58 3a 4d 4f 44 4c ...
                                                                                
           V0: 0x 50 43 49 65 47 65 6e 33 ...
                                                                                
           RV: 0x b5 00 00
[15:48:51 cmf-tm-3:~]$ vppctl clear run; sleep 11; vppctl show run; vppctl show 
threads; vppctl show cpu; vppctl show buffers ; vppctl show pci
Thread 0 vpp_main (lcore 0)
Time 11.0, 10 sec internal node vector rate 0.00
  vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
api-rx-from-ring                any wait                 0               0      
         1          2.55e4            0.00       0
dpdk-process                    any wait                 0               0      
         4          4.92e6            0.00       0
fib-walk                        any wait                 0               0      
         5          1.64e4            0.00       0
ikev2-manager-process           any wait                 0               0      
        11          1.33e4            0.00       0
ip4-full-reassembly-expire-wal  any wait                 0               0      
         1          5.88e3            0.00       0
ip6-full-reassembly-expire-wal  any wait                 0               0      
         1          1.36e4            0.00       0
ip6-icmp-neighbor-discovery-ev  any wait                 0               0      
        11          1.59e4            0.00       0
statseg-collector-process       time wait                0               0      
         1          9.02e4            0.00       0
unix-cli-local:21                active                  1               0      
         2          7.80e8            0.00       0
unix-cli-new-session            any wait                 0               0      
         3          6.72e3            0.00       0
unix-epoll-input                 polling            313788               0      
         0          1.05e5            0.00       0
---------------
Thread 1 vpp_wk_0 (lcore 1)
Time 11.0, 10 sec internal node vector rate 11.96
  vector rates in 1.0481e6, out 5.2438e5, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
dpdk-crypto-input                polling            481937               0      
         0          4.52e2            0.00     100
dpdk-input                       polling            481937         5770073      
         0          1.28e2           11.97     100
ethernet-input                   active             481937         5770073      
         0          9.24e1           11.97       0
ip4-input-no-checksum            active             481937         5770073      
         0          4.19e1           11.97       0
ip4-lookup                       active             481937         5770073      
         0          4.36e1           11.97       0
ip4-midchain                     active             481937         5770073      
         0          6.71e1           11.97       0
iptfs-encap4-tun                 active             481937         5770073      
         0          5.04e3           11.97     102
iptfs-pacer                      polling            481937         5763093      
         0          2.59e2           11.96     100
---------------
Thread 2 vpp_wk_1 (lcore 2)
Time 11.0, 10 sec internal node vector rate 4.92
  vector rates in 1.6265e6, out 8.1323e5, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
dpdk-crypto-input                polling           2030780         8948373      
         0          7.26e2            4.41     100
dpdk-esp4-decrypt                active            1817341         8948372      
         0          7.54e2            4.92       0
dpdk-esp4-decrypt-post           active            1817341         8948373      
         0          4.84e2            4.92       0
dpdk-input                       polling           2030780         8948372      
         0          3.82e2            4.41     100
ethernet-input                   active            1817341         8948372      
         0          1.25e2            4.92       0
ip4-input-no-checksum            active            1817341         8948372      
         0          1.58e2            4.92       0
ip4-local                        active            1817341         8948372      
         0          7.65e1            4.92       0
ip4-lookup                       active            1817341         8948372      
         0          7.13e1            4.92       0
ipsec4-if-input                  active            1817341         8948372      
         0          7.66e1            4.92       0
iptfs-decap-reorder              active            1817341         8948373      
         0          8.19e2            4.92       2
---------------
Thread 3 vpp_wk_2 (lcore 3)
Time 11.0, 10 sec internal node vector rate 0.00
  vector rates in 7.6921e5, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
dpdk-crypto-input                polling          62322008               0      
         0          2.12e2            0.00     100
iptfs-zpool-poller               polling          62322008         8464081      
         0          1.74e3             .14       0
---------------
Thread 4 vpp_wk_3 (lcore 4)
Time 11.0, 10 sec internal node vector rate 4.46
  vector rates in 1.3319e6, out 5.1868e5, drop 1.0542e1, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
HundredGigabitEthernet21/0/1-o   active            1309445         5707367      
         0          7.34e1            4.36       0
HundredGigabitEthernet21/0/1-t   active            1309445         5707367      
         0          7.24e2            4.36       2
dpdk-crypto-input                polling          38715930               0      
         0          2.79e2            0.00     100
drop                             active                 27             116      
         0          1.09e3            4.29       4
ip4-input-no-checksum            active            1309445         5707367      
         0          9.23e1            4.36       0
ip4-load-balance                 active            1309445         5707367      
         0          5.47e1            4.36       0
ip4-lookup                       active            1309445         5707367      
         0          7.79e1            4.36       0
ip4-rewrite                      active            1309445         5707367      
         0          8.84e1            4.36       0
iptfs-decap                      active            1817342        14655289      
         0          8.19e2            8.06     110
---------------
Thread 5 vpp_wk_4 (lcore 5)
Time 11.0, 10 sec internal node vector rate 5.24
  vector rates in 1.6260e6, out 1.6260e6, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
HundredGigabitEthernet21/0/0-o   active            1704581         8945941      
         0          5.88e1            5.25       0
HundredGigabitEthernet21/0/0-t   active            1704581         8945941      
         0          3.61e2            5.25       2
dpdk-crypto-input                polling           1704581         8945941      
         0          5.71e2            5.25     100
dpdk-esp4-encrypt                active            1704581         8945939      
         0          1.82e3            5.25       2
ip4-lookup                       active            1704581         8945941      
         0          7.83e1            5.25       0
ip4-rewrite                      active            1704581         8945941      
         0          6.81e1            5.25       0
iptfs-output                     polling           1704581         8945939      
         0          7.19e2            5.25     100
ID     Name                Type        LWP     Sched Policy (Priority)  lcore  
Core   Socket State
0      vpp_main                        122294  other (0)                0      
0      0
1      vpp_wk_0            workers     122296  other (0)                1      
1      0
2      vpp_wk_1            workers     122297  other (0)                2      
4      0
3      vpp_wk_2            workers     122298  other (0)                3      
5      0
4      vpp_wk_3            workers     122299  other (0)                4      
8      0
5      vpp_wk_4            workers     122300  other (0)                5      
9      0
Model name:               AMD EPYC 7302 16-Core Processor
Microarch model (family): unknown (family 0x0f model 0x31)
Flags:                    sse3 pclmulqdq ssse3 sse41 sse42 avx rdrand avx2 pqm 
pqe rdseed aes sha invariant_tsc
Base frequency:           2.99 GHz
Pool Name            Index NUMA  Size  Data Size  Total  Avail  Cached   Used
default-numa-0         0     0   10688   10240   100462  84078   2220    14164
default-numa-1         1     1   10688   10240   100462 100462     0       0
Address      Sock VID:PID     Link Speed   Driver          Product Name         
           Vital Product Data
0000:21:00.0   0  15b3:101b   unknown      mlx5_core       ConnectX-6 VPI 
adapter card, HDR PN: MCX653106A-HDAT
                                                                                
           EC: A8
                                                                                
           V2: 0x 4d 43 58 36 35 33 31 30 ...
                                                                                
           SN: MT1944K18413
                                                                                
           V3: 0x 64 34 36 36 30 30 32 64 ...
                                                                                
           VA: 0x 4d 4c 58 3a 4d 4e 3d 4d ...
                                                                                
           V0: 0x 50 43 49 65 47 65 6e 34 ...
                                                                                
           RV: 0x ef 00
0000:21:00.1   0  15b3:101b   unknown      mlx5_core       ConnectX-6 VPI 
adapter card, HDR PN: MCX653106A-HDAT
                                                                                
           EC: A8
                                                                                
           V2: 0x 4d 43 58 36 35 33 31 30 ...
                                                                                
           SN: MT1944K18413
                                                                                
           V3: 0x 64 34 36 36 30 30 32 64 ...
                                                                                
           VA: 0x 4d 4c 58 3a 4d 4e 3d 4d ...
                                                                                
           V0: 0x 50 43 49 65 47 65 6e 34 ...
                                                                                
           RV: 0x ef 00
0000:62:00.0   0  8086:1521   5.0 GT/s x2  igb
0000:62:00.1   0  8086:1521   5.0 GT/s x2  igb
(default) [15:52:12 cmf-xe-3:~]$ vppctl clear run; sleep 11; vppctl show run; 
vppctl show threads; vppctl show cpu; vppctl show buffers ; vppctl show pci
Thread 0 vpp_main (lcore 0)
Time 10.9, 10 sec internal node vector rate 0.00
  vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
api-rx-from-ring                any wait                 0               0      
         1          1.59e4            0.00       0
dpdk-process                    any wait                 0               0      
         4          3.86e6            0.00       0
fib-walk                        any wait                 0               0      
         5          6.79e3            0.00       0
ikev2-manager-process           any wait                 0               0      
        11          5.86e3            0.00       0
ip4-full-reassembly-expire-wal  any wait                 0               0      
         1          4.32e3            0.00       0
ip6-full-reassembly-expire-wal  any wait                 0               0      
         1          4.53e3            0.00       0
ip6-icmp-neighbor-discovery-ev  any wait                 0               0      
        11          4.61e3            0.00       0
statseg-collector-process       time wait                0               0      
         1          5.35e4            0.00       0
unix-cli-local:12                active                  1               0      
         2          1.33e9            0.00       0
unix-cli-new-session            any wait                 0               0      
         3          3.44e3            0.00       0
unix-epoll-input                 polling            110560               0      
         0          2.08e5            0.00       0
---------------
Thread 1 vpp_wk_0 (lcore 1)
Time 10.9, 10 sec internal node vector rate 0.00
  vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
dpdk-crypto-input                polling          32687202               0      
         0          1.06e2            0.00     100
dpdk-input                       polling          32687202               0      
         0          2.23e2            0.00     100
iptfs-pacer                      polling          32687202               0      
         0          2.83e2            0.00     100
---------------
Thread 2 vpp_wk_1 (lcore 2)
Time 10.9, 10 sec internal node vector rate 2.40
  vector rates in 1.6236e6, out 8.1181e5, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
dpdk-crypto-input                polling           3775633         8925777      
         0          4.04e2            2.36     100
dpdk-esp4-decrypt                active            3714648         8925775      
         0          3.87e2            2.40       0
dpdk-esp4-decrypt-post           active            3714648         8925777      
         0          2.83e2            2.40       0
dpdk-input                       polling           3775633         8925775      
         0          2.75e2            2.36     100
ethernet-input                   active            3714648         8925775      
         0          1.26e2            2.40       0
ip4-input-no-checksum            active            3714648         8925775      
         0          1.58e2            2.40       0
ip4-local                        active            3714648         8925775      
         0          1.28e2            2.40       0
ip4-lookup                       active            3714648         8925775      
         0          1.28e2            2.40       0
ipsec4-if-input                  active            3714648         8925775      
         0          1.39e2            2.40       0
iptfs-decap-reorder              active            3714648         8925777      
         0          5.27e2            2.40       2
---------------
Thread 3 vpp_wk_2 (lcore 3)
Time 10.9, 10 sec internal node vector rate 0.00
  vector rates in 8.1182e5, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
dpdk-crypto-input                polling          56667179               0      
         0          1.23e2            0.00     100
iptfs-zpool-poller               polling          56667179         8925963      
         0          1.18e3             .16       0
---------------
Thread 4 vpp_wk_3 (lcore 4)
Time 10.9, 10 sec internal node vector rate 2.40
  vector rates in 8.1181e5, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
dpdk-crypto-input                polling          52210543               0      
         0          2.76e2            0.00     100
iptfs-decap                      active            3714648         8925775      
         0          3.57e2            2.40     110
---------------
Thread 5 vpp_wk_4 (lcore 5)
Time 10.9, 10 sec internal node vector rate 1.84
  vector rates in 1.6236e6, out 1.6236e6, drop 0.0000e0, punt 0.0000e0
             Name                 State         Calls          Vectors        
Suspends      Packet-Clocks   Vectors/Call
HundredGigabitEthernet65/0/1-o   active            4857443         8925766      
         0          1.57e2            1.84       0
HundredGigabitEthernet65/0/1-t   active            4857443         8925766      
         0          3.96e2            1.84       2
dpdk-crypto-input                polling           4857443         8925766      
         0          4.08e2            1.84     100
dpdk-esp4-encrypt                active            4857443         8925766      
         0          7.01e2            1.84       2
ip4-lookup                       active            4857443         8925766      
         0          1.99e2            1.84       0
ip4-rewrite                      active            4857443         8925766      
         0          1.45e2            1.84       0
iptfs-output                     polling           4857443         8925766      
         0          5.35e2            1.84     100
ID     Name                Type        LWP     Sched Policy (Priority)  lcore  
Core   Socket State
0      vpp_main                        87567   other (0)                0      
0      0
1      vpp_wk_0            workers     87630   other (0)                1      
5      0
2      vpp_wk_1            workers     87631   other (0)                2      
1      0
3      vpp_wk_2            workers     87632   other (0)                3      
4      0
4      vpp_wk_3            workers     87633   other (0)                4      
2      0
5      vpp_wk_4            workers     87634   other (0)                5      
3      0
Model name:               Intel(R) Xeon(R) Silver 4116 CPU @ 2.10GHz
Microarch model (family): [0x6] Skylake ([0x55] Skylake X/SP) stepping 0x4
Flags:                    sse3 pclmulqdq ssse3 sse41 sse42 avx rdrand avx2 rtm 
pqm pqe avx512f rdseed aes invariant_tsc
Base frequency:           2.09 GHz
Pool Name            Index NUMA  Size  Data Size  Total  Avail  Cached   Used
default-numa-0         0     0   10688   10240   100462  84910   1991    13561
Address      Sock VID:PID     Link Speed   Driver          Product Name         
           Vital Product Data
0000:04:00.0   0  14e4:165f   5.0 GT/s x1  tg3             Broadcom NetXtreme 
Gigabit Ether PN: BCM95720
                                                                                
           MN: 1028
                                                                                
           V0: 0x 46 46 56 32 31 2e 34 30 ...
                                                                                
           V1: 0x 44 53 56 31 30 32 38 56 ...
                                                                                
           V2: 0x 4e 50 59 32
                                                                                
           V3: 0x 50 4d 54 31
                                                                                
           V4: 0x 4e 4d 56 42 72 6f 61 64 ...
                                                                                
           V5: 0x 44 54 49 4e 49 43
                                                                                
           V6: 0x 44 43 4d 31 30 30 31 30 ...
                                                                                
           RV: 0x ee 00 00 00 00 00 00 00 ...
0000:04:00.1   0  14e4:165f   5.0 GT/s x1  tg3             Broadcom NetXtreme 
Gigabit Ether PN: BCM95720
                                                                                
           MN: 1028
                                                                                
           V0: 0x 46 46 56 32 31 2e 34 30 ...
                                                                                
           V1: 0x 44 53 56 31 30 32 38 56 ...
                                                                                
           V2: 0x 4e 50 59 32
                                                                                
           V3: 0x 50 4d 54 31
                                                                                
           V4: 0x 4e 4d 56 42 72 6f 61 64 ...
                                                                                
           V5: 0x 44 54 49 4e 49 43
                                                                                
           V6: 0x 44 43 4d 31 30 30 31 30 ...
                                                                                
           RV: 0x ee 00 00 00 00 00 00 00 ...
0000:65:00.0   0  15b3:1017   8.0 GT/s x16 mlx5_core       CX516A - ConnectX-5 
QSFP28      PN: MCX516A-CCAT
                                                                                
           EC: AA
                                                                                
           V2: 0x 4d 43 58 35 31 36 41 2d ...
                                                                                
           SN: MT1934J09467
                                                                                
           V3: 0x 34 65 39 61 34 39 39 34 ...
                                                                                
           VA: 0x 4d 4c 58 3a 4d 4f 44 4c ...
                                                                                
           V0: 0x 50 43 49 65 47 65 6e 33 ...
                                                                                
           RV: 0x b5 00 00
0000:65:00.1   0  15b3:1017   8.0 GT/s x16 mlx5_core       CX516A - ConnectX-5 
QSFP28      PN: MCX516A-CCAT
                                                                                
           EC: AA
                                                                                
           V2: 0x 4d 43 58 35 31 36 41 2d ...
                                                                                
           SN: MT1934J09467
                                                                                
           V3: 0x 34 65 39 61 34 39 39 34 ...
                                                                                
           VA: 0x 4d 4c 58 3a 4d 4f 44 4c ...
                                                                                
           V0: 0x 50 43 49 65 47 65 6e 33 ...
                                                                                
           RV: 0x b5 00 00

Attachment: signature.asc
Description: Message signed with OpenPGP

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#17042): https://lists.fd.io/g/vpp-dev/message/17042
Mute This Topic: https://lists.fd.io/mt/75716056/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Reply via email to