Hi Jim in order to enable ZC you should add the zc: prefix to the interface name:
zbalance_ipc -i zc:ens5f0 -m 4 -n 48 -c 99 -g 70 -S 71 -p Alfredo > On 21 Jun 2019, at 00:04, Jim Hranicky <[email protected]> wrote: > > Should have sent this in. PF_RING version v.7.5.0.190404 . > > Jim > > On 6/20/19 3:30 PM, Jim Hranicky wrote: >> I seem to be : >> >> % lsmod | egrep 'pf_ring|ixgbe' >> ixgbe_zc 339253 0 >> pf_ring 1246667 103 ixgbe_zc >> ptp 19231 2 tg3,ixgbe_zc >> >> Still seeing the same behavior with sar: >> >> <root@ewansens2|~> # sar -n DEV 1 4 | grep ens5f0 >> 03:27:05 PM ens5f0 1074552.00 0.00 2394420.68 0.00 0.00 >> 0.00 3.00 >> 03:27:06 PM ens5f0 0.00 0.00 0.00 0.00 0.00 >> 0.00 0.00 >> 03:27:07 PM ens5f0 1093220.00 0.00 2394094.27 0.00 0.00 >> 0.00 8.00 >> 03:27:08 PM ens5f0 0.00 0.00 0.00 0.00 0.00 >> 0.00 0.00 >> Average: ens5f0 541943.00 0.00 1197128.74 0.00 0.00 >> 0.00 2.75 >> >> <root@ewansens2|~> # sar -n EDEV 1 4 | grep ens5f0 >> 03:27:16 PM ens5f0 0.00 0.00 0.00 0.00 0.00 >> 0.00 0.00 0.00 0.00 >> 03:27:17 PM ens5f0 0.00 0.00 0.00 1646283.00 0.00 >> 0.00 0.00 0.00 0.00 >> 03:27:18 PM ens5f0 0.00 0.00 0.00 0.00 0.00 >> 0.00 0.00 0.00 0.00 >> 03:27:19 PM ens5f0 0.00 0.00 0.00 1618365.00 0.00 >> 0.00 0.00 0.00 0.00 >> Average: ens5f0 0.00 0.00 0.00 816162.00 0.00 >> 0.00 0.00 0.00 0.00 >> >> zbalance_ipc is running without throwing any errors: >> >> % ps -ef | grep zbalance >> root 7554 99 06:27 ? 12:12:02 /usr/local/pf/sbin/zbalance_ipc -i ens5f0 -m >> 4 -n 48 -c 99 -g 70 -S 71 -p >> >> Output at start: >> >> 20/Jun/2019 06:27:29 [zbalance_ipc.c:1116] Starting balancer with 48 >> consumer queues.. >> 20/Jun/2019 06:27:29 [zbalance_ipc.c:1126] Run your application instances >> as follows: >> 20/Jun/2019 06:27:29 [zbalance_ipc.c:1131] pfcount -i zc:99@0 >> 20/Jun/2019 06:27:29 [zbalance_ipc.c:1131] pfcount -i zc:99@1 >> >> Jim >> >> On 6/20/19 4:26 AM, Alfredo Cardigliano wrote: >>> Hi Jim >>> please note that you are not using ZC, your adapter is supported by the >>> ixgbe-zc driver, >>> for best performance please configure it following this guide: >>> https://urldefense.proofpoint.com/v2/url?u=http-3A__www.ntop.org_guides_pf-5Fring_get-5Fstarted_packages-5Finstallation.html&d=DwIFAg&c=sJ6xIWYx-zLMB3EPkvcnVg&r=V4XBkE-sKNhwbB4FTyGW0Q&m=aQ70XP8PJ2JSfZ7Uq3B3nHVW3Odt3gEkhvAOp5O6PiI&s=EViEEq_oXhcA_9Idbzm7eCsxLYKENRsp1G6_7HRV4aU&e= >>> >>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__www.ntop.org_guides_pf-5Fring_get-5Fstarted_packages-5Finstallation.html&d=DwIFAg&c=sJ6xIWYx-zLMB3EPkvcnVg&r=V4XBkE-sKNhwbB4FTyGW0Q&m=aQ70XP8PJ2JSfZ7Uq3B3nHVW3Odt3gEkhvAOp5O6PiI&s=EViEEq_oXhcA_9Idbzm7eCsxLYKENRsp1G6_7HRV4aU&e= >>> > >>> >>> Regards >>> Alfredo >>> >>>> On 19 Jun 2019, at 00:11, Jim Hranicky <[email protected]> wrote: >>>> >>>> I've noticed some strange output from sar when running zbalance_ipc. >>>> It seems I only get stats every other second, on odd seconds in this >>>> case: >>>> >>>> % sar -n DEV 1 10 | grep ens5f0 >>>> 05:58:09 PM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s >>>> txcmp/s rxmcst/s >>>> 05:58:09 PM ens5f0 1001033.00 0.00 1440901.59 0.00 0.00 >>>> 0.00 20.00 >>>> 05:58:10 PM ens5f0 0.00 0.00 0.00 0.00 0.00 >>>> 0.00 0.00 >>>> 05:58:11 PM ens5f0 1024305.00 0.00 1422458.64 0.00 0.00 >>>> 0.00 24.00 >>>> 05:58:12 PM ens5f0 0.00 0.00 0.00 0.00 0.00 >>>> 0.00 0.00 >>>> 05:58:13 PM ens5f0 1028284.00 0.00 1567748.74 0.00 0.00 >>>> 0.00 36.00 >>>> 05:58:14 PM ens5f0 0.00 0.00 0.00 0.00 0.00 >>>> 0.00 0.00 >>>> 05:58:15 PM ens5f0 1037512.00 0.00 1568361.43 0.00 0.00 >>>> 0.00 20.00 >>>> 05:58:16 PM ens5f0 0.00 0.00 0.00 0.00 0.00 >>>> 0.00 0.00 >>>> 05:58:17 PM ens5f0 1009894.00 0.00 1482515.69 0.00 0.00 >>>> 0.00 10.00 >>>> 05:58:18 PM ens5f0 0.00 0.00 0.00 0.00 0.00 >>>> 0.00 0.00 >>>> Average: ens5f0 510102.80 0.00 748198.61 0.00 0.00 >>>> 0.00 11.00 >>>> >>>> Checking for drops, I see them on the even seconds: >>>> >>>> % sar -n EDEV 1 10 | grep ens5f0 >>>> 05:58:38 PM IFACE rxerr/s txerr/s coll/s rxdrop/s txdrop/s >>>> txcarr/s rxfram/s rxfifo/s txfifo/s >>>> 05:58:39 PM ens5f0 0.00 0.00 0.00 0.00 0.00 >>>> 0.00 0.00 0.00 0.00 >>>> 05:58:40 PM ens5f0 0.00 0.00 0.00 629536.00 0.00 >>>> 0.00 0.00 0.00 0.00 >>>> 05:58:41 PM ens5f0 0.00 0.00 0.00 0.00 0.00 >>>> 0.00 0.00 0.00 0.00 >>>> 05:58:42 PM ens5f0 0.00 0.00 0.00 517831.00 0.00 >>>> 0.00 0.00 0.00 0.00 >>>> 05:58:43 PM ens5f0 0.00 0.00 0.00 0.00 0.00 >>>> 0.00 0.00 0.00 0.00 >>>> 05:58:44 PM ens5f0 0.00 0.00 0.00 558658.00 0.00 >>>> 0.00 0.00 0.00 0.00 >>>> 05:58:45 PM ens5f0 0.00 0.00 0.00 0.00 0.00 >>>> 0.00 0.00 0.00 0.00 >>>> 05:58:46 PM ens5f0 0.00 0.00 0.00 595583.00 0.00 >>>> 0.00 0.00 0.00 0.00 >>>> 05:58:47 PM ens5f0 0.00 0.00 0.00 0.00 0.00 >>>> 0.00 0.00 0.00 0.00 >>>> 05:58:48 PM ens5f0 0.00 0.00 0.00 588821.00 0.00 >>>> 0.00 0.00 0.00 0.00 >>>> Average: ens5f0 0.00 0.00 0.00 289042.90 0.00 >>>> 0.00 0.00 0.00 0.00 >>>> >>>> ethtool is reporting a lot of missed packets: >>>> >>>> % ethtool -S ens5f0 | egrep 'rx_dropped|rx_missed|rx_packets|errors' >>>> rx_packets: 1775168454257 >>>> rx_errors: 0 >>>> tx_errors: 0 >>>> rx_dropped: 0 >>>> rx_over_errors: 0 >>>> rx_crc_errors: 0 >>>> rx_frame_errors: 0 >>>> rx_fifo_errors: 0 >>>> rx_missed_errors: 1031957653637 >>>> tx_aborted_errors: 0 >>>> tx_carrier_errors: 0 >>>> tx_fifo_errors: 0 >>>> tx_heartbeat_errors: 0 >>>> rx_length_errors: 0 >>>> rx_long_length_errors: 0 >>>> rx_short_length_errors: 0 >>>> rx_csum_offload_errors: 13923182 >>>> fcoe_last_errors: 0 >>>> >>>> zbalance_ipc : >>>> >>>> /usr/local/pf/sbin/zbalance_ipc -i ens5f0 -m 4 -n 48 -c 99 -g 70 -S 71 -p >>>> >>>> 48 snorts are running along with zbalance_ipc . >>>> >>>> Can anyone account for this behavior? Is zbalance_ipc unable to keep up, >>>> or are there config changes I should make? >>>> >>>> Card info : >>>> >>>> 81:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ >>>> Network Connection (rev 01) >>>> >>>> Thanks, >>>> -- >>>> Jim Hranicky >>>> Data Security Specialist >>>> UF Information Technology >>>> >>>> _______________________________________________ >>>> Ntop-misc mailing list >>>> [email protected] >>>> https://urldefense.proofpoint.com/v2/url?u=http-3A__listgateway.unipi.it_mailman_listinfo_ntop-2Dmisc&d=DwIFAg&c=sJ6xIWYx-zLMB3EPkvcnVg&r=V4XBkE-sKNhwbB4FTyGW0Q&m=aQ70XP8PJ2JSfZ7Uq3B3nHVW3Odt3gEkhvAOp5O6PiI&s=ZX__Hj4a-geUCeo2W2b3gpN4o2qSmb8Hiw3aNrGZeD8&e= >>>> >>> >>> >>> >>> _______________________________________________ >>> Ntop-misc mailing list >>> [email protected] >>> https://urldefense.proofpoint.com/v2/url?u=http-3A__listgateway.unipi.it_mailman_listinfo_ntop-2Dmisc&d=DwICAg&c=sJ6xIWYx-zLMB3EPkvcnVg&r=V4XBkE-sKNhwbB4FTyGW0Q&m=aQ70XP8PJ2JSfZ7Uq3B3nHVW3Odt3gEkhvAOp5O6PiI&s=ZX__Hj4a-geUCeo2W2b3gpN4o2qSmb8Hiw3aNrGZeD8&e= >>> >>> >> _______________________________________________ >> Ntop-misc mailing list >> [email protected] >> https://urldefense.proofpoint.com/v2/url?u=http-3A__listgateway.unipi.it_mailman_listinfo_ntop-2Dmisc&d=DwICAg&c=sJ6xIWYx-zLMB3EPkvcnVg&r=V4XBkE-sKNhwbB4FTyGW0Q&m=LF-8RGmNT3RBgHTIWnB5S_YucaJYB9eu6KGxofRcOCk&s=MvuxbrqnKoewXCWvX4mpbE3WtGKBwJ9n2vSoGAxPPBI&e= >> >> _______________________________________________ Ntop-misc mailing list [email protected] http://listgateway.unipi.it/mailman/listinfo/ntop-misc
