On Mon, Feb 12, 2024 at 6:37 AM Sri kor <esrik...@gmail.com> wrote:
> Thanks Ales! > There are cases where some logical_routers have more MAC_binding entries > and need to be flush more frequently than others. In cases like noisy > neighbors, bloating mac_binding table, We may need to increase the > frequency of flushing mac_binding table for that specific logical_router. > If we want to flush the percentage of mac_binding entries per > logical_router, is it possible to configure mac_binding_removal_limit in > terms of the percentage of entries of LR? > Unfortunately not, that would require code change at the moment. > > Our scale is big, When we trigger flushing mac entries for all LRs at a > single point of time, that triggers lot of cpu load on ovn central because > of ARP learning. Is it possible to trigger flushing MAC_binding table > entries of each LR at different times? > With the mac_binding_removal_limit configured the load should spread out over time, because there is a forced timeout of 5 seconds after the limit is reached. What might be helpful is the recent addition of configuring the aging not only for specific LR but also for specific CIDR within that LR [0]. > > Thanks > Srini > > > On Tue, Feb 6, 2024 at 10:45 PM Ales Musil <amu...@redhat.com> wrote: > >> >> >> On Tue, Feb 6, 2024 at 6:30 PM Sri kor <esrik...@gmail.com> wrote: >> >>> Thanks Akes for your inputs. >>> I have been monitoring all the table update using ovsdb-mon >>> <https://github.com/amorenoz/ovsdb-mon> . I dont see any addition or >>> deletion in MAC_binding table updates. I have been running this script >>> overnight. There was no change in the count and the table entries. I am >>> suspecting that I might have missed some configuration parameter. I am >>> referring here >>> <https://github.com/ovn-org/ovn/blob/branch-23.09/northd/aging.c#L116> >>> >>> *_uuid : 82d23fff-c341-451f-9208-4429a1b204ec* >>> >>> *datapath : 99b6b710-80f9-432b-8c96-0f99d2dea8da* >>> >>> *ip : "172.27.6.45"* >>> >>> *logical_port : >>> a_ed1328b3_0bb2_4af0_a648_0f01b0363a9e_lrp_8c9bff10_2ae8_4fef_8720_dcde1a5e54dd* >>> >>> *mac : "7e:2e:7f:6b:32:54"* >>> >>> *timestamp : 1705947447229* >>> >>> >>> *[root@ovnkube-db-0 ~]# ovsdb-client get-schema-version >>> tcp:10.71.1.2:6642 <http://10.71.1.2:6642> --no-leader-only20.29.0* >>> >>> >> I'm sorry I should have spotted the mistake right away. It is indeed the >> wrong configuration. Both options are supposed to be set per logical router >> [0] instead of NB_Global table. >> >> >>> >>> On Tue, Feb 6, 2024 at 4:02 AM Ales Musil <amu...@redhat.com> wrote: >>> >>>> >>>> >>>> On Tue, Feb 6, 2024 at 1:23 AM Sri kor via discuss < >>>> ovs-discuss@openvswitch.org> wrote: >>>> >>>>> Hi Team, >>>>> >>>>> I have configured mac_binding_age_threshold to 1sec and >>>>> mac_binding_removal_limit="5000". I was expecting mac_binding table >>>>> entries >>>>> to be flushed, but it's not happening. We are currently using 23.09.1. Is >>>>> it a known issue ? >>>>> Please advise from below logs. >>>>> >>>> >>>> Hi, >>>> in 23.09 we added a mechanism that will refresh MAC bindings that are >>>> still in use [0]. Is it possible that there is some traffic flowing which >>>> will keep those MAC bindings alive? >>>> It also might be a coincidence, but deleted mac bindings might be >>>> populated back again so the overall count is the same. I would suggest >>>> monitoring MAC binding doesn't have any traffic flowing to see if it goes >>>> away. >>>> >>>> Also the mac_binding_removal_limit option imposes delay for deletion. >>>> If this limit is reached next aging can happen only after 5 seconds. >>>> >>>> >>>>> >>>>> thanks, >>>>> Srini >>>>> [root@ovnkube-db-0 log]# ovn-nbctl --version >>>>> ovn-nbctl 23.09.1 >>>>> Open vSwitch Library 3.2.2 >>>>> DB Schema 7.1.0 >>>>> >>>>> [root@ovnkube-db-0 log]# ovn-nbctl --no-leader-only find NB_global >>>>> _uuid : d01b9c57-29c5-4b86-8de5-c03a9f30825b >>>>> connections : [6c9c0c05-af2a-43ab-9164-24588e8b0a3c] >>>>> external_ids : {} >>>>> hv_cfg : 12935 >>>>> hv_cfg_timestamp : 1705104326732 >>>>> ipsec : false >>>>> name : "" >>>>> nb_cfg : 13573 >>>>> nb_cfg_timestamp : 1707178571143 >>>>> options : {mac_binding_age_threshold="1", >>>>> mac_binding_removal_limit="5000", mac_prefix="fe:58:59", >>>>> max_tunid="16711680", northd_internal_version="23.09.1-20.29.0-71.6", >>>>> northd_probe_interval="5000", ovn-garp-max-timeout-sec="60", >>>>> svc_monitor_mac="5a:7f:14:6c:47:da"} >>>>> sb_cfg : 13573 >>>>> sb_cfg_timestamp : 1707178571869 >>>>> ssl : [] >>>>> [root@ovnkube-db-0 log]# ovn-Sbctl --no-leader-only find SB_global >>>>> bash: ovn-Sbctl: command not found >>>>> [root@ovnkube-db-0 log]# ovn-sbctl --no-leader-only find SB_global >>>>> _uuid : 8bb031f1-a428-449d-9559-c4c326e91f2d >>>>> connections : [a501a7ba-8970-4dc3-94db-0088ab951aa5] >>>>> external_ids : {} >>>>> ipsec : false >>>>> nb_cfg : 13573 >>>>> options : {mac_binding_age_threshold="1", >>>>> mac_binding_removal_limit="5000", mac_prefix="fe:58:59", >>>>> max_tunid="16711680", northd_internal_version="23.09.1-20.29.0-71.6", >>>>> northd_probe_interval="5000", ovn-garp-max-timeout-sec="60", >>>>> svc_monitor_mac="5a:7f:14:6c:47:da"} >>>>> ssl : [] >>>>> [root@ovnkube-db-0 ~]# while true; do ovn-sbctl --no-leader-only >>>>> list MAC_Binding | grep mac | wc; sleep 10;done >>>>> 10546 31638 442932 >>>>> 10546 31638 442932 >>>>> 10546 31638 442932 >>>>> 10546 31638 442932 >>>>> 10546 31638 442932 >>>>> 10546 31638 442932 >>>>> 10546 31638 442932 >>>>> _______________________________________________ >>>>> discuss mailing list >>>>> disc...@openvswitch.org >>>>> https://mail.openvswitch.org/mailman/listinfo/ovs-discuss >>>>> >>>> >>>> Hopefully some of this is helpful. >>>> >>>> Best regards, >>>> Ales >>>> >>>> [0] >>>> https://github.com/ovn-org/ovn/commit/e1ab41ee32aa2782db82406b8bd9cda0e1fabc3c >>>> >>>> >>>> -- >>>> >>>> Ales Musil >>>> >>>> Senior Software Engineer - OVN Core >>>> >>>> Red Hat EMEA <https://www.redhat.com> >>>> >>>> amu...@redhat.com >>>> <https://red.ht/sig> >>>> >>> >> Best regards, >> Ales >> >> [0] https://github.com/ovn-org/ovn/blob/branch-23.09/ovn-nb.xml#L165 >> -- >> >> Ales Musil >> >> Senior Software Engineer - OVN Core >> >> Red Hat EMEA <https://www.redhat.com> >> >> amu...@redhat.com >> <https://red.ht/sig> >> > Best regards, Ales [0] https://github.com/ovn-org/ovn/blob/main/ovn-nb.xml#L2696 -- Ales Musil Senior Software Engineer - OVN Core Red Hat EMEA <https://www.redhat.com> amu...@redhat.com <https://red.ht/sig>
_______________________________________________ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
