On 8/31/22 08:24, Oleksandr Mykhalskyi wrote: > Hello, Ilya > It`s great news, thank you a lot! > > Regarding testing - I am not sure, we are using OVS in containers, prepared > by openstack kola team. > I will try to build OVS from source in proper way, to test the patch, and > give you feedback.
Thanks! For now, I think, I'll go ahead and apply the fix, since it was reviewed and it is more or less obviously correct. But it would still be great to see a confirmation that it fixes your issue. Best regards, Ilya Maximets. > > Thank you. > > -----Original Message----- > From: Ilya Maximets <i.maxim...@ovn.org> > Sent: Saturday, August 20, 2022 2:12 AM > To: Oleksandr Mykhalskyi <oleksandr.mykhals...@netcracker.com> > Cc: i.maxim...@ovn.org; ovs-discuss@openvswitch.org; Dan Williams > <d...@redhat.com>; Terry Wilson <twil...@redhat.com> > Subject: Re: [ovs-discuss] Unreasonably often OVS DB compaction > > [External Email] > ________________________________ > > > > On 8/18/22 11:44, Oleksandr Mykhalskyi wrote: >> Good day, Ilya >> >> Here are part of logs from one of cloud controllers with OVN databases (OVS >> version 2.15.2): >> >> 2022-07-31T06:43:34.501Z|22618|raft|INFO|Transferring leadership to write a >> snapshot. >> 2022-07-31T06:43:40.344Z|22620|ovsdb|INFO|OVN_Southbound: Database >> compaction took 5178ms >> 2022-07-31T06:53:30.735Z|22823|raft|INFO|received leadership transfer from >> 3d60 in term 7198 2022-07-31T06:57:39.616Z|23004|raft|INFO|Transferring >> leadership to write a snapshot. >> 2022-07-31T06:57:43.860Z|23007|ovsdb|INFO|OVN_Southbound: Database >> compaction took 4210ms >> 2022-07-31T07:12:02.552Z|23065|raft|INFO|received leadership transfer from >> 3d60 in term 7200 2022-07-31T07:12:20.060Z|23076|raft|INFO|Transferring >> leadership to write a snapshot. >> 2022-07-31T07:12:27.262Z|23097|ovsdb|INFO|OVN_Southbound: Database >> compaction took 4003ms >> 2022-07-31T07:24:29.820Z|23162|raft|INFO|received leadership transfer from >> 3d60 in term 7202 2022-07-31T07:32:25.125Z|23382|raft|INFO|Transferring >> leadership to write a snapshot. >> 2022-07-31T07:32:29.196Z|23384|ovsdb|INFO|OVN_Southbound: Database >> compaction took 4044ms >> 2022-07-31T07:37:03.280Z|23406|raft|INFO|received leadership transfer from >> 3d60 in term 7204 2022-07-31T07:46:00.005Z|23636|raft|INFO|Transferring >> leadership to write a snapshot. >> 2022-07-31T07:46:03.997Z|23638|ovsdb|INFO|OVN_Southbound: Database >> compaction took 3972ms >> 2022-07-31T07:48:39.696Z|23655|raft|INFO|received leadership transfer from >> 3d60 in term 7206 2022-07-31T07:59:23.896Z|23866|raft|INFO|Transferring >> leadership to write a snapshot. >> 2022-07-31T07:59:28.056Z|23869|ovsdb|INFO|OVN_Southbound: Database >> compaction took 4134ms >> 2022-07-31T08:07:04.581Z|23976|raft|INFO|received leadership transfer from >> 3d60 in term 7208 2022-07-31T08:18:58.858Z|24220|raft|INFO|Transferring >> leadership to write a snapshot. >> 2022-07-31T08:19:02.964Z|24222|ovsdb|INFO|OVN_Southbound: Database >> compaction took 4070ms >> 2022-07-31T08:19:21.872Z|24276|raft|INFO|received leadership transfer from >> 3d60 in term 7210 2022-07-31T08:37:12.292Z|24579|raft|INFO|Transferring >> leadership to write a snapshot. >> 2022-07-31T08:37:16.214Z|24581|ovsdb|INFO|OVN_Southbound: Database >> compaction took 3899ms >> 2022-07-31T08:37:37.502Z|24598|raft|INFO|received leadership transfer from >> 3d60 in term 7212 2022-07-31T08:47:55.412Z|24791|raft|INFO|Transferring >> leadership to write a snapshot. >> 2022-07-31T08:47:59.465Z|24793|ovsdb|INFO|OVN_Southbound: Database >> compaction took 4033ms >> >> Just after compaction, DB size is 105Mb, after that DB grows to 106-107Mb in >> 10-20min, and we have compaction again. >> >> Full story: >> 2022-07-30 06:43 - I updated cloud and restarted OVN SB DB cluster. There >> were no compactions during that day. >> 2022-07-31 06:43 - DB triggered first compaction after reboot and then >> started to do it each 10-20min. >> 2022-07-31 17:00 - I restarted DB cluster again. >> 2022-08-01 15:00 - DB triggered first compaction after reboot, when DB size >> was 210MB, and started to do compaction again, each 10-20min. > > Thanks! I think, I found a 'typo' that caused the issue. > Posted a fix here: > > https://patchwork.ozlabs.org/project/openvswitch/patch/20220819230810.2626573-1-i.maxim...@ovn.org/ > > Would be great if you can test it out. > > Best regards, Ilya Maximets. > >> >> Thank you. >> >> Oleksandr Mykhalskyi, System Engineer, IT Servers and Services, LAUT >> Netcracker Technology >> >> +38 (044) 238-8727 ext 6404 | office >> >> >> -----Original Message----- >> From: Ilya Maximets <i.maxim...@ovn.org> >> Sent: Wednesday, August 17, 2022 3:46 PM >> To: Oleksandr Mykhalskyi <oleksandr.mykhals...@netcracker.com> >> Cc: i.maxim...@ovn.org; ovs-discuss@openvswitch.org; Dan Williams >> <d...@redhat.com>; Terry Wilson <twil...@redhat.com> >> Subject: Re: [ovs-discuss] Unreasonably often OVS DB compaction >> >> [External Email] >> ________________________________ >> >> >> >>> Terry, thank you for update. >>> I will check if openstack xena or yoga uses OVS 2.17 >>> >>> Meanwhile, my main concern - why OVS DB triggers compaction every 10-20min >>> regardless of conditions, described in >>> http://www.openvswitch.org/support/dist-docs/ovsdb-server.1.txt? >>> For our case, with OVN DB DB size 105Mb (after first compaction), I am >>> expecting to have next compaction after reaching DB size 210Mb, but not >>> after 106-107Mb. >> >> >> Hi, Oleksandr. >> >> That doesn't sound right indeed. I've never seen that behavior and I'm not >> sure how that can happen. >> >> How do you detect that DB is compacting? Are you looking for a message >> regarding a leadership transfer or, maybe, reports about time it took to >> compact? If you can provide some parts of ovsdb-server logs, that might >> also be useful. >> >> Best regards, Ilya Maximets. >> >> >> ________________________________ >> The information transmitted herein is intended only for the person or entity >> to which it is addressed and may contain confidential, proprietary and/or >> privileged material. Any review, retransmission, dissemination or other use >> of, or taking of any action in reliance upon, this information by persons or >> entities other than the intended recipient is prohibited. If you received >> this in error, please contact the sender and delete the material from any >> computer. > > > > ________________________________ > The information transmitted herein is intended only for the person or entity > to which it is addressed and may contain confidential, proprietary and/or > privileged material. Any review, retransmission, dissemination or other use > of, or taking of any action in reliance upon, this information by persons or > entities other than the intended recipient is prohibited. If you received > this in error, please contact the sender and delete the material from any > computer. _______________________________________________ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
