Hello Vladislav I appreciate your reply, yes indeed we are in the process of migration from 22.03 to 24.03 (I would say the fix you’ve mentioned is there), yes, truly we do observe the performance boost approx. 4 times Vanilla 22.03 vs Vanilla 24.03. This is great. The problem is that in is the large scale the boost in 4 times will be consumed quite shortly and we again will confront the problem of 100% CPU for NorthD Thus, looking further I am searching for a solution that would allow us make an additional grouping for Logical_DB_Groups, if possible, perhaps specific for our custom installation, that would completely close the case with the scaling.
Yours truly, George From: Vladislav Odintsov <odiv...@gmail.com> Date: Thursday, 28 March 2024, 17:13 To: Шагов Георгий <gmsha...@cloud.ru> Cc: "ovs-discuss@openvswitch.org" <ovs-discuss@openvswitch.org> Subject: Re: [ovs-discuss] Huge Logical_DP_Groups; NorthD 100% CPU ВНИМАНИЕ! ВНЕШНИЙ ОТПРАВИТЕЛЬ Если отправитель почты неизвестен, не переходите по ссылкам, не сообщайте пароль, не запускайте вложения и сообщите коллегам из ЦКЗ на secur...@cloud.ru<mailto:secur...@cloud.ru> Hi George, do you experience these problems with 22.03 version? If yes, you may want try patch by Ilya [1], which is a part of 23.09 release. Shortly, there was a problem where a new datapath in OVN caused a full re-create of datapath_groups, which results in a huge ovsdb transaction. 1: https://github.com/ovn-org/ovn/commit/2a57b204459612a9a4edb49b9c5ebc44e101ee93 On 28 Mar 2024, at 16:24, Шагов Георгий via discuss <ovs-discuss@openvswitch.org> wrote: Hello everyone In our setup (*) we have encountered a problem with NorthD consuming 100% CPU Looking into transaction log of SBDB it was found that some transactions from NorthD take almost 2Mb in Json; these are not exception, rather regular Looking deeply into the transaction we have encountered Huge Logical_DP_Group Record, More in details: 2Mb Json SBDB Transaction Record was parsed by json_pp to json file, that takes 157K Lines, from which 152K Lines – Logical_DP_Group That Logical_DP_Group record contains of 10 Groups into it. Approx 4K dp per every group Googling for a similar case I have found one, that looked close to our: (link1) – this is not our case – we checked that Unfortunately, the basic information regarding Logical DB Groups is well documented into the code of NorthD Any clue/help/questions are extremely appreciated (*) Setup: - OVN 22.03.3 – we are in process of migrating to 24.03 - OVS 2.17.7 – the same for 3.3 - Routers – approx. 5K (link1): https://github.com/ovn-org/ovn/commit/db4cb7098c890e974175d4d05dd70dc409fad91e Yours truly, George УВЕДОМЛЕНИЕ О КОНФИДЕНЦИАЛЬНОСТИ: Это электронное сообщение и любые документы, приложенные к нему, содержат конфиденциальную информацию. Настоящим уведомляем Вас о том, что если это сообщение не предназначено Вам, использование, копирование, распространение информации, содержащейся в настоящем сообщении, а также осуществление любых действий на основе этой информации, строго запрещено. Если Вы получили это сообщение по ошибке, пожалуйста, сообщите об этом отправителю по электронной почте и удалите это сообщение. CONFIDENTIALITY NOTICE: This email and any files attached to it are confidential. If you are not the intended recipient you are notified that using, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited. If you have received this email in error please notify the sender and delete this email. _______________________________________________ discuss mailing list disc...@openvswitch.org<mailto:disc...@openvswitch.org> https://mail.openvswitch.org/mailman/listinfo/ovs-discuss Regards, Vladislav Odintsov УВЕДОМЛЕНИЕ О КОНФИДЕНЦИАЛЬНОСТИ: Это электронное сообщение и любые документы, приложенные к нему, содержат конфиденциальную информацию. Настоящим уведомляем Вас о том, что если это сообщение не предназначено Вам, использование, копирование, распространение информации, содержащейся в настоящем сообщении, а также осуществление любых действий на основе этой информации, строго запрещено. Если Вы получили это сообщение по ошибке, пожалуйста, сообщите об этом отправителю по электронной почте и удалите это сообщение. CONFIDENTIALITY NOTICE: This email and any files attached to it are confidential. If you are not the intended recipient you are notified that using, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited. If you have received this email in error please notify the sender and delete this email.
_______________________________________________ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
