Public bug reported: With latest eventlet bump to 0.38.2 with https://review.opendev.org/c/openstack/requirements/+/933257 rally ovn job timing out[1] and blocking neutron gate.
>From logs seeing couple of errors like:- RuntimeError: Second simultaneous write on fileno 9 detected. Unless you really know what you're doing, make sure that only one greenthread can write any particular socket. Consider using a pools.Pool. If you do know what you're doing and want to disable this error, call eventlet.debug.hub_prevent_multiple_readers(False) - MY THREAD=<built-in method switch of GreenThread object at 0x76e6b4b9f4c0>; THAT THREAD=FdListener('write', 9, <built-in method switch of GreenThread object at 0x76e6af781e80>, <built-in method throw of GreenThread object at 0x76e6af781e80>) and ovsdbapp.exceptions.TimeoutException: Commands [DeleteLRouterExtGwCommand(_result=None, lrouter=neutron-99811269-9e53-4e73-85c2-4f5f8113cf70, if_exists=True, maintain_bfd=True), LrDelCommand(_result=None, router=neutron-99811269-9e53-4e73-85c2-4f5f8113cf70, if_exists=True)] exceeded timeout 180 seconds, cause: TXN queue is full [1] https://zuul.opendev.org/t/openstack/builds?job_name=neutron-ovn- rally-task&project=openstack%2Fneutron&result=TIMED_OUT&skip=0 ** Affects: neutron Importance: Critical Status: Confirmed ** Tags: ovn ** Changed in: neutron Status: New => Confirmed ** Changed in: neutron Importance: Undecided => Critical ** Tags added: ovn -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/2094970 Title: rally ovn job timing out with eventlet 0.38.2 Status in neutron: Confirmed Bug description: With latest eventlet bump to 0.38.2 with https://review.opendev.org/c/openstack/requirements/+/933257 rally ovn job timing out[1] and blocking neutron gate. From logs seeing couple of errors like:- RuntimeError: Second simultaneous write on fileno 9 detected. Unless you really know what you're doing, make sure that only one greenthread can write any particular socket. Consider using a pools.Pool. If you do know what you're doing and want to disable this error, call eventlet.debug.hub_prevent_multiple_readers(False) - MY THREAD=<built-in method switch of GreenThread object at 0x76e6b4b9f4c0>; THAT THREAD=FdListener('write', 9, <built-in method switch of GreenThread object at 0x76e6af781e80>, <built-in method throw of GreenThread object at 0x76e6af781e80>) and ovsdbapp.exceptions.TimeoutException: Commands [DeleteLRouterExtGwCommand(_result=None, lrouter=neutron-99811269-9e53-4e73-85c2-4f5f8113cf70, if_exists=True, maintain_bfd=True), LrDelCommand(_result=None, router=neutron-99811269-9e53-4e73-85c2-4f5f8113cf70, if_exists=True)] exceeded timeout 180 seconds, cause: TXN queue is full [1] https://zuul.opendev.org/t/openstack/builds?job_name=neutron-ovn- rally-task&project=openstack%2Fneutron&result=TIMED_OUT&skip=0 To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/2094970/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp