[Python-buildbots] Worker failures and restart

2021-08-16 Thread David Edelsohn
Yesterday, a large number of buildbots entered an error state. There has been no comment here. I see that some of the failing buildbots have recovered. I don't know if they explicitly were restarted, e.g., cstratak-RHEL8-ppc64le. The AIX and MacOS builders remain paused. I have restarted the A

[Python-buildbots] Re: Worker failures and restart

2021-08-16 Thread Charalampos Stratakis
I've checked the buildbot and it seems that no one ssh'ed into it while the issue was resolved so there was no intervention from the client side. On Mon, Aug 16, 2021 at 2:47 PM David Edelsohn wrote: > Yesterday, a large number of buildbots entered an error state. There > has been no comment he

[Python-buildbots] Re: Worker failures and restart

2021-08-16 Thread Victor Stinner
The traceback looks like a legit bug in Buildbot. You can try to report it to Buildbot: https://github.com/buildbot/buildbot Victor On Mon, Aug 16, 2021 at 2:47 PM David Edelsohn wrote: > > Yesterday, a large number of buildbots entered an error state. There > has been no comment here. I see t

[Python-buildbots] Re: Worker failures and restart

2021-08-16 Thread Victor Stinner
Some Twisted logs. I replaced the IP address with or in logs. I don't know what is the worker 52.179.5.160 which creates an Unicode error. 2021-08-16 12:34:45+ [Broker,] Got workerinfo from 'koobs-freebsd-9e36' 2021-08-16 12:34:45+ [Broker,] worker koobs-freebsd-9e36 cannot attach