[issue42097] Python 3.7.9 logging/threading/fork hang

2020-10-26 Thread Andrew de Quincey
Andrew de Quincey added the comment: Hi, sorry, I was ill on Friday, apologies for the delayed reply. We're not using os.fork() directly, and I'm afraid the multiprocessing thing I mentioned was a bit of a red herring. We're using a capped pool of threads to spawn subp

[issue42097] Python 3.7.9 logging/threading/fork hang

2020-10-20 Thread Andrew de Quincey
Change by Andrew de Quincey : Removed file: https://bugs.python.org/file49531/test.py ___ Python tracker <https://bugs.python.org/issue42097> ___ ___ Python-bugs-list m

[issue42097] Python 3.7.9 logging/threading/fork hang

2020-10-20 Thread Andrew de Quincey
Andrew de Quincey added the comment: Before anyone suggests it might be the logstash code we're calling in the comment, it ain't. The bug is easily replicated using entirely python built in code. See test.py attached. If you're having trouble triggering it (seems to v

[issue42097] Python 3.7.9 logging/threading/fork hang

2020-10-20 Thread Andrew de Quincey
Andrew de Quincey added the comment: My colleague reports it does happen on their Mac as well, but that it took about 50 tries for it to trigger. -- ___ Python tracker <https://bugs.python.org/issue42

[issue42097] Python 3.7.9 logging/threading/fork hang

2020-10-20 Thread Andrew de Quincey
Andrew de Quincey added the comment: Debugging a bit more shows our code is deadlocked at: File "/usr/lib/python3.7/logging/__init__.py", line 219, in _acquireLock _lock.acquire() File "/usr/lib/python3.7/logging/config.py", line 501, in configure logging._

[issue42097] Python 3.7.9 logging/threading/fork hang

2020-10-20 Thread Andrew de Quincey
New submission from Andrew de Quincey : We've been having some mysterious hangs in our threaded code. Debugging with GDB shows it ends up deadlocking during logging inside logging._acquireLock() I googled and found someone else with the same issue: https://stackoverflow.com/ques