New submission from Petr Viktorin:

There are two "barrier" like abstractions on Lib/logging/handlers.py in the 
_monitor method.

First _monitor has two loops, what is already kind of a hint something is not 
right.

Second, it has two ways to exit the loop, that also exit the thread:
1) The _stop threading.Event is "set"
2) The _sentinel object is added to the queue

The problem is, the documentation says that the correct way to not loose 
records, the stop method must be called, but, the stop method just sets the 
_stop object and then adds the _sentinel object to the queue.

The loop stops when noticing that _stop is set, and then enters a second 
version of the loop, trying again to see the _sentinel object, but this time 
with non blocking read.

The test case shows the problem, but it also hints about the race conditions by 
the fact that running the test case under "taskset 1" works, so, to reproduce 
the issue, run the test under a multiprocessor environment.

The proper solution would be to have a proper locking mechanism, otherwise, the 
_stop object should not be used, and rely only in seeing the _sentinel field; 
this is what the class DeterministicQueueListener does in the test case.


(Reported by Paulo Andrade at 
https://bugzilla.redhat.com/show_bug.cgi?id=1370484 )

----------
components: Library (Lib)
files: test.py
messages: 274139
nosy: encukou, vinay.sajip
priority: normal
severity: normal
status: open
title: logging's QueueListener drops log messages
versions: Python 3.3, Python 3.4, Python 3.5, Python 3.6
Added file: http://bugs.python.org/file44323/test.py

_______________________________________
Python tracker <rep...@bugs.python.org>
<http://bugs.python.org/issue27930>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

Reply via email to