Was this issue ever resolved? What is the current best practice for those
wishing to use a priority queue with multiprocessing?
On Sunday, May 10, 2009 6:35:03 AM UTC-7, Jesse Noller wrote:
> On Sat, May 9, 2009 at 6:11 PM, uuid wrote:
> > The Queue module, apparently, is thread safe, but *not*
Dear Jesse,
thanks for the hint.
I see you are already assigned to the FIFO bug
(http://bugs.python.org/issue4999), so I won't burden you even more.
Clearly, a reliable FIFO behavior of multiprocessing.Queue helps more
than a priority queue, since it can be used to build one, so that
should r
On Sat, May 9, 2009 at 6:11 PM, uuid wrote:
> The Queue module, apparently, is thread safe, but *not* process safe. If you
> try to use an ordinary Queue, it appears inaccessible to the worker process.
> (Which, after all, is quite logical, since methods for moving items between
> the threads of t
The Queue module, apparently, is thread safe, but *not* process safe.
If you try to use an ordinary Queue, it appears inaccessible to the
worker process. (Which, after all, is quite logical, since methods for
moving items between the threads of the same process are quite
different from inter-pr
uuid wrote:
Scott David Daniels wrote:
? "one producer, many consumers" ?
What would the priority queue do? Choose a consumer?
Sorry, I should have provided a little more detail. There is one
producer thread, reading urls from multiple files and external input.
These urls have a certain prio
Scott David Daniels wrote:
>
> ? "one producer, many consumers" ?
> What would the priority queue do? Choose a consumer?
Sorry, I should have provided a little more detail. There is one
producer thread, reading urls from multiple files and external input.
These urls have a certain priority, and
uuid wrote:
Any recommendation on an alternate way to build a priority queue to use
with a "one producer, many consumers" type multiprocessing setup would
be welcomed!
? "one producer, many consumers" ?
What would the priority queue do? Choose a consumer?
--Scott David Daniels
scott.dani...@
I just read up and it seems that no matter the approach, it's futile to
use multiprocessing.Queue, since there is a bug that prevents true
FIFO. (http://bugs.python.org/issue4999)
Any recommendation on an alternate way to build a priority queue to use
with a "one producer, many consumers" type
