[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Changes by Brian Curtin : -- nosy: -brian.curtin ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.p

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Changes by Steven Myint : -- nosy: +myint ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.or

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Changes by Ned Deily : -- nosy: +sbt ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mai

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Markus Unterwaditzer added the comment: Can this issue or #9205 be reopened as this particular instance of the problem doesn't seem to be resolved? I still seem to need the workaround from http://stackoverflow.com/a/1408476 -- nosy: +untitaker ___ P

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Changes by Martin Dengler : -- nosy: +mdengler ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.pyth

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Antoine Pitrou added the comment: Note that #9205 fixed concurrent.futures, but not multiprocessing.Pool which is a different kettle of fish. -- nosy: +pitrou ___ Python tracker ___

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Vinay Sajip added the comment: Closing, as Andrey Vlasovskikh has agreed that this is a duplicate of #9205. -- nosy: +vinay.sajip resolution: -> duplicate status: open -> closed ___ Python tracker

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Changes by Gökçen Eraslan : -- nosy: +Gökçen.Eraslan ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Changes by Greg Brockman : -- nosy: +gdb ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Andrey Vlasovskikh added the comment: > On closer look your patch is also ignoring SystemExit. I think it's > beneficial to honor SystemExit, so a user could use this as a means to > replace the current process with a new one. Yes, SystemExit should cancel all the tasks that are currently in

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Jesse Noller added the comment: > If we keep that behavior, the real problem here is that the > result handler hangs if the process that reserved a job is gone, which is > going to be handled > by #9205. Should we mark it as a duplicate? I would tend to agree with your assessment; we're better

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Ask Solem added the comment: On closer look your patch is also ignoring SystemExit. I think it's beneficial to honor SystemExit, so a user could use this as a means to replace the current process with a new one. If we keep that behavior, the real problem here is that the result handler hangs

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Ask Solem added the comment: This is related to our discussions at #9205 as well (http://bugs.python.org/issue9205), as the final patch there will also fix this issue. -- ___ Python tracker __

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Changes by Brian Curtin : -- nosy: +asksol ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.or

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Albert Strasheim added the comment: Any chance of getting this patch applied? Thanks. -- ___ Python tracker ___ ___ Python-bugs-list m

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Changes by Albert Strasheim : -- nosy: +Albert.Strasheim ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: http://

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Changes by Brian Curtin : -- nosy: +jnoller ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.o

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Andrey Vlasovskikh added the comment: Here is a patch that fixes this problem. Basically, it catches all the BaseExceptions that could happen during: a) getting a task from the `inqueue`, b) calling a user function, c) putting a task into the `outqueue`. The exception handler puts the excepti

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Changes by Andrey Vlasovskikh : Removed file: http://bugs.python.org/file16743/test_pool_keyboardinterrupt.py ___ Python tracker ___ ___ Python

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Andrey Vlasovskikh added the comment: Despite of several workarounds available on the Web, the problem persists. Almost any exception that is rised in `worker` function while putting or getting tasks from queues result in Pool hang up. Currently, `worker` is only aware of Exception descendant

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Andrey Vlasovskikh added the comment: Yes, I've come up with the same solution by myself, but it cannot cover all the cases of the bug. It works only for cases when ^C is hit during a call to the users' function: http://stackoverflow.com/questions/1408356/keyboard-interrupts-with-pythons-mult

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Brian Curtin added the comment: You might want to take a look here: http://jessenoller.com/2009/01/08/multiprocessingpool-and-keyboardinterrupt/ -- ___ Python tracker ___ __

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Andrey Vlasovskikh added the comment: Yes, here is my test case. -- Added file: http://bugs.python.org/file16743/test_pool_keyboardinterrupt.py ___ Python tracker ___ ___

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

Brian Curtin added the comment: Do you have a test case which can reproduce the issue? -- nosy: +brian.curtin stage: -> test needed type: crash -> behavior ___ Python tracker __

[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt

New submission from Andrey Vlasovskikh : multiprocessing.Pool methods map, imap, etc. are said to be able to normally handle exceptions. But it seems that it is true only for synchronous exceptions inside their first func arguments. When (typically during a long-running parallel map) a user hi