Re: python multiprocessing

2017-10-09 Thread dieter
Xristos Xristoou writes: > I have three functions in the python that each one puts an image (image path) > as input and makes a simple image processing and creates a new image (image > path) as output. In order to make effective use of multiprocessing, you need to split your complete task into

python multiprocessing

2017-10-07 Thread Xristos Xristoou
them using python multiprocessing. I have read about multiprocessing map and pool but I was pretty confused . whenever I summarize I have three interdependent functions and I would like to run them together if done. I would also like to know how I would perform these three functions in a

python multiprocessing question

2017-09-03 Thread Xristos Xristoou
hello i have create a 4 function using python(f1,f2,f3,f4) and i have 4 cores in my system. def f1() ... ... def f2() ... ... def f3() ... ... def f4() ... .

Graceful exit from Python + multiprocessing daemons

2016-05-20 Thread deva . seetharam
Hello, Greetings! I would like to get your advice wrt following situation: I have a Linux daemon written in python (version 2.7) using the python-daemon (https://pypi.python.org/pypi/python-daemon) module. The objective of using python daemon is to run as an init.d script in Linux. This gets i

Re: Help with Python Multiprocessing

2014-11-24 Thread sohcahtoa82
On Sunday, November 23, 2014 12:56:51 PM UTC-8, Anurag wrote: > Hey Socha, > Your solution works. But then, all my 3 workers are running in a single > command window. How do I make them run in three different command windows? That, I don't know. You would probably need to open a new command wind

Re: Help with Python Multiprocessing

2014-11-23 Thread Anurag
Hey Socha, Your solution works. But then, all my 3 workers are running in a single command window. How do I make them run in three different command windows? -- https://mail.python.org/mailman/listinfo/python-list

Re: Help with Python Multiprocessing

2014-11-14 Thread sohcahtoa82
On Thursday, November 13, 2014 3:22:49 PM UTC-8, Anurag wrote: > On Thursday, November 13, 2014 2:18:50 PM UTC-5, sohca...@gmail.com wrote: > > On Thursday, November 13, 2014 10:07:56 AM UTC-8, Anurag wrote: > > > I am having trouble understanding the Multiprocessing module. > > > I need to run thr

Re: Help with Python Multiprocessing

2014-11-13 Thread Anurag
On Thursday, November 13, 2014 2:22:29 PM UTC-5, Gary Herron wrote: > On 11/13/2014 10:07 AM, Anurag wrote: > > I am having trouble understanding the Multiprocessing module. > > I need to run three different files 'Worker1' , 'Worker2', 'Worker3' all at > > once. Currently I am doing this : > > >

Re: Help with Python Multiprocessing

2014-11-13 Thread Anurag
On Thursday, November 13, 2014 2:18:50 PM UTC-5, sohca...@gmail.com wrote: > On Thursday, November 13, 2014 10:07:56 AM UTC-8, Anurag wrote: > > I am having trouble understanding the Multiprocessing module. > > I need to run three different files 'Worker1' , 'Worker2', 'Worker3' all at > > once. C

Re: Help with Python Multiprocessing

2014-11-13 Thread Gary Herron
On 11/13/2014 10:07 AM, Anurag wrote: I am having trouble understanding the Multiprocessing module. I need to run three different files 'Worker1' , 'Worker2', 'Worker3' all at once. Currently I am doing this : from multiprocessing import Process import Worker1.py import Worker2.py import Worke

Re: Help with Python Multiprocessing

2014-11-13 Thread sohcahtoa82
On Thursday, November 13, 2014 10:07:56 AM UTC-8, Anurag wrote: > I am having trouble understanding the Multiprocessing module. > I need to run three different files 'Worker1' , 'Worker2', 'Worker3' all at > once. Currently I am doing this : > > from multiprocessing import Process > > import Wor

Re: Help with Python Multiprocessing

2014-11-13 Thread MRAB
On 2014-11-13 18:10, Anurag wrote: On Thursday, November 13, 2014 1:07:56 PM UTC-5, Anurag wrote: I am having trouble understanding the Multiprocessing module. I need to run three different files 'Worker1' , 'Worker2', 'Worker3' all at once. Currently I am doing this : from multiprocessing imp

Re: Help with Python Multiprocessing

2014-11-13 Thread Anurag
On Thursday, November 13, 2014 1:07:56 PM UTC-5, Anurag wrote: > I am having trouble understanding the Multiprocessing module. > I need to run three different files 'Worker1' , 'Worker2', 'Worker3' all at > once. Currently I am doing this : > > from multiprocessing import Process > > import Work

Help with Python Multiprocessing

2014-11-13 Thread Anurag
I am having trouble understanding the Multiprocessing module. I need to run three different files 'Worker1' , 'Worker2', 'Worker3' all at once. Currently I am doing this : from multiprocessing import Process import Worker1.py import Worker2.py import Worker3.py p1 = Process(target=Worker1.py)

Re: Finding the source of an exception in a python multiprocessing program

2013-04-25 Thread Neil Cerutti
raise self._value >> >> The code that's failing is in self.wait. Somewhere in there you >> must be masking an exception and storing it in self._value >> instead of letting it propogate and crash your program. This is >> hiding the actual context. > > I

Re: Finding the source of an exception in a python multiprocessing program

2013-04-24 Thread Dave Angel
On 04/24/2013 08:00 PM, Oscar Benjamin wrote: On 25 April 2013 00:26, Dave Angel wrote: On 04/24/2013 05:09 PM, William Ray Wing wrote: My question is why bother with multithreading? Why not just do these as separate processes? You said "they in no way interact with each other" and

Re: Finding the source of an exception in a python multiprocessing program

2013-04-24 Thread Oscar Benjamin
be masking an exception and storing it in self._value >>> instead of letting it propogate and crash your program. This is >>> hiding the actual context. >>> >>> -- >>> Neil Cerutti >>> -- >>> http://mail.python.org/mailman/listinfo/python-l

Re: Finding the source of an exception in a python multiprocessing program

2013-04-24 Thread Dave Angel
self._value instead of letting it propogate and crash your program. This is hiding the actual context. -- Neil Cerutti -- http://mail.python.org/mailman/listinfo/python-list I'm sorry, I'm not following you. The "get" routine (and thus self.wait) is part of the &q

Re: Finding the source of an exception in a python multiprocessing program

2013-04-24 Thread MRAB
On 24/04/2013 20:25, William Ray Wing wrote: I run a bit of python code that monitors my connection to the greater Internet. It checks connectivity to the requested target IP addresses, logging both successes and failures, once every 15 seconds. I see failures quite regularly, predictably on

Re: Finding the source of an exception in a python multiprocessing program

2013-04-24 Thread Oscar Benjamin
On 24 April 2013 20:25, William Ray Wing wrote: > I run a bit of python code that monitors my connection to the greater > Internet. It checks connectivity to the requested target IP addresses, > logging both successes and failures, once every 15 seconds. I see failures > quite regularly, pred

Re: Finding the source of an exception in a python multiprocessing program

2013-04-24 Thread William Ray Wing
re you > must be masking an exception and storing it in self._value > instead of letting it propogate and crash your program. This is > hiding the actual context. > > -- > Neil Cerutti > -- > http://mail.python.org/mailman/listinfo/python-list I'm sorry, I'm not

Re: Finding the source of an exception in a python multiprocessing program

2013-04-24 Thread Neil Cerutti
On 2013-04-24, William Ray Wing wrote: > When I look at the pool module, the error is occurring in > get(self, timeout=None) on the line after the final else: > > def get(self, timeout=None): > self.wait(timeout) > if not self._ready: > raise TimeoutError >

Finding the source of an exception in a python multiprocessing program

2013-04-24 Thread William Ray Wing
I run a bit of python code that monitors my connection to the greater Internet. It checks connectivity to the requested target IP addresses, logging both successes and failures, once every 15 seconds. I see failures quite regularly, predictably on Sunday nights after midnight when various netw

Re: Python multiprocessing: Permission denied

2010-01-08 Thread t0ster
On Jan 6, 1:20 am, Steven D'Aprano wrote: > On Tue, 05 Jan 2010 13:52:18 -0800,t0sterwrote: > > It looks like the user don't have permission to access shared memory. > > When executing with root privileges it works fine. > > > Is there any solution to run it as normal user(not root)? > > Then give

Re: Python multiprocessing: Permission denied

2010-01-05 Thread Steven D'Aprano
On Tue, 05 Jan 2010 13:52:18 -0800, t0ster wrote: > It looks like the user don't have permission to access shared memory. > When executing with root privileges it works fine. > > Is there any solution to run it as normal user(not root)? Then give the user permission to access shared memory. Why

Python multiprocessing: Permission denied

2010-01-05 Thread t0ster
Hi guys, I'm getting an error when trying to execute python program that uses multiprocessing package: File "/usr/local/lib/python2.6/multiprocessing/__init__.py", line 178, in RLock return RLock() File "/usr/local/lib/python2.6/multiprocessing/synchronize.py", line 142, in __init__ Se

python multiprocessing proxy

2009-10-05 Thread DrFalk3N
I have a 2 processes: the first process is manager.py and starts in backgroung: from multiprocessing.managers import SyncManager, BaseProxy from CompositeDict import * class CompositeDictProxy(BaseProxy): _exposed_ = ('addChild', 'setName') def addChild(self, child):