Re: Need some IPC pointers

2011-12-08 Thread Lie Ryan
On 12/01/2011 08:03 AM, Andrew Berg wrote: I've done some research, but I'm not sure what's most appropriate for my situation. What I want to do is have a long running process that spawns processes (that aren't necessarily written in Python) and communicates with them. The children can be spawned

Re: Need some IPC pointers

2011-12-06 Thread Andrew Berg
What about named pipes? I don't mind a bit of "if Windows do this, else, do that" as long I'm not coding two or more completely different approaches. I'm not too familiar with named pipes, though; perhaps someone with some experience could chime in. Apparently this didn't go through to Google Gro

Re: Need some IPC pointers

2011-12-06 Thread Floris Bruynooghe
I'm surprised no one has mentioned zeromq as transport yet. It provides scaling from in proc (between threads) to inter-process and remote machines in a fairly transparent way. It's obviously not the python stdlib and as any system there are downsides too. Regards, Floris -- http://mail.pyth

Re: Need some IPC pointers

2011-12-02 Thread bobicanprogram
On Nov 30, 4:03 pm, Andrew Berg wrote: > I've done some research, but I'm not sure what's most appropriate for my > situation. What I want to do is have a long running process that spawns > processes (that aren't necessarily written in Python) and communicates > with them. The children can be spaw

Re: Need some IPC pointers

2011-11-30 Thread Andrew Berg
On 11/30/2011 10:35 PM, Alec Taylor wrote: > Sure, I'll give you some pointers: I almost rephrased the subject line because I knew someone would make that joke. :P -- CPython 3.2.2 | Windows NT 6.1.7601.17640 | Thunderbird 7.0 -- http://mail.python.org/mailman/listinfo/python-list

Re: Need some IPC pointers

2011-11-30 Thread Alec Taylor
:P On Thu, Dec 1, 2011 at 4:02 PM, Roy Smith wrote: > In article , >  Alec Taylor wrote: > >> Sure, I'll give you some pointers: >> >> 0x3A28213A >> 0x6339392C >> 0x7363682E > > What, no 0xDEADBEEF ??? > -- > http://mail.python.org/mailman/listinfo/python-list -- http://mail.python.org/mailman/

Re: Need some IPC pointers

2011-11-30 Thread Roy Smith
In article , Alec Taylor wrote: > Sure, I'll give you some pointers: > > 0x3A28213A > 0x6339392C > 0x7363682E What, no 0xDEADBEEF ??? -- http://mail.python.org/mailman/listinfo/python-list

Re: Need some IPC pointers

2011-11-30 Thread Alec Taylor
Sure, I'll give you some pointers: 0x3A28213A 0x6339392C 0x7363682E -- http://mail.python.org/mailman/listinfo/python-list

Re: Need some IPC pointers

2011-11-30 Thread Chris Angelico
On Thu, Dec 1, 2011 at 8:03 AM, Andrew Berg wrote: > processes (that aren't necessarily written in Python) ... > non-local processes would be nice ... > The implementation needs to be cross-platform ... > I don't think I'll ever need to transfer anything complicated or large - > just strings or po

Re: Need some IPC pointers

2011-11-30 Thread Irmen de Jong
On 30-11-11 23:28, Irmen de Jong wrote: On 30-11-11 22:03, Andrew Berg wrote: processes (that aren't necessarily written in Python) and communicates Oops, missed this on my first read. This rules out my suggestion of Pyro because that requires Python on both ends (or Java/.net on the client

Re: Need some IPC pointers

2011-11-30 Thread Devin Jeanpierre
> Sounds interesting, but I'm not familiar with threading (not that I > wouldn't be willing to learn). > Is it even possible to pipe into a running process, though? You create the pipe to the process when you start it. e.g. subprocess.Popen(['ls', 'foo'], stdout=subprocess.PIPE, stdin=subproc

Re: Need some IPC pointers

2011-11-30 Thread Irmen de Jong
On 30-11-11 22:03, Andrew Berg wrote: I've done some research, but I'm not sure what's most appropriate for my situation. What I want to do is have a long running process that spawns processes (that aren't necessarily written in Python) and communicates with them. The children can be spawned at a

Re: Need some IPC pointers

2011-11-30 Thread Andrew Berg
On 11/30/2011 3:32 PM, Devin Jeanpierre wrote: > You could also use threads and pipes. (I'm not actually > sure how threads+pipes works, but I'm told that it's a viable > approach). Sounds interesting, but I'm not familiar with threading (not that I wouldn't be willing to learn). Is it even possibl

Re: Need some IPC pointers

2011-11-30 Thread Devin Jeanpierre
> I'm thinking sockets, but perhaps there's something simpler/easier. Sockets are the only thing that will work without threads on all platforms. You could also use threads and pipes. (I'm not actually sure how threads+pipes works, but I'm told that it's a viable approach). Usually things are sim

Re: Need some IPC pointers

2011-11-30 Thread Miki Tebeka
There are two different problems. One is the medium to pass messages, sockets are good but there are other options and depends on your requirement you need to pick the best one. The other is serialization format, here you have marshal, pickle, JSON, XML and more. For me JSON over sockets works