Re: [Rpy] data.frames in rpy2

2008-06-26 Thread Sean Davis
On Wed, Jun 25, 2008 at 5:30 PM, Laurent Gautier <[EMAIL PROTECTED]> wrote: > 2008/6/25 Sean Davis <[EMAIL PROTECTED]>: >> First, Laurent, I am giving rpy2 a try and REALLY like what I see so >> far. It is very much more intuitive, both from the point-of-view of >> an R programmer as well as for p

Re: [Rpy] rpy in 2 threads

2008-06-26 Thread Gregory Warnes
Hi Laurent, It does seem desirable to include an component with Rpy for handling multi-threading and R. We should think a bit about the right way to implement this. I think it would be good to make sure and use an code implementation that is a good match for the right conceptual model. To this e

Re: [Rpy] rpy in 2 threads

2008-06-26 Thread Gregory Warnes
Several years ago I used Rpy plus RPVM to distributed R computations across multiple processing nodes (inluding multiple CPU¹s on a single Sun SMP server), so this should work OK. Note, however, that requires writing/utilizing code that has been explicitly parallelized. -Greg On 6/26/08 12:29P

Re: [Rpy] rpy in 2 threads

2008-06-26 Thread Gregory Warnes
Side note: I developed the RSOAP package to allow a single multi-threaded python application to interact with multiple independent R processes cleanly. Take a look at http://rsoap.sourceforge.net or http://sourceforge.net/projects/rsoap/ -Greg On 6/26/08 11:17AM , "laurent oget" <[EMAIL PROTE

Re: [Rpy] rpy in 2 threads

2008-06-26 Thread Laurent Gautier
I think that Rmpi creates processes and passes messages between them. It *should* work without problems with rpy. Although, two threads worth a look at: https://stat.ethz.ch/pipermail/r-devel/2006-October/043218.html http://tolstoy.newcastle.edu.au/R/e3/devel/07/11/0291.html 2008/6/26 Sean D

Re: [Rpy] rpy in 2 threads

2008-06-26 Thread Sean Davis
On Thu, Jun 26, 2008 at 12:05 PM, Laurent Gautier <[EMAIL PROTECTED]> wrote: > yes. Unless you use a package like Rmpi. I have NO idea how that would work with Rpy, but it is another possibility. Also, I think there has been some work to vectorize the math libraries. Sean > 2008/6/26 laurent o

Re: [Rpy] rpy in 2 threads

2008-06-26 Thread Laurent Gautier
yes. 2008/6/26 laurent oget <[EMAIL PROTECTED]>: > So if I want to take advantage of my two cores, i need two processes, right? > > 2008/6/26 Gregory Warnes <[EMAIL PROTECTED]>: >> >> Hello Laurent, >> >> The R system itself is not thread safe, and has quite a bit of persistent >> state. Therefor

Re: [Rpy] rpy in 2 threads

2008-06-26 Thread laurent oget
So if I want to take advantage of my two cores, i need two processes, right? 2008/6/26 Gregory Warnes <[EMAIL PROTECTED]>: > > Hello Laurent, > > The R system itself is *not* thread safe, and has quite a bit of > persistent state. Therefore if you want to use R from multiple threads, you > will

Re: [Rpy] rpy in 2 threads

2008-06-26 Thread Laurent Gautier
Speaking of which, it would be nice if rpy was shipped with a vanilla locking mechanism. R remaining probably thread-unsafe for the foreseeable future, I was thinking of having something like a two-locks mechanism that would lock R and release Python's GIL whenever an access to R is made. The exp

Re: [Rpy] rpy in 2 threads

2008-06-26 Thread Gregory Warnes
Hello Laurent, The R system itself is not thread safe, and has quite a bit of persistent state. Therefore if you want to use R from multiple threads, you will need to arrange to have a single thread interact with R at a time via appropriate locking or delegation. -G On 6/26/08 11:17AM , "lau

[Rpy] rpy in 2 threads

2008-06-26 Thread laurent oget
fellows, did anybody experiment with running rpy in 2 threads? - Check out the new SourceForge.net Marketplace. It's the best place to buy or sell services for just about anything Open Source. http://sourceforge.net/services/b