Re: [BangPypers] Ideas for Python concurrency...

On Tue, Feb 8, 2011 at 2:15 PM, Vishal wrote: > On Tue, Feb 8, 2011 at 2:10 PM, Baishampayan Ghose >wrote: > > > > Mutliprocessing means, data copying, talking to each other through > PIPES, > > > also it has its issues with running on Windows (all function calls > should > > be pickelable) > >

Re: [BangPypers] BangPypers meeting February 2011

Hi All, Majority of the people are fine with Feb 12th (Saturday): http://doodle.com/53iqx4gdu5fuzws7 So, we will have a regular meeting at 3 pm on that day. If more people are interested we can have a sprint otherwise we will go for normal discussions. Can anyone from ThoughtWorks confirm the ve

Re: [BangPypers] Ideas for Python concurrency...

On Tue, Feb 08 2011, vikas ruhil wrote: > i am telling about that specific case for that project , also specific > about question which is ask by Vishal . i know OS always matter but > not in some specific case i know you talking about this > "multiprocessing is a package that supports spawning pr

Re: [BangPypers] Ideas for Python concurrency...

> This might sound crazy..and dont know if its even possible, but... You aren't and it is. If the underlying interpreter is encapsulated in the right way[1], it is certainly possible. This is exactly how multiple interpreters run in a single JVM instance[2] in JRuby (though the reason this feature

Re: [BangPypers] Ideas for Python concurrency...

i am telling about that specific case for that project , also specific about question which is ask by Vishal . i know OS always matter but not in some specific case i know you talking about this "multiprocessing is a package that supports spawning processes using an API similar to the threading

Re: [BangPypers] Ideas for Python concurrency...

On Tue, Feb 08 2011, vikas ruhil wrote: > I am using Linux , unix both for this , whatsoever OS never matter? [...] The OS matters in many cases. It's folly to think otherwise. The multiprocessing modules implementation on windows is significantly different (and inferior) to the implementation

Re: [BangPypers] Ideas for Python concurrency...

I am using Linux , unix both for this , whatsoever OS never matter? often you could go with bill gates also . On Tue, Feb 8, 2011 at 3:03 PM, Vishal wrote: > Vikas, > > Thanks for the detailed info. What OS were you using for this project ? > > Thanks and best regards, > Vishal >

Re: [BangPypers] Ideas for Python concurrency...

Vikas, Thanks for the detailed info. What OS were you using for this project ? Thanks and best regards, Vishal On Tue, Feb 8, 2011 at 2:44 PM, vikas ruhil wrote: > Python GIL problem is solved you can look at here multiprocessing module > was > developed, which enables true parallel processing

Re: [BangPypers] Ideas for Python concurrency...

On Tue, Feb 8, 2011 at 2:33 PM, Noufal Ibrahim wrote: > On Tue, Feb 08 2011, Baishampayan Ghose wrote: > > >> Mutliprocessing means, data copying, talking to each other through > PIPES, > >> also it has its issues with running on Windows (all function calls > should be > >> pickelable) > >> > >>

Re: [BangPypers] Ideas for Python concurrency...

2011/2/8 Vishal : > On Tue, Feb 8, 2011 at 2:02 PM, Anand Chitipothu wrote: > >> 2011/2/8 Vishal : >> > Hello, >> > >> > This might sound crazy..and dont know if its even possible, but... >> > >> > Is it possible that the Python process, creates copies of the interpreter >> > for each thread that i

Re: [BangPypers] Ideas for Python concurrency...

also when you perform you can face any problem you can look at debugger You can obtain it from http://code.google.com/p/ pydbgr/ On Tue, Feb 8, 2011 at 2:44 PM, vikas ruhil wrote: > Python GIL problem is solved you can look at here multiprocessing module > was

Re: [BangPypers] Ideas for Python concurrency...

Python GIL problem is solved you can look at here multiprocessing module was developed, which enables true parallel processing with Python on a multiprocore machine, with an interface very close to that of the threading module.Moreover, one can run a program across machines! In other words, the mul

Re: [BangPypers] Ideas for Python concurrency...

On Tue, Feb 08 2011, Baishampayan Ghose wrote: >> Mutliprocessing means, data copying, talking to each other through PIPES, >> also it has its issues with running on Windows (all function calls should be >> pickelable) >> >> Threads seems pretty stable on most platforms where Python runs. > > Thre

Re: [BangPypers] Ideas for Python concurrency...

Result is not in order even if our tasks’ queue was in order. This is because the program run in parallel. –Queue.get() return the data to the worker and delete it. also kept in mind while sharing memory –Python provide two ways for the data to be stored in a shared memory map: •Value : –The retu

Re: [BangPypers] Ideas for Python concurrency...

use this type Threading : •Thread(target=do_work,args=(work_queue,)) –Multiprocessing: •Process(target=do_work,args=(work_queue,)) On Tue, Feb 8, 2011 at 1:54 PM, Vishal wrote: > Hello, > > This might sound crazy..and dont know if its even possible, but... > > Is it possible that the Python pro

Re: [BangPypers] Ideas for Python concurrency...

for this use python in VMD ,HPC environment On Tue, Feb 8, 2011 at 2:19 PM, Santosh Rajan wrote: > Have you considered using queue's with multiprocessing? > > On Tue, Feb 8, 2011 at 2:15 PM, Vishal wrote: > > On Tue, Feb 8, 2011 at 2:10 PM, Baishampayan Ghose >wrote: > > > >> > Mutliprocessi

[BangPypers] beta test of python out

visit :ftp://ftp.python.org/pub/python/src/ ___ BangPypers mailing list BangPypers@python.org http://mail.python.org/mailman/listinfo/bangpypers

Re: [BangPypers] Ideas for Python concurrency...

Have you considered using queue's with multiprocessing? On Tue, Feb 8, 2011 at 2:15 PM, Vishal wrote: > On Tue, Feb 8, 2011 at 2:10 PM, Baishampayan Ghose wrote: > >> > Mutliprocessing means, data copying, talking to each other through PIPES, >> > also it has its issues with running on Windows (a

Re: [BangPypers] Ideas for Python concurrency...

On Tue, Feb 8, 2011 at 2:10 PM, Baishampayan Ghose wrote: > > Mutliprocessing means, data copying, talking to each other through PIPES, > > also it has its issues with running on Windows (all function calls should > be > > pickelable) > > > > Threads seems pretty stable on most platforms where Pyt

Re: [BangPypers] Ideas for Python concurrency...

> Mutliprocessing means, data copying, talking to each other through PIPES, > also it has its issues with running on Windows (all function calls should be > pickelable) > > Threads seems pretty stable on most platforms where Python runs. Threads won't help you much because of the Python GIL. Rega

Re: [BangPypers] Ideas for Python concurrency...

On Tue, Feb 8, 2011 at 2:02 PM, Anand Chitipothu wrote: > 2011/2/8 Vishal : > > Hello, > > > > This might sound crazy..and dont know if its even possible, but... > > > > Is it possible that the Python process, creates copies of the interpreter > > for each thread that is launched, and some how the

Re: [BangPypers] Ideas for Python concurrency...

2011/2/8 Vishal : > Hello, > > This might sound crazy..and dont know if its even possible, but... > > Is it possible that the Python process, creates copies of the interpreter > for each thread that is launched, and some how the thread is bound to its > own interpreter ? > > This will increase the

[BangPypers] Ideas for Python concurrency...

Hello, This might sound crazy..and dont know if its even possible, but... Is it possible that the Python process, creates copies of the interpreter for each thread that is launched, and some how the thread is bound to its own interpreter ? This will increase the python process size...for sure, h