Re: Shared memory python between two separate shell-launched processes

2011-02-12 Thread Adam Skutt
On Feb 12, 3:29 am, John Nagle wrote: > >     If you're having trouble debugging a sequential program, > you do not want to add shared memory to the problem. No, you don't want to add additional concurrent threads of execution. But he's not doing that, he's just preloading stuff into RAM. It's n

Re: Shared memory python between two separate shell-launched processes

2011-02-12 Thread John Nagle
On 2/10/2011 9:21 AM, Charles Fox (Sheffield) wrote: On Feb 10, 3:43 pm, Jean-Paul Calderone wrote: On Feb 10, 9:30 am, "Charles Fox (Sheffield)" wrote: Thanks Jean-Paul, I'll have a think about this. I'm not sure if it will get me exactly what I want though, as I would need to keep unloadin

Re: Shared memory python between two separate shell-launched processes

2011-02-11 Thread Miki Tebeka
> So speed up the compile-test cycle I'm thinking about running a > completely separate process (not a fork, but a processed launched form > a different terminal) that can load the cache once then dunk it in an > area of shareed memory.Each time I debug the main program, it can > start up quick

Re: Shared memory python between two separate shell-launched processes

2011-02-11 Thread Philip
On Feb 11, 6:27 am, Adam Skutt wrote: > On Feb 10, 9:30 am, "Charles Fox (Sheffield)" > wrote: > > > But when I look at posix_ipc and POSH it looks like you have to fork > > the second process from the first one, rather than access the shared > > memory though a key ID as in standard C unix share

Re: Shared memory python between two separate shell-launched processes

2011-02-11 Thread Jean-Paul Calderone
On Feb 11, 5:52 am, "Charles Fox (Sheffield)" wrote: > On Feb 10, 6:22 pm, Jean-Paul Calderone > wrote: > > > > > > > > > > > On Feb 10, 12:21 pm, "Charles Fox (Sheffield)" > > wrote: > > > > On Feb 10, 3:43 pm, Jean-Paul Calderone > > > wrote: > > > > > On Feb 10, 9:30 am, "Charles Fox (Sheffi

Re: Shared memory python between two separate shell-launched processes

2011-02-11 Thread Adam Skutt
On Feb 10, 9:30 am, "Charles Fox (Sheffield)" wrote: > > But when I look at posix_ipc and POSH it looks like you have to fork > the second process from the first one, rather than access the shared > memory though a key ID as in standard C unix shared memory.  Am I > missing something?   Are there

Re: Shared memory python between two separate shell-launched processes

2011-02-11 Thread Charles Fox (Sheffield)
On Feb 10, 6:22 pm, Jean-Paul Calderone wrote: > On Feb 10, 12:21 pm, "Charles Fox (Sheffield)" > wrote: > > > > > On Feb 10, 3:43 pm, Jean-Paul Calderone > > wrote: > > > > On Feb 10, 9:30 am, "Charles Fox (Sheffield)" > > > wrote: > > > > > Hi guys, > > > > I'm working on debugging a large py

Re: Shared memory python between two separate shell-launched processes

2011-02-10 Thread Jean-Paul Calderone
On Feb 10, 12:21 pm, "Charles Fox (Sheffield)" wrote: > On Feb 10, 3:43 pm, Jean-Paul Calderone > wrote: > > > > > > > > > > > On Feb 10, 9:30 am, "Charles Fox (Sheffield)" > > wrote: > > > > Hi guys, > > > I'm working on debugging a large python simulation which begins by > > > preloading a hug

Re: Shared memory python between two separate shell-launched processes

2011-02-10 Thread Charles Fox (Sheffield)
On Feb 10, 3:43 pm, Jean-Paul Calderone wrote: > On Feb 10, 9:30 am, "Charles Fox (Sheffield)" > wrote: > > > Hi guys, > > I'm working on debugging a large python simulation which begins by > > preloading a huge cache of data.  I want to step through code on many > > runs to do the debugging.   P

Re: Shared memory python between two separate shell-launched processes

2011-02-10 Thread Jean-Paul Calderone
On Feb 10, 9:30 am, "Charles Fox (Sheffield)" wrote: > Hi guys, > I'm working on debugging a large python simulation which begins by > preloading a huge cache of data.  I want to step through code on many > runs to do the debugging.   Problem is that it takes 20 seconds to > load the cache at each

Shared memory python between two separate shell-launched processes

2011-02-10 Thread Charles Fox (Sheffield)
Hi guys, I'm working on debugging a large python simulation which begins by preloading a huge cache of data. I want to step through code on many runs to do the debugging. Problem is that it takes 20 seconds to load the cache at each launch. (Cache is a dict in a 200Mb cPickle binary file). So