Re: Shared memory python between two separate shell-launched processes

2011-02-12 Thread Adam Skutt
On Feb 12, 3:29 am, John Nagle wrote: > >     If you're having trouble debugging a sequential program, > you do not want to add shared memory to the problem. No, you don't want to add additional concurrent threads of execution. But he's not doing that, he's just preloading stuff into RAM. It's n

Re: Shared memory python between two separate shell-launched processes

2011-02-12 Thread John Nagle
On 2/10/2011 9:21 AM, Charles Fox (Sheffield) wrote: On Feb 10, 3:43 pm, Jean-Paul Calderone wrote: On Feb 10, 9:30 am, "Charles Fox (Sheffield)" wrote: Thanks Jean-Paul, I'll have a think about this. I'm not sure if it will get me exactly what I want though, as I would need to keep unloadin

Re: Shared memory python between two separate shell-launched processes

2011-02-11 Thread Miki Tebeka
> So speed up the compile-test cycle I'm thinking about running a > completely separate process (not a fork, but a processed launched form > a different terminal) that can load the cache once then dunk it in an > area of shareed memory.Each time I debug the main program, it can > start up quick

Re: Shared memory python between two separate shell-launched processes

2011-02-11 Thread Philip
On Feb 11, 6:27 am, Adam Skutt wrote: > On Feb 10, 9:30 am, "Charles Fox (Sheffield)" > wrote: > > > But when I look at posix_ipc and POSH it looks like you have to fork > > the second process from the first one, rather than access the shared > > memory though a key ID as in standard C unix share

Re: Shared memory python between two separate shell-launched processes

2011-02-11 Thread Jean-Paul Calderone
On Feb 11, 5:52 am, "Charles Fox (Sheffield)" wrote: > On Feb 10, 6:22 pm, Jean-Paul Calderone > wrote: > > > > > > > > > > > On Feb 10, 12:21 pm, "Charles Fox (Sheffield)" > > wrote: > > > > On Feb 10, 3:43 pm, Jean-Paul Calderone > > > wrote: > > > > > On Feb 10, 9:30 am, "Charles Fox (Sheffi

Re: Shared memory python between two separate shell-launched processes

2011-02-11 Thread Adam Skutt
On Feb 10, 9:30 am, "Charles Fox (Sheffield)" wrote: > > But when I look at posix_ipc and POSH it looks like you have to fork > the second process from the first one, rather than access the shared > memory though a key ID as in standard C unix shared memory.  Am I > missing something?   Are there

Re: Shared memory python between two separate shell-launched processes

2011-02-11 Thread Charles Fox (Sheffield)
On Feb 10, 6:22 pm, Jean-Paul Calderone wrote: > On Feb 10, 12:21 pm, "Charles Fox (Sheffield)" > wrote: > > > > > On Feb 10, 3:43 pm, Jean-Paul Calderone > > wrote: > > > > On Feb 10, 9:30 am, "Charles Fox (Sheffield)" > > > wrote: > > > > > Hi guys, > > > > I'm working on debugging a large py

Re: Shared memory python between two separate shell-launched processes

2011-02-10 Thread Jean-Paul Calderone
On Feb 10, 12:21 pm, "Charles Fox (Sheffield)" wrote: > On Feb 10, 3:43 pm, Jean-Paul Calderone > wrote: > > > > > > > > > > > On Feb 10, 9:30 am, "Charles Fox (Sheffield)" > > wrote: > > > > Hi guys, > > > I'm working on debugging a large python simulation which begins by > > > preloading a hug

Re: Shared memory python between two separate shell-launched processes

2011-02-10 Thread Charles Fox (Sheffield)
On Feb 10, 3:43 pm, Jean-Paul Calderone wrote: > On Feb 10, 9:30 am, "Charles Fox (Sheffield)" > wrote: > > > Hi guys, > > I'm working on debugging a large python simulation which begins by > > preloading a huge cache of data.  I want to step through code on many > > runs to do the debugging.   P

Re: Shared memory python between two separate shell-launched processes

2011-02-10 Thread Jean-Paul Calderone
On Feb 10, 9:30 am, "Charles Fox (Sheffield)" wrote: > Hi guys, > I'm working on debugging a large python simulation which begins by > preloading a huge cache of data.  I want to step through code on many > runs to do the debugging.   Problem is that it takes 20 seconds to > load the cache at each

Re: shared memory pointer

2007-09-11 Thread Tim Golden
Tim wrote: > I think I want to stay away from mmap because it uses the disk to > store my memory. My point is that, whatever mmap is doing, your own code is doing *exactly the same thing*. Passing the INVALID_HANDLE_VALUE as both your code and the mmap code are doing is documented as producing an

Re: shared memory pointer

2007-09-11 Thread Tim
WowYou put some detail in this response. Thanks so much! I think I want to stay away from mmap because it uses the disk to store my memory. I am trying to stay away from that. I am building strip charts in this python project to view my data. Currently, I am using a file and I have to open the

Re: shared memory pointer

2007-09-11 Thread Tim Golden
Tim wrote: > I saw the mmap function in the shared memory example. I had some > concern with my large memory size being written to the disk drive. I > though it might slow down my application. The reason I am writting > this new code is because the existing method using a file. I thought > shared m

Re: shared memory pointer

2007-09-10 Thread Tim Golden
Tim wrote: > I reviewed the mmap function and I have a question. In the example > code below, what is the connection between the data in shared memory > and the mmap function. The fileno is zero. Why is it zero? The size > makes sense because there is 256 bytes in shared memory. The tag is > MyFile

Re: shared memory pointer

2007-09-10 Thread MC
Hi! I agree ; on windows mmap use Memory-Mapped-file, who use virtual memory. And shared memory use physical memory. The difference is OS an not Python -- @-salutations Michel Claveau -- http://mail.python.org/mailman/listinfo/python-list

Re: shared memory pointer

2007-09-10 Thread Tim
On Sep 10, 10:11 am, Tim Golden <[EMAIL PROTECTED]> wrote: > Tim wrote: > > Hello Everyone, > > > I am getting shared memory in python using the following. > > > szName = c_char_p(name) > > hMapObject = windll.kernel32.CreateFileMappingA(INVALID_HANDLE_VALUE, > > None, PAGE_READONLY, 0,

Re: shared memory pointer

2007-09-10 Thread Tim
On Sep 10, 10:11 am, Tim Golden <[EMAIL PROTECTED]> wrote: > Tim wrote: > > Hello Everyone, > > > I am getting shared memory in python using the following. > > > szName = c_char_p(name) > > hMapObject = windll.kernel32.CreateFileMappingA(INVALID_HANDLE_VALUE, > > None, PAGE_READONLY, 0,

Re: shared memory pointer

2007-09-10 Thread Tim Golden
Tim wrote: > Hello Everyone, > > I am getting shared memory in python using the following. > > szName = c_char_p(name) > hMapObject = windll.kernel32.CreateFileMappingA(INVALID_HANDLE_VALUE, > None, PAGE_READONLY, 0, TABLE_SHMEMSIZE, szName) > if (hMapObject == 0): > print

Re: Shared Memory Space - Accross Apps & Network

2007-05-25 Thread Irmen de Jong
Hendrik van Rooyen wrote: >>> Just to get the ball rolling, I'd suggest two things: >>> >>> Pyro -http://pyro.sf.net > > This is good advice, if you have the power to run it. What do you mean exactly by "the power to run it"? --Irmen -- http://mail.python.org/mailman/listinfo/python-list

Re: Shared Memory Space - Accross Apps & Network

2007-05-25 Thread Hendrik van Rooyen
From: "D.Hering" wrote: > On May 23, 4:04 am, Tim Golden <[EMAIL PROTECTED]> wrote: > > Robert Rawlins - Think Blue wrote: > > I did not see the original post either :-( ... > > > I've got an application that runs on an embedded system, the application > > > uses a whole bunch or dicts and othe

Re: Shared Memory Space - Accross Apps & Network

2007-05-24 Thread Cameron Laird
In article <[EMAIL PROTECTED]>, Tim Golden <[EMAIL PROTECTED]> wrote: . . . >PyLinda - http://www-users.cs.york.ac.uk/~aw/pylinda/ > >This implements the tuplespace paradigm. It's great >fun to use, but as far as I know this i

Re: Shared Memory Space - Accross Apps & Network

2007-05-23 Thread Paul Boddie
On 23 May, 11:48, "D.Hering" <[EMAIL PROTECTED]> wrote: > > Possibly, IPython's new interactive parallel environment is what you > are looking for:http://ipython.scipy.org/moin/Parallel_Computing See this and related projects on the python.org Wiki: http://wiki.python.org/moin/ParallelProcessing

Re: Shared Memory Space - Accross Apps & Network

2007-05-23 Thread Paul Boddie
On 23 May, 11:48, "D.Hering" <[EMAIL PROTECTED]> wrote: > > Possibly, IPython's new interactive parallel environment is what you > are looking for:http://ipython.scipy.org/moin/Parallel_Computing See this and related projects on the python.org Wiki: http://wiki.python.org/moin/ParallelProcessing

Re: Shared Memory Space - Accross Apps & Network

2007-05-23 Thread D.Hering
On May 23, 4:04 am, Tim Golden <[EMAIL PROTECTED]> wrote: > Robert Rawlins - Think Blue wrote: > > > I've got an application that runs on an embedded system, the application > > uses a whole bunch or dicts and other data types to store state and other > > important information. > > I'm looking to b

Re: Shared Memory Space - Accross Apps & Network

2007-05-23 Thread D.Hering
On May 23, 4:04 am, Tim Golden <[EMAIL PROTECTED]> wrote: > Robert Rawlins - Think Blue wrote: > > > I've got an application that runs on an embedded system, the application > > uses a whole bunch or dicts and other data types to store state and other > > important information. > > I'm looking to b

Re: Shared Memory Space - Accross Apps & Network

2007-05-23 Thread Gabriel Genellina
En Wed, 23 May 2007 05:04:10 -0300, Tim Golden <[EMAIL PROTECTED]> escribió: > I noticed that the post hadn't appeared on Google > Groups, at least. I read things via the mailing list; > is it possible your post hasn't made it across to > Usenet either? I read this thru the gmane news interfase

Re: Shared Memory Space - Accross Apps & Network

2007-05-23 Thread Tim Golden
Robert Rawlins - Think Blue wrote: > I've got an application that runs on an embedded system, the application > uses a whole bunch or dicts and other data types to store state and other > important information. > I'm looking to build a small network of these embedded systems, and I'd love > to hav

Re: Shared memory

2006-03-02 Thread Paddy
Pylinda ? http://www-users.cs.york.ac.uk/~aw/pylinda/ -- http://mail.python.org/mailman/listinfo/python-list

Re: Shared memory

2006-03-02 Thread Michel Claveau
mmap? -- @-salutations Michel Claveau -- http://mail.python.org/mailman/listinfo/python-list

Re: Shared Memory Example (Python, ctypes, VC++)

2005-03-19 Thread Do Re Mi chel La Si Do
Thanks. -- http://mail.python.org/mailman/listinfo/python-list