Re: memory management

2013-02-18 Thread Sudheer Joseph
> Python version and OS please. And is the Python 32bit or 64bit? How > > much RAM does the computer have, and how big are the swapfiles ? > Python 2.7.3 ubuntu 12.04 64 bit 4GB RAM > > "Fairly big" is fairly vague. To some people, a list with 100k members > > is huge, but not to a modern

Re: memory management

2013-02-18 Thread Dave Angel
On 02/18/2013 10:29 AM, Sudheer Joseph wrote: HI, I have been trying to compute cross correlation between a time series at a location f(1) and the timeseries of spatial data f(XYT) and saving the resulting correlation coefficients and lags in a 3 dimensional array which is of fairly b

RE: memory management

2011-11-09 Thread Juan Declet-Barreto
ption? -juan -Original Message- From: Dave Angel [mailto:d...@davea.name] Sent: Monday, November 07, 2011 1:50 PM To: Juan Declet-Barreto Cc: python-list@python.org Subject: Re: memory management On 11/07/2011 03:33 PM, Juan Declet-Barreto wrote: > Well, I am using Python 2.5 (and the ID

Re: memory management

2011-11-07 Thread Terry Reedy
On 11/7/2011 3:47 PM, Stefan Krah wrote: Juan Declet-Barreto wrote: Well, I am using Python 2.5 (and the IDLE shell) in Windows XP, which ships with ESRI's ArcGIS. In addition, I am using some functions in the arcgisscripting Python geoprocessing module for geographic information systems (GIS)

Re: memory management

2011-11-07 Thread Chris Angelico
On Tue, Nov 8, 2011 at 6:43 AM, Juan Declet-Barreto wrote: > > I have a script that traverses a file structure using os.walk and adds > directory names to a list. It works for a small number of directories, but > when I set it loose on a directory with thousands of dirs/subdirs, it crashes > th

Re: memory management

2011-11-07 Thread Dave Angel
On 11/07/2011 03:33 PM, Juan Declet-Barreto wrote: Well, I am using Python 2.5 (and the IDLE shell) in Windows XP, which ships with ESRI's ArcGIS. In addition, I am using some functions in the arcgisscripting Python geoprocessing module for geographic information systems (GIS) applications, wh

Re: memory management

2011-11-07 Thread Stefan Krah
Juan Declet-Barreto wrote: > Well, I am using Python 2.5 (and the IDLE shell) in Windows XP, which > ships with ESRI's ArcGIS. In addition, I am using some functions in the > arcgisscripting Python geoprocessing module for geographic information > systems (GIS) applications, which can complicate t

RE: memory management

2011-11-07 Thread Juan Declet-Barreto
ython-list@python.org Subject: Re: memory management On 11/07/2011 02:43 PM, Juan Declet-Barreto wrote: > Hi, > > Can anyone provide links or basic info on memory management, variable > dereferencing, or the like? I have a script that traverses a file structure > using os.walk and

Re: memory management

2011-11-07 Thread Dave Angel
On 11/07/2011 02:43 PM, Juan Declet-Barreto wrote: Hi, Can anyone provide links or basic info on memory management, variable dereferencing, or the like? I have a script that traverses a file structure using os.walk and adds directory names to a list. It works for a small number of directorie

Re: memory management - avoid swapping/paging

2010-10-22 Thread Jon Clements
On 21 Oct, 16:45, Nobody wrote: > On Thu, 21 Oct 2010 02:34:15 -0700, Jon Clements wrote: > > I'm after something that says: "I want 512mb of physical RAM, I don't > > want you to page/swap it, if you can't do that, don't bother at all". > > Now I'm guessing, that an OS might be able to grant that

Re: memory management - avoid swapping/paging

2010-10-21 Thread Nobody
On Thu, 21 Oct 2010 02:34:15 -0700, Jon Clements wrote: > I'm after something that says: "I want 512mb of physical RAM, I don't > want you to page/swap it, if you can't do that, don't bother at all". > Now I'm guessing, that an OS might be able to grant that, but later on > have to kill the proces

Re: memory management - avoid swapping/paging

2010-10-21 Thread Alain Ketterlin
Jon Clements writes: > Is there a cross-platform way using Python to guarantee that an object > will never be swapped/paged to disk? I'll be honest and say I'm really > not sure if this is a particular language question or rather specific > to an OS. > > Under linux it appears I could create a r

Re: Memory Management in Embedded Python

2007-01-18 Thread Martin v. Löwis
Huayang Xia schrieb: > I have a piece of code like this: > > void funct(PyObject* pyobj) > { > char str[128]; > strncpy(str, "just a test string", sizeof(str)); > PyObject* pydata = PyObject_CallMethod(pyobj, "method_x", > "s", str); > Py_DECREF(py

Re: Memory Management in python 2.5

2006-10-09 Thread Fredrik Lundh
[EMAIL PROTECTED] wrote: >I just checked the comsuptiom with the 'top' unix util. I am procesing > html docs and the amount of memory rises continiously. what library are you using for this ? > I am using a lot of lists and docs. Some of them with objects. Do i > have to make any special thing i

Re: Memory Management in python 2.5

2006-10-09 Thread cesar . ortiz
I just checked the comsuptiom with the 'top' unix util. I am procesing html docs and the amount of memory rises continiously. I am using a lot of lists and docs. Some of them with objects. Do i have to make any special thing in order to get them released back to the Memory Manager? For instantec..

Re: Memory Management in python 2.5

2006-10-09 Thread Fredrik Lundh
[EMAIL PROTECTED] wrote: > Hi, I am starting to have a look to a python program that does not free > memory (I am using python 2.4.3). As I have read about a new memory > management in python 2.5 (http://evanjones.ca/python-memory.html) I > decided to try the program with the new version. > With t

Re: Memory Management in python 2.5

2006-10-09 Thread Max M
[EMAIL PROTECTED] skrev: > Hi, I am starting to have a look to a python program that does not free > memory (I am using python 2.4.3). As I have read about a new memory > management in python 2.5 (http://evanjones.ca/python-memory.html) I > decided to try the program with the new version. > With th