Re: Memory error while saving dictionary of size 65000X50 using pickle

2008-07-07 Thread Nagu
Thank you very much Martin. It worked like a charm. -- http://mail.python.org/mailman/listinfo/python-list

Re: Memory error while saving dictionary of size 65000X50 using pickle

2008-07-07 Thread Martin v. Löwis
> I didn't have the problem with dumping as a string. When I tried to > save this object to a file, memory error pops up. That's not what the backtrace says. The backtrace says that the error occurs inside pickle.dumps() (and it is consistent with the functions being called, so it's plausible). >

Re: Memory error while saving dictionary of size 65000X50 using pickle

2008-07-07 Thread Nagu
I didn't have the problem with dumping as a string. When I tried to save this object to a file, memory error pops up. I am sorry for the mention of size for a dictionary. What I meant by 65000X50 is that it has 65000 keys and each key has a list of 50 tuples. I was able to save a dictionary objec

Re: Memory error while saving dictionary of size 65000X50 using pickle

2008-07-07 Thread Martin v. Löwis
Nagu wrote: > I am trying to save a dictionary of size 65000X50 to a local file and > I get the memory error problem. What do you mean by this size specification? When I interpreter X as multiplication, I can't see a problem: the code import pickle d = {} for i in xrange(65000*50): d[i]=i p

Re: Memory error while saving dictionary of size 65000X50 using pickle

2008-07-07 Thread Larry Bates
Nagu wrote: I am trying to save a dictionary of size 65000X50 to a local file and I get the memory error problem. How do I go about resolving this? Is there way to partition the pickle object and combine later if this is a problem due to limited resources (memory) on the machine (it is 32 bit ma

Memory error while saving dictionary of size 65000X50 using pickle

2008-07-07 Thread Nagu
I am trying to save a dictionary of size 65000X50 to a local file and I get the memory error problem. How do I go about resolving this? Is there way to partition the pickle object and combine later if this is a problem due to limited resources (memory) on the machine (it is 32 bit machine Win XP,