Thomas Ploch wrote: > Ravi Teja schrieb: > > Thomas Ploch wrote: > >> Hi folks, > >> > >> I have a data structure that looks like this: > >> > >> d = { > >> 'url1': { > >> 'emails': ['a', 'b', 'c',...], > >> 'matches': ['d', 'e', 'f',...] > >> }, > >> 'url2': {... > >> } > >> > >> This dictionary will get _very_ big, so I want to write it somehow to a > >> file after it has grown to a certain size. > >> > >> How would I achieve that? > >> > >> Thanks, > >> Thomas > > > > Pickle/cPickle are standard library modules that can persist data. > > But in this case, I would recommend ZODB/Durus. > > > > (Your code example scares me. I hope you have benevolent purposes for > > that application.) > > > > Ravi Teja. > > > > Thanks, but why is this code example scaring you? > > Thomas
The code indicates that you are trying to harvest a _very_ (as you put it) large set of email addresses from web pages. With my limited imagination, I can think of only one group of people who would need to do that. But considering that you write good English, you must not be one of those mean people that needed me to get a new email account just for posting to Usenet :-). Ravi Teja. -- http://mail.python.org/mailman/listinfo/python-list