(UPDATE) Memory problems (garbage collection)

2009-04-23 Thread Carbon Man
Thanks for the replies. I got my program working but the memory problem remains. When the program finishes and I am brought back to the PythonWin the memory is still tied up until I run gc.collect(). While my choice of platform for XML processing may not be the best one (I will change it later)

Re: Memory problems (garbage collection)

2009-04-23 Thread Christian Heimes
Peter Otten wrote: > Like Gerhard says, in the long run you are probably better off with > ElementTree. In the long run it's even better to use lxml [1]. It's the fastest und most powerful XML library for Python. It also supports element tree. Christian [1] http://codespeak.net/lxml/ -- http://

Re: Memory problems (garbage collection)

2009-04-23 Thread Carbon Man
Thanks for the help. I converted everything into the StringIO() format. Memory is still getting chewed up. I will look at ElementTree later but for now I believe the speed issue must be related to the amount of memory that is getting used. It is causing all of windows to slow to a crawl. gc.coll

Re: Memory problems (garbage collection)

2009-04-23 Thread Peter Otten
Carbon Man wrote: > Very new to Python, running 2.5 on windows. > I am processing an XML file (7.2MB). Using the standard library I am > recursively processing each node and parsing it. The branches don't go > particularly deep. What is happening is that the program is running really > really slow

Re: Memory problems (garbage collection)

2009-04-23 Thread Gerhard Häring
Here's a link for you: http://wiki.python.org/moin/PythonSpeed/PerformanceTips which also talks about string concatenation and othere do's and don'ts. -- Gerhard -- http://mail.python.org/mailman/listinfo/python-list

Re: Memory problems (garbage collection)

2009-04-23 Thread Gerhard Häring
Carbon Man wrote: > Very new to Python, running 2.5 on windows. > I am processing an XML file (7.2MB). Using the standard library I am > recursively processing each node and parsing it. The branches don't go > particularly deep. What is happening is that the program is running really > really sl

Memory problems (garbage collection)

2009-04-22 Thread Carbon Man
Very new to Python, running 2.5 on windows. I am processing an XML file (7.2MB). Using the standard library I am recursively processing each node and parsing it. The branches don't go particularly deep. What is happening is that the program is running really really slowly, so slow that even runn