Hi,
I am currently investigating what seems to be a memory leak in python.
(version 2.5.1). I have made python work with a custom memory sub-allocator
(pool). The idea is to preallocate a pool of memory during initialization
of my application and ensure that Python doesn't make any s
In message <[EMAIL PROTECTED]>,
Serge Orlov <[EMAIL PROTECTED]> writes
>The next step is to find out what type of objects contributes to the
>growth most of all,
Shame you aren't on Windows, as Python Memory Validator does all of
this.
>after that print several object of that type that
>didn't
Either of it would do, I am creating a discrete time simulator.
--
http://mail.python.org/mailman/listinfo/python-list
[EMAIL PROTECTED] wrote:
> I ran simulation for 128 nodes and used the following
>
> oo = gc.get_objects()
> print len(oo)
>
> on every time step the number of objects are increasing. For 128 nodes
> I had 1058177 objects.
>
> I think I need to revisit the code and remove the referencesbut how
[EMAIL PROTECTED] wrote:
> Sure, are there any available simulators...since i am modifying some
> stuff i thought of creating one of my own. But if you know some
> exisiting simlators , those can be of great help to me.
http://simpy.sourceforge.net/
--
http://mail.python.org/mailman/listinfo/pyth
[EMAIL PROTECTED] enlightened us with:
> Sure, are there any available simulators...since i am modifying some
> stuff i thought of creating one of my own. But if you know some
> exisiting simlators , those can be of great help to me.
Don't know any by name, but I'm sure you can find some on Google
I ran simulation for 128 nodes and used the following
oo = gc.get_objects()
print len(oo)
on every time step the number of objects are increasing. For 128 nodes
I had 1058177 objects.
I think I need to revisit the code and remove the referencesbut how
to do that. I am still a newbie coder an
With 1024 nodes it runs fine...but takes around4 hours to run on AMD
3100.
--
http://mail.python.org/mailman/listinfo/python-list
Sure, are there any available simulators...since i am modifying some
stuff i thought of creating one of my own. But if you know some
exisiting simlators , those can be of great help to me.
Thanks
--
http://mail.python.org/mailman/listinfo/python-list
[EMAIL PROTECTED] wrote:
(top-post corrected)
>
> bruno at modulix wrote:
>
>>[EMAIL PROTECTED] wrote:
>>
>>>I have a python code which is running on a huge data set. After
>>>starting the program the computer becomes unstable and gets very
>>>diffucult to even open konsole to kill that process.
[EMAIL PROTECTED] wrote:
> I am using Ubuntu Linux.
>
> My program is a simulation program with four classes and it mimics bit
> torrent file sharing systems on 2000 nodes. Now, each node has lot of
> attributes and my program kinds of tries to keep tab of everything. As
> I mentioned its a simulat
[EMAIL PROTECTED] enlightened us with:
> My program is a simulation program with four classes and it mimics
> bittorrent file sharing systems on 2000 nodes.
Wouldn't it be better to use an existing simulator? That way, you
won't have to do the stuff you don't want to think about, and focus on
the
[EMAIL PROTECTED] wrote:
> The amount of data I read in is actually small.
>
> If you see my algorithm above it deals with 2000 nodes and each node
> has ot of attributes.
>
> When I close the program my computer becomes stable and performs as
> usual. I check the performance in Performance monito
The amount of data I read in is actually small.
If you see my algorithm above it deals with 2000 nodes and each node
has ot of attributes.
When I close the program my computer becomes stable and performs as
usual. I check the performance in Performance monitor and using "top"
and the total memory
I am using Ubuntu Linux.
My program is a simulation program with four classes and it mimics bit
torrent file sharing systems on 2000 nodes. Now, each node has lot of
attributes and my program kinds of tries to keep tab of everything. As
I mentioned its a simulation program, it starts at time T=0 a
[EMAIL PROTECTED] wrote:
> I have a python code which is running on a huge data set. After
> starting the program the computer becomes unstable and gets very
> diffucult to even open konsole to kill that process. What I am assuming
> is that I am running out of memory.
>
> What should I do to make
1) Review your design - You say you are processing a large data set,
just make sure you are not trying to store 3 versions. If you are
missing a design, create a flow chart or something that is true to the
code you have produced. You could probably even post the design if you
are brave enough.
2)
[EMAIL PROTECTED] enlightened us with:
> I have a python code which is running on a huge data set. After
> starting the program the computer becomes unstable and gets very
> diffucult to even open konsole to kill that process. What I am
> assuming is that I am running out of memory.
Before acting
Its kinda 65o lines of code...not the best idea to paste the code.
[EMAIL PROTECTED] wrote:
> Can you paste an example of the code you're using?
--
http://mail.python.org/mailman/listinfo/python-list
how big is the set? 100MB, more? what are you doing with the set? do
you have a small example that can prove the set is causing the freeze?
I am not the sharpest tool in the shed but it sounds like you might be
multiplying your set in/directly either permanently or temporarily on
purpose or acciden
Can you paste an example of the code you're using?
--
http://mail.python.org/mailman/listinfo/python-list
I have a python code which is running on a huge data set. After
starting the program the computer becomes unstable and gets very
diffucult to even open konsole to kill that process. What I am assuming
is that I am running out of memory.
What should I do to make sure that my code runs fine without
Hi Nick,
Thanks for reply... Please include me in reply.
Currently i am not in the list (i will subscribe soon)
I upgarded to 2.4.1 - still the same issue.
Nick>
Thats not a lot of leak - have you done that over a
longer time period?
Abhi>
I have tried for 4 days. It has reached 150MB.
Nick>
A
Abhishek S <[EMAIL PROTECTED]> wrote:
> I am seeing that the python application is very slowly
> eating up the memory. i need help to indentify it.
>
> It start with 11MB and keeps growing by 1 MB around
> every 30mins.
>
> #top | grep python
> 10351 root 15 0 26584 25M 3896 S
"Abhishek S" <[EMAIL PROTECTED]> wrote:
> I am seeing that the python application is very slowly
> eating up the memory. i need help to indentify it.
what Python application?
> It start with 11MB and keeps growing by 1 MB around
> every 30mins.
have you checked for growing lists (etc)?
--
Hi,
using python2.2.2
I am seeing that the python application is very slowly
eating up the memory. i need help to indentify it.
It start with 11MB and keeps growing by 1 MB around
every 30mins.
#top | grep python
10351 root 15 0 26584 25M 3896 S 0.5 0.8
46:05 1 python2
10351 ro
26 matches
Mail list logo
