Re: [GENERAL] memory issues when running with mod_perl

2006-10-10 Thread Fred Tyler
On 10/1/06, Fred Tyler <[EMAIL PROTECTED]> wrote: > However, my machine looses between 500 M and 800 M in two weeks, and > within that time, I restart pg only very few times, say 3-4 times. > Does pg allocate other shmem blocks? If there is really a kernel memory > problem in shmem, how can I loo

Re: [GENERAL] memory issues when running with mod_perl

2006-10-03 Thread Jonathan Vanasco
On Oct 1, 2006, at 12:24 PM, Fred Tyler wrote: It is not from the exit. I see the exact same problem and I never restart postgres and it never crashes. It runs constanty and with no crashes for 20-30 days until the box is out of memory and I have to reboot. my theory, which i hope to prove/di

Re: [GENERAL] memory issues when running with mod_perl

2006-10-03 Thread Tom Lane
Jonathan Vanasco <[EMAIL PROTECTED]> writes: > except instead of relying on a leak to increase memory, I'd like a > rather intensive large function with a dataset to consumer massive > amounts of ram. I just can't think of any function to do that. Sort a big chunk of data with a high work_mem

Re: [GENERAL] memory issues when running with mod_perl

2006-10-03 Thread Jonathan Vanasco
On Oct 1, 2006, at 11:56 AM, Tom Lane wrote: OK, that kills the theory that the leak is triggered by subprocess exit. Another thing that would be worth trying is to just stop and start the postmaster a large number of times, to see if the leak occurs at postmaster exit. On FreeBSD I'm not s

Re: [GENERAL] memory issues when running with mod_perl

2006-10-01 Thread Jorge Godoy
Andreas Rieke <[EMAIL PROTECTED]> writes: > It's 2.6.13-15. Thus, if we have a kernel bug, the newest known leaky > version is 2.6.13-15, whereas the oldest fixed version should be 2.6.16.27. I have a few servers with 2.6.16.21 and I don't see the problem as well. -- Jorge Godoy <[EMAIL

Re: [GENERAL] memory issues when running with mod_perl

2006-10-01 Thread Andreas Rieke
Fred, > > What is your kernel version? It's 2.6.13-15. Thus, if we have a kernel bug, the newest known leaky version is 2.6.13-15, whereas the oldest fixed version should be 2.6.16.27. As many people run pg on older kernel versions, I would expect many others having memory problems in that case.

Re: [GENERAL] memory issues when running with mod_perl

2006-10-01 Thread Tom Lane
"Fred Tyler" <[EMAIL PROTECTED]> writes: >>> R2: After having a look at the linux kernel mailing list, it seems that >>> this problem is not yet known there. > It is possible that it has already been fixed. I am seeing this memory > leak quite clearly on 2.6.12.6, but there's no evidence of it at

Re: [GENERAL] memory issues when running with mod_perl

2006-10-01 Thread Fred Tyler
OK, that kills the theory that the leak is triggered by subprocess exit. Another thing that would be worth trying is to just stop and start the postmaster a large number of times, to see if the leak occurs at postmaster exit. It is not from the exit. I see the exact same problem and I never rest

Re: [GENERAL] memory issues when running with mod_perl

2006-10-01 Thread Fred Tyler
> Tonight I am going to upgrade postgres on the first machine and see if > it makes any difference, but it'll be about a week before I know for > sure if memory is still being lost (it's such a slow leak that you > cannot tell with just a couple days). I use the latest 8.1.4 postgres software on

Re: [GENERAL] memory issues when running with mod_perl

2006-10-01 Thread Tom Lane
Andreas Rieke <[EMAIL PROTECTED]> writes: > R1: First of all, I tried the loop from your older OS X problem: > while true > do > psql -c "select count(*) from tenk1" regression > done > Even after running the psql command for more than a million times over > quite a small table

Re: [GENERAL] memory issues when running with mod_perl

2006-10-01 Thread Andreas Rieke
Fred, Fred Tyler wrote: > Tonight I am going to upgrade postgres on the first machine and see if > it makes any difference, but it'll be about a week before I know for > sure if memory is still being lost (it's such a slow leak that you > cannot tell with just a couple days). I use the latest 8.

Re: [GENERAL] memory issues when running with mod_perl

2006-10-01 Thread Fred Tyler
However, my machine looses between 500 M and 800 M in two weeks, and within that time, I restart pg only very few times, say 3-4 times. Does pg allocate other shmem blocks? If there is really a kernel memory problem in shmem, how can I loose so much memory? This is the same thing I am seeing --

Re: [GENERAL] memory issues when running with mod_perl

2006-10-01 Thread Andreas Rieke
Tom, thanks for all the facts first. Tom Lane wrote: >If the shared segment is no longer present according to ipcs, >and there are no postgres processes still running, then it's >simply not possible for it to be postgres' fault if memory has >not been reclaimed. So you're looking at a kernel bu

Re: [GENERAL] memory issues when running with mod_perl

2006-09-30 Thread Jonathan Vanasco
On Sep 30, 2006, at 12:28 PM, Tom Lane wrote: If the shared segment is no longer present according to ipcs, and there are no postgres processes still running, then it's simply not possible for it to be postgres' fault if memory has not been reclaimed. So you're looking at a kernel bug. thats

Re: [GENERAL] memory issues when running with mod_perl

2006-09-30 Thread Tom Lane
Andreas Rieke <[EMAIL PROTECTED]> writes: > I am the guy who posted the problem to mod_perl, and yes, I am quite > sure that we are talking about the right numbers. The best argument is > that the machine in fact starts swapping when memory is gone - and this > means there is neither free nor cache

Re: [GENERAL] memory issues when running with mod_perl

2006-09-30 Thread Andreas Rieke
Martijn, > Are you sure you're looking at the right numbers? Disk cache should be > counted as part of free memory, for example. I am the guy who posted the problem to mod_perl, and yes, I am quite sure that we are talking about the right numbers. The best argument is that the machine in fact sta

Re: [GENERAL] memory issues when running with mod_perl

2006-09-28 Thread Martijn van Oosterhout
On Wed, Sep 27, 2006 at 05:03:15PM -0400, Jonathan Vanasco wrote: > > Someone posted an issue to the mod-perl list a few weeks ago about > their machine losing a ton of memory under a mod-perl2/apache/ > postgres system - and only being able to reclaim it from reboots Are you sure you're looki