Re: [PERFORM] PostgreSQL 8.0 occasionally slow down

2007-07-03 Thread Ho Fat Tsang
2007/7/3, Greg Smith <[EMAIL PROTECTED]>: On Fri, 29 Jun 2007, Ho Fat Tsang wrote: > I noticed that for each time the pgsql slow down, there is a short > period a process called "pdflush" eating up lot of I/O. I've goolgled > and know it is a process for writing dirty pages back to the disk by

Re: [PERFORM] PostgreSQL 8.0 occasionally slow down

2007-07-03 Thread Ho Fat Tsang
2007/6/29, Richard Huxton <[EMAIL PROTECTED]>: Ho Fat Tsang wrote: > Hi Richard, > >I've tested again according your suggestion. I noticed that for each > time the pgsql slow down, there is a short period a process called > "pdflush" > eating up lot of I/O. I've goolgled and know it is a pro

Re: [PERFORM] PostgreSQL 8.0 occasionally slow down

2007-07-03 Thread Ho Fat Tsang
Hi Kevin, Thank for your configuration. I have tested with this configuration (amended a bit) and it helps a bit. But i have found the root cause is related to the application that using PG. But yet i can learn much to tune the PG in my restricted environment !. Regards, Twinsen 2007/6/28

Re: [PERFORM] PostgreSQL 8.0 occasionally slow down

2007-07-03 Thread Ho Fat Tsang
Hi Greg. 2007/6/28, Greg Smith <[EMAIL PROTECTED]>: On Thu, 28 Jun 2007, Ho Fat Tsang wrote: > I have tuned the checkpoint_timeout to 30 second which is ten times less > than default and the issue is still reproduced. Doing a checkpoint every 30 seconds is crazy; no wonder your system is pa

Re: [PERFORM] PostgreSQL 8.0 occasionally slow down

2007-07-02 Thread Greg Smith
On Fri, 29 Jun 2007, Ho Fat Tsang wrote: I noticed that for each time the pgsql slow down, there is a short period a process called "pdflush" eating up lot of I/O. I've goolgled and know it is a process for writing dirty pages back to the disk by the Linux kernel. The pdflush documentation i

Re: [PERFORM] PostgreSQL 8.0 occasionally slow down

2007-06-29 Thread Alvaro Herrera
Richard Huxton escribió: > Ho Fat Tsang wrote: > > Correct me if i am wrong. It seems postgresql 8.0 does not bundle > >auto-vacuum by default. So all vacuum and analyse are done manually ? So > >what i have tested related to vaccuum is running auto-vacuum (a executeable > >located in /bin) paral

Re: [PERFORM] PostgreSQL 8.0 occasionally slow down

2007-06-29 Thread Richard Huxton
Ho Fat Tsang wrote: Hi Richard, I've tested again according your suggestion. I noticed that for each time the pgsql slow down, there is a short period a process called "pdflush" eating up lot of I/O. I've goolgled and know it is a process for writing dirty pages back to the disk by the Linu

Re: [PERFORM] PostgreSQL 8.0 occasionally slow down

2007-06-28 Thread Ho Fat Tsang
Hi Richard, I've tested again according your suggestion. I noticed that for each time the pgsql slow down, there is a short period a process called "pdflush" eating up lot of I/O. I've goolgled and know it is a process for writing dirty pages back to the disk by the Linux kernel. I will have f

Re: [PERFORM] PostgreSQL 8.0 occasionally slow down

2007-06-28 Thread Kevin Grittner
>>> On Thu, Jun 28, 2007 at 1:54 AM, in message <[EMAIL PROTECTED]>, "Ho Fat Tsang" <[EMAIL PROTECTED]> wrote: > > I don't know why the server occasionally > slow down a bit for every 3 minutes. If the problem is checkpoints, try making your background writer more aggressive. This allows mor

Re: [PERFORM] PostgreSQL 8.0 occasionally slow down

2007-06-28 Thread Gregory Stark
"Greg Smith" <[EMAIL PROTECTED]> writes: > On Thu, 28 Jun 2007, Ho Fat Tsang wrote: > >> I have tuned the checkpoint_timeout to 30 second which is ten times less than >> default and the issue is still reproduced. > > Your problem looks exactly like a pause at every checkpoint, and I'm not > sure w

Re: [PERFORM] PostgreSQL 8.0 occasionally slow down

2007-06-28 Thread Greg Smith
On Thu, 28 Jun 2007, Ho Fat Tsang wrote: I have tuned the checkpoint_timeout to 30 second which is ten times less than default and the issue is still reproduced. Doing a checkpoint every 30 seconds is crazy; no wonder your system is pausing so much. Put the timeout back to the default. What

Re: [PERFORM] PostgreSQL 8.0 occasionally slow down

2007-06-28 Thread Richard Huxton
Ho Fat Tsang wrote: Hi Richard, Thank for your prompt reply. I have used the command "vmstat 10" to investigate the I/O issue and listed below : procs ---memory-- ---swap-- -io --system-- cpu r b swpd free buff cache si sobibo incs us

Re: [PERFORM] PostgreSQL 8.0 occasionally slow down

2007-06-28 Thread Ho Fat Tsang
Hi Richard, Thank for your prompt reply. I have used the command "vmstat 10" to investigate the I/O issue and listed below : procs ---memory-- ---swap-- -io --system-- cpu r b swpd free buff cache si sobibo incs us sy id wa 0 0 26848

Re: [PERFORM] PostgreSQL 8.0 occasionally slow down

2007-06-28 Thread Richard Huxton
Ho Fat Tsang wrote: Hi Richard, I have tuned the checkpoint_timeout to 30 second which is ten times less than default and the issue is still reproduced. Do you have any recommended configuration for WAL ? If you look at the output of "vmstat 10" and "iostat -m 10" (I'm assuming you're on Li

Re: [PERFORM] PostgreSQL 8.0 occasionally slow down

2007-06-28 Thread Ho Fat Tsang
Hi Richard, I have tuned the checkpoint_timeout to 30 second which is ten times less than default and the issue is still reproduced. Do you have any recommended configuration for WAL ? Thanks Twinsen 2007/6/28, Richard Huxton <[EMAIL PROTECTED]>: Ho Fat Tsang wrote: > > I am new for postg

Re: [PERFORM] PostgreSQL 8.0 occasionally slow down

2007-06-28 Thread Richard Huxton
Ho Fat Tsang wrote: I am new for postgresql server. And now i work on a projects which requires postgreSQL 8.0 and Java. I don't know why the server occasionally slow down a bit for every 3 minutes. Do anyone can help me about this ? or any resolution for a sudden performance degrade ( beca

Re: [PERFORM] PostgreSQL 8.0 occasionally slow down

2007-06-28 Thread Andreas Kostyrka
Two points: * need more information about the circumstances. * could it be that autovaccum hits you? Andreas -- Ursprüngl. Mitteil. -- Betreff:[PERFORM] PostgreSQL 8.0 occasionally slow down Von:"Ho Fat Tsang" <[EMAIL PROTECTED]> Datum: 28.06.2007 06:56

[PERFORM] PostgreSQL 8.0 occasionally slow down

2007-06-27 Thread Ho Fat Tsang
Hi, I am new for postgresql server. And now i work on a projects which requires postgreSQL 8.0 and Java. I don't know why the server occasionally slow down a bit for every 3 minutes. I have changed the log configuration so that it logs all statement transaction > 1000 ms and the result shown be