Re: [GENERAL] checkpoints/bgwriter tuning verification

2009-11-20 Thread Andres Freund
On Friday 30 October 2009 15:30:34 Vick Khera wrote: > I really don't think I'm saturating the disk bandwidth. I see spikes > of 18MB/s or more, but it usually hovers at under 3MB/s according to > iostat output. Looking at the iostat -x output is often more interesting - especially the utilizatio

Re: [GENERAL] checkpoints/bgwriter tuning verification

2009-10-30 Thread Vick Khera
On Thu, Oct 29, 2009 at 10:24 PM, Greg Smith wrote: > There are two ways that that writes can hang: > > 1) You've gotten to the point in the checkpoint cycle where it's calling > fsync to flush everything out of the filesystem.  At this point you could > potentially have a big chunk of data that n

Re: [GENERAL] checkpoints/bgwriter tuning verification

2009-10-30 Thread Vick Khera
On Thu, Oct 29, 2009 at 4:42 PM, Scott Marlowe wrote: > First step to speed things up is putting pg_xlog on its own disk(s). > Since pg_xlog is mostly sequentially access, it's much faster when > Did that with a symlink. I always do that. My frustration is that I have this really fast RAID subs

Re: [GENERAL] checkpoints/bgwriter tuning verification

2009-10-30 Thread Guillaume Lelarge
Le vendredi 30 octobre 2009 à 03:24:05, Greg Smith a écrit : > On Thu, 29 Oct 2009, Vick Khera wrote: > > Greg, do you have a performance tuning book? If so, I really want to > > buy it! Your articles are awesome. > > Give me a few more months... > Are you kidding or is it a great teaser? it w

Re: [GENERAL] checkpoints/bgwriter tuning verification

2009-10-30 Thread Brad Nicholson
On Fri, 2009-10-30 at 07:15 -0400, Steve Clark wrote: > On 10/29/2009 04:42 PM, Scott Marlowe wrote: > > On Thu, Oct 29, 2009 at 12:46 PM, Vick Khera wrote: > >> On my primary DB I'm observing random slowness which just doesn't make > >> sense to me. The I/O system can easily do 40MB/sec writes,

Re: [GENERAL] checkpoints/bgwriter tuning verification

2009-10-30 Thread Steve Clark
On 10/29/2009 04:42 PM, Scott Marlowe wrote: On Thu, Oct 29, 2009 at 12:46 PM, Vick Khera wrote: On my primary DB I'm observing random slowness which just doesn't make sense to me. The I/O system can easily do 40MB/sec writes, but I'm only seeing a sustained 5MB/sec, even as the application is

Re: [GENERAL] checkpoints/bgwriter tuning verification

2009-10-29 Thread Greg Smith
On Thu, 29 Oct 2009, Vick Khera wrote: Greg, do you have a performance tuning book? If so, I really want to buy it! Your articles are awesome. Give me a few more months... basically, the next checkpoint starts within a few seconds of the prior one completing. That's the expected behavior

Re: [GENERAL] checkpoints/bgwriter tuning verification

2009-10-29 Thread Scott Marlowe
On Thu, Oct 29, 2009 at 12:46 PM, Vick Khera wrote: > On my primary DB I'm observing random slowness which just doesn't make > sense to me.  The I/O system can easily do 40MB/sec writes, but I'm > only seeing a sustained 5MB/sec, even as the application is stalling > waiting on the DB. Just one p

Re: [GENERAL] checkpoints/bgwriter tuning verification

2009-10-29 Thread Brad Nicholson
On Thu, 2009-10-29 at 14:46 -0400, Vick Khera wrote: > On my primary DB I'm observing random slowness which just doesn't make > sense to me. The I/O system can easily do 40MB/sec writes, but I'm > only seeing a sustained 5MB/sec, even as the application is stalling > waiting on the DB. > > My onl

[GENERAL] checkpoints/bgwriter tuning verification

2009-10-29 Thread Vick Khera
On my primary DB I'm observing random slowness which just doesn't make sense to me. The I/O system can easily do 40MB/sec writes, but I'm only seeing a sustained 5MB/sec, even as the application is stalling waiting on the DB. My only guess is that I'm getting hit by checkpoints too often, and thi