Re: [PERFORM] Very slow checkpoints

2015-03-18 Thread Steven Jones
Hi, >> >> Device: rrqm/s wrqm/s r/s w/s rkB/s wkB/s avgrq-sz >> avgqu-sz await r_await w_await svctm %util >> sda 0.00 0.00 0.00 5.00 0.00 2056.00 822.40 >> 0.00 0.00 0.00 0.00 0.00 0.00 >> sdb 0.00 0.00 1055.00 549.00 41166.50 22840.00 79.81 >> 5.28 3.28 4.94 0.10 0.62 100.00 > Your sdb is satura

Re: [PERFORM] Very slow checkpoints

2015-03-18 Thread Steven Jones
ry slow checkpoints > To: steven.jones1...@outlook.com > CC: pgsql-performance@postgresql.org > > On Wed, Mar 18, 2015 at 12:21 PM, Steven Jones > wrote: >> - typical DW - relatively constant periodic data loads - i.e. heavy write >> - we receive large CSV files ~ 5-

Re: [PERFORM] Very slow checkpoints

2015-03-18 Thread Steven Jones
bject: Re: [PERFORM] Very slow checkpoints > To: steven.jones1...@outlook.com > CC: pgsql-performance@postgresql.org > > On Wed, Mar 18, 2015 at 12:58 PM, Steven Jones > wrote: >> Yes BBU is on the controller; 1024Mb. It is a HP P410i controller, with >> write caching t

Re: [PERFORM] Very slow checkpoints

2015-03-18 Thread Steven Jones
[PERFORM] Very slow checkpoints > To: steven.jones1...@outlook.com > CC: pgsql-performance@postgresql.org > > Hi Steven, > > On Wed, Mar 18, 2015 at 12:21 PM, Steven Jones > wrote: >> - system is HP blade; 128Gb RAM, 2x 8-core, 12x 10k RPM RAID1+0 (database) > >

Re: [PERFORM] Very slow checkpoints

2015-03-18 Thread Steven Jones
Apologies about the formatting; resending again as plain-text. Regards, Steve From: steven.jones1...@outlook.com To: pgsql-performance@postgresql.org Subject: [PERFORM] Very slow checkpoints Date: Wed, 18 Mar 2015 11:21:08 + Hi, We have a so far (to us) unexplainable issue on our productio

[PERFORM] Very slow checkpoints

2015-03-18 Thread Steven Jones
Hi, We have a so far (to us) unexplainable issue on our production systems after we roughly doubled the amount of data we import daily. We should be ok on pure theoretical hardware performance, but we are seeing some weird IO counters when the actual throughput of the writes is very low. The use