[PERFORM] local-storage versus SAN sequential read performance comparison

This is outside of PG performance proper, but while testing pg_dump and pg_restore performance on local-storage versus SAN storage I noticed a big performance drops on in the SAN configuration. I'm told that both local storage and SAN storage are 15k drives with local-storage running dual RAID1 con

Re: [PERFORM] Configuration Recommendations

Oops - couple of corrections and clarifications below... On Sat, May 19, 2012 at 9:47 AM, Jan Nielsen wrote: > After seeing less much performance during pg_dump and pg_restore > operations from a 10x15k SAN RAID1+1 XFS mount > 10x15k RAID1+0 on a SAN with XFS on /dev/sdc > (al

Re: [PERFORM] Configuration Recommendations

After seeing less much performance during pg_dump and pg_restore operations from a 10x15k SAN RAID1+1 XFS mount ( allocsize=256m,attr2,logbufs=8,logbsize=256k,noatime,nobarrier) than the local-storage 2x15k RAID1 EXT4 mount, I ran the following test of the effect of read-ahead (RA): for t in `seq

Re: [PERFORM] Configuration Recommendations

On Tue, May 15, 2012 at 11:53 AM, Greg Sabino Mullane wrote: > >>> Is it established practice in the Postgres world to separate indexes > >>> from tables? I would assume that the reasoning of Richard Foote - > >>> albeit for Oracle databases - is also true for Postgres: > > > >> Yes, it's an estab

Re: [PERFORM] Configuration Recommendations

Starting to get some quantitative data now. Here is the results from the pgbench scaling: pgbench -t 2000 -c 32 -S pgbench for scales of 2^n where n=0..14 for scale, DB size in MB, and transactions per second: Scale DB Size TPS --- 1 21 65618 2 36 66060

Re: [PERFORM] Configuration Recommendations

Hi John, On Thu, May 3, 2012 at 12:54 AM, John Lister wrote: > On 03/05/2012 03:10, Jan Nielsen wrote: > > > 300GB RAID10 2x15k drive for OS on local storage > */dev/sda1 RA*4096 > */dev/sda1 FS*

Re: [PERFORM] Configuration Recommendations

On Thu, May 3, 2012 at 7:05 AM, Shaun Thomas wrote: > I like to follow this: > > http://www.westnet.com/~**gsmith/content/linux-pdflush.**htm > Thanks for the reference, Shaun. > As a note, there are actually new tunables for some of t

Re: [PERFORM] Configuration Recommendations

Hi Robert, On Thu, May 3, 2012 at 1:28 AM, Robert Klemme wrote: > Hi Jan, > > On Thu, May 3, 2012 at 4:10 AM, Jan Nielsen > wrote: > > Below is the hardware, firmware, OS, and PG configuration pieces that I'm > > settling in on. As was noted, the local storage

Re: [PERFORM] Configuration Recommendations

Below is the hardware, firmware, OS, and PG configuration pieces that I'm settling in on. As was noted, the local storage used for OS is actually two disks with RAID 10. If anything appears like a mistake or something is missing, I'd appreciate the feedback. I'm still working on the benchmarks scr

Re: [PERFORM] Parallel Scaling of a pgplsql problem

On Wed, Apr 25, 2012 at 12:52 PM, Venki Ramachandran < venki_ramachand...@yahoo.com> wrote: > Hi all: > Can someone please guide me as to how to solve this problem? If this is > the wrong forum, please let me know which one to post this one in. I am new > to Postgres (about 3 months into it) > > I

Re: [PERFORM] Configuration Recommendations

Oopps; looping in the list... On Tue, Apr 24, 2012 at 8:57 PM, Jan Nielsen wrote: > On Mon, Apr 23, 2012 at 11:53 PM, Robert Klemme < > shortcut...@googlemail.com> wrote: > >> On Tue, Apr 24, 2012 at 4:56 AM, Jan Nielsen >> wrote: >> > We are conside

Re: [PERFORM] Configuration Recommendations

On Tue, Apr 24, 2012 at 1:32 PM, Shaun Thomas wrote: > On 04/23/2012 09:56 PM, Jan Nielsen wrote: > > The new hardware for the 50GB PG 9.0 machine is: >> * 24 cores across 2 sockets >> * 64 GB RAM >> * 10 x 15k SAS drives on SAN >> * 1 x 15k SAS drive loc

[PERFORM] Configuration Recommendations

I'm a n00b [1] to tuning DBs so if anyone has a bit of time to provide feedback, I'd sure appreciate any input the community might have on the plan, configuration, etc. I could very well have unintentionally left-off crucial parts of my descriptions below and for that I apologize for wasting time -