Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Scott Carey
On 4/28/09 5:10 PM, "Whit Armstrong" wrote: > Thanks, Scott. > > So far, I've followed a pattern similar to Scott Marlowe's setup. I > have configured 2 disks as a RAID 1 volume, and 4 disks as a RAID 10 > volume. So, the OS and xlogs will live on the RAID 1 vol and the data > will live on th

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Scott Carey
On 4/28/09 5:02 PM, "Whit Armstrong" wrote: > are there any other xfs settings that should be tuned for postgres? > > I see this post mentions "allocation groups." does anyone have > suggestions for those settings? > http://archives.postgresql.org/pgsql-admin/2009-01/msg00144.php > > what abo

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Scott Marlowe
On Tue, Apr 28, 2009 at 5:58 PM, Scott Carey wrote: > 1.  If everything is on the same partition/file system, fsyncs from the > xlogs may cross-pollute to the data.  Ext3 is notorious for this, though > data=writeback limits the effect you especially might not want > data=writeback on your OS par

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Whit Armstrong
Thanks, Scott. So far, I've followed a pattern similar to Scott Marlowe's setup. I have configured 2 disks as a RAID 1 volume, and 4 disks as a RAID 10 volume. So, the OS and xlogs will live on the RAID 1 vol and the data will live on the RAID 10 vol. I'm running the memtest on it now, so we st

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Whit Armstrong
are there any other xfs settings that should be tuned for postgres? I see this post mentions "allocation groups." does anyone have suggestions for those settings? http://archives.postgresql.org/pgsql-admin/2009-01/msg00144.php what about raid stripe size? does it really make a difference? I th

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Scott Carey
>> >> server information: >> Dell PowerEdge 2970, 8 core Opteron 2384 >> 6 1TB hard drives with a PERC 6i >> 64GB of ram > > We're running a similar configuration: PowerEdge 8 core, PERC 6i, but we have > 8 of the 2.5" 10K 384GB disks. > > When I asked the same question on this forum, I was advi

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Scott Carey
On 4/28/09 11:16 AM, "Craig James" wrote: > Kenneth Marshall wrote: Additionally are there any clear choices w/ regard to filesystem types? ?Our choices would be xfs, ext3, or ext4. >>> Well, there's a lot of people who use xfs and ext3. XFS is generally >>> rated higher than ext3 both

Re: [PERFORM] pg_lock_status() performance

2009-04-28 Thread Tom Lane
Merlin Moncure writes: >> On Tue, Apr 28, 2009 at 5:41 PM, Tom Lane wrote: >>> [squint...]  AFAICS the only *direct* cost component in pg_lock_status >>> is the number of locks actually held or awaited.  If there's a >>> noticeable component that depends on max_locks_per_transaction, it must >>>

Re: [PERFORM] pg_lock_status() performance

2009-04-28 Thread Merlin Moncure
On Tue, Apr 28, 2009 at 5:42 PM, Merlin Moncure wrote: > On Tue, Apr 28, 2009 at 5:41 PM, Tom Lane wrote: >> Merlin Moncure writes: >>> I have a unloaded development server running 8.4b1 that is returning >>> from a 'select * from pg_locks' in around 5 ms.  While the time itself >>> is not a big

Re: [PERFORM] pg_lock_status() performance

2009-04-28 Thread Merlin Moncure
On Tue, Apr 28, 2009 at 5:41 PM, Tom Lane wrote: > Merlin Moncure writes: >> I have a unloaded development server running 8.4b1 that is returning >> from a 'select * from pg_locks' in around 5 ms.  While the time itself >> is not a big deal, I was curious and tested querying locks on a fairly >>

Re: [PERFORM] pg_lock_status() performance

2009-04-28 Thread Tom Lane
Merlin Moncure writes: > I have a unloaded development server running 8.4b1 that is returning > from a 'select * from pg_locks' in around 5 ms. While the time itself > is not a big deal, I was curious and tested querying locks on a fairly > busy (200-500 tps sustained) running 8.2 on inferior ha

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Scott Marlowe
On Tue, Apr 28, 2009 at 12:40 PM, Kenneth Marshall wrote: > On Tue, Apr 28, 2009 at 01:30:59PM -0500, Kevin Grittner wrote: >> Craig James wrote: >> >> > After a reading various articles, I thought that "noop" was the >> > right choice when you're using a battery-backed RAID controller. >> > The

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Scott Marlowe
On Tue, Apr 28, 2009 at 12:37 PM, Whit Armstrong wrote: >>  echo noop >/sys/block/hdx/queue/scheduler > > can this go into /etc/init.d somewhere? > > or does that change stick between reboots? I just stick in /etc/rc.local -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Whit Armstrong
I see. Thanks for everyone for replying. The whole discussion has been very helpful. Cheers, Whit On Tue, Apr 28, 2009 at 3:13 PM, Kevin Grittner wrote: > Whit Armstrong wrote: >>>   echo noop >/sys/block/hdx/queue/scheduler >> >> can this go into /etc/init.d somewhere? > > We set the defaul

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Scott Marlowe
On Tue, Apr 28, 2009 at 12:06 PM, Kenneth Marshall wrote: > On Tue, Apr 28, 2009 at 11:56:25AM -0600, Scott Marlowe wrote: >> On Tue, Apr 28, 2009 at 11:48 AM, Whit Armstrong >> wrote: >> > Thanks, Scott. >> > >> > Just to clarify you said: >> > >> >> postgres. ?So, my pg_xlog and all OS and logg

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Kevin Grittner
Whit Armstrong wrote: >> echo noop >/sys/block/hdx/queue/scheduler > > can this go into /etc/init.d somewhere? We set the default for the kernel in the /boot/grub/menu.lst file. On a kernel line, add elevator=xxx (where xxx is your choice of scheduler). -Kevin -- Sent via pgsql-perfor

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Whit Armstrong
> echo noop >/sys/block/hdx/queue/scheduler can this go into /etc/init.d somewhere? or does that change stick between reboots? -Whit On Tue, Apr 28, 2009 at 2:16 PM, Craig James wrote: > Kenneth Marshall wrote: Additionally are there any clear choices w/ regard to filesystem t

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Kenneth Marshall
On Tue, Apr 28, 2009 at 01:30:59PM -0500, Kevin Grittner wrote: > Craig James wrote: > > > After a reading various articles, I thought that "noop" was the > > right choice when you're using a battery-backed RAID controller. > > The RAID controller is going to cache all data and reschedule the

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Kevin Grittner
Craig James wrote: > After a reading various articles, I thought that "noop" was the > right choice when you're using a battery-backed RAID controller. > The RAID controller is going to cache all data and reschedule the > writes anyway, so the kernal schedule is irrelevant at best, and can > s

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Craig James
Kenneth Marshall wrote: Additionally are there any clear choices w/ regard to filesystem types? ?Our choices would be xfs, ext3, or ext4. Well, there's a lot of people who use xfs and ext3. XFS is generally rated higher than ext3 both for performance and reliability. However, we run Centos 5 i

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Alan Hodgson
On Tuesday 28 April 2009, Whit Armstrong wrote: > Additionally are there any clear choices w/ regard to filesystem > types? Our choices would be xfs, ext3, or ext4. xfs consistently delivers much higher sequential throughput than ext3 (up to 100%), at least on my hardware. -- Even a sixth-gra

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Craig James
Whit Armstrong wrote: I have the opportunity to set up a new postgres server for our production database. I've read several times in various postgres lists about the importance of separating logs from the actual database data to avoid disk contention. Can someone suggest a typical partitioning

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Kenneth Marshall
On Tue, Apr 28, 2009 at 11:56:25AM -0600, Scott Marlowe wrote: > On Tue, Apr 28, 2009 at 11:48 AM, Whit Armstrong > wrote: > > Thanks, Scott. > > > > Just to clarify you said: > > > >> postgres. ?So, my pg_xlog and all OS and logging stuff goes on the > >> RAID-10 and the main store for the db goe

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Scott Marlowe
On Tue, Apr 28, 2009 at 11:48 AM, Whit Armstrong wrote: > Thanks, Scott. > > Just to clarify you said: > >> postgres.  So, my pg_xlog and all OS and logging stuff goes on the >> RAID-10 and the main store for the db goes on the RAID-10. > > Is that meant to be that the pg_xlog and all OS and loggi

[PERFORM] pg_lock_status() performance

2009-04-28 Thread Merlin Moncure
I have a unloaded development server running 8.4b1 that is returning from a 'select * from pg_locks' in around 5 ms. While the time itself is not a big deal, I was curious and tested querying locks on a fairly busy (200-500 tps sustained) running 8.2 on inferior hardware. This returned (after an

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Whit Armstrong
Thanks, Scott. Just to clarify you said: > postgres.  So, my pg_xlog and all OS and logging stuff goes on the > RAID-10 and the main store for the db goes on the RAID-10. Is that meant to be that the pg_xlog and all OS and logging stuff go on the RAID-1 and the real database (the /var/lib/postgr

Re: [PERFORM] partition question for new server setup

2009-04-28 Thread Scott Marlowe
On Tue, Apr 28, 2009 at 10:56 AM, Whit Armstrong wrote: > I have the opportunity to set up a new postgres server for our > production database.  I've read several times in various postgres > lists about the importance of separating logs from the actual database > data to avoid disk contention. > >

[PERFORM] partition question for new server setup

2009-04-28 Thread Whit Armstrong
I have the opportunity to set up a new postgres server for our production database. I've read several times in various postgres lists about the importance of separating logs from the actual database data to avoid disk contention. Can someone suggest a typical partitioning scheme for a postgres se

[PERFORM] any interest of changing the page size ?

2009-04-28 Thread Laurent Laborde
Friendly greetings ! According to : http://developer.postgresql.org/pgdocs/postgres/storage-page-layout.html Every table and index is stored as an array of pages of a fixed size (usually 8 kB, although a different page size can be selected when compiling the server). Is there any usage/interest