Re: [PERFORM] file system and raid performance

2008-12-09 Thread M. Edward (Ed) Borasky
Scott Marlowe wrote: > On Sun, Dec 7, 2008 at 10:59 PM, M. Edward (Ed) Borasky > <[EMAIL PROTECTED]> wrote: >> Ah, but shouldn't a PostgreSQL (or any other database, for that matter) >> have its own set of filesystems tuned to the application's I/O patterns? >> Sure, there are some people who need

Re: [PERFORM] file system and raid performance

2008-12-08 Thread david
On Mon, 8 Dec 2008, Scott Marlowe wrote: On Sun, Dec 7, 2008 at 10:59 PM, M. Edward (Ed) Borasky <[EMAIL PROTECTED]> wrote: Ah, but shouldn't a PostgreSQL (or any other database, for that matter) have its own set of filesystems tuned to the application's I/O patterns? Sure, there are some peopl

Re: [PERFORM] file system and raid performance

2008-12-08 Thread Scott Marlowe
On Sun, Dec 7, 2008 at 10:59 PM, M. Edward (Ed) Borasky <[EMAIL PROTECTED]> wrote: > Ah, but shouldn't a PostgreSQL (or any other database, for that matter) > have its own set of filesystems tuned to the application's I/O patterns? > Sure, there are some people who need to have all of their eggs in

Re: [PERFORM] file system and raid performance

2008-12-08 Thread Jean-David Beyer
M. Edward (Ed) Borasky wrote: Ah, but shouldn't a PostgreSQL (or any other database, for that matter) have its own set of filesystems tuned to the application's I/O patterns? Sure, there are some people who need to have all of their eggs in one basket because they can't afford multiple baskets.

Re: [PERFORM] file system and raid performance

2008-12-07 Thread M. Edward (Ed) Borasky
Bruce Momjian wrote: > Mark Mielke wrote: >> Greg Smith wrote: >>> On Fri, 15 Aug 2008, Bruce Momjian wrote: 'data=writeback' is the recommended mount method for that file system, though I see that is not mentioned in our official documentation. >>> While writeback has good perform

Re: [PERFORM] file system and raid performance

2008-12-06 Thread Bruce Momjian
Mark Mielke wrote: > Greg Smith wrote: > > On Fri, 15 Aug 2008, Bruce Momjian wrote: > >> 'data=writeback' is the recommended mount method for that file > >> system, though I see that is not mentioned in our official > >> documentation. > > While writeback has good performance characteristics, I

Re: [PERFORM] file system and raid performance

2008-08-18 Thread Mark Wong
On Fri, Aug 15, 2008 at 12:22 PM, Bruce Momjian <[EMAIL PROTECTED]> wrote: > Mark Wong wrote: >> On Mon, Aug 4, 2008 at 10:04 PM, <[EMAIL PROTECTED]> wrote: >> > On Mon, 4 Aug 2008, Mark Wong wrote: >> > >> >> Hi all, >> >> >> >> We've thrown together some results from simple i/o tests on Linux >>

Re: [PERFORM] file system and raid performance

2008-08-16 Thread Mark Mielke
Greg Smith wrote: On Fri, 15 Aug 2008, Bruce Momjian wrote: 'data=writeback' is the recommended mount method for that file system, though I see that is not mentioned in our official documentation. While writeback has good performance characteristics, I don't know that I'd go so far as to suppo

Re: [PERFORM] file system and raid performance

2008-08-15 Thread Greg Smith
On Fri, 15 Aug 2008, Bruce Momjian wrote: 'data=writeback' is the recommended mount method for that file system, though I see that is not mentioned in our official documentation. While writeback has good performance characteristics, I don't know that I'd go so far as to support making that an

Re: [PERFORM] file system and raid performance

2008-08-15 Thread Mark Wong
On Fri, Aug 15, 2008 at 12:22 PM, Bruce Momjian <[EMAIL PROTECTED]> wrote: > Mark Wong wrote: >> On Mon, Aug 4, 2008 at 10:04 PM, <[EMAIL PROTECTED]> wrote: >> > On Mon, 4 Aug 2008, Mark Wong wrote: >> > >> >> Hi all, >> >> >> >> We've thrown together some results from simple i/o tests on Linux >>

Re: [PERFORM] file system and raid performance

2008-08-15 Thread Bruce Momjian
Mark Wong wrote: > On Mon, Aug 4, 2008 at 10:04 PM, <[EMAIL PROTECTED]> wrote: > > On Mon, 4 Aug 2008, Mark Wong wrote: > > > >> Hi all, > >> > >> We've thrown together some results from simple i/o tests on Linux > >> comparing various file systems, hardware and software raid with a > >> little bi

Re: [PERFORM] file system and raid performance

2008-08-08 Thread Greg Smith
On Thu, 7 Aug 2008, Mark Mielke wrote: Now, modern Linux distributions default to "relatime" Right, but Mark's HP test system is running Gentoo. (ducks) According to http://brainstorm.ubuntu.com/idea/2369/ relatime is the default for Fedora 8, Mandriva 2008, Pardus, and Ubuntu 8.04. Anywa

Re: [PERFORM] file system and raid performance

2008-08-08 Thread Mark Wong
On Thu, Aug 7, 2008 at 3:08 PM, Mark Mielke <[EMAIL PROTECTED]> wrote: > Andrej Ricnik-Bay wrote: > > 2008/8/8 Scott Marlowe <[EMAIL PROTECTED]>: > > > noatime turns off the atime write behaviour. Or did you already know > that and I missed some weird post where noatime somehow managed to > slow d

Re: [PERFORM] file system and raid performance

2008-08-08 Thread Mark Wong
On Thu, Aug 7, 2008 at 3:08 PM, Mark Mielke <[EMAIL PROTECTED]> wrote: > Andrej Ricnik-Bay wrote: > > 2008/8/8 Scott Marlowe <[EMAIL PROTECTED]>: > > > noatime turns off the atime write behaviour. Or did you already know > that and I missed some weird post where noatime somehow managed to > slow d

Re: [PERFORM] file system and raid performance

2008-08-08 Thread Mark Wong
On Thu, Aug 7, 2008 at 3:08 PM, Mark Mielke <[EMAIL PROTECTED]> wrote: > Andrej Ricnik-Bay wrote: > > 2008/8/8 Scott Marlowe <[EMAIL PROTECTED]>: > > > noatime turns off the atime write behaviour. Or did you already know > that and I missed some weird post where noatime somehow managed to > slow d

Re: [PERFORM] file system and raid performance

2008-08-08 Thread Mark Wong
[EMAIL PROTECTED]; pgsql- >> [EMAIL PROTECTED]; Gabrielle Roth >> Subject: Re: [PERFORM] file system and raid performance >> > >> I have heard of one or two situations where the combination of the >> disk controller caused bizarre behaviors with different jou

Re: [PERFORM] file system and raid performance

2008-08-07 Thread Mark Mielke
Andrej Ricnik-Bay wrote: 2008/8/8 Scott Marlowe <[EMAIL PROTECTED]>: noatime turns off the atime write behaviour. Or did you already know that and I missed some weird post where noatime somehow managed to slow down performance? Scott, I'm quite aware of what noatime does ... you didn'

Re: [PERFORM] file system and raid performance

2008-08-07 Thread Scott Marlowe
On Thu, Aug 7, 2008 at 3:57 PM, Andrej Ricnik-Bay <[EMAIL PROTECTED]> wrote: > 2008/8/8 Scott Marlowe <[EMAIL PROTECTED]>: >> noatime turns off the atime write behaviour. Or did you already know >> that and I missed some weird post where noatime somehow managed to >> slow down performance? > > Sco

Re: [PERFORM] file system and raid performance

2008-08-07 Thread Gregory S. Youngblood
> -Original Message- > From: Mark Wong [mailto:[EMAIL PROTECTED] > Sent: Thursday, August 07, 2008 12:37 PM > To: Mario Weilguni > Cc: Mark Kirkwood; [EMAIL PROTECTED]; [EMAIL PROTECTED]; pgsql- > [EMAIL PROTECTED]; Gabrielle Roth > Subject: Re: [PERFORM] file system

Re: [PERFORM] file system and raid performance

2008-08-07 Thread Andrej Ricnik-Bay
2008/8/8 Scott Marlowe <[EMAIL PROTECTED]>: > noatime turns off the atime write behaviour. Or did you already know > that and I missed some weird post where noatime somehow managed to > slow down performance? Scott, I'm quite aware of what noatime does ... you didn't miss a post, but if you look

Re: [PERFORM] file system and raid performance

2008-08-07 Thread Scott Marlowe
On Thu, Aug 7, 2008 at 2:59 PM, Andrej Ricnik-Bay <[EMAIL PROTECTED]> wrote: > To me it still boggles the mind that noatime should actually slow down > activities on ANY file-system ... has someone got an explanation for > that kind of behaviour? As far as I'm concerned this means that even > to a

Re: [PERFORM] file system and raid performance

2008-08-07 Thread Andrej Ricnik-Bay
To me it still boggles the mind that noatime should actually slow down activities on ANY file-system ... has someone got an explanation for that kind of behaviour? As far as I'm concerned this means that even to any read I'll add the overhead of a write - most likely in a disk-location slightly of

Re: [PERFORM] file system and raid performance

2008-08-07 Thread Mark Wong
On Thu, Aug 7, 2008 at 3:21 AM, Mario Weilguni <[EMAIL PROTECTED]> wrote: > Mark Kirkwood schrieb: >> >> Mark Kirkwood wrote: >>> >>> You are right, it does (I may be recalling performance from my other >>> machine that has a 3Ware card - this was a couple of years ago...) Anyway, >>> I'm thinking

Re: [PERFORM] file system and raid performance

2008-08-07 Thread Mario Weilguni
Mark Kirkwood schrieb: Mark Kirkwood wrote: You are right, it does (I may be recalling performance from my other machine that has a 3Ware card - this was a couple of years ago...) Anyway, I'm thinking for the Hardware raid tests they may need to be specified. FWIW - of course this somewha

Re: [PERFORM] file system and raid performance

2008-08-07 Thread Mark Kirkwood
Mark Kirkwood wrote: You are right, it does (I may be recalling performance from my other machine that has a 3Ware card - this was a couple of years ago...) Anyway, I'm thinking for the Hardware raid tests they may need to be specified. FWIW - of course this somewhat academic given that th

Re: [PERFORM] file system and raid performance

2008-08-06 Thread Mark Kirkwood
Gregory S. Youngblood wrote: From: Mark Kirkwood [mailto:[EMAIL PROTECTED] Mark Wong wrote: On Mon, Aug 4, 2008 at 10:56 PM, Gregory S. Youngblood <[EMAIL PROTECTED]> wrote: I recently ran some tests on Ubuntu Hardy Server (Linux) comparing JFS, XFS, and ZFS+FU

Re: [PERFORM] file system and raid performance

2008-08-05 Thread Mark Kirkwood
Mark Wong wrote: On Mon, Aug 4, 2008 at 10:56 PM, Gregory S. Youngblood <[EMAIL PROTECTED]> wrote: I recently ran some tests on Ubuntu Hardy Server (Linux) comparing JFS, XFS, and ZFS+FUSE. It was all 32-bit and on old hardware, plus I only used bonnie++, so the numbers are really only usefu

Re: [PERFORM] file system and raid performance

2008-08-05 Thread Gregory S. Youngblood
> From: Mark Kirkwood [mailto:[EMAIL PROTECTED] > Mark Wong wrote: > > On Mon, Aug 4, 2008 at 10:56 PM, Gregory S. Youngblood > <[EMAIL PROTECTED]> wrote: > > > >> I recently ran some tests on Ubuntu Hardy Server (Linux) comparing > JFS, XFS, > >> and ZFS+FUSE. It was all 32-bit and on old hardware

Re: [PERFORM] file system and raid performance

2008-08-05 Thread Fernando Ike
On Tue, Aug 5, 2008 at 4:54 AM, Mark Wong <[EMAIL PROTECTED]> wrote: > Hi all, Hi > We've thrown together some results from simple i/o tests on Linux > comparing various file systems, hardware and software raid with a > little bit of volume management: > > http://wiki.postgresql.org/wiki/HP_ProLi

Re: [PERFORM] file system and raid performance

2008-08-05 Thread Mark Wong
On Mon, Aug 4, 2008 at 10:56 PM, Gregory S. Youngblood <[EMAIL PROTECTED]> wrote: > I recently ran some tests on Ubuntu Hardy Server (Linux) comparing JFS, XFS, > and ZFS+FUSE. It was all 32-bit and on old hardware, plus I only used > bonnie++, so the numbers are really only useful for my hardware

Re: [PERFORM] file system and raid performance

2008-08-05 Thread Mark Wong
On Mon, Aug 4, 2008 at 10:04 PM, <[EMAIL PROTECTED]> wrote: > On Mon, 4 Aug 2008, Mark Wong wrote: > >> Hi all, >> >> We've thrown together some results from simple i/o tests on Linux >> comparing various file systems, hardware and software raid with a >> little bit of volume management: >> >> htt

Re: [PERFORM] file system and raid performance

2008-08-05 Thread Gregory S. Youngblood
I recently ran some tests on Ubuntu Hardy Server (Linux) comparing JFS, XFS, and ZFS+FUSE. It was all 32-bit and on old hardware, plus I only used bonnie++, so the numbers are really only useful for my hardware. What parameters were used to create the XFS partition in these tests? And, what optio

Re: [PERFORM] file system and raid performance

2008-08-04 Thread david
On Mon, 4 Aug 2008, Mark Wong wrote: Hi all, We've thrown together some results from simple i/o tests on Linux comparing various file systems, hardware and software raid with a little bit of volume management: http://wiki.postgresql.org/wiki/HP_ProLiant_DL380_G5_Tuning_Guide What I'd like to

[PERFORM] file system and raid performance

2008-08-04 Thread Mark Wong
Hi all, We've thrown together some results from simple i/o tests on Linux comparing various file systems, hardware and software raid with a little bit of volume management: http://wiki.postgresql.org/wiki/HP_ProLiant_DL380_G5_Tuning_Guide What I'd like to ask of the folks on the list is how rele