Re: RAID 5 performance issue.

2007-10-11 Thread Andrew Clayton
On Thu, 11 Oct 2007 13:06:39 -0400, Bill Davidsen wrote: > Andrew Clayton wrote: > > On Fri, 5 Oct 2007 16:56:03 -0400, John Stoffel wrote: > > > > >> Can you start a 'vmstat 1' in one window, then start whatever > > >> you do > >> to

Re: RAID 5 performance issue.

2007-10-07 Thread Andrew Clayton
On Fri, 5 Oct 2007 16:56:03 -0400, John Stoffel wrote: > Can you start a 'vmstat 1' in one window, then start whatever you do > to get crappy performance. That would be interesting to see. In trying to find something simple that can show the problem I'm seeing. I think I may have found the culpr

Re: RAID 5 performance issue.

2007-10-06 Thread Andrew Clayton
On Wed, 3 Oct 2007 12:48:27 -0400 (EDT), Justin Piszcz wrote: > Also if it is software raid, when you make the XFS filesyste, on it, > it sets up a proper (and tuned) sunit/swidth, so why would you want > to change that? Oh I didn't, the sunit and swidth were set automatically. Do they look sane?

Re: RAID 5 performance issue.

2007-10-05 Thread Andrew Clayton
On Fri, 5 Oct 2007 15:02:22 -0400, John Stoffel wrote: > > How much memory does this system have? Have you checked the output of 2GB > /proc/mtrr at all? There' have been reports of systems with a bad $ cat /proc/mtrr reg00: base=0x ( 0MB), size=2048MB: write-back, count=1 > BIOS

Re: RAID 5 performance issue.

2007-10-05 Thread Andrew Clayton
On Fri, 5 Oct 2007 12:16:07 -0400 (EDT), Justin Piszcz wrote: > > Hm, unfortunately at this point I think I am out of ideas you may > need to ask the XFS/linux-raid developers how to run blktrace during > those operations to figure out what is going on. No problem, cheers. > BTW: Last thing I

Re: RAID 5 performance issue.

2007-10-05 Thread Andrew Clayton
On Fri, 5 Oct 2007 10:07:47 -0400 (EDT), Justin Piszcz wrote: > Yikes, yeah I would get them off the PCI card, what kind of > motherboard is it? If you don't have a PCI-e based board it probably > won't help THAT much but it still should be better than placing 3 > drives on a PCI card. Moved the

Re: RAID 5 performance issue.

2007-10-05 Thread Andrew Clayton
On Fri, 5 Oct 2007 10:07:47 -0400 (EDT), Justin Piszcz wrote: > Yikes, yeah I would get them off the PCI card, what kind of > motherboard is it? If you don't have a PCI-e based board it probably > won't help THAT much but it still should be better than placing 3 > drives on a PCI card. It's a Ty

Re: RAID 5 performance issue.

2007-10-05 Thread Andrew Clayton
On Fri, 5 Oct 2007 13:53:12 +0100, Andrew Clayton wrote: > Unfortunately problem remains. > > I'll try the noop scheduler as I don't think I ever tried that one. Didn't help either, oh well. If I hit the disk in workstation with a big dd then in iostat I see it maxi

Re: RAID 5 performance issue.

2007-10-05 Thread Andrew Clayton
On Fri, 5 Oct 2007 07:08:51 -0400 (EDT), Justin Piszcz wrote: > The mount options are from when the filesystem was made for > sunit/swidth I believe. > > -N Causes the file system parameters to be printed > out without really creating the file system. > > You should be able to ru

Re: RAID 5 performance issue.

2007-10-05 Thread Andrew Clayton
On Fri, 5 Oct 2007 06:25:20 -0400 (EDT), Justin Piszcz wrote: > So you have 3 SATA 1 disks: Yeah, 3 of them in the array, there is a fourth standalone disk which contains the root fs from which the system boots.. > http://digital-domain.net/kernel/sw-raid5-issue/mdadm-D > > Do you compile your

Re: RAID 5 performance issue.

2007-10-04 Thread Andrew Clayton
On Thu, 04 Oct 2007 12:46:05 -0400, Steve Cousins wrote: > Andrew Clayton wrote: > > On Thu, 4 Oct 2007 10:39:09 -0400 (EDT), Justin Piszcz wrote: > > > > > > >> What type (make/model) of the drives? > >> > > > The drives are 250GB H

Re: RAID 5 performance issue.

2007-10-04 Thread Andrew Clayton
On Thu, 4 Oct 2007 12:19:20 -0400 (EDT), Justin Piszcz wrote: > > 7K250 > > http://www.itreviews.co.uk/hardware/h912.htm > > http://techreport.com/articles.x/8362 > "The T7K250 also supports Native Command Queuing (NCQ)." > > You need to enable AHCI in order to reap the benefits though. Cheer

Re: RAID 5 performance issue.

2007-10-04 Thread Andrew Clayton
On Thu, 4 Oct 2007 12:20:25 -0400 (EDT), Justin Piszcz wrote: > > > On Thu, 4 Oct 2007, Andrew Clayton wrote: > > > On Thu, 4 Oct 2007 10:10:02 -0400 (EDT), Justin Piszcz wrote: > > > > > >> Also, did performance just go to crap one day or was it gradu

Re: RAID 5 performance issue.

2007-10-04 Thread Andrew Clayton
On Thu, 4 Oct 2007 10:39:09 -0400 (EDT), Justin Piszcz wrote: > What type (make/model) of the drives? The drives are 250GB Hitachi Deskstar 7K250 series ATA-6 UDMA/100 > True, the controller may not be able to do it either. > > What types of disks/controllers again? The RAID disks are curren

Re: RAID 5 performance issue.

2007-10-04 Thread Andrew Clayton
On Thu, 4 Oct 2007 10:10:02 -0400 (EDT), Justin Piszcz wrote: > Also, did performance just go to crap one day or was it gradual? IIRC I just noticed one day that firefox and vim was stalling. That was back in February/March I think. At the time the server was running a 2.6.18 kernel, since then

Re: RAID 5 performance issue.

2007-10-04 Thread Andrew Clayton
On Thu, 4 Oct 2007 10:09:22 -0400 (EDT), Justin Piszcz wrote: > Is NCQ enabled on the drives? I don't think the drives are capable of that. I don't seen any mention of NCQ in dmesg. Andrew - To unsubscribe from this list: send the line "unsubscribe linux-raid" in the body of a message to [EMAIL

Re: RAID 5 performance issue.

2007-10-04 Thread Andrew Clayton
On Wed, 3 Oct 2007 13:36:39 -0700, David Rees wrote: > Not bad, but not that good, either. Try running xfs_fsr into a nightly > cronjob. By default, it will defrag mounted xfs filesystems for up to > 2 hours. Typically this is enough to keep fragmentation well below 1%. I ran it last night on the

Re: RAID 5 performance issue.

2007-10-03 Thread Andrew Clayton
On Wed, 3 Oct 2007 13:36:39 -0700, David Rees wrote: > > # xfs_db -c frag -f /dev/md0 > > actual 1828276, ideal 1708782, fragmentation factor 6.54% > > > > Good or bad? > > Not bad, but not that good, either. Try running xfs_fsr into a nightly > cronjob. By default, it will defrag mounted xfs fil

Re: RAID 5 performance issue.

2007-10-03 Thread Andrew Clayton
On Wed, 3 Oct 2007 16:35:21 -0400 (EDT), Justin Piszcz wrote: > What does cat /sys/block/md0/md/mismatch_cnt say? $ cat /sys/block/md0/md/mismatch_cnt 0 > That fragmentation looks normal/fine. Cool. > Justin. Andrew - To unsubscribe from this list: send the line "unsubscribe linux-raid" in th

Re: RAID 5 performance issue.

2007-10-03 Thread Andrew Clayton
On Wed, 03 Oct 2007 19:53:08 +0200, Goswin von Brederlow wrote: > Andrew Clayton <[EMAIL PROTECTED]> writes: > > > Hi, > > > > Hardware: > > > > Dual Opteron 2GHz cpus. 2GB RAM. 4 x 250GB SATA hard drives. 1 > > (root file system) is connected

Re: RAID 5 performance issue.

2007-10-03 Thread Andrew Clayton
On Wed, 3 Oct 2007 12:43:24 -0400 (EDT), Justin Piszcz wrote: > Have you checked fragmentation? You know, that never even occurred to me. I've gotten into the mind set that it's generally not a problem under Linux. > xfs_db -c frag -f /dev/md3 > > What does this report? # xfs_db -c frag -f /de

RAID 5 performance issue.

2007-10-03 Thread Andrew Clayton
Hi, Hardware: Dual Opteron 2GHz cpus. 2GB RAM. 4 x 250GB SATA hard drives. 1 (root file system) is connected to the onboard Silicon Image 3114 controller. The other 3 (/home) are in a software RAID 5 connected to a PCI Silicon Image 3124 card. I moved the 3 raid disks off the on board controll