Re: [zfs-discuss] snv_133 - high cpu

2010-02-24 Thread Bruno Sousa
Hi, Until it's fixed the 132 build should be used instead of the 133? Bruno On 25-2-2010 3:22, Bart Smaalders wrote: > On 02/24/10 12:57, Bruno Sousa wrote: >> Yes i'm using the mtp driver . In total this system has 3 HBA's, 1 >> internal (Dell perc), and 2 Sun non-raid HBA's. >> I'm also using m

Re: [zfs-discuss] snv_133 - high cpu

2010-02-24 Thread Bart Smaalders
On 02/24/10 12:57, Bruno Sousa wrote: Yes i'm using the mtp driver . In total this system has 3 HBA's, 1 internal (Dell perc), and 2 Sun non-raid HBA's. I'm also using multipath, but if i disable multipath i have pretty much the same results.. Bruno From what I understand, the fix is expected

Re: [zfs-discuss] snv_133 - high cpu

2010-02-24 Thread Bruno Sousa
Yes i'm using the mtp driver . In total this system has 3 HBA's, 1 internal (Dell perc), and 2 Sun non-raid HBA's. I'm also using multipath, but if i disable multipath i have pretty much the same results.. Bruno On 24-2-2010 19:42, Andy Bowers wrote: > Hi Bart, > yep, I got Bruno to run a

Re: [zfs-discuss] snv_133 - high cpu

2010-02-24 Thread Andy Bowers
Hi Bart, yep, I got Bruno to run a kernel profile lockstat... it does look like the mpt issue.. andy :--- Count indv cuml rcnt nsec Hottest CPU+PILCaller 2861 7% 55% 0.00

Re: [zfs-discuss] snv_133 - high cpu

2010-02-24 Thread Bart Smaalders
On 02/23/10 15:20, Chris Ridd wrote: On 23 Feb 2010, at 19:53, Bruno Sousa wrote: The system becames really slow during the data copy using network, but i copy data between 2 pools of the box i don't notice that issue, so probably i may be hitting some sort of interrupt conflit in the networ

[zfs-discuss] snv_133 - high cpu - update

2010-02-24 Thread Bruno Sousa
Hi all, I still didn't find the problem but it seems to be related with interrupts sharing between onboard network cards (broadcom) and the intel 10gbE card PCI-e. Runing a simple iperf from a linux box to my zfs box, if i use bnx2 or bnx3 i have a performance over 100 mbs, but if i use bnx0, bxn1

Re: [zfs-discuss] snv_133 - high cpu

2010-02-23 Thread Chris Ridd
On 23 Feb 2010, at 19:53, Bruno Sousa wrote: > The system becames really slow during the data copy using network, but i copy > data between 2 pools of the box i don't notice that issue, so probably i may > be hitting some sort of interrupt conflit in the network cards...This system > is config

Re: [zfs-discuss] snv_133 - high cpu

2010-02-23 Thread Bruno Sousa
The system becames really slow during the data copy using network, but i copy data between 2 pools of the box i don't notice that issue, so probably i may be hitting some sort of interrupt conflit in the network cards...This system is configured with *alot *of interfaces, being : 4 internal broadc

Re: [zfs-discuss] snv_133 - high cpu

2010-02-23 Thread Bob Friesenhahn
On Tue, 23 Feb 2010, Bruno Sousa wrote: I don't have compression and deduplication enabled, but checksums are. However disabling checksums gives a 0.5 load reduction only... Since high CPU consumption is unusual, I would suspect a device driver issue. Perhaps there is an interrupt conflict s

Re: [zfs-discuss] snv_133 - high cpu

2010-02-23 Thread Bob Friesenhahn
On Tue, 23 Feb 2010, Eugen Leitl wrote: In terms of scaling, does zfs on OpenSolaris play well on multiple cores? How much disks (assuming 100 MByte/s throughput for each) would be considered pushing it for a current single-socket quadcore? In any large storage system, most disks are relativel

Re: [zfs-discuss] snv_133 - high cpu

2010-02-23 Thread Bruno Sousa
Hi Bob, I have neither deduplication or compression enabled. The checksum are enabled, but if try to disable it i gain aroud 0.5 less load on the box, so it still seems to be to much. Bruno On 23-2-2010 20:03, Bob Friesenhahn wrote: > On Tue, 23 Feb 2010, Bruno Sousa wrote: >> Could the fact of

Re: [zfs-discuss] snv_133 - high cpu

2010-02-23 Thread Bruno Sousa
Hi, I don't have compression and deduplication enabled, but checksums are. However disabling checksums gives a 0.5 load reduction only... Bruno On 23-2-2010 20:27, Eugen Leitl wrote: > On Tue, Feb 23, 2010 at 01:03:04PM -0600, Bob Friesenhahn wrote: > > >> Zfs can consume appreciable CPU if c

Re: [zfs-discuss] snv_133 - high cpu

2010-02-23 Thread Eugen Leitl
On Tue, Feb 23, 2010 at 01:03:04PM -0600, Bob Friesenhahn wrote: > Zfs can consume appreciable CPU if compression, sha256 checksums, > and/or deduplication is enabled. Otherwise, substantial CPU > consumption is unexpected. In terms of scaling, does zfs on OpenSolaris play well on multiple cor

Re: [zfs-discuss] snv_133 - high cpu

2010-02-23 Thread Bob Friesenhahn
On Tue, 23 Feb 2010, Bruno Sousa wrote: Could the fact of having a RAIDZ2 configuration be the cause for such a big load on the zfs box, or maybe am i missing something ? Zfs can consume appreciable CPU if compression, sha256 checksums, and/or deduplication is enabled. Otherwise, substantial

[zfs-discuss] snv_133 - high cpu

2010-02-23 Thread Bruno Sousa
Hi all, I'm currently evaluating the possibility of migrating a NFS server (Linux Centos 5.4 / RHEL 5.4 x64-32) based to a opensolaris box and i'm seeing some huge cpu usage in the opensolaris box. The zfs box is a Dell R710 with 2 Quad-Cores (Intel E5506 @ 2.13GHz), 16Gb ram , 2 Sun non-Raid HB