Re: Major SMP problems with lstat/namei

2008-10-03 Thread Jeff Wheelhouse
On Oct 1, 2008, at 5:17 PM, John Baldwin wrote: It sounds like you missed some of the dirhash changes somehow, as dirhash no longer has any lockmgr stuff in it (and only ever did in HEAD). I've generated a patch though using svn. You can grab it from http://www.FreeBSD.org/~jhb/patches/ufs_lo

Re: Major SMP problems with lstat/namei

2008-10-01 Thread John Baldwin
On Thursday 25 September 2008 07:00:04 pm Jeff Wheelhouse wrote: > > On Sep 24, 2008, at 12:12 PM, John Baldwin wrote: > > Shared lookups only work on the NFS client in 6.x. I'm about to > > turn them on > > for UFS in HEAD (8.x) and will backport the needed fixes to 7.x > > after 7.1 > > (to

Re: Major SMP problems with lstat/namei

2008-09-26 Thread John Baldwin
On Friday 26 September 2008 05:20:14 am Dag-Erling Smørgrav wrote: > Jeff Wheelhouse <[EMAIL PROTECTED]> writes: > > http://software.wheelhouse.org/rptest.tar.bz2 > > Thanks. I get similar results on head; vfs.lookup_shared actually seems > to *reduce* performance by about 10% - 20%. I ran the t

Re: Major SMP problems with lstat/namei

2008-09-26 Thread Dag-Erling Smørgrav
Jeff Wheelhouse <[EMAIL PROTECTED]> writes: > http://software.wheelhouse.org/rptest.tar.bz2 Thanks. I get similar results on head; vfs.lookup_shared actually seems to *reduce* performance by about 10% - 20%. I ran the test on both UFS and ZFS; there is no significant difference. DES -- Dag-Erl

Re: Major SMP problems with lstat/namei

2008-09-25 Thread Jeff Wheelhouse
On Sep 24, 2008, at 12:12 PM, John Baldwin wrote: Shared lookups only work on the NFS client in 6.x. I'm about to turn them on for UFS in HEAD (8.x) and will backport the needed fixes to 7.x after 7.1 (too risky to merge to 7.x this close to a release). OK, given all the patches you refer

Re: Major SMP problems with lstat/namei

2008-09-25 Thread Jeff Wheelhouse
On Sep 25, 2008, at 10:51 AM, Dag-Erling Smørgrav wrote: Jeff Wheelhouse <[EMAIL PROTECTED]> writes: I've written a quick benchmark with a pair of tests to simplify/measure the problem. [...] Care to share? No problem: http://software.wheelhouse.org/rptest.tar.bz2 Thanks, Jeff _

Re: Major SMP problems with lstat/namei

2008-09-25 Thread Dag-Erling Smørgrav
Jeff Wheelhouse <[EMAIL PROTECTED]> writes: > I've written a quick benchmark with a pair of tests to > simplify/measure the problem. [...] Care to share? DES -- Dag-Erling Smørgrav - [EMAIL PROTECTED] ___ freebsd-hackers@freebsd.org mailing list http:

Re: Major SMP problems with lstat/namei

2008-09-24 Thread Julian Elischer
Jeff Wheelhouse wrote: On Sep 24, 2008, at 6:12 AM, Ivan Voras wrote: There is nothing that can be done within the 6.x branch. 7.x contains many improvements but I think only 8.x will directly change the lockmgr and the namei cache. The best things you can try right now is to use 7-STABLE (or s

Re: Major SMP problems with lstat/namei

2008-09-24 Thread Jeff Wheelhouse
On Sep 24, 2008, at 2:10 PM, John Baldwin wrote: You can still use cvs to pull the revisions. All those e-mail msg's have the CVS revisions in them, too. If I'm ever to do anything that will benefit someone besides myself, it's worth my making the effort to learn SVN. We have coasted on

Re: Major SMP problems with lstat/namei

2008-09-24 Thread John Baldwin
On Wednesday 24 September 2008 01:47:32 pm Jeff Wheelhouse wrote: > > On Sep 24, 2008, at 12:12 PM, John Baldwin wrote: > > Shared lookups only work on the NFS client in 6.x. I'm about to > > turn them on > > for UFS in HEAD (8.x) and will backport the needed fixes to 7.x > > after 7.1 > > (t

Re: Major SMP problems with lstat/namei

2008-09-24 Thread Jeff Wheelhouse
On Sep 24, 2008, at 12:12 PM, John Baldwin wrote: Shared lookups only work on the NFS client in 6.x. I'm about to turn them on for UFS in HEAD (8.x) and will backport the needed fixes to 7.x after 7.1 (too risky to merge to 7.x this close to a release). Testers available, when you get to

Re: Major SMP problems with lstat/namei

2008-09-24 Thread John Baldwin
On Wednesday 24 September 2008 12:52:59 am Jeff Wheelhouse wrote: > > We have encountered some serious SMP performance/scalability problems > that we've tracked back to lstat/namei calls. I've written a quick > benchmark with a pair of tests to simplify/measure the problem. Both > tests us

Re: Major SMP problems with lstat/namei

2008-09-24 Thread Jeff Wheelhouse
On Sep 24, 2008, at 6:12 AM, Ivan Voras wrote: There is nothing that can be done within the 6.x branch. 7.x contains many improvements but I think only 8.x will directly change the lockmgr and the namei cache. The best things you can try right now is to use 7-STABLE (or soon to be released 7.

Re: Major SMP problems with lstat/namei

2008-09-24 Thread Jeremy Chadwick
On Wed, Sep 24, 2008 at 09:26:55AM +0200, Daniel Gerzo wrote: > Hello Jeff, > > On Wed, 24 Sep 2008 00:52:59 -0400, Jeff Wheelhouse > <[EMAIL PROTECTED]> wrote: > > > > We have encountered some serious SMP performance/scalability problems > > that we've tracked back to lstat/namei calls. I've

Re: Major SMP problems with lstat/namei

2008-09-24 Thread Daniel Gerzo
Hello Jeff, On Wed, 24 Sep 2008 00:52:59 -0400, Jeff Wheelhouse <[EMAIL PROTECTED]> wrote: > > We have encountered some serious SMP performance/scalability problems > that we've tracked back to lstat/namei calls. I've written a quick this all seems like a reason of very poor performance of

Re: Major SMP problems with lstat/namei

2008-09-24 Thread Ivan Voras
Ivan Voras wrote: > There is nothing that can be done within the 6.x branch. 7.x contains > many improvements but I think only 8.x will directly change the lockmgr > and the namei cache. The best things you can try right now is to use > 7-STABLE (or soon to be released 7.1; you might need tuning w

Re: Major SMP problems with lstat/namei

2008-09-24 Thread Ivan Voras
Jeff Wheelhouse wrote: > This is on 6.3-RELEASE-p4 with vfs.lookup_shared=1. > > I believe this is the same issue that was previously discussed as "2 x > quad-core system is slower that 2 x dual core on FreeBSD" archived here: > > http://lists.freebsd.org/pipermail/freebsd-stable/2007-November/0

Major SMP problems with lstat/namei

2008-09-23 Thread Jeff Wheelhouse
We have encountered some serious SMP performance/scalability problems that we've tracked back to lstat/namei calls. I've written a quick benchmark with a pair of tests to simplify/measure the problem. Both tests use a tree of directories: the top level directory contains five subdirecto