Re: Extreme load with local password db lookups

2007-12-08 Thread Doug Barton
Jeremy Chadwick wrote: > On Fri, Dec 07, 2007 at 08:44:37AM +0100, Patrick van Iersel wrote: >>> From: Eugene Grosbein <[EMAIL PROTECTED]> >>> See http://www.freebsd.org/cgi/query-pr.cgi?pr=75855 >>> It seems the regression from RELENG_4 is still here. >>> >>> There are so many regressions in perfo

Re: Extreme load with local password db lookups

2007-12-07 Thread Pieter de Goeje
On Friday 07 December 2007, Eugene Grosbein wrote: > > I would like to point out that in FreeBSD 7.x there is a daemon called > > nscd. I believe it was created exactly for this purpose (speeding up name > > lookups by caching them). > > Is it true that 4.x has nearly O(n) lookup speed while later

Re: Extreme load with local password db lookups

2007-12-07 Thread Eugene Grosbein
> I would like to point out that in FreeBSD 7.x there is a daemon called nscd. > I > believe it was created exactly for this purpose (speeding up name lookups by > caching them). Is it true that 4.x has nearly O(n) lookup speed while later versions has O(n^2) method? Why 4.x does not need cach

Re: Extreme load with local password db lookups

2007-12-07 Thread Pieter de Goeje
On Friday 07 December 2007, Jeremy Chadwick wrote: > On Fri, Dec 07, 2007 at 08:44:37AM +0100, Patrick van Iersel wrote: > > > From: Eugene Grosbein <[EMAIL PROTECTED]> > > > See http://www.freebsd.org/cgi/query-pr.cgi?pr=75855 > > > It seems the regression from RELENG_4 is still here. > > > > > >

Re: Extreme load with local password db lookups

2007-12-07 Thread Patrick van Iersel
> From: Eugene Grosbein <[EMAIL PROTECTED]> > Date: Fri, 7 Dec 2007 14:48:47 +0700 > To: Patrick van Iersel <[EMAIL PROTECTED]> > Cc: freebsd-stable@FreeBSD.org > Subject: Re: Extreme load with local password db lookups > > On Fri, Dec 07, 2007 at 08:44:37A

Re: Extreme load with local password db lookups

2007-12-06 Thread Jeremy Chadwick
On Fri, Dec 07, 2007 at 08:44:37AM +0100, Patrick van Iersel wrote: > > From: Eugene Grosbein <[EMAIL PROTECTED]> > > See http://www.freebsd.org/cgi/query-pr.cgi?pr=75855 > > It seems the regression from RELENG_4 is still here. > > > > There are so many regressions in performance that I still > >

Re: Extreme load with local password db lookups

2007-12-06 Thread Eugene Grosbein
On Fri, Dec 07, 2007 at 08:44:37AM +0100, Patrick van Iersel wrote: > > See http://www.freebsd.org/cgi/query-pr.cgi?pr=75855 > > It seems the regression from RELENG_4 is still here. > > > > There are so many regressions in performance that I still > > prefer to invest time to patch bsd.ports.mk t

Re: Extreme load with local password db lookups

2007-12-06 Thread Patrick van Iersel
> From: Eugene Grosbein <[EMAIL PROTECTED]> > Organization: SVZServ > Date: Fri, 07 Dec 2007 12:40:42 +0700 > To: Jeremy Chadwick <[EMAIL PROTECTED]> > Cc: Patrick van Iersel <[EMAIL PROTECTED]>, freebsd-stable@FreeBSD.org > Subject: Re: Extreme load with l

Re: Extreme load with local password db lookups

2007-12-06 Thread Eugene Grosbein
Jeremy Chadwick wrote: > > > Here's the situation. We have an web/ftp server with around 74000 users > > > defined in the local unix password database. On 4.9-stable which it is > > > running now, there is no noticable load when lookups are done (logins via > > > ftp, ~user lookups from apache etc

Re: Extreme load with local password db lookups

2007-12-06 Thread Patrick van Iersel
t;>> group: files >>> passwd: files >>> >> >> The default value is "compat" on both RELENG_6 and RELENG_7. I don't >> think switching to "files" will fix his problem (I'll be very surprised >> if it does). >>

Re: Extreme load with local password db lookups

2007-12-06 Thread Dennis Berger
A common way to debug is to isolate the affected systemcalls, by using tools like ktrace or strace. Strace can also record a timestamp, you can see how long it takes to complete a specific systemcall # strace -r -f Do a single login and then examine the results. happy debugging. regards, Den

Re: Extreme load with local password db lookups

2007-12-06 Thread Ivan Voras
Patrick van Iersel wrote: > However on 6-STABLE (FreeBSD 6.3-PRERELEASE #0: Wed Dec 5 13:35:05 CET > 2007) these same lookups cause very high load and things slow down to a > crawl. Hi, How do you know it's the passwd lookups that cause the problems? (I'm not saying they're not...) signature

Re: Extreme load with local password db lookups

2007-12-06 Thread Jeremy Chadwick
On Thu, Dec 06, 2007 at 06:22:07PM +0700, Eugene Grosbein wrote: > On Thu, Dec 06, 2007 at 11:37:50AM +0100, Patrick van Iersel wrote: > > > Here's the situation. We have an web/ftp server with around 74000 users > > defined in the local unix password database. On 4.9-stable which it is > > runnin

Re: Extreme load with local password db lookups

2007-12-06 Thread Eugene Grosbein
On Thu, Dec 06, 2007 at 11:37:50AM +0100, Patrick van Iersel wrote: > Here's the situation. We have an web/ftp server with around 74000 users > defined in the local unix password database. On 4.9-stable which it is > running now, there is no noticable load when lookups are done (logins via > ftp,