Re: [GENERAL] SMP scaling

2005-03-18 Thread Tom Lane
Mark Rae <[EMAIL PROTECTED]> writes: > Even with the numa support, which makes sure any memory allocated by > malloc or the stack ends up local to the processor which originally > called it, and then continues to schedule the process on that CPU, > there is still the problem that all table access

Re: [GENERAL] SMP scaling

2005-03-18 Thread Mark Rae
On Fri, Mar 18, 2005 at 01:31:51PM -0500, Tom Lane wrote: > BTW, although I know next to nothing about NUMA, I do know that it is > configurable to some extent (eg, via numactl). What was the > configuration here exactly, and did you try alternatives? Also, > what was the OS exactly? (I've heard

Re: [GENERAL] SMP scaling

2005-03-18 Thread Tom Lane
Mark Rae <[EMAIL PROTECTED]> writes: > The altix still only scales up to 10x rather than 16x, but that probably > is the NUMA configuration taking effect now. BTW, although I know next to nothing about NUMA, I do know that it is configurable to some extent (eg, via numactl). What was the config

Re: [GENERAL] SMP scaling

2005-03-18 Thread Tom Lane
Bruce Momjian writes: > So it seems our entire SMP problem was that global lock. Nice. Yeah, I was kind of expecting to see the LockMgrLock up next, but it seems we're still a ways away from having a problem there. I guess that's because we only tend to touch locks once per query, whereas we're

Re: [GENERAL] SMP scaling

2005-03-18 Thread Bruce Momjian
Mark Rae wrote: > On Fri, Mar 18, 2005 at 10:38:24AM -0500, Tom Lane wrote: > > Hey, that looks pretty sweet. One thing this obscures though is whether > > there is any change in the single-client throughput rate --- ie, is "1.00" > > better or worse for CVS tip vs 8.0.1? > > Here are the figures

Re: [GENERAL] SMP scaling

2005-03-18 Thread Mark Rae
On Fri, Mar 18, 2005 at 10:38:24AM -0500, Tom Lane wrote: > Hey, that looks pretty sweet. One thing this obscures though is whether > there is any change in the single-client throughput rate --- ie, is "1.00" > better or worse for CVS tip vs 8.0.1? Here are the figures in queries per second. Cli

Re: [GENERAL] SMP scaling

2005-03-18 Thread Tom Lane
Mark Rae <[EMAIL PROTECTED]> writes: > Ok, I've done the tests comparing 8.0.1 against a snapshot from the 16th > and the results are impressive. > Clients1 2 3 4 6 8 12 16 > 32 64 > -

[GENERAL] SMP scaling

2005-03-18 Thread Mark Rae
On Tue, Mar 15, 2005 at 07:00:25PM -0500, Bruce Momjian wrote: > Oh, you have to try CVS HEAD or a nightly snapshot. Tom made a major > change that allows scaling in SMP environments. Ok, I've done the tests comparing 8.0.1 against a snapshot from the 16th and the results are impressive. As well