Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-03-01 Thread Craig Boston
On Tue, Feb 27, 2007 at 04:12:52PM -0600, Jim C. Nasby wrote: > On Tue, Feb 27, 2007 at 03:59:52PM -0500, Kris Kennaway wrote: > > > > I've mentioned this a couple of times, but postgresql didn't scale > > well [on freebsd at least] when I tried it last year. I hope to > > revisit when I get time

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-03-01 Thread Coleman Kane
On 2/28/07, Sten Daniel Soersdal <[EMAIL PROTECTED]> wrote: Jim C. Nasby wrote: > On Tue, Feb 27, 2007 at 03:59:52PM -0500, Kris Kennaway wrote: >> On Tue, Feb 27, 2007 at 12:25:11PM -0600, Jim C. Nasby wrote: >>> On Sat, Feb 24, 2007 at 04:31:11PM -0500, Kris Kennaway wrote: Now that the g

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-28 Thread Sten Daniel Soersdal
Jim C. Nasby wrote: > On Tue, Feb 27, 2007 at 03:59:52PM -0500, Kris Kennaway wrote: >> On Tue, Feb 27, 2007 at 12:25:11PM -0600, Jim C. Nasby wrote: >>> On Sat, Feb 24, 2007 at 04:31:11PM -0500, Kris Kennaway wrote: Now that the goals of the SMPng project are complete, for the past year

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-27 Thread Jim C. Nasby
On Tue, Feb 27, 2007 at 03:59:52PM -0500, Kris Kennaway wrote: > On Tue, Feb 27, 2007 at 12:25:11PM -0600, Jim C. Nasby wrote: > > On Sat, Feb 24, 2007 at 04:31:11PM -0500, Kris Kennaway wrote: > > > Now that the goals of the SMPng project are complete, for the past > > > year or more several of us

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-27 Thread Kris Kennaway
On Tue, Feb 27, 2007 at 12:25:11PM -0600, Jim C. Nasby wrote: > On Sat, Feb 24, 2007 at 04:31:11PM -0500, Kris Kennaway wrote: > > Now that the goals of the SMPng project are complete, for the past > > year or more several of us have been working hard on profiling FreeBSD > > in various multiproces

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-27 Thread Jim C. Nasby
On Sat, Feb 24, 2007 at 04:31:11PM -0500, Kris Kennaway wrote: > Now that the goals of the SMPng project are complete, for the past > year or more several of us have been working hard on profiling FreeBSD > in various multiprocessor workloads, and looking for performance > bottlenecks to be optimiz

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-26 Thread Divacky Roman
On Sat, Feb 24, 2007 at 04:31:11PM -0500, Kris Kennaway wrote: > Now that the goals of the SMPng project are complete, for the past > year or more several of us have been working hard on profiling FreeBSD > in various multiprocessor workloads, and looking for performance > bottlenecks to be optimiz

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-26 Thread Kris Kennaway
On Mon, Feb 26, 2007 at 11:15:27PM +0100, Divacky Roman wrote: > I wonder if anyone measured what effect superpages has on mysql performance... > this should not help scaling but I can imagine it has some effect. I have thought about trying this but have not found the time. I am currently very h

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-26 Thread Kris Kennaway
On Mon, Feb 26, 2007 at 07:08:37PM +1100, Peter Jeremy wrote: > On 2007-Feb-24 16:31:11 -0500, Kris Kennaway <[EMAIL PROTECTED]> wrote: > >We have recently made significant progress on optimizing for MySQL > >running on an 8-core amd64 system. The graph of results may be found > >here: > > > > htt

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-26 Thread Peter Jeremy
On 2007-Feb-24 16:31:11 -0500, Kris Kennaway <[EMAIL PROTECTED]> wrote: >We have recently made significant progress on optimizing for MySQL >running on an 8-core amd64 system. The graph of results may be found >here: > > http://www.freebsd.org/~kris/scaling/scaling.png Those results look wonderfu

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-25 Thread Martin Blapp
Hi, If you can package up some kind of test or analogous workload that I can run, I'd be happy to take a look at profiling it on MP hardware. Should be possible. Btw. Has setting kern.threads.virtual_cpu to a different value effect for running programms or just started ones ? P.S. I assum

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-25 Thread Kris Kennaway
On Mon, Feb 26, 2007 at 12:27:01AM +0100, Martin Blapp wrote: > > Hi, > > >If you can package up some kind of test or analogous workload that I > >can run, I'd be happy to take a look at profiling it on MP hardware. > > > > Should be possible. Btw. Has setting kern.threads.virtual_cpu to a diffe

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-25 Thread Martin Blapp
Hi, It would be really great if we could find "workload owners" who would maintain easy-to-run benchmark configurations and also run them regularly on a fixed hardware configuration over a long time publishing results and testing patches. Kris has done this for SQL benchmarks to great effect

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-25 Thread Kris Kennaway
On Sun, Feb 25, 2007 at 01:54:20PM +0100, Martin Blapp wrote: > > Hi, > > >It would be really great if we could find "workload owners" who would > >maintain easy-to-run benchmark configurations and also run them regularly > >on a fixed hardware configuration over a long time publishing results

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-25 Thread Robert Watson
On Sun, 25 Feb 2007, Martin Blapp wrote: It would be really great if we could find "workload owners" who would maintain easy-to-run benchmark configurations and also run them regularly on a fixed hardware configuration over a long time publishing results and testing patches. Kris has done thi

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-25 Thread Andre Guibert de Bruet
On Feb 25, 2007, at 12:41 AM, Kris Kennaway wrote: On Sat, Feb 24, 2007 at 10:00:35PM -0700, Coleman Kane wrote: What does the performance curve look like for the in-CVS 7-CURRENT tree with 4BSD or ULE ? How do those stand up against the Linux SMP scheduler for scalability. It would be nice

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-25 Thread Robert Watson
On Sun, 25 Feb 2007, Kris Kennaway wrote: On Sat, Feb 24, 2007 at 10:00:35PM -0700, Coleman Kane wrote: What does the performance curve look like for the in-CVS 7-CURRENT tree with 4BSD or ULE ? How do those stand up against the Linux SMP scheduler for scalability. It would be nice to see the

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-24 Thread Coleman Kane
On 2/24/07, Kris Kennaway <[EMAIL PROTECTED]> wrote: On Sun, Feb 25, 2007 at 05:47:55AM +, Coleman Kane wrote: > On Sun, Feb 25, 2007 at 12:41:20AM -0500, Kris Kennaway wrote, and it was proclaimed: > > On Sat, Feb 24, 2007 at 10:00:35PM -0700, Coleman Kane wrote: > > > > > What does the per

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-24 Thread Coleman Kane
On Sun, Feb 25, 2007 at 12:41:20AM -0500, Kris Kennaway wrote, and it was proclaimed: > On Sat, Feb 24, 2007 at 10:00:35PM -0700, Coleman Kane wrote: > > > What does the performance curve look like for the in-CVS 7-CURRENT tree with > > 4BSD or ULE ? How do those stand up against the Linux SMP sc

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-24 Thread Kris Kennaway
On Sun, Feb 25, 2007 at 01:05:53AM -0500, Andre Guibert de Bruet wrote: > On Feb 25, 2007, at 12:41 AM, Kris Kennaway wrote: > > >On Sat, Feb 24, 2007 at 10:00:35PM -0700, Coleman Kane wrote: > > > >>What does the performance curve look like for the in-CVS 7-CURRENT > >>tree with > >>4BSD or ULE

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-24 Thread Kris Kennaway
On Sun, Feb 25, 2007 at 05:47:55AM +, Coleman Kane wrote: > On Sun, Feb 25, 2007 at 12:41:20AM -0500, Kris Kennaway wrote, and it was > proclaimed: > > On Sat, Feb 24, 2007 at 10:00:35PM -0700, Coleman Kane wrote: > > > > > What does the performance curve look like for the in-CVS 7-CURRENT tr

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-24 Thread Kris Kennaway
On Sat, Feb 24, 2007 at 10:00:35PM -0700, Coleman Kane wrote: > What does the performance curve look like for the in-CVS 7-CURRENT tree with > 4BSD or ULE ? How do those stand up against the Linux SMP scheduler for > scalability. It would be nice to see the comparison displayed to see what > the p

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-24 Thread Coleman Kane
On 2/24/07, Kris Kennaway <[EMAIL PROTECTED]> wrote: Now that the goals of the SMPng project are complete, for the past year or more several of us have been working hard on profiling FreeBSD in various multiprocessor workloads, and looking for performance bottlenecks to be optimized. We have re

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-24 Thread Matt Olander
On Saturday 24 February 2007 1:31 pm, Kris Kennaway wrote: > Now that the goals of the SMPng project are complete, for the past > year or more several of us have been working hard on profiling > FreeBSD in various multiprocessor workloads, and looking for > performance bottlenecks to be optimized.

Progress on scaling of FreeBSD on 8 CPU systems

2007-02-24 Thread Kris Kennaway
Now that the goals of the SMPng project are complete, for the past year or more several of us have been working hard on profiling FreeBSD in various multiprocessor workloads, and looking for performance bottlenecks to be optimized. We have recently made significant progress on optimizing for MySQL