Re: slow tar performance on fbsd5

2005-08-25 Thread Divacky Roman

cannot this be related to low value of nswbufs (fixed in curennt and I think
releng_6)?

On Wed, Aug 24, 2005 at 06:33:57PM +0200, JG wrote:
> Hello,
> 
> I had to unpack a lot of tar archives and I occasional noticed terrible
> bad performance on freebsd5.
> 
> This is my test file:
> 
> 854251520 24 Sie 12:13 mysql-m.tgz
> 
> There are some real MySQL tables in it, it has been done with tar
> -cvf. This archive contains about 146.000 small files. 
> 
> ---
> Unpacking it on FreeBSD5 gives me such results:
> 
> # time tar -xf mysql-m.tgz
> 2.130u 20.187s 7:02.69 5.2% 41+382k 13097+8205io 0pf+0w
> ...so 7 minutes of real time.
> 
> This is today's FreeBSD 5.4-STABLE but I also tried 5.4-release.
> 
> That server is brand new Dell PE2850 with Seagate ST373207L SCSI
> drive, no raid. Parition is default UFS2 mounted with noatime, softupdates on.
> This is Dual Xeon 2.8, 2GB ram.
> 
> My sysctls:
> vfs.ufs.dirhash_maxmem=16777216 (much better than default 2MB)
> machdep.hyperthreading_allowed=1 (better dd results)
> kern.maxfiles=65536
> kern.maxfilesperproc=65536
> vfs.read_max=16
> 
> I've tried a few different kernels - I had results like 6-15 minutes
> of real time. 6 minutes was the best.
> 
> I've also tried standard sysctls, and with/without make.conf cputype.
> I've tested bsdtar and gtar from ports (btw. gtar seems to be faster).
> 
> I didn't noticed slowness of any other things on this server. I've quiet good 
> DD results.
> 
> Diskinfo shows:
> # diskinfo  -tv /dev/da3s1d
> /dev/da3s1d
> 512 # sectorsize
> 73402366464 # mediasize in bytes (68G)
> 143363997   # mediasize in sectors
> 8923# Cylinders according to firmware.
> 255 # Heads according to firmware.
> 63  # Sectors according to firmware.
> 
> Seek times:
> Full stroke:  250 iter in   3.107691 sec =   12.431 msec
> Half stroke:  250 iter in   2.223141 sec =8.893 msec
> Quarter stroke:   500 iter in   3.595413 sec =7.191 msec
> Short forward:400 iter in   1.832164 sec =4.580 msec
> Short backward:   400 iter in   2.047162 sec =5.118 msec
> Seq outer:   2048 iter in   0.315528 sec =0.154 msec
> Seq inner:   2048 iter in   0.320899 sec =0.157 msec
> Transfer rates:
> outside:   102400 kbytes in   1.341191 sec =76350 kbytes/sec
> middle:102400 kbytes in   1.536625 sec =66640 kbytes/sec
> inside:102400 kbytes in   2.731570 sec =37488 kbytes/sec
> 
> 
> Soon I'll be able to post results from my other server powered by
> FreeBSD 4.11 with poor SCSI, maybe in the night.
> 
> 
> This is result from Gentoo Linux on 2.6.x hardened kernel:
> # time tar -xf mysql-m.tgz
> 
> real1m3.944s
> user0m1.702s
> sys 0m15.794s
> 
> Only ~one minute! Six times faster than on a FreeBSD. I'm not a linux
> fan, and I don't want to tell you how good linux is, but I would to
> find out what causes such bad results on my favourite FreeBSD...
> 
> This one is noname server with Dual Xeon 2.8, 2GB ram. It has
> SATA Maxtor drive. Partition is ext3 -T news, -O dir_index, with
> atime! I've similar results with ReiserFS.
> 
> --
> 
> Both systems was good optimized - as good as I can. All services (like
> mysql, apache) was terminated before my tests. Both FreeBSD's
> locate.updatedb and Gentoo's updatedb disabled.
> 
> 
> Thank you for any opinions or hints how to tune FreeBSD a bit.
> 
> Best Regards,
> JG
> 
> ___
> freebsd-performance@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-performance
> To unsubscribe, send any mail to "[EMAIL PROTECTED]"
___
freebsd-performance@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-performance
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re: Samba Performance problem

2006-10-02 Thread Divacky Roman
On Mon, Oct 02, 2006 at 12:42:41PM -0400, Nick Evans wrote:
> On Mon, 02 Oct 2006 10:30:23 -0400
> Mike Jakubik <[EMAIL PROTECTED]> wrote:
> 
> > Nick Evans wrote:
> > > Mike Jakubik <[EMAIL PROTECTED]> wrote:
> > >   
> > >> Quite possibly, just as MySQL has been written with Linux primarily in
> > >> mind. 
> > >
> > > It should be possible to profile smbd and see where the bottleneck is, no?
> > > Has anyone tried it?
> > >   
> > 
> > 
> > It should be, but i don't believe anyone has tried yet.
> > 
> 
> Does anyone know how to get gprof to set the gmon.out file with a pid number
> in the filename? It's kind of hard to get output of the pid that controls a
> file transfer without it. Everything I've found via Google is not working so
> far.

I'd start with plain ktrace and look in the trace to check for 'suspicious 
things'.
It might be something trivial like calling gettimeofday() way too often as it
was with mysql
___
freebsd-performance@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-performance
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re: Help with improving mysql performance on 6.2PRE

2006-10-06 Thread Divacky Roman
On Wed, Oct 04, 2006 at 08:52:51PM -0400, Jerry Bell wrote:
> I have a Dell PE2950 with 2 dual core 3.73Ghz processors and 4G of ram. 
> I've looked through some of the lists here and have seen super-smack
> results in the 42k qps range on a 2 dual core opteron system.  I'm able to
> get up to about 34k with the wide at the back of my server whilest rubbing
> the side of it.
> 
> Here's what I've done:
> built both mysql 5.0 and 5.1 from ports with build_static and
> optimazations on.
> changed the clock to TSC
> 
> added the following to my /etc/libmap.conf file:
> [mysqld]
> libc_r.so.5 libthr.so.2
> libc_r.so.6 libthr.so.2
> libthr.so.2 libthr.so.2
> libpthread.so.1 libthr.so.2
> libpthread.so.2 libthr.so.2
> 
> And this is about the best result I get:
> 2950# super-smack -d mysql select-key-mysql.smack 10 1
> Query Barrel Report for client smacker1
> connect: max=200ms  min=0ms avg= 20ms from 10 clients
> Query_type  num_queries max_timemin_timeq_per_s
> select_index20  0   0   34440.88
> 
> 
> Are there any other optimizations I need to do to mysql or freebsd?  I'm
> still not 100% convinced that I've done everything I need to use libthr
> instead of libpthread.

on UP people recomend to use TSC instead of acpi timer
___
freebsd-performance@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-performance
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re: DNS Performance Numbers

2006-10-25 Thread Divacky Roman
On Tue, Oct 24, 2006 at 09:59:57PM -0500, [EMAIL PROTECTED] wrote:
> I am running some performance tests on named to see how it performs
> with different configurations on FreeBSD and figured I would share the
> first results.  The first tests are  for serving up static data.
> 
> System:
>  Supermicro PDSMi Motherboard
>  1G Memory
>  Intel Pentium D CPU 3.40GHz
>  Intel Gigibit NIC
>  Bind 9.2.3
> 
> OS  UP  UP+PMP  MP+PMP+TP   MP+TT   MP+TP+P 
> MP+TT+P
> ---
> FreeBSD 4.1128455   28370   28976   X   X   X   X   X
> FreeBSD 6.1 29074   34260   34635   35730   17846   38780   19776   
> 44188
> FreeBSD Stable  30190   34707   33294   36651   18893   39374   19449   
> 44169
> FreeBSD Current 30707   34029   32300   33689   15535   40554   13886   
> 42071
> Ubuntu 6.06 X   X   X   X   X   37294   X   X

I see regression between -current and -stable. are you sure you tested without
any debuging stuff? some performance speedups went in in 7-current

also - do you use the same config everywhere? -current GENERIC doesnt have 
COMPAT_43
for example which miht affect performance (additional locking) etc.

roman
___
freebsd-performance@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-performance
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re: em forwarding performance (was Proposed 6.2 em RELEASE patch

2006-11-24 Thread Divacky Roman
On Fri, Nov 24, 2006 at 03:27:40PM -0500, Mike Tancsa wrote:
> At 03:28 AM 11/24/2006, Massimo Lusetti wrote:
> >On Thu, 2006-11-23 at 11:52 -0500, Mike Tancsa wrote:
> >
> >> I might give OpenBSD a quick try as a reference.
> >
> >That would be very interesting.
> 
> OpenBSD 4.0 i386 panics on boot.
> 
> I also posted some results with PMC compiled into the kernel
> 
> ipfw compiled into the kernel, with 1 rule
> 
> http://www.tancsa.com/pmc/

I see generic_bzero/bcopy used quite often. why dont you define 
cpu I586_CPU
in your kernel config?

also... bde@ just commited some bzero-related optimizations to routing
code.. might be work trying..

just an idea

roman
___
freebsd-performance@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-performance
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re: em forwarding performance (was Proposed 6.2 em RELEASE patch

2006-11-25 Thread Divacky Roman
On Fri, Nov 24, 2006 at 04:18:03PM -0500, Mike Tancsa wrote:
> At 04:03 PM 11/24/2006, Divacky Roman wrote:
> >On Fri, Nov 24, 2006 at 03:27:40PM -0500, Mike Tancsa wrote:
> >> At 03:28 AM 11/24/2006, Massimo Lusetti wrote:
> >> >On Thu, 2006-11-23 at 11:52 -0500, Mike Tancsa wrote:
> >> >
> >> >> I might give OpenBSD a quick try as a reference.
> >> >
> >> >That would be very interesting.
> >>
> >> OpenBSD 4.0 i386 panics on boot.
> >>
> >> I also posted some results with PMC compiled into the kernel
> >>
> >> ipfw compiled into the kernel, with 1 rule
> >>
> >> http://www.tancsa.com/pmc/
> >
> >I see generic_bzero/bcopy used quite often. why dont you define
> >cpu I586_CPU
> >in your kernel config?
> 
> Hi,
> 
> I had
> 
> cpu I486_CPU
> cpu I586_CPU
> cpu I686_CPU
 
hm.. now I am confused. the rule is that having I586_CPU improves
performance because optimized bzero/bcopy is included (its not
included if you only have I686_CPU).

I dont understand why the generic version is used.
___
freebsd-performance@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-performance
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re: em forwarding performance (was Proposed 6.2 em RELEASE patch

2006-11-26 Thread Divacky Roman
On Sat, Nov 25, 2006 at 05:22:16AM -0600, Matthew D. Fuller wrote:
> On Sat, Nov 25, 2006 at 09:36:05AM +0100 I heard the voice of
> Divacky Roman, and lo! it spake thus:
> >  
> > hm.. now I am confused. the rule is that having I586_CPU improves
> > performance because optimized bzero/bcopy is included (its not
> > included if you only have I686_CPU).
> 
> Haven't we been by this before?  It's not included even if you have
> I586_CPU either.
> 
> See src/sys/i386/isa/npx.c, line 432:
> 
> #ifdef I586_CPU_XXX   <
> ^^^
> 
> This has been disabled since r1.95, in 2001 (in 5-CURRENT days).
> There may be SOMETHING about including I586_CPU that speeds things up,
> but it ain't that.

the log says:

People are still having problems with i586_* on UP machines and SMP
machines, so just hack it to disable them for now until it can be fixed.

noone has been able to step up and fix that? for more then 5 years?
huh.. I guess thats quite low hanging fruit worth shoting down..


___
freebsd-performance@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-performance
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re: (S)ATA performance in FBSD 6.2/7.0

2007-03-02 Thread Divacky Roman
On Fri, Mar 02, 2007 at 10:43:34AM +0100, Wojciech Puchar wrote:
> >another while the box didn't do anything else than copying. I watched the 
> >copy process via 'systat -vmstat 1' and realized, that the value of 'KB/t' 
> >never go byond 128 (128kb buffer limit?). But more frustrating, I never got
> 
> what's wrong? FreeBSD uses 128k limit by default.
> 
> edit /usr/src/sys/sys/param.h
> 
> and change
> 
> #define MAXPHYS (128 * 1024)   /* max raw I/O transfer size */
> 
> 
> to say
> 
> #define MAXPHYS (1024 * 1024)   /* max raw I/O transfer size */

did anyone measure impact on various benchmark of this change? is 128k the
optimal size for "nowadays computers" ? if we can squeeze more performance
out of a typical box by just raising one define it would be great...

roman
___
freebsd-performance@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-performance
To unsubscribe, send any mail to "[EMAIL PROTECTED]"