the apache httpd may cry foul because you are testing with a prefork config instead of worker assuming you can scare up another processor is there a way to run the same httpd test suite with apache worker?
assuming the definition data_transfer_rate is accurate http://en.wikipedia.org/wiki/Transfer_rate#Network_throughput_.28data_transfer_rate.29_and_goodput data transfer rate refers to the achieved average net bit rate that is delivered to the application layer, exclusive of all protocol overhead, data packets retransmissions, etc. i would be interested to know how you detect protocol overhead and packet retransmits (to exclude for your data_transfer_rate calculations) this is good information Martin ______________________________________________ Verzicht und Vertraulichkeitanmerkung/Note de déni et de confidentialité Diese Nachricht ist vertraulich. Sollten Sie nicht der vorgesehene Empfaenger sein, so bitten wir hoeflich um eine Mitteilung. Jede unbefugte Weiterleitung oder Fertigung einer Kopie ist unzulaessig. Diese Nachricht dient lediglich dem Austausch von Informationen und entfaltet keine rechtliche Bindungswirkung. Aufgrund der leichten Manipulierbarkeit von E-Mails koennen wir keine Haftung fuer den Inhalt uebernehmen. Ce message est confidentiel et peut être privilégié. Si vous n'êtes pas le destinataire prévu, nous te demandons avec bonté que pour satisfaire informez l'expéditeur. N'importe quelle diffusion non autorisée ou la copie de ceci est interdite. Ce message sert à l'information seulement et n'aura pas n'importe quel effet légalement obligatoire. Étant donné que les email peuvent facilement être sujets à la manipulation, nous ne pouvons accepter aucune responsabilité pour le contenu fourni. > Date: Mon, 18 May 2009 10:17:06 -0400 > From: ch...@christopherschultz.net > To: users@tomcat.apache.org > Subject: Apache httpd vs Tomcat static content performance > > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > All, > > Last week, I decided to actually run my own performance measurements. > Before I waste a lot of time benchmarking, I wanted to vet my > methodology so I get all the data worth taking. > > I'm using ApacheBench 2.3 (ships with httpd 2.2.10) as my benchmarking > tool, all running on localhost to avoid anything on my local network > interfering with the tests. I've also blocked all incoming traffic to > the web server using iptables. This machine provides no other services > (except ssh) and is only used by me, so that should be sufficient. > > I have 15 static files of sizes 4, 8, 16, 32, 64, 128, and 512 > kilobytes, 1, 2, 4, 8, 16, and 32 megabytes. I'm requesting each of them > 100,000 times with a concurrency of 1 (single thread makes 100,000 > requests). I'm using the "Transfer rate" (in KiB/sec) as the sample for > each. I have not enabled keepalives, but may for a second set of data. > > I will be comparing an out-of-the-box prefork MPM httpd 2.2.10 > configuration against an out-of-the-box Tomcat 5.5.26 Coyote, APR, and > APR without sendfile configurations (I didn't realize until after I > started my Coyote tests that NIO is only available in TC6.0, so I'll be > doing my NIO tests on 6.0). > > I have a set of numbers for httpd and Coyote already (see below). > > I have a few questions for those who wish to comment: > > 1. Is the number of requests (100,0000 sufficient? It seems to take > forever on this machine... my Coyote tests took longer than > overnight. > > 2. Is a concurrency of 1 okay? I thought about it and testing the > ability of the OS to schedule processes and threads doesn't seem > like it adds anything to the data. > > 3. Is it worth testing without sendfile enabled on those connectors > that support it? I can reduce the time to generate all the data by > skipping 3 of the tests. > > 4. Is transfer rate the best data to use? I suppose that depends on > what I want to demonstrate. Since we get questions on this list like > "which is faster for static content?" I figured that one of two > things would be appropriate: the transfer rate or the number of > requests per second. These numbers are directly related, and it's > easier to graph numbers that are in the same range (you can serve > a 4KiB file much faster than a 32MiB file), so I chose the former. > > Below is the data I've collected so far. I'll publish everything on my > blog, including graphs, etc. once it's finished. (Strange that httpd > dramatically increased its transfer rate when requesting the 16MiB file!) > > - -chris > > 100000 Requests localhost keepalive=off > Concurrency=1 > Transfer Rate (KiB/sec) > File Size Apache httpd TC5.5 Coyote > 4kiB 6215.20 5467.43 > 8kiB 11630.17 9732.60 > 16kiB 21271.92 16266.66 > 32kiB 38257.77 27530.75 > 64kiB 63729.12 41946.45 > 128kiB 91768.23 56000.19 > 256kiB 126919.12 72062.84 > 512kiB 160506.81 66654.86 > 1MiB 180850.63 72533.92 > 2MiB 185157.29 75957.71 > 4MiB 185262.91 77969.20 > 8MiB 185152.66 79075.54 > 16MiB 256399.66 80364.26 > 32MiB 189933.50 80243.41 > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.9 (MingW32) > Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ > > iEYEARECAAYFAkoRbeIACgkQ9CaO5/Lv0PAewQCbB7L0jaCWSD6EAcECKIRW/Uy2 > AAUAoKpR/2MweDPcnmv3+a+EQd6n55+i > =Jd6Q > -----END PGP SIGNATURE----- > > --------------------------------------------------------------------- > To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org > For additional commands, e-mail: users-h...@tomcat.apache.org > _________________________________________________________________ Hotmail® has a new way to see what's up with your friends. http://windowslive.com/Tutorial/Hotmail/WhatsNew?ocid=TXT_TAGLM_WL_HM_Tutorial_WhatsNew1_052009
