On Fri, Mar 25, 2011 at 01:33:25PM -0400, Mark Phippard wrote:
> Hi,
>
> I have been working on a framework for writing tests to record
> performance. I have something good enough to share:
>
> https://ctf.open.collab.net/sf/projects/csvn
>
> It is pretty easy to add new tests if you have ideas on more tests you
> think we should add. I think I have pretty good coverage of the major
> functions. The wiki on the site I linked to above has details on how
> I have constructed the current tests. I am going to put out a call to
> users for feedback and try to get more people to run the tests and
> record results.
>
> I am not claiming these are anything definitive or even that we will
> use them to help us make the release decision, but I think it is a
> start on coming up with some reproducible tests that people can run
> easily. If after people look at and run the tests they think they are
> useful or can be tweaked to be useful, then great. If not, then at
> least I got to write some code for a change :)
>
> The tests are written in Java because that is what I know and it gives
> me good cross platform coverage. However, the Java just drives the
> command line so all you need to do is have the svn command line in
> your PATH and that is what it uses for all the work.
I've run these tests on OpenBSD 4.9 (amd64) and got the following results:
=================== TEST RESULTS ==================
SVN Version: 1.6.17-dev
Tests: Basic Tests
Action Time Millis
---------- --------- ---------
Checkout: 0:21.232 21232
Update: 1:07.533 67533
Switch: 0:16.122 16122
Proplist: 0:00.226 226
Status: 0:00.174 174
Commit: 0:05.883 5883
svnversion: 0:00.104 104
Tests: Merge Tests
Action Time Millis
---------- --------- ---------
Merge-all: 0:27.993 27993
Merge-revert: 0:12.054 12054
Merge-synch: 0:15.082 15082
Merge-reintegrate: 0:13.653 13653
Tests: Folder Tests
Action Time Millis
---------- --------- ---------
Folder-co: 10:02.645 602645
Folder-st: 0:00.872 872
Folder-ci: 1:16.709 76709
Folder-up: 3:26.989 206989
svnversion: 0:00.768 768
Tests: Binaries Tests
Action Time Millis
---------- --------- ---------
Bin-co: 4:09.777 249777
Bin-up-r25: 2:49.036 169036
Bin-sw: 3:46.945 226945
Bin-cleanup: 0:01.069 1069
Bin-rm: 0:03.232 3232
Bin-st: 0:00.270 270
Bin-commit: 0:07.356 7356
Bin-mv: 0:05.662 5662
Bin-st-mv: 0:00.275 275
Bin-commit: 0:03.844 3844
svnversion: 0:00.166 166
=================== END RESULTS ==================
Total execution time: 34:44.375 2084375
Results in wiki format:
Basic Tests:
| 1.6.17-dev | r1085946 | 0:21.232 | 1:07.533 | 0:16.122 | 0:00.226 | 0:00.174
Merge Tests:
| 1.6.17-dev | r1085946 | 0:27.993 | 0:12.054 | 0:15.082 | 0:13.653
Folder Tests:
| 1.6.17-dev | r1085946 | 10:02.645 | 0:00.872 | 1:16.709 | 3:26.989 | 0:00.768
Binaries Tests:
| 1.6.17-dev | r1085946 | 4:09.777 | 2:49.036 | 3:46.945 | 0:01.069 | 0:03.232
.166
=================== TEST RESULTS ==================
SVN Version: 1.7.0-dev
Tests: Basic Tests
Action Time Millis
---------- --------- ---------
Checkout: 0:36.024 36024
Update: 1:01.197 61197
Switch: 0:02.004 2004
Proplist: 0:00.198 198
Status: 0:00.215 215
Commit: 0:01.358 1358
svnversion: 0:00.208 208
Tests: Merge Tests
Action Time Millis
---------- --------- ---------
Merge-all: 0:05.227 5227
Merge-revert: 0:05.827 5827
Merge-synch: 0:05.393 5393
Merge-reintegrate: 0:11.169 11169
Tests: Folder Tests
Action Time Millis
---------- --------- ---------
Folder-co: 7:19.267 439267
Folder-st: 0:01.209 1209
Folder-ci: 0:10.676 10676
Folder-up: 0:04.626 4626
svnversion: 0:01.705 1705
Tests: Binaries Tests
Action Time Millis
---------- --------- ---------
Bin-co: 3:15.021 195021
Bin-up-r25: 0:09.250 9250
Bin-sw: 1:35.125 95125
Bin-cleanup: 0:00.181 181
Bin-rm: 0:42.754 42754
Bin-st: 0:00.422 422
Bin-commit: 0:04.432 4432
Bin-mv: 0:12.726 12726
Bin-st-mv: 0:00.415 415
Bin-commit: 0:08.612 8612
svnversion: 0:00.419 419
=================== END RESULTS ==================
Total execution time: 18:38.683 1118683
Results in wiki format:
Basic Tests:
| 1.7.0-dev | r1085943 | 0:36.024 | 1:01.197 | 0:02.004 | 0:00.198 | 0:00.215 |
0:01.358 | 0:00.208
Merge Tests:
| 1.7.0-dev | r1085943 | 0:05.227 | 0:05.827 | 0:05.393 | 0:11.169
Folder Tests:
| 1.7.0-dev | r1085943 | 7:19.267 | 0:01.209 | 0:10.676 | 0:04.626 | 0:01.705
Binaries Tests:
| 1.7.0-dev | r1085943 | 3:15.021 | 0:09.250 | 1:35.125 | 0:00.181 | 0:42.754 |
0:00.422 | 0:04.432 | 0:12.726 | 0:00.415 | 0:08.612 | 0:00.419
