nickva commented on PR #6015: URL: https://github.com/apache/couchdb/pull/6015#issuecomment-4568909637
I ran a few [k6-couch](https://github.com/nickva/k6-couch) benchmark runs against main ``` BENCH_DOCS=100000 BENCH_DURATION=3m BENCH_SCENARIOS=doc_get,doc_insert k6 run k6_couchdb.js ... running (3m46.0s), 00000/01000 VUs, 198002 complete and 0 interrupted iterations doc_get ✓ [======================================] 0000/0500 VUs 3m0s 1000.00 iters/s doc_insert ✓ [======================================] 0000/0500 VUs 3m0s 100.00 iters/s ``` (100k docs, doc get and doc insert for 3 minute) Main: ``` { name:doc_get }.............: avg=1.68ms min=1.06ms med=1.48ms max=116.65ms p(90)=1.8ms p(95)=1.93ms { name:doc_insert }..........: avg=3.95ms min=2.62ms med=3.5ms max=151.07ms p(90)=4.24ms p(95)=4.57ms { name:doc_get }.............: avg=2.03ms min=1.06ms med=1.48ms max=149.24ms p(90)=1.82ms p(95)=1.98ms { name:doc_insert }..........: avg=4.6ms min=2.6ms med=3.51ms max=170.73ms p(90)=4.29ms p(95)=4.74ms { name:doc_get }.............: avg=2.12ms min=1.06ms med=1.49ms max=157.79ms p(90)=1.81ms p(95)=1.99ms { name:doc_insert }..........: avg=4.58ms min=2.59ms med=3.51ms max=164.38ms p(90)=4.28ms p(95)=4.68ms ``` No Eof (PR) ``` { name:doc_get }.............: avg=2.25ms min=1.04ms med=1.56ms max=162.39ms p(90)=1.98ms p(95)=2.23ms { name:doc_insert }..........: avg=5.15ms min=2.67ms med=3.97ms max=193.4ms p(90)=5.11ms p(95)=5.93ms { name:doc_get }.............: avg=1.85ms min=1.07ms med=1.52ms max=176.15ms p(90)=1.89ms p(95)=2.05ms { name:doc_insert }..........: avg=4.49ms min=2.73ms med=3.85ms max=210.74ms p(90)=4.8ms p(95)=5.29ms { name:doc_get }.............: avg=1.77ms min=1.07ms med=1.53ms max=148.22ms p(90)=1.9ms p(95)=2.07ms { name:doc_insert }..........: avg=4.4ms min=2.76ms med=3.88ms max=123.9ms p(90)=4.79ms p(95)=5.31ms ``` The difference is there but is tiny: Medians for doc_get main: `1.48, 1.48,1.49` pr: `1.56,1.52,1.53` Medians for doc_insert: main: `3.5, 3.51, 3.51` pr: `3.97, 3.85, 3.88` So maybe 0.1-0.5 msec difference P90 for doc_get: main: `1.8, 1.82, 1.81` pr: `1.98, 1.89, 1.9` P90 for doc_insert: main: `4.24, 4.29, 4.28` pr: `5.11, 4.8, 4.79` About the same for reads and <1msec difference for writes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
