[
https://issues.apache.org/jira/browse/KUDU-3557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17831053#comment-17831053
]
ASF subversion and git services commented on KUDU-3557:
-------------------------------------------------------
Commit 926cac023832f29fc2f51c161c03aeea9f3d7036 in kudu's branch
refs/heads/master from 宋家成
[ https://gitbox.apache.org/repos/asf?p=kudu.git;h=926cac023 ]
KUDU-3557 Simple way to change maximum thread cache size of tcmalloc.
Now, Lock contention is too high in tcmalloc while the cluster in
under high throughput. Making the total thread cache size larger
could highly decrease the lock contention. Even though the max size
of one single thread cache could not be greater than 4096KB at the
first time, but it could request more from unclaimed cache space
or steal from other thread cache each time it's doing garbage
collection. For more details about tcmalloc, please check document:
https://gperftools.github.io/gperftools/tcmalloc.html
KUDU-3557 shows the difference on lock contention while setting
different sizes of max_total_thread_cache_bytes. Please check it
for details.
Change-Id: I3cb8c6ed6a8f24c63258ae65f8b841fe74b75308
Reviewed-on: http://gerrit.cloudera.org:8080/21076
Tested-by: Alexey Serbin <ale...@apache.org>
Reviewed-by: Alexey Serbin <ale...@apache.org>
> Add ability to set maximum thread cache size of tcmalloc easily.
> ----------------------------------------------------------------
>
> Key: KUDU-3557
> URL: https://issues.apache.org/jira/browse/KUDU-3557
> Project: Kudu
> Issue Type: Improvement
> Reporter: Song Jiacheng
> Priority: Major
> Attachments: image-2024-02-27-15-58-05-449.png,
> image-2024-02-27-15-58-14-096.png, image-2024-02-27-15-59-25-180.png
>
>
> {color:#172b4d}Now, Lock contention is too high in tcmalloc while the cluster
> in under high throughput. Making the total thread cache size larger could
> highly decrease the lock contention. Even though the max size of one single
> thread cache could not be larger than 4096KB, but tcmalloc will have much
> more room to control the total size if {color}max_total_thread_cache_bytes is
> larger.
> Here are some comparison between tservers which are set to different
> max_total_thread_cache_bytes
> ta2:512MB others:32MB(default)
> X: time Y: metric spinlock_contention_time
> {color:#172b4d}!image-2024-02-27-15-58-05-449.png!{color}
> {color:#172b4d}!image-2024-02-27-15-59-25-180.png!{color}
> {color:#172b4d} {color}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
