[ https://issues.apache.org/jira/browse/KAFKA-15402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17916357#comment-17916357 ]
Benoit Delbosc commented on KAFKA-15402: ---------------------------------------- I think I have found the cause this is related to the {{FETCH_MAX_WAIT_MS_CONFIG}} which is 500ms by default. Reducing the {{fetch.max.wait.ms}} to 25ms similarly reduces the duration of consumer close. This change in behavior is certainly related to KAFKA-14365 (v3.5.0). It would be nice to not to not block this {{fetch.max.wait.ms}} amount of time when closing a consumer. > Performance regression on close consumer after upgrading to 3.5.0 > ----------------------------------------------------------------- > > Key: KAFKA-15402 > URL: https://issues.apache.org/jira/browse/KAFKA-15402 > Project: Kafka > Issue Type: Bug > Components: clients, consumer > Affects Versions: 3.5.0, 3.6.0, 3.5.1 > Reporter: Benoit Delbosc > Assignee: Kirk True > Priority: Major > Fix For: 4.1.0 > > Attachments: image-2023-08-24-18-51-21-720.png, > image-2023-08-24-18-51-57-435.png, image-2023-08-25-10-50-28-079.png > > > Hi, > After upgrading to Kafka client version 3.5.0, we have observed a significant > increase in the duration of our Java unit tests. These unit tests heavily > rely on the Kafka Admin, Producer, and Consumer API. > When using Kafka server version 3.4.1, the duration of the unit tests > increased from 8 seconds (with Kafka client 3.4.1) to 18 seconds (with Kafka > client 3.5.0). > Upgrading the Kafka server to 3.5.1 show similar results. > I have come across the issue KAFKA-15178, which could be the culprit. I will > attempt to test the proposed patch. > In the meantime, if you have any ideas that could help identify and address > the regression, please let me know. -- This message was sent by Atlassian Jira (v8.20.10#820010)