[email protected] has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/23687 )

Change subject: IMPALA-14562: Enable Hierarchical event processing by default
......................................................................


Patch Set 2:

(1 comment)

http://gerrit.cloudera.org:8080/#/c/23687/2/be/src/catalog/catalog-server.cc
File be/src/catalog/catalog-server.cc:

http://gerrit.cloudera.org:8080/#/c/23687/2/be/src/catalog/catalog-server.cc@261
PS2, Line 261: DEFINE_bool(enable_hierarchical_event_processing, true,
We need to reduce hms_event_polling_interval_s to < 1sec. Since multiple 
threads are processing events, polling frequency can be increased to use the 
full potential of HEP. We can keep 0.2sec or lower. Because we have 
max_outstanding_events_on_executors to limit the max outstanding events at any 
point of time. So if outstanding events hit the limit, we don’t pull any more 
events from HMS(on subsequent processEvents() thread schedules) until it comes 
down below this.

hms_event_polling_interval_s can be configured to a lower possible value that 
ensures HMS don't get overloaded with too frequent calls.



--
To view, visit http://gerrit.cloudera.org:8080/23687
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ie9a28f863ef17456817e0a335215450e514b1f5b
Gerrit-Change-Number: 23687
Gerrit-PatchSet: 2
Gerrit-Owner: Sai Hemanth Gantasala <[email protected]>
Gerrit-Reviewer: Anonymous Coward <[email protected]>
Gerrit-Reviewer: Fang-Yu Rao <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Quanlong Huang <[email protected]>
Gerrit-Reviewer: Sai Hemanth Gantasala <[email protected]>
Gerrit-Comment-Date: Thu, 20 Nov 2025 11:36:33 +0000
Gerrit-HasComments: Yes

Reply via email to