Yida Wu has uploaded a new patch set (#5). ( 
http://gerrit.cloudera.org:8080/23094 )

Change subject: IMPALA-12057: Track removed coordinators to reject queued 
queries early
......................................................................

IMPALA-12057: Track removed coordinators to reject queued queries early

Queries in global admission control can remain queued for a long time
if they are assigned to a coordinator that has already left the
cluster. Admissiond can't distinguish between a coordinator that
hasn’t yet been propagated via the statestore and one that has
already been removed, resulting in unnecessary waiting until timeout.

This change tracks recently removed coordinators and rejects such
queued queries immediately using REASON_COORDINATOR_REMOVED.
To ensure the removed coordinator list remains simple and bounded,
it avoids duplicate entries and enforces FIFO eviction at
MAX_REMOVED_COORD_SIZE (1000).

Tests:
Added unit tests to verify the eviction logic and the duplicate
case.
Added regression test test_coord_not_registered_in_ac.

Change-Id: I1e0f270299f8c20975d7895c17f4e2791c3360e0
---
M be/src/scheduling/admission-controller.cc
M be/src/scheduling/cluster-membership-mgr-test.cc
M be/src/scheduling/cluster-membership-mgr.cc
M be/src/scheduling/cluster-membership-mgr.h
M tests/custom_cluster/test_admission_controller.py
5 files changed, 201 insertions(+), 10 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/94/23094/5
--
To view, visit http://gerrit.cloudera.org:8080/23094
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I1e0f270299f8c20975d7895c17f4e2791c3360e0
Gerrit-Change-Number: 23094
Gerrit-PatchSet: 5
Gerrit-Owner: Yida Wu <wydbaggio...@gmail.com>
Gerrit-Reviewer: Abhishek Rawat <ara...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
Gerrit-Reviewer: Yida Wu <wydbaggio...@gmail.com>

Reply via email to