Riza Suminto has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/22617


Change subject: IMPALA-13842: Standardize workload management tests
......................................................................

IMPALA-13842: Standardize workload management tests

This patch standardize test against system tables (sys.impala_query_log
and sys.impala_query_live) to use common superclass named
WorkloadManagementTestSuite. The setup_method of this superclass wait
for workload management init completion (wait_for_wm_init_complete()),
while the teardown_method wait until
impala-server.completed-queries.queued metric reach
0 (wait_for_wm_idle()).

test_query_log.py, test_query_live.py and
test_workload_mgmt_sql_details.py are refactored to extend from
WorkloadManagementTestSuite. Tests to assert the query log table flush
behavior is grouped together in TestQueryLogTableFlush.

test_workload_mgmt_init.py does not extend from
WorkloadManagementTestSuite because it is testing cluster start and
restart scenario. This patch only add wait_for_wm_idle() at
teardown_method where it make sense to do so.

workload_mgmt parameter in CustomClusterTestSuite.with_args() is
standardized to setup appropriate default flags for
IMPALAD_ARGS
  '--enable_workload_mgmt=true --query_log_write_interval_s=1'
and CATALOGD_ARGS
  '--enable_workload_mgmt=true'

in cluster_setup() rather than passing it down to
_start_impala_cluster(). Note that IMPALAD_ARGS and CATALOGD_ARGS flags
added by workload_mgmt and impalad_graceful_shutdown parameter is still
overridable to different value by explicitly adding it in impalad_args
and catalogd_args parameter. Setting workload_mgmt=True should also
followed by setting impalad_graceful_shutdown=True whenever possible.

Additionally print total wait time in wait_for_metric_value().

Testing:
- Run modified tests and pass.

Change-Id: Iecf6452fa963304e263805ebeb017c843d17dd16
---
M be/src/service/workload-management-worker.cc
M tests/common/custom_cluster_test_suite.py
M tests/common/impala_cluster.py
M tests/common/impala_service.py
A tests/common/wm_test_suite.py
M tests/custom_cluster/test_admission_controller.py
M tests/custom_cluster/test_query_live.py
M tests/custom_cluster/test_query_log.py
M tests/custom_cluster/test_workload_mgmt_init.py
M tests/custom_cluster/test_workload_mgmt_sql_details.py
10 files changed, 444 insertions(+), 421 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/17/22617/1
--
To view, visit http://gerrit.cloudera.org:8080/22617
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: Iecf6452fa963304e263805ebeb017c843d17dd16
Gerrit-Change-Number: 22617
Gerrit-PatchSet: 1
Gerrit-Owner: Riza Suminto <riza.sumi...@cloudera.com>

Reply via email to