Taraka Rama Rao Lethavadla created HIVE-27126: -------------------------------------------------
Summary: Display Yarn resources availability in real time along with Tez job progress Key: HIVE-27126 URL: https://issues.apache.org/jira/browse/HIVE-27126 Project: Hive Issue Type: Improvement Components: HiveServer2 Reporter: Taraka Rama Rao Lethavadla Right we don't know if the queue used in Hive query execution is having enough resources or not. We are already displaying tez job details like number of task per each vertex and how are they progressing. If the resources available are not good enough to execute the query in parallel or query that use to take shorter time is taking time, then we can use this new detail to understand that queue is busy and resources are not enough {noformat} ---------------------------------------------------------------------------------------------- VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 230 0 10 230 0 1 Reducer 2 container INITED 1 0 0 1 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/02 [>>--------------------------] 0% ELAPSED TIME: 58.33 s ---------------------------------------------------------------------------------------------- {noformat} So it would be great to display current resource availability in that specific queue along with above info in real time would help understand why a query can be slow -- This message was sent by Atlassian Jira (v8.20.10#820010)