Taraka Rama Rao Lethavadla created HIVE-27126:
-------------------------------------------------

             Summary: Display Yarn resources availability in real time along 
with Tez job progress 
                 Key: HIVE-27126
                 URL: https://issues.apache.org/jira/browse/HIVE-27126
             Project: Hive
          Issue Type: Improvement
          Components: HiveServer2
            Reporter: Taraka Rama Rao Lethavadla


Right we don't know if the queue used in Hive query execution is having enough 
resources or not. We are already displaying tez job details like number of task 
per each vertex and how are they progressing. 

If the resources available are not good enough to execute the query in parallel 
or query that use to take shorter time is taking time, then we can use this new 
detail to understand that queue is busy and resources are not enough

 

 

 
{noformat}
----------------------------------------------------------------------------------------------
        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  
FAILED  KILLED
----------------------------------------------------------------------------------------------
Map 1            container       RUNNING    230          0        10      230   
  0       1
Reducer 2        container        INITED      1          0        0        1    
   0       0
----------------------------------------------------------------------------------------------
VERTICES: 00/02  [>>--------------------------] 0%    ELAPSED TIME: 58.33 s
----------------------------------------------------------------------------------------------
{noformat}
So it would be great to display current resource availability in that specific 
queue along with above info in real time would help understand why a query can 
be slow

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to