Peter Vary created HIVE-21847:
---------------------------------

             Summary: Reduce the communication rate between TezAM and 
LlapDaemons for Llap statistics
                 Key: HIVE-21847
                 URL: https://issues.apache.org/jira/browse/HIVE-21847
             Project: Hive
          Issue Type: Sub-task
            Reporter: Peter Vary


HIVE-21846 is suboptimal if we have big number of TezAMs and LlapDaemons.

We have to find a better way which is scaleable.

Possible solution could be:
 * Elect a TezAM leader for statistics fetching using ZooKeeper for the election
 * TezAM should become a leader and fetch LlapDaemon data from the Daemons if 
there is no existing leader
 * TezAM should query the data from the leader TezAM if there is an existing 
leader.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to