Vihang Karajgaonkar created HIVE-23018:
------------------------------------------

             Summary: Provide a bulk API to fire multiple listener events
                 Key: HIVE-23018
                 URL: https://issues.apache.org/jira/browse/HIVE-23018
             Project: Hive
          Issue Type: Improvement
            Reporter: Vihang Karajgaonkar
            Assignee: Vihang Karajgaonkar


Metastore provides a API to fire a listener event (currently only supports 
INSERT event). The problem with that API is that it only takes in one partition 
at a time. A typical query may insert data into multiple partitions at a time. 
In such a case query engines like HS2 or Impala will have to issue multiple 
RPCs to metastore sequentially to fire these events. This can show up as a 
slowdown to the user if the query engines do not return the prompt to the user 
until all the events are fired (In case of HS2 and Impala). It would be great 
if we have bulk API which takes in multiple partitions for a table so that 
metastore can generate many such events in one RPC.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to