[ 
https://issues.apache.org/jira/browse/HIVE-12856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153414#comment-15153414
 ] 

Gunther Hagleitner commented on HIVE-12856:
-------------------------------------------

I've just glanced at this - is there a writeup somewhere on how this will work? 
Looks like you're polling metastore from llap and that will force you to have a 
metastore server somewhere. Why can't you push the info into the daemon with 
the query fragment?

> LLAP: update (add/remove) the UDFs available in LLAP when they are changed 
> (refresh periodically)
> -------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-12856
>                 URL: https://issues.apache.org/jira/browse/HIVE-12856
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>         Attachments: HIVE-12856.01.nogen.patch, HIVE-12856.01.patch, 
> HIVE-12856.02.nogen.patch, HIVE-12856.02.patch, HIVE-12856.nogen.patch, 
> HIVE-12856.patch
>
>
> I don't think re-querying the functions is going to scale, and the sessions 
> obviously cannot notify all LLAP clusters of every change. We should add 
> global versioning to metastore functions to track changes, and then possibly 
> add a notification mechanism, potentially thru ZK to avoid overloading the 
> metastore itself.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to