[ https://issues.apache.org/jira/browse/HIVE-12856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153414#comment-15153414 ]
Gunther Hagleitner commented on HIVE-12856: ------------------------------------------- I've just glanced at this - is there a writeup somewhere on how this will work? Looks like you're polling metastore from llap and that will force you to have a metastore server somewhere. Why can't you push the info into the daemon with the query fragment? > LLAP: update (add/remove) the UDFs available in LLAP when they are changed > (refresh periodically) > ------------------------------------------------------------------------------------------------- > > Key: HIVE-12856 > URL: https://issues.apache.org/jira/browse/HIVE-12856 > Project: Hive > Issue Type: Sub-task > Reporter: Sergey Shelukhin > Assignee: Sergey Shelukhin > Attachments: HIVE-12856.01.nogen.patch, HIVE-12856.01.patch, > HIVE-12856.02.nogen.patch, HIVE-12856.02.patch, HIVE-12856.nogen.patch, > HIVE-12856.patch > > > I don't think re-querying the functions is going to scale, and the sessions > obviously cannot notify all LLAP clusters of every change. We should add > global versioning to metastore functions to track changes, and then possibly > add a notification mechanism, potentially thru ZK to avoid overloading the > metastore itself. -- This message was sent by Atlassian JIRA (v6.3.4#6332)