Yes, we'll share and check in the thrift equivalent protobuf sepc in Apache Hive repo. As for the proto libraries, we'll open source and distribute them under the Apache license. Based on our preliminary evaluation, it might be better to load these proto libraries at run time and not bloat up the Hive codebase. Would that work for you Jan?
Feng On Tue, Aug 18, 2020 at 10:12 AM Jan Fili <janf...@gmail.com> wrote: > Would you mind shading the proto-library in hive-exec-core along the way? > > Am Mo., 17. Aug. 2020 um 08:31 Uhr schrieb Feng Lu <fen...@google.com>: > > > > It has been a while since we shared this design proposal, if there's no > more concern, we'll go ahead with the implementation work soon. > > Thank you! > > > > On Fri, Jul 31, 2020 at 1:57 PM Feng Lu <fen...@google.com> wrote: > >> > >> Hi all, > >> > >> Several of us from Google and Cloudera explored the possibility of > adding gRPC support in Apache Hive. The detailed design proposal can be > found here: > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158869886 > . > >> > >> TL;DR: > >> Why? > >> - modernize Hive Metastore's Thrift interface to gRPC based for > enhanced/more flexible authentication/authorization support. > >> - leverage the gRPC streaming capability to reduce response latency and > Hive Metastore resource footprint. > >> > >> How? > >> - we provide a thin translation layer that converts Thrift to gRPC (and > vice versa) messages in memory initially. > >> - over time, Hive Metastore methods (e.g., getTable) will be > implemented directly on gRPC so no gRPC->Thrift conversation is required. > >> > >> Thank you and any feedback is welcome. Have a great weekend! > >> > >> p.s., If we don't see much concern from the community, the next step is > to get the dev work started in the next couple of months. > >> > >> Feng >
