I think for DataFusion to Hive metastore we just need to implement the HMS thrift API and create a client implementation. Agree this is best suited under datafusion-contrib.
On Wed, Oct 4, 2023 at 4:06 AM Raphael Taylor-Davies <r.taylordav...@googlemail.com.invalid> wrote: > Hi, > > I think [1] might be a good place to start and handle coordination for > this undertaking. I suspect it would probably want to live under the > datafusion-contrib organisation, similar to HDFS [2] > > Kind Regards, > > Raphael > > [1]: https://github.com/apache/arrow-datafusion/issues/2209 > [2]: https://github.com/datafusion-contrib/datafusion-objectstore-hdfs > > On 04/10/2023 00:18, Kothapalli, Vamsi wrote: > > Hi devs, > > > > I would like to start discussion with possible integration of Hive > Metastore with Data fusion, > > > > > > Simmilarly along the lines of this Glue catalog itegration > > https://github.com/apache/arrow-datafusion/issues/2206, Can anyone > suggest me how the code should look like if > > I or some would like to work on building HiveMetastore as catalog > provider feature in data fusion > > > > Thanks, > > Vamsi > > > > > > [ > https://opengraph.githubassets.com/e562cb13412873d4ec10975083b49f02937926cfb878b1c07f4daf147c1f7494/apache/arrow-datafusion/issues/2206 > ]<https://github.com/apache/arrow-datafusion/issues/2206> > > [datafusion-contrib] AWS Glue Integration · Issue #2206 · > apache/arrow-datafusion< > https://github.com/apache/arrow-datafusion/issues/2206> > > Is your feature request related to a problem or challenge? Please > describe what you are trying to do. This has been discussed in various > places, #907 and datafusion-contrib/datafusion-objectstore-s... > > github.com > > > > >
