Re: Apache Iceberg integration

2020-01-09 Thread Feng Lu
For someone like me who is new to the hive community, is there a (semi-)formal process on contributing a large-scale feature like Hive-Iceberg integration? For example, hive improvement proposal, community voting, development and code review, release, etc. Thank you and sorry for derailing this co

Re: Apache Iceberg integration

2020-01-09 Thread Peter Vary
Hi Elliot, I think would be really worthwhile to have Iceberg integration with Hive. Minimally for reading through the available interfaces, then handling schema evolution / schema synchronization etc. Later having the possibility to write to an Iceberg table would be good as well, but integrati

Apache Iceberg integration

2020-01-08 Thread Elliot West
Hello, We're considering working on an integration of Apache Iceberg with Hive, initially so that the latest snapshot of Iceberg tables can be queried via Hive, but later to allow the writing of data using the Iceberg table format. I wanted to first check for the existence and status of any simil