Re: Hive Iceberg integration

2021-03-03 Thread Ryan Blue
David, we already have Hive support in Iceberg, so there is no need to create a separate project. I think the problem is that we can't make changes to Hive that are needed for that support. We're reaching the limits of what can be done in an external project, so we can either add/update interfaces

Re: Hive Iceberg integration

2021-03-03 Thread David
Hello Team, I'm not sure how far out you want to scope this, but I think we have enough sub-projects as it is within the Hive core project. To build the entire project takes a considerable amount of time. Would it be possible to roll this out like Jackson or DataNucleaus? https://github.com/apa

Re: Hive Iceberg integration

2021-03-03 Thread Ryan Blue
I think that this direction sounds reasonable. It makes sense to start building the integration in Hive because it will be easier to iterate there. Iceberg is quite different in some areas and I think that would probably mean that Hive needs to change to provide a really great experience. That was

[jira] [Created] (HIVE-24842) SHOW CREATE TABLE on a VIEW with partition returns wrong sql.

2021-03-03 Thread Anurag Shekhar (Jira)
Anurag Shekhar created HIVE-24842: - Summary: SHOW CREATE TABLE on a VIEW with partition returns wrong sql. Key: HIVE-24842 URL: https://issues.apache.org/jira/browse/HIVE-24842 Project: Hive

Hive Iceberg integration

2021-03-03 Thread Peter Vary
Hi Iceberg and Hive Teams, As some of you already know we are working on making Iceberg available as a first class storage layer for Hive. Folks on the Iceberg side made a good job on utilizing the existing Hive SerDe API for the released Hive 2.3.8 and 3.1.2 versions. Thanks to their efforts w