Re: [DISCUSS] Hive Support

Thanks Wing Yew for filling in the missing part. > > The built-in version is also used for other things that Spark may use from > Hive (aside from interaction with HMS), such as Hive SerDes. AFAIK, this is blocking Spark itself from upgrade the built-in version to Hive 4. Thanks Peter for recap.

Re: [DISCUSS] REST Catalog bulk object lookup

Hi, Vladimir: Thanks for raising this. I think your proposal is mixing two things up: 1. Add an endpoint for loading a catalog object by name without knowing its type. This is reasonable to me. 2. Make the endpoint a bulk load operation. I'm hesitating with this option since it makes error handlin

Re: [DISCUSS] REST: Way to query if metadata pointer is the latest

Hi, If the Table interface had been defined as immutable, sharing BaseTable objects could have been a viable option. However, since that’s not the case, changing the current design to share BaseTable objects may lead to compatibility issues with the existing API. Regarding the current() and re

Re: [ANN] Apache Iceberg Summit 2025, dates, venue and CFP

Thanks for putting this together everyone. Looking forward to the event and meeting in person! Best, Kevin Liu On Tue, Jan 7, 2025 at 2:15 AM Jean-Baptiste Onofré wrote: > Hi everyone, > > With this new year comes a new announcement: Apache Iceberg Summit 2025 ! > > Iceberg Summit 2025 is a hyb

Re: ​[discuss] Allow 200 responses for HEAD requests in REST API

Hey folks, Thanks for the feedback on the proposal. I believe it’s best to retain the current 204 response code for HEAD requests in the REST API. Existing client and server implementations that adhere to the spec expect only 204 responses. Introducing an additional 200 response code would create

Re: [Discuss] Replace Hadoop Catalog Examples with JDBC Catalog in Documentation

Hey folks, Happy new year! I want to bump this thread with the freshed PR #11845 . I've applied the recommendations from this thread. The PR replaces examples of Hadoop catalog in the Getting Started pages with the JDBC Catalog along with an added exam

Re: [DISCUSS] Hive Support

Hi Peter, Re "Hive would provide a HMS client jar which only contains java code which is needed to connect and communicate using Thrift with a HMS instance (no internal HMS server code etc). We could use it as a dependency for our iceberg-hive-metastore module. Either setting a minimal version

Re: [DISCUSS] Hive Support

Thanks Wing Yew, We should remove the Iceberg Hive Runtime module, but make sure that the Iceberg Hive Metastore module tests are running against the supported(?) Hive 2.3.10/3.1.3/4.0.1 versions. Other tests could run against whatever Hive version they prefer In details: -- Let me r

[ANN] Apache Iceberg Summit 2025, dates, venue and CFP

Hi everyone, With this new year comes a new announcement: Apache Iceberg Summit 2025 ! Iceberg Summit 2025 is a hybrid event sanctioned by The Apache Software Foundation and organized by Dremio, Snowflake, and Microsoft. The summit aims to promote Apache Iceberg education and knowledge-sharing am