Re: Reading Glue catalog Views created on top of Iceberg tables.

Views are currently not supported by Iceberg, but are under active development. You can check the current status of Iceberg View support here . Eduard On Mon, Sep 25, 2023 at 8:39 PM Agrawal, Sanket wrote: > Hello Everyone, > > > > We have setup sp

Flink: new sink base on the unified sink API

Hi everyone, I am working on revisiting the PR created by Liwei Li and Kyle Bendickson where they were implementing the Flink SinkV2 interface in the Iceberg Flink connector. The discussion has been halted around a year ago, but some of our users would love to have the automatic small file compact

Re: Reading Glue catalog Views created on top of Iceberg tables.

View support in Spark requires the implementation of the View DataSource V2 SPIP (see associated Spark Jira SPARK-31357 ). The interface P

RE: Reading Glue catalog Views created on top of Iceberg tables.

It’s in the AWS Glue catalog. AWS Glue Catalog allows to create views on top of Iceberg tables. Regards, Sanket A. From: Walaa Eldin Moustafa Sent: Tuesday, September 26, 2023 8:00 PM To: dev@iceberg.apache.org Subject: [EXT] Re: Reading Glue catalog Views created on top of Iceberg tables. Vie

Re: Reading Glue catalog Views created on top of Iceberg tables.

Then the above setup should work (assuming you create the view from Spark). Thanks, Walaa. On Tue, Sep 26, 2023 at 7:50 AM Agrawal, Sanket wrote: > It’s in the AWS Glue catalog. AWS Glue Catalog allows to create views on > top of Iceberg tables. > > > > Regards, > > Sanket A. > > > > *From:* Wa

Re: [PROPOSAL] Preparing first Apache Iceberg Summit

Hi Ryan, My bad: I understood in the previous discussion about the summit that we wanted something more concrete in terms of format, length, organisation, how we can set this up. Of course, no problem to take a step back, and the document is definitely where we can work all together. I'm also in

Re: [DISCUSS] Spark 3.1 support?

I am planning to cut an RC tomorrow. I'll submit a PR to drop 3.1 later today. On 2023/09/25 03:10:14 Anton Okolnychyi wrote: > Let's wait until we are ready to cut an RC to see if anyone still expresses > interest in Spark 3.1. If not, I propose to not include it in 1.4 as it has > been already

Re: [PROPOSAL] Preparing first Apache Iceberg Summit

JB, What do you mean --- are you going to put together the proposal for how this would work? Or are you saying that anyone interested in that topic could add it to the doc? Ryan On Tue, Sep 26, 2023 at 12:26 PM Jean-Baptiste Onofré wrote: > Hi Ryan, > > My bad: I understood in the previous dis

Re: [PROPOSAL] Preparing first Apache Iceberg Summit

I mean that anyone interested can add it to the doc. I think we have different motivation and ideas. It’s great to share all together. Personally, my motivation is to promote the project (because it’s super interesting) and connect dots with other Apache projects. I also think it’s good timing to g