Re: Reading Glue catalog Views created on top of Iceberg tables.

2023-09-26 Thread Walaa Eldin Moustafa
Sanket A. > > > > *From:* Walaa Eldin Moustafa > *Sent:* Tuesday, September 26, 2023 8:00 PM > *To:* dev@iceberg.apache.org > *Subject:* [EXT] Re: Reading Glue catalog Views created on top of Iceberg > tables. > > > > View support in Spark requires

RE: Reading Glue catalog Views created on top of Iceberg tables.

2023-09-26 Thread Agrawal, Sanket
It’s in the AWS Glue catalog. AWS Glue Catalog allows to create views on top of Iceberg tables. Regards, Sanket A. From: Walaa Eldin Moustafa Sent: Tuesday, September 26, 2023 8:00 PM To: dev@iceberg.apache.org Subject: [EXT] Re: Reading Glue catalog Views created on top of Iceberg tables

Re: Reading Glue catalog Views created on top of Iceberg tables.

2023-09-26 Thread Walaa Eldin Moustafa
View support in Spark requires the implementation of the View DataSource V2 SPIP (see associated Spark Jira SPARK-31357 ). The interface P

Re: Reading Glue catalog Views created on top of Iceberg tables.

2023-09-26 Thread Eduard Tudenhoefner
Views are currently not supported by Iceberg, but are under active development. You can check the current status of Iceberg View support here . Eduard On Mon, Sep 25, 2023 at 8:39 PM Agrawal, Sanket wrote: > Hello Everyone, > > > > We have setup sp

Reading Glue catalog Views created on top of Iceberg tables.

2023-09-25 Thread Agrawal, Sanket
Hello Everyone, We have setup spark and setup everything as mentioned at https://iceberg.apache.org/docs/latest/aws/ to integrate Spark, Iceberg, and AWS Glue Catalog. We are able to read tables through this but we are unable to read data through views. PFB, the error: pyspark.errors.exception