RE: Re: Guidance on implementing Hybrid CDC Pattern from "CDC patterns in Apache Iceberg" talk

2023-09-25 Thread Nick Del Nano
Thanks everyone for the feedback :) On 2023/09/22 22:55:57 Alex Reid wrote: > Hi Nick, > > Ryan's suggestions are what I'd recommend as well. Another option would be > to store the snapshot-id as a table property in the target table (though, > you introduce the possibility of being out of sync si

Reading Glue catalog Views created on top of Iceberg tables.

2023-09-25 Thread Agrawal, Sanket
Hello Everyone, We have setup spark and setup everything as mentioned at https://iceberg.apache.org/docs/latest/aws/ to integrate Spark, Iceberg, and AWS Glue Catalog. We are able to read tables through this but we are unable to read data through views. PFB, the error: pyspark.errors.exception