Hi Iceberg folks,

I'm working on a project where we're migrating tables from hive to iceberg.
We are revamping our ingestion pipeline in parallel from batch to stream.
Originally, our plan was to have two separate tables, a backfill table and
a live table, that would be stitched together via a view for downstream
consumers. This is proving rather difficult. In the absence of engine
agnostic views we were going to prepend views with the engine type (ie
trino_my_table and spark_my_table) but I receive a
org.apache.spark.sql.AnalysisException:
Catalog iceberg_catalog does not support views error when trying to create
the spark view. With the ongoing work towards engine agnostic views I'm
unsure if this limitation is expected or easily surpassed with some
config/spark change?

Thank you for your time,

Marc

Reply via email to