Re: Airflow Integration

2021-03-02 Thread Gustavo Torres Torres
an unpartitioned Hive table, > where the backing Iceberg table was using identity partitions for the > originally requested columns. > > Hope this helps a bit. > > Thanks, > Peter > > On Mar 2, 2021, at 03:38, Gustavo Torres Torres < > gustavo.tor...@airbnb.com.

Airflow Integration

2021-03-01 Thread Gustavo Torres Torres
Hey folks, Lately I've been thinking about integration between Airflow & Iceberg for a smooth transition from Hive-based tables to Iceberg ones and would like to hear about your experience. Specifically about Iceberg partition sensors in Airflow. >From the way I see it, there are two ways to go a

Re: How to time travel using Presto?

2020-09-15 Thread Gustavo Torres Torres
I believe you can see all snapshots available from a table by running: SELECT * FROM my_db."my_table$snapshots" >From there you can get all different snapshot_id available. Then you can just filter based on that snapshot_id: SELECT * FROM my_db."my_table@SNAPSHOT_ID" On Tue, Sep 15, 2020 at 6:4