Re: Iceberg data backup and disaster recovery strategy

2022-06-29 Thread Yufei Gu
Hi Vinod, The problem of moving an Iceberg table is the absolute path within the metadata layer. They may not work once you move it from one place to another. Here are solutions: 1. Make sure the paths are the same, or it works across regions. For example, you can use https://docs.aws.amazon.com/A

Iceberg data backup and disaster recovery strategy

2022-06-28 Thread Vinod Kumar Mullangi
Hi Team, I am working as a Data Engineer in Expedia. As part of one of my projects. I am doing some research on process for backing up and restoring iceberg tables(stored in aws s3) so that we can recover data if an Iceberg table is accidentally dropped. I went over few documentations but not ab