Re: [DISCUSS] Spark Catalog - Drop vs Drop with Purge

2024-12-16 Thread Jean-Baptiste Onofré
It sounds good to me. Thanks ! Regards JB On Wed, Dec 11, 2024 at 7:20 PM Russell Spitzer wrote: > > Hi Y'all! > > Today we had a little discussion on the Apache Iceberg Catalog Community Sync > about DROP and DROP WITH PURGE. Currently the SparkCatalog implementation > inside of the reference l

Re: [DISCUSS] Spark Catalog - Drop vs Drop with Purge

2024-12-11 Thread rdb...@gmail.com
That plan sounds good to me. Thanks, Russell! On Wed, Dec 11, 2024 at 1:43 PM Yufei Gu wrote: > +1 on adding a flag to support the Spark REST client behavior change > between v1.8 and v2.0. > > At the same time, we may clarify further more on the behavior of DropTable > REST API, > https://githu

Re: [DISCUSS] Spark Catalog - Drop vs Drop with Purge

2024-12-11 Thread Yufei Gu
+1 on adding a flag to support the Spark REST client behavior change between v1.8 and v2.0. At the same time, we may clarify further more on the behavior of DropTable REST API, https://github.com/apache/iceberg/blob/feed4e2544b5839fbc2fe040965af3906d053302/open-api/rest-catalog-open-api.yaml#L1099

[DISCUSS] Spark Catalog - Drop vs Drop with Purge

2024-12-11 Thread Russell Spitzer
Hi Y'all! Today we had a little discussion on the Apache Iceberg Catalog Community Sync about DROP and DROP WITH PURGE. Currently the SparkCatalog implementation inside of the reference library has a unique method of DROP WITH PURGE vs other implementations. The pseudo code is essentially ``` us