Re: Behavior of dropping table with HadoopCatalog

2023-08-30 Thread Manish Malhotra
Yes, that always make sense On Wed, Aug 30, 2023 at 8:30 AM Ryan Blue wrote: > This is one of the many problems with not using a real catalog. If there > are any metadata files under the table location, then the table exists so > we have to delete. The solution is to not use the HadoopCatalog, w

Re: Behavior of dropping table with HadoopCatalog

2023-08-30 Thread Ryan Blue
This is one of the many problems with not using a real catalog. If there are any metadata files under the table location, then the table exists so we have to delete. The solution is to not use the HadoopCatalog, which has been the community's recommendation for several years. On Wed, Aug 30, 2023

Re: Behavior of dropping table with HadoopCatalog

2023-08-30 Thread russell . spitzer
There is no way to drop a Hadoop catalog table without removing the directory so I’m not sure what the alternative would beSent from my iPhoneOn Aug 29, 2023, at 10:10 PM, Manu Zhang wrote:Hi all,The current behavior of dropping a table with HadoopCatalog looks inconsistent to me. When stored at

Behavior of dropping table with HadoopCatalog

2023-08-29 Thread Manu Zhang
Hi all, The current behavior of dropping a table with HadoopCatalog looks inconsistent to me. When stored at the default location under table path, metadata and data will be deleted regardless of the "purge" flag. When stored elsewhere, they will be left there if not "purge". Is this by design? @