Re: Restrict orphan file removal to data/metadata directories

2025-03-05 Thread Szehon Ho
Hi Karuppayya Wanted to check, would a regex suffice for this use case (ie, match /data/*, /metadata/*) and to keep it more general ? The idea came from Dan in a one off chat. Thanks Szehon On Wed, Feb 26, 2025 at 1:41 PM Pucheng Yang wrote: > Yes, Iceberg spec does not define where the data

Re: Restrict orphan file removal to data/metadata directories

2025-02-26 Thread Pucheng Yang
Yes, Iceberg spec does not define where the data and metadata should be located. /data and /metadata are paths by default, but users can override this behavior by having customized location provider or set write.metadata.path explicitly. On Wed, Feb 26, 2025 at 1:24 PM karuppayya wrote: > Hello