Hi Ajantha, It looks the catalog sync link is not publicly accessible. Can you check?
Thanks, Manu On Wed, Jul 17, 2024 at 12:42 AM Ajantha Bhat <ajanthab...@gmail.com> wrote: > We have discussed this yesterday in the catalog sync from *44:00 to > 1:03:36* > > https://drive.google.com/file/d/1SMOlxus5C92FvW9T4LOXy8Ue_9cmPLyX/view?usp=sharing&t=2643 > > IIRC, the conclusion was that each catalog may handle namespaces > differently, with some supporting multi-level namespaces and others not. > Iceberg does not intend to standardize this behavior, so it is up to each > catalog to update their documentation regarding their specific behavior. > > - Ajantha > > > On Tue, Jul 16, 2024 at 3:12 PM Jean-Baptiste Onofré <j...@nanthrax.net> > wrote: > >> Hi >> >> As namespace is not part of the spec, each REST server implementation >> can use a different logic from another one. >> The TCK will be able to verify the most abstract operations on >> namespace (common denominator on namespace behavior). >> >> Regards >> JB >> >> On Tue, Jul 16, 2024 at 11:11 AM Yong Zhang <zhangyong1025...@gmail.com> >> wrote: >> > >> > It seems TCK will make sure the logic of the REST is consistent. So in >> > the future iceberg will make all things align. >> > >> > We can merge the current PR to avoid a burden on the user. WDYT? >> > >> > Thanks! >> > Yong >> > >> > On Thu, 11 Jul 2024 at 01:04, Ajantha Bhat <ajanthab...@gmail.com> >> wrote: >> >> >> >> Thanks for initiating this discussion. >> >> >> >> I suggested moving it to the mailing list because the javadoc of >> SupportsNamespaces and the REST API spec don't clearly define how to handle >> missing parent namespaces. >> >> >> >> I'm generally +1 of the idea to automatically create missing >> namespaces now, as it reduces the burden on the user. However, I believe >> this approach should be standardized and adopted by all catalogs that >> support multi-level namespaces to avoid confusion. >> >> That is we need to update the java doc and REST API spec descriptions >> for this behavior once we have consensus. >> >> >> >> - Ajantha >> >> >> >> On Wed, Jul 10, 2024 at 7:44 PM Renjie Liu <liurenjie2...@gmail.com> >> wrote: >> >>> >> >>> Hi, Yong: >> >>> >> >>> Thanks for reporting this. >> >>> >> >>>> Do you think iceberg needs to standardize the REST spec to make sure >> the >> >>>> logic is the same for using the SupportsNamespace interface? >> >>> >> >>> >> >>> Yes, I think it's valuable. I remember @Jean-Baptiste Onofré had a >> proposal for TCK of rest catalog, and this case shows that TCK has a lot of >> merit. >> >>> >> >>> On Wed, Jul 10, 2024 at 5:47 PM Yong Zhang < >> zhangyong1025...@gmail.com> wrote: >> >>>> >> >>>> Hi all, >> >>>> >> >>>> When I was using the SupportsNamespaces to do the namespace >> >>>> create and exists check with other catalog services that implement >> >>>> the Iceberg REST API, I found it has different results with different >> >>>> catalog services. Iceberg has provided a standard API to do the >> >>>> namespace operations, but seems iceberg does not have a standard >> >>>> spec on the REST API implementation. That makes the other catalog >> >>>> services implement differently and then breaks the SupportsNamespace >> >>>> interface usage. >> >>>> >> >>>> Do you think iceberg needs to standardize the REST spec to make sure >> the >> >>>> logic is the same for using the SupportsNamespace interface? >> >>>> Otherwise, the SupportsNamespace interface is meaningless because >> the client >> >>>> needs to handle different logic to create a namespace or other >> operations >> >>>> when using different catalog. >> >>>> >> >>>> For example, Nessie doesn't support auto-creating parent namespace: >> >>>> https://github.com/apache/iceberg/pull/10630 >> >>>> But the JDBC catalog supports it. >> >>>> >> >>>> Thanks. >> >>>> Yong >> >>>> >> >