This is the public link: https://www.youtube.com/watch?v=JSN9T20eAuU

-Jack

On Tue, Jul 16, 2024 at 7:38 PM Manu Zhang <owenzhang1...@gmail.com> wrote:

> Hi Ajantha,
>
> It looks the catalog sync link is not publicly accessible. Can you check?
>
> Thanks,
> Manu
>
> On Wed, Jul 17, 2024 at 12:42 AM Ajantha Bhat <ajanthab...@gmail.com>
> wrote:
>
>> We have discussed this yesterday in the catalog sync from *44:00 to
>> 1:03:36*
>>
>> https://drive.google.com/file/d/1SMOlxus5C92FvW9T4LOXy8Ue_9cmPLyX/view?usp=sharing&t=2643
>>
>> IIRC, the conclusion was that each catalog may handle namespaces
>> differently, with some supporting multi-level namespaces and others not.
>> Iceberg does not intend to standardize this behavior, so it is up to each
>> catalog to update their documentation regarding their specific behavior.
>>
>> - Ajantha
>>
>>
>> On Tue, Jul 16, 2024 at 3:12 PM Jean-Baptiste Onofré <j...@nanthrax.net>
>> wrote:
>>
>>> Hi
>>>
>>> As namespace is not part of the spec, each REST server implementation
>>> can use a different logic from another one.
>>> The TCK will be able to verify the most abstract operations on
>>> namespace (common denominator on namespace behavior).
>>>
>>> Regards
>>> JB
>>>
>>> On Tue, Jul 16, 2024 at 11:11 AM Yong Zhang <zhangyong1025...@gmail.com>
>>> wrote:
>>> >
>>> > It seems TCK will make sure the logic of the REST is consistent. So in
>>> > the future iceberg will make all things align.
>>> >
>>> > We can merge the current PR to avoid a burden on the user. WDYT?
>>> >
>>> > Thanks!
>>> > Yong
>>> >
>>> > On Thu, 11 Jul 2024 at 01:04, Ajantha Bhat <ajanthab...@gmail.com>
>>> wrote:
>>> >>
>>> >> Thanks for initiating this discussion.
>>> >>
>>> >> I suggested moving it to the mailing list because the javadoc of
>>> SupportsNamespaces and the REST API spec don't clearly define how to handle
>>> missing parent namespaces.
>>> >>
>>> >> I'm generally +1 of the idea to automatically create missing
>>> namespaces now, as it reduces the burden on the user. However, I believe
>>> this approach should be standardized and adopted by all catalogs that
>>> support multi-level namespaces to avoid confusion.
>>> >> That is we need to update the java doc and REST API spec descriptions
>>> for this behavior once we have consensus.
>>> >>
>>> >> - Ajantha
>>> >>
>>> >> On Wed, Jul 10, 2024 at 7:44 PM Renjie Liu <liurenjie2...@gmail.com>
>>> wrote:
>>> >>>
>>> >>> Hi, Yong:
>>> >>>
>>> >>> Thanks for reporting this.
>>> >>>
>>> >>>> Do you think iceberg needs to standardize the REST spec to make
>>> sure the
>>> >>>> logic is the same for using the SupportsNamespace interface?
>>> >>>
>>> >>>
>>> >>> Yes, I think it's valuable. I remember @Jean-Baptiste Onofré had a
>>> proposal for TCK of rest catalog, and this case shows that TCK has a lot of
>>> merit.
>>> >>>
>>> >>> On Wed, Jul 10, 2024 at 5:47 PM Yong Zhang <
>>> zhangyong1025...@gmail.com> wrote:
>>> >>>>
>>> >>>> Hi all,
>>> >>>>
>>> >>>> When I was using the SupportsNamespaces to do the namespace
>>> >>>> create and exists check with other catalog services that implement
>>> >>>> the Iceberg REST API, I found it has different results with
>>> different
>>> >>>> catalog services. Iceberg has provided a standard API to do the
>>> >>>> namespace operations, but seems iceberg does not have a standard
>>> >>>> spec on the REST API implementation. That makes the other catalog
>>> >>>> services implement differently and then breaks the SupportsNamespace
>>> >>>> interface usage.
>>> >>>>
>>> >>>> Do you think iceberg needs to standardize the REST spec to make
>>> sure the
>>> >>>> logic is the same for using the SupportsNamespace interface?
>>> >>>> Otherwise, the SupportsNamespace interface is meaningless because
>>> the client
>>> >>>> needs to handle different logic to create a namespace or other
>>> operations
>>> >>>> when using different catalog.
>>> >>>>
>>> >>>> For example, Nessie doesn't support auto-creating parent namespace:
>>> >>>> https://github.com/apache/iceberg/pull/10630
>>> >>>> But the JDBC catalog supports it.
>>> >>>>
>>> >>>> Thanks.
>>> >>>> Yong
>>> >>>>
>>>
>>

Reply via email to