Hi everyone,

Recently I took a stab at implementing reading UknownType
<https://github.com/apache/iceberg/pull/13445> in the Java implementation.
I thought it would make sense to add this to the reference implementation
first. However, I ran into a limitation with the current definition in the
spec:

Must be optional with null defaults; not stored in data files


One obvious limitation is that it cannot be the key of a MapType, as it has
to be not-null. It can't be stored either as the value of a MapType since
there is no easy way to store just the key without doing awkward things,
such as writing just the keys as a list.

My initial idea was to disallow the use of UnknownType as the element in
ListType and not allow the UnknownType as either a Key or Value of a MapType.
Any thoughts or concerns?

Kind regards from Belgium,
Fokko

Reply via email to