RE: Re: [DISCUSS] Limitation of storing UnknownType in MapType

2025-07-31 Thread Ala Łuszczak
Another scenario I would be concerned about is a table that contains only UnknownType top-level fields. What will happen in such a scenario? Will the Parquet format tolerate zero-column files? I think it's likely that even if Parquet-java supports this, it might be an untested and unsupported corne

Re: [DISCUSS] Limitation of storing UnknownType in MapType

2025-07-28 Thread Bart Samwel
On Sat, Jul 26, 2025 at 6:09 PM Kevin Liu wrote: > > My initial idea was to disallow the use of UnknownType as the element > in ListType and not allow the UnknownType as either a Key or Value of a > MapType. Any thoughts or concerns? > > That makes sense. I would also include `StructType` here to

Re: [DISCUSS] Limitation of storing UnknownType in MapType

2025-07-26 Thread Kevin Liu
> My initial idea was to disallow the use of UnknownType as the element in ListType and not allow the UnknownType as either a Key or Value of a MapType. Any thoughts or concerns? That makes sense. I would also include `StructType` here too. `StructType` is another "complex type" (extends NestedTy