Re: [Early Feedback] Variant and Subcolumnarization Support

2024-08-14 Thread David Cashman
as a JSON null. Thanks, David On Wed, Aug 14, 2024 at 5:11 PM Selcuk Aya wrote: > > Hi David, just to clarify, I think we can shred arrays with json nulls > without having to use untyped_value column, is this correct? > > Selcuk > > On Wed, Aug 14, 2024 at 11:31 PM David Cashman

Re: [Early Feedback] Variant and Subcolumnarization Support

2024-08-14 Thread David Cashman
Hi Nick, Your understanding is correct. The null in the Variant spec is meant to encode a JSON null. A row-level value can be SQL null as in any nullable column, but within a Variant value, there is only the Variant-encoded null (i.e. JSON null). Some of the Spark expressions (e.g. cast to a non-V