I’ve done something like this in the past. It was two parts - first figure
out the desired schema and then when reading files make them conform to
that schema.
The first step could be by specifying the schema or by unioning the
schemas. Fields appearing in only some files are treated as null in th
ore, it is considered undefined behavior to pass filter
> with null values."
>
> So, I guess a third option would be a variant of `filter` which treated
> `null` as `false`.
>
> On Wed, Feb 10, 2021 at 10:50 AM Ben Chambers
> wrote:
>
>> I'm trying to impleme
with null values."
So, I guess a third option would be a variant of `filter` which treated
`null` as `false`.
On Wed, Feb 10, 2021 at 10:50 AM Ben Chambers wrote:
> I'm trying to implement something along the lines of "X if Y > Z", but
> treating the case of Y or Z as
I'm trying to implement something along the lines of "X if Y > Z", but
treating the case of Y or Z as null as "false". Interestingly, this is
difficult with the way the kernels are created:
1. `Y > Z` will treat `null > ???` as null.
"Perform left > right operation on two arrays. Non-null values a
