Re: RunEndEncodedArray Null Counts

2023-01-23 Thread Andrew Lamb
To complete this thread, the documentation has been updated to clarify the intent[1]. Thank you all very much, Andrew [1] https://github.com/apache/arrow/pull/33831 On Mon, Jan 23, 2023 at 8:32 AM Raphael Taylor-Davies wrote: > Hi Tobias, > > Thank you for clarifying this, makes sense to me >

Re: RunEndEncodedArray Null Counts

2023-01-23 Thread Raphael Taylor-Davies
Hi Tobias, Thank you for clarifying this, makes sense to me Kind Regards, Raphael On 22/01/2023 16:15, Tobias Zagorni wrote: Hi Raphael, I think this is indeed a documentation mistake, it should say 0! For exeactly these reasons you mentioned I determined that it is best to leave the null c

RE: RunEndEncodedArray Null Counts

2023-01-22 Thread Tobias Zagorni
Hi Raphael, I think this is indeed a documentation mistake, it should say 0! For exeactly these reasons you mentioned I determined that it is best to leave the null count field always 0 for RLE arrays. This way it is consistent with union types, at least. RunLengthEncoded data should not contain