Re: [PyArrow] Arrow StructArray buffer allocation

2022-03-04 Thread Hanqi Wu
> On Mar 4, 2022, at 9:08 AM, Antoine Pitrou wrote: > > > I opened https://issues.apache.org/jira/browse/ARROW-15846 > Regards > > Antoine. > > > Le 04/03/2022 à 15:05, Antoine Pitrou a écrit : >> Le 04/03/2022 à 15:01, Hanqi Wu a écrit : >>>

Re: [PyArrow] Arrow StructArray buffer allocation

2022-03-04 Thread Hanqi Wu
must still have an allocated validity bitmap, if it has one or more null values.” https://arrow.apache.org/docs/format/Columnar.html#struct-layout Thanks, Hanqi On Mar 4, 2022, at 8:57 AM, Antoine Pitrou mailto:anto...@python.org>> wrote: Hi Hanqi, Le 04/03/2022 à 14:53, Hanqi Wu a écrit :

Re: [PyArrow] Arrow StructArray buffer allocation

2022-03-04 Thread Hanqi Wu
> On Mar 4, 2022, at 8:47 AM, Antoine Pitrou wrote: > > > Le 04/03/2022 à 04:17, Hanqi Wu a écrit : >> Hello community, >> As per the below documentation, for an Arrow StructArray, it won’t have any >> physical buffers backing it if it doesn’t contain any null valu

[PyArrow] Arrow StructArray buffer allocation

2022-03-04 Thread Hanqi Wu
Hello community, As per the below documentation, for an Arrow StructArray, it won’t have any physical buffers backing it if it doesn’t contain any null value: https://arrow.apache.org/docs/format/Columnar.html#struct-layout However, in PyArrow, it complains if you try to import from C an ArrowAr

[PyArrow] Arrow StructArray buffer allocation

2022-03-04 Thread Hanqi Wu
Hello community, As per the below documentation, for an Arrow StructArray, it won’t have any physical buffers backing it if it doesn’t contain any null value: https://arrow.apache.org/docs/format/Columnar.html#struct-layout However, in PyArrow, it complains if you try to import from C an ArrowAr