The Arrow format does not indicate any particular value "underneath" a null so I'm not sure what can be "fixed" here. What precisely are you doing with the data that is failing?
On Fri, Feb 28, 2020 at 4:57 PM Pierre Belzile <pierre.belz...@gmail.com> wrote: > > When I recover an array of type dictionary int32 -> string from a parquet > file and that array has null positions, it seems that the indices that > correspond to null positions are undefined. I.e. not guaranteed to be 0. > This causes a crash when using a transpose map when trying to read the > transpose value. Does this seem possible? Fixed in 0.16.0? > > If not I can create a JIRA but it is difficult to create a code snippet to > reproduce because it depends on uninitialized memory. > > Pierre
