Re: Support for reading arbitrary nested objects

2020-11-12 Thread Micah Kornfield
Hi Renato, I would suggest reading the Arrow specification [1] which explains how nesting is handled. -Micah [1] https://arrow.apache.org/docs/format/Columnar.html On Thu, Nov 12, 2020 at 6:40 AM Renato Marroquín Mogrovejo < renatoj.marroq...@gmail.com> wrote: > Hi Micah, > > Thanks for the ans

Re: Support for reading arbitrary nested objects

2020-11-12 Thread Renato Marroquín Mogrovejo
Hi Micah, Thanks for the answer! yeah basically that was my question, I was not sure about the full extent of support for nested data, but it seems that both (parquet binding and arrow format) do reading/writing nested objects. Just a couple of follow up questions: - If Arrow/Feather file format

Re: Support for reading arbitrary nested objects

2020-11-11 Thread Micah Kornfield
Hi Renato, I'm not clear if you are asking if the Arrow/Feather file format support this or if Arrow's parquet binding support it. Regardless, both formats as of 2.0.0 now support arbitrarily nested data (there were some bugs discovered after the 2.0.0 release, and I just started a discussion on d