Hi Micah,

Thanks for clearing this up for me!

Best,
Sarah
________________________________
From: Micah Kornfield <emkornfi...@gmail.com>
Sent: Monday, October 25, 2021 12:06 PM
To: dev <dev@arrow.apache.org>
Subject: Re: [Parquet, C++] Writing Compliant Nested Types to Parquet

Hi Sarah,
For new consumers of the library setting it to true probably makes sense.
For Arrow itself, it is a breaking change (it breaks field naming and exact
round tripping) which is why we haven't flipped it yet.

More discussion is happening on
https://issues.apache.org/jira/browse/ARROW-14196<https://issues.apache.org/jira/browse/ARROW-14196>

Cheers,
Micah

On Mon, Oct 25, 2021 at 7:49 AM Sarah Gilmore <sgilm...@mathworks.com>
wrote:

> Hi all,
>
> I have a question about writing nested datatypes to Parquet files. I
> noticed that the use_compliant_nested_types option is set to false by
> default. I was wondering if there was a particular reason this is set to
> false by default. I noticed a comment in parquet/properties.h<
> https://github.com/apache/arrow/blob/be665ef948cb2c6706c60053c5db918e948713e8/cpp/src/parquet/properties.h#L650<https://github.com/apache/arrow/blob/be665ef948cb2c6706c60053c5db918e948713e8/cpp/src/parquet/properties.h#L650>>
> suggesting the default should be flipped to true at some point. Is there a
> reason why you wouldn't want to set this option to true?
>
> Thanks,
> Sarah
>

Reply via email to