I've sent multiple emails to dev-unsubscr...@arrow.apache.org and have not been
removed from this list. Please remove this address.
Sent from ProtonMail mobile
> types to signed prior to writing the Parquet file
>
> - Wes
>
> On Tue, Oct 29, 2019 at 9:09 AM Isaac Myers
> isaacmy...@protonmail.com.invalid wrote:
>
>
> > Fields with unsigned types written with Arrow C++ can't be read by PySpark,
> > due to
Fields with unsigned types written with Arrow C++ can't be read by PySpark, due
to Spark's lack of support unsigned types (per
https://issues.apache.org/jira/browse/SPARK-10113). There is already an issue
to address the same problem when writing tables with unsigned fields using
PyArrow (https:
‐‐‐
On Thursday, October 10, 2019 12:44 PM, Wes McKinney
wrote:
> We haven't implemented storing field-level metadata in Parquet files
> yet. It's somewhat tricky. See
> https://issues.apache.org/jira/browse/ARROW-4359
>
> On Thu, Oct 10, 2019 at 11:51 AM Isaac Myers
I can write both field- and schema-level metadata and read the values back from
schema or relevant field. I write the schema and table described by the schema
to a local parquet file. Upon reading the table or schema from the parquet
file, only schema metadata are present and field metadata are
