V Luong created ARROW-6719: ------------------------------ Summary: Parquet read_table error in Python3.7: pyarrow.lib.ArrowInvalid: Column data for field with type list<...> is inconsistent with schema list<...> Key: ARROW-6719 URL: https://issues.apache.org/jira/browse/ARROW-6719 Project: Apache Arrow Issue Type: Bug Affects Versions: 0.14.1 Environment: Python 3.7 Reporter: V Luong
I have Parquet files with certain complex columns of type List<item: double>, List<item: string>, etc. and am using latest PyArrow (0.14.1) to process them. In Python 2.7, pyarrow.parquet.read_table(...) processes these files correctly, without any problem. But in Python 3.7, the same pyarrow.parquet.read_table(...) function calls return errors of the following kind: "pyarrow.lib.ArrowInvalid: Column data for field 0 with type list<item: double> is inconsistent with schema list<element: double>" -- This message was sent by Atlassian Jira (v8.3.4#803005)