V Luong created ARROW-6719:
------------------------------

             Summary: Parquet read_table error in Python3.7: 
pyarrow.lib.ArrowInvalid: Column data for field with type list<...> is 
inconsistent with schema list<...>
                 Key: ARROW-6719
                 URL: https://issues.apache.org/jira/browse/ARROW-6719
             Project: Apache Arrow
          Issue Type: Bug
    Affects Versions: 0.14.1
         Environment: Python 3.7
            Reporter: V Luong


I have Parquet files with certain complex columns of type List<item: double>, 
List<item: string>, etc. and am using latest PyArrow (0.14.1) to process them.

In Python 2.7, pyarrow.parquet.read_table(...) processes these files correctly, 
without any problem.

But in Python 3.7, the same pyarrow.parquet.read_table(...) function calls 
return errors of the following kind:

"pyarrow.lib.ArrowInvalid: Column data for field 0 with type list<item: double> 
is inconsistent with schema list<element: double>"



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to