Hi all, I am wondering what's the best way to get pyarrow schema from a pandas DataFrame?
So far I have:
"
pdf = pd.DataFrame({'a': [1, 2, 3], 'b': [4.0, 5.0, 6.0], 'c': ["hello",
"world", "arrow"], 'd': [[1.0, 2.0], [3.0], [4.0, 5.0]]})
arrow_schema = pa.Table.from_pandas(pdf, preserve_index=False).schema
"
Type inference works pretty well here. I am wondering if this is the
correct way of doing this and if this approach works well with large
DataFrames?
