Re: PyArrow <-> Pandas Timestamp Conversion Error

2024-10-24 Thread Lee, David (ITE)
There isn’t really a need to read parquet into arrow tables. You can just use pyarrow to read row groups from the smaller files and write them to a new file using pyarrow.parquet.ParquetFile From: Karthik Deivasigamani via user Sent: Wednesday, October 9, 2024 6:

Re: PyArrow <-> Pandas Timestamp Conversion Error

2024-10-24 Thread Lee, David (ITE)
Pandas by default treats timestamps as python objects. to_pandas() has this option below. date_as_objectbool, default True Cast dates to objects. If False, convert to dat