Re: COPY TO STDOUT Apache Arrow support

2023-05-02 Thread Adam Lippai
Hi, There is also a new Arrow C library (one .h and one .c file) which makes it easier to use it from the postgresql codebase. https://arrow.apache.org/blog/2023/03/07/nanoarrow-0.1.0-release/ https://github.com/apache/arrow-nanoarrow/tree/main/dist Best regards, Adam Lippai On Thu, Apr 13

Re: COPY TO STDOUT Apache Arrow support

2023-04-13 Thread Adam Lippai
Hi, There are two bigger developments in this topic: 1. Pandas 2.0 is released and it can use Apache Arrow as a backend 2. Apache Arrow ADBC is released which standardizes the client API. Currently it uses the postgresql wire protocol underneath Best regards, Adam Lippai On Thu, Apr

COPY TO STDOUT Apache Arrow support

2022-04-21 Thread Adam Lippai
serialization overhead when using the postgresql wire format can be significant. Best regards, Adam Lippai