Re: [go-nuts] Pass SQL null values to Parquet

2023-01-23 Thread Brian Candler
If you're using a third-party parquet encoding library, you'll need to pass null/not-null using whatever convention that library requires. I took a quick look at xitongsys/parquet-go's front-page documentation, and it seems it handles null (OPTIONAL) using pointers: https://github.com/xitongsys/

Re: [go-nuts] Pass SQL null values to Parquet

2023-01-22 Thread Nick White
On Sun, Jan 22, 2023 at 08:56:12PM +, Rory Campbell-Lange wrote: > I have implemented a fairly efficient line-wise dump file reader which > includes a rudimentary table typer. However I'm not sure how to represent > nulls in my go code so that I can pass these onto parquet encoders. > > Is a

[go-nuts] Pass SQL null values to Parquet

2023-01-22 Thread Rory Campbell-Lange
I'm writing a PostgreSQL dump file to parquet converter as a hobby project. PostgreSQL dump files are simply plain-text files containing, as the man page puts it "the SQL commands required to reconstruct the database to the state it was in at the time it was saved." Null SQL values are represent