Re: [VOTE] Release PyIceberg 0.4.0 RC1

+1 (non binding) Regards JB On Mon, Jun 26, 2023 at 11:27 AM Fokko Driesprong wrote: > > Hi Everyone, > > > Excited to start the 0.4.0 PyIceberg release process. The 0.4.0 release is > packed with cool features: > > Support for converting Parquet schemas into Iceberg ones > Support for reading

Re: allowing configs to be specified in SQLConf for Spark reads/writes

+1 for adding OPTIONS hints. If we can do that in SQL extensions then that makes sense to me for the existing Spark versions that don't support it. On Mon, Jun 26, 2023 at 11:18 AM Szehon Ho wrote: > Hi, > > Yea that sounds good to me. > > Btw, that being said, I'm not opposed to configuring som

Re: allowing configs to be specified in SQLConf for Spark reads/writes

Hi, Yea that sounds good to me. Btw, that being said, I'm not opposed to configuring some of options in the thread, especially write options, as sql conf either. (Not sure this mechanism can support write conf without some changes to parser). And in any case, it could be cascading: sql_dynamic_

Re: [VOTE] Release PyIceberg 0.4.0 RC1

+1 * Ran license validation with RAT * Verified signature and checksum * Built and tested with `make install` and `make test` * Installed the RC and exercised the CLI with a REST catalog On Mon, Jun 26, 2023 at 2:27 AM Fokko Driesprong wrote: > Hi Everyone, > > > Excited to start the 0.4.0 PyIc

[VOTE] Release PyIceberg 0.4.0 RC1

Hi Everyone, Excited to start the 0.4.0 PyIceberg release process. The 0.4.0 release is packed with cool features: - Support for converting Parquet schemas into Iceberg ones - Support for reading data using FSSpec