alamb opened a new issue, #79: URL: https://github.com/apache/parquet-testing/issues/79
- https://github.com/apache/parquet-testing/pull/76 adds example variant binary values [Variant](https://github.com/apache/parquet-format/blob/master/VariantEncoding.md) is a binary format similar to JSON but allows more types in its value fields. At the time of writing, I could not figure out how to create variants with certain types using Apache Spark ```sql -- TODO is not clear how to create the following types using Spark SQL -- TODO TimeNTZ (Type ID 17) -- TODO 'timestamp with timezone' (Type ID 18) -- TODO 'timestamp with time zone' (Type ID 19) -- TODO 'UUID' (Type ID 20) ``` @emkornfield suggested in https://github.com/apache/parquet-testing/pull/76#discussion_r2069205964 > I think these were added after the spark implementation, so we likely need either a PR to spark or maybe Rust can take the lead once it has them done. This ticket tracks adding examples for these 4 primitive types -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
