Re: [QUESTION][C++] Understanding a StructType

2025-02-25 Thread Arthur Andres
Hi Artem, I can't speak with authority on the subject, but I've been using "empty struct". By empty I mean they don't have any child type. When you create an array, there would still be one underlying "mask" array to represent the presence of an element ({} vs null). import pyarrow as pa assert

[QUESTION][Parquet][Encryption] Checksum Flow for Parquet Modular Encryption

2025-02-25 Thread Jason Sebastian Kusuma
Hi everyone, I want to ask the proper practice for doing checksums on parquet with modular encryption using pyarrow. My current process is: 1. Create a parquet file (not yet encrypred) and generate checksum. 2. Create the encrypted version of the file using the ParquetWriter with encryption propert