Re: [QUESTION][Parquet][Encryption] Checksum Flow for Parquet Modular Encryption

2025-02-27 Thread Felipe Oliveira Carvalho
Further reading: https://en.wikipedia.org/wiki/Authenticated_encryption AES-GCM is a form of Authenticated Encryption. On Thu, Feb 27, 2025 at 3:33 AM Antoine Pitrou wrote: > > Hello, > > Parquet encryption ensures integrity if you use the default encryption > algorithm AES_GCM (not AES_CTR). Y

Re: [QUESTION][Parquet][Encryption] Checksum Flow for Parquet Modular Encryption

2025-02-27 Thread Rok Mihevc
Yet another good resource would be parquet encryption docs [1]. Search for "integrity" to see how AES-GCM is used to ensure it. [1] https://parquet.apache.org/docs/file-format/data-pages/encryption/ Rok On Thu, Feb 27, 2025 at 8:22 PM Felipe Oliveira Carvalho < felipe...@gmail.com> wrote: > Fur

Re: [QUESTION][Parquet][Encryption] Checksum Flow for Parquet Modular Encryption

2025-02-27 Thread Antoine Pitrou
Hello, Parquet encryption ensures integrity if you use the default encryption algorithm AES_GCM (not AES_CTR). You don't have to checksum the file yourself. Regards Antoine. On Tue, 25 Feb 2025 16:19:59 +0700 Jason Sebastian Kusuma wrote: > Hi everyone, > I want to ask the proper practice f