rok opened a new issue, #16737: URL: https://github.com/apache/datafusion/issues/16737
### Is your feature request related to a problem or challenge? #16351 added modular encryption reading and writing. We should enable multi threaded encrypted writing. ### Describe the solution you'd like `output_single_parquet_file_parallelized` in `ParquetSink` should use encryption properties passed with `WriterProperties`. ### Describe alternatives you've considered Current `arrow-rs` API does not provide public API for passing `FileEncryptor` (for security reasons) so no good alternatives were identified. ### Additional context This will require an upstream change in `arrow-rs` that is currently in draft https://github.com/apache/arrow-rs/pull/7818. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
