adamreeve commented on issue #15216: URL: https://github.com/apache/datafusion/issues/15216#issuecomment-2826229093
With the KMS API not being included in arrow-rs but being built as a third-party crate (https://github.com/apache/arrow-rs/pull/7387#issuecomment-2819908130), I would assume we probably don't want to depend on that in Datafusion, but keep the encryption integration more flexible to allow other approaches? I think it should still be possible to achieve this while mostly using string-based configuration, but the encryption configuration might need to be an opaque string or an arbitrary JSON object. We could support configuring encryption keys directly by default without needing programmatic access, but allow registering factory methods that could take the configuration string and produce file decryption or encryption properties. I believe you've suggested something like this previously @corwinjoy. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
