Hello, With regards to my earlier email and JIRA request : https://issues.apache.org/jira/browse/FLINK-27333 <https://issues.apache.org/jira/browse/FLINK-27333> ,
I have opened a PR for the same: https://github.com/apache/flink/pull/19540 <https://github.com/apache/flink/pull/19540> Thanks, Chinmay > On Apr 20, 2022, at 1:36 PM, Chinmay Sumant <csum...@apple.com> wrote: > > Hello, > > We have a security requirement to client side encrypt flink state for certain > flink applications that process sensitive data. Currently, there is no > feature that supports this out of the box on AWS S3 backend. > > One way to do it is to use flink-s3-fs-hadoop compiled against hadoop 3.3.2 > for checkpoints as hadoop 3.3.2 provides out of the box AWS client side > encryption using AWS KMS. > > I have filed a JIRA requesting the shaded Hadoop version upgrade in > flink-filesystems module: https://issues.apache.org/jira/browse/FLINK-27333 > <https://issues.apache.org/jira/browse/FLINK-27333> > > We were able to experiment with an internal build on our flink jobs and saw > no issues in checkpoints in flink 1.14.3 after the Hadoop version change. > Wanted to check with the community if there are any concerns in moving ahead > with this version upgrade. If there are no concerns, the JIRA can be assigned > to me to try to take the changes to the main flink repo. > > Thanks, > Chinmay
