Re: [Reposting] How to set md5 checksum

2020-07-24 Thread Steve Loughran
There's a broader issue here which is "S3A support for buckets with Object Lock" I suspect that there will be more to this than just setting an MD5 checksum on file uploads. AFAIK, nobody has done this/is working on the feature; there's so many other issues than nobody is going to do it unless it

[Reposting] How to set md5 checksum

2020-07-17 Thread nikita Balakrishnan
Hey team, I’m developing a system where we are trying to sink to an immutable s3 bucket as part of a flink job. This bucket has server side encryption set to KMS. The DataStream sink works perfectly fine when I don’t use the immutable bucket but when I use an immutable bucket, I get exceptions reg