I only quickly skimmed the Hadoop docs and found this (although it is
not documented very well I might add). If this does not do the trick,
I'd suggest to reach out to the Hadoop project, since we're using their
S3 filesystem.
On 16/07/2020 19:32, nikita Balakrishnan wrote:
Hey Chesnay,
Than
Hey Chesnay,
Thank you for getting back with that! I tried setting that too, it still
gives me the same exception. Is there something else that I'm missing?
I also have fs.s3a.bucket..server-side-encryption-algorithm=SSE-KMS
and fs.s3a.bucket..server-side-encryption.key set.
Is there no need to s
Please try configuring :
fs.s3a.etag.checksum.enabled: true
On 16/07/2020 03:11, nikita Balakrishnan wrote:
Hello team,
I’m developing a system where we are trying to sink to an immutable s3
bucket. This bucket has server side encryption set as KMS. The DataStream
sink works perfectly fine wh
Hello team,
I’m developing a system where we are trying to sink to an immutable s3
bucket. This bucket has server side encryption set as KMS. The DataStream
sink works perfectly fine when I don’t use the immutable bucket but when I
use an immutable bucket, I get exceptions regarding multipart uplo
