Hello, I am writing a custom S3 object encoder (code here: https://pastebin.com/raw/9Ag4ZVpX) used via:
StreamingFileSink<KafkaRecord> dataSink = StreamingFileSink
.forRowFormat(new Path("s3a://some_path"), new RecordDataSerializer())
During execution, it does not produce any data in S3. This pipeline works
if the data is not compressed beforehand, and no exceptions are thrown in
Flink logs or in the webUI. I am confused what is happening and would
appreciate any help.
