Hi,
As per my understanding, Encoder's encode method is called for each and
every message and hence it is not logical to create compressor around given
output stream which will lead into unpredictable erroneous situation.
Encode responsibility is to encode the given object, not to compress. It
see
Hello,
I am writing a custom S3 object encoder (code here:
https://pastebin.com/raw/9Ag4ZVpX) used via:
StreamingFileSink dataSink = StreamingFileSink
.forRowFormat(new Path("s3a://some_path"), new RecordDataSerializer())
During execution, it does not produce any data in S3. This pipeline
