I have created a process *outside* of flink for this. would be nice to use
Flink though.
It is important to us that the we only checkpoint after the records are
successfully saved in S3.
This is to insure all records are saved during node failure.
The process I wrote adds records to a file on dis
Not an expert, but I would think this will not be trivial since the reason
for using checkpointing to trigger is to guarantee exactly once semantics
in the event of a failure which in turn is tightly integrated into the CP
mechanism. The precursor the StreamingFileSink was BucketingFileSink which
