Re: [External] Flink StreamingFileSink not ingesting to S3 when checkpointing is disabled

2019-05-27 Thread Timothy Victor
You must have checkpointing enabled to use the StreamingFileSink. The feature relies on CP for achieving exactly once semantics. >> This is integrated with the checkpointing mechanism to provide exactly once semantics. https://ci.apache.org/projects/flink/flink-docs-master/api/java/org/apache/f

[External] Flink StreamingFileSink not ingesting to S3 when checkpointing is disabled

2019-05-27 Thread Vishal Sharma
Hello everyone, I want to use aws s3 as sink for a data stream in flink. I am using StreamingFileSink class to create a sink. I don't need checkpointing for my job, but when I disable checkpointing, data is no longer written to S3. case 1 : checkpointing enabled When checkpointing is enabled, th