Hi Taher, The StreamingFileSink implements a version of TwoPhaseCommit. Can you elaborate a bit on what do you mean by " TwoPhaseCommit is not being used"?
Cheers, Kostas On Thu, Jan 10, 2019 at 9:29 AM Taher Koitawala <taher.koitaw...@gslab.com> wrote: > Hi All, > As per my understanding and the API of StreamingFileSink, > TwoPhaseCommit is not being used. Can someone please confirm is that's > right? Also if StreamingFileSink does not support > TwoPhaseCommits what is the best way to implement this? > > > Regards, > Taher Koitawala > GS Lab Pune > +91 8407979163 >