Re: Exactly once semantics for hdfs sink

2020-02-12 Thread Khachatryan Roman
Hi Vishwas, Please let me know if you have any specific questions about the StreamingFile sink. Regards, Roman On Wed, Feb 12, 2020 at 4:45 AM Zhijiang wrote: > Hi Vishwas, > > I guess this link [1] can help understand how it works and how to use in > practice for StreamingFileSink. > > [1] >

Re: Exactly once semantics for hdfs sink

2020-02-11 Thread Zhijiang
Hi Vishwas, I guess this link [1] can help understand how it works and how to use in practice for StreamingFileSink. [1] https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/connectors/streamfile_sink.html Best, Zhijiang ---

Re: Exactly once semantics for hdfs sink

2020-02-11 Thread Vishwas Siravara
Hi Khachatryan, Thanks for your reply. Can you help me understand how it works with hdfs specifically , even a link to a document will help. Best, Vishwas On Mon, Feb 10, 2020 at 10:32 AM Khachatryan Roman < khachatryan.ro...@gmail.com> wrote: > Hi Vishwas, > > Yes, Streaming File Sink does sup

Re: Exactly once semantics for hdfs sink

2020-02-10 Thread Khachatryan Roman
Hi Vishwas, Yes, Streaming File Sink does support exactly-once semantics and can be used with HDFS. Regards, Roman On Mon, Feb 10, 2020 at 5:20 PM Vishwas Siravara wrote: > Hi all, > I want to use the StreamingFile sink for writing data to hdfs. Can I > achieve exactly once semantics with thi