Re: StreamingFilSink with FlinkRunner

2025-01-20 Thread Taher Koitawala
Folks any idea on this? On Wed, 15 Jan 2025 at 7:08 AM, Taher Koitawala wrote: > Adding Flink community here just incase anyone has more info on this. > > On Tue, 14 Jan 2025 at 1:00 PM, Taher Koitawala > wrote: > >> Hi All, >> Been moving from Flink development to Beam development i

Re: StreamingFilSink with FlinkRunner

2025-01-14 Thread Taher Koitawala
Adding Flink community here just incase anyone has more info on this. On Tue, 14 Jan 2025 at 1:00 PM, Taher Koitawala wrote: > Hi All, > Been moving from Flink development to Beam development i want am > using FileIO parquet Io. > > Folks in Flink we could use streaming flink sink with

StreamingFilSink with FlinkRunner

2025-01-14 Thread Taher Koitawala
Hi All, Been moving from Flink development to Beam development i want am using FileIO parquet Io. Folks in Flink we could use streaming flink sink with checkpointing and be rest assured that no duplicate data would fall to the sink because flink’s streaming file sink would make sure of t