FileSystem connector CSV format output

2024-09-16 Thread amogh joshi
Hi, I am building a pretty straightforward processing pipeline as described below, using *DataStream* *APIs* and *FileSystem connector, Flink version > 1.19*. *filesystem-source (CSV) -> transforms -> filesystem-sink (CSV**)* The documentation for the FileSystem connector shows examples for both

Re: Flink filesystem connector with regex support

2024-08-20 Thread amogh joshi
t;.csv"))) > .build(); > ``` > > Best, > Feng > > > > On Sat, Aug 17, 2024 at 4:41 AM amogh joshi wrote: > >> Hi Users, >> >> Any clues on configurable regex path for FilesSource/Filesystem connector >> for stream APIs is appreciate

Re: Flink filesystem connector with regex support

2024-08-16 Thread amogh joshi
Hi Users, Any clues on configurable regex path for FilesSource/Filesystem connector for stream APIs is appreciated. Regards, Amogh. On Thu, 15 Aug, 2024, 11:18 amogh joshi, wrote: > Hi, > > I am building a pretty straightforward processing pipeline as described > below, using

Flink filesystem connector with regex support

2024-08-14 Thread amogh joshi
Hi, I am building a pretty straightforward processing pipeline as described below, using *DataStream* *APIs* and *FileSystem connector*. *filesystem-source -> transforms -> database-sink* Everything worked well till the filesystem (source) had just a single type (JSON) of files. Recently the fil