Hi,

I am building a pretty straightforward processing pipeline as described
below, using *DataStream* *APIs* and *FileSystem connector, Flink version >
1.19*.

*filesystem-source (CSV) -> transforms -> filesystem-sink (CSV**)*

The documentation for the FileSystem connector shows examples for both File
Source and File  Sink.
There is a CsvReaderFormat format that can be used with the File Source for
CSV parsing. However, there does not seem to be a similar format (like
CsvWriterFormat) for File Sink.
Also, like SimpleStringEncoder, there is no CsvEncoder.

What could be the recommended way to have a CSV FileSink with the
DataStream APIs?
Does flink provide a CSV serializer for FileSink? Otherwise, serialization
can be implemented as a map function before the data reaches the sink.

Regards,
Amogh.

Reply via email to