user@flink.apache.org
Subject: Re: Writing to S3 parquet files in Blink batch mode. Flink 1.10
Hi Dmytro,
Yes, Batch mode must disabled checkpoint, So StreamingFileSink can not be used
in batch mode (StreamingFileSink requires checkpoint whatever formats), we are
refactoring it to more generic, and ca
Hi Dmytro,
Yes, Batch mode must disabled checkpoint, So StreamingFileSink can not be
used in batch mode (StreamingFileSink requires checkpoint whatever
formats), we are refactoring it to more generic, and can be used in batch
mode, but this is a future topic.
Currently, in batch mode, for sink, we
Hi guys,
In our use case we consider to write data to AWS S3 in parquet format using
Blink Batch mode.
As far as I see from one side to write parquet file valid approach is to use
StreamingFileSink with Parquet bulk-encoded format, but
Based to documentation and tests it works only with OnCheckp
