Re: Why does Flink FileSystem sink splits into multiple files

2021-03-15 Thread Yik San Chan
to its own file. > > The commas were changed to tabs because you specified > .field_delimiter('\t'). > > > Regards, > > David > > On Mon, Mar 15, 2021 at 9:49 AM Yik San Chan > wrote: > >> The question is cross-posted on StackOverflow >> https

Re: Why does Flink FileSystem sink splits into multiple files

2021-03-15 Thread David Anderson
5, 2021 at 9:49 AM Yik San Chan wrote: > The question is cross-posted on StackOverflow > https://stackoverflow.com/questions/66634813/why-does-flink-filesystem-sink-splits-into-multiple-files > . > > I want to use Flink to read from an input file, do some aggregation, and > write

Why does Flink FileSystem sink splits into multiple files

2021-03-15 Thread Yik San Chan
The question is cross-posted on StackOverflow https://stackoverflow.com/questions/66634813/why-does-flink-filesystem-sink-splits-into-multiple-files . I want to use Flink to read from an input file, do some aggregation, and write the result to an output file. The job is in batch mode. See