Re: Part files generated in reactive mode

2023-07-04 Thread Hang Ruan
Hi, Wang Mengxi, You should use the file compaction feature[1] to compact the small files. Best, Hang [1] https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/connectors/datastream/filesystem/#compaction Wang, Mengxi X via user 于2023年7月4日周二 22:44写道: > Hi, > > > > We want to process

Part files generated in reactive mode

2023-07-04 Thread Wang, Mengxi X via user
Hi, We want to process one 2GB file and the output should also be a single 2GB file, but after we enabled reactive mode it generated several hundred small output files instead of one 2GB file. Can anybody help please? Best wishes, Mengxi Wang This message is confidential and subject to terms