Hi, Wang Mengxi,
You should use the file compaction feature[1] to compact the small files.
Best,
Hang
[1]
https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/connectors/datastream/filesystem/#compaction
Wang, Mengxi X via user 于2023年7月4日周二 22:44写道:
> Hi,
>
>
>
> We want to process
Hi,
We want to process one 2GB file and the output should also be a single 2GB
file, but after we enabled reactive mode it generated several hundred small
output files instead of one 2GB file. Can anybody help please?
Best wishes,
Mengxi Wang
This message is confidential and subject to terms