What's the purpose of uniqueId in FileWriterBucket

2021-10-07 Thread wu shaoj
Hi, folks, >From 1.14, file sink add a uid to a committed file, so would you mind to tell >me what’s the purpose of this field? Can it be removed safely? https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/connectors/datastream/file_sink/#part-file-configuration

Re: What's the purpose of uniqueId in FileWriterBucket

2021-10-08 Thread wu shaoj
If flink job recover from previous checkpoint/savepoint, will it re-output records to a different file with same partFileIndex? And can we upgrade flink to 1.4 smoothly? From: Yun Gao Date: Friday, October 8, 2021 at 22:43 To: wu shaoj , dev@flink.apache.org Subject: Re: What's the pu