JingsongLi commented on pull request #12283: URL: https://github.com/apache/flink/pull/12283#issuecomment-632971290
> @JingsongLi Thank you for working on this. I have one additional question that is not addressed in the docs. What happens when a record is supposed to be written into a partition that has already been committed. Is it dropped? written into its own file? What happens? Late data processing can be "drop late date" or "continue appending". For now, just "continue appending". So the policy of partition commit needs to be idempotent. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
