Caizhi Weng created FLINK-29805:
-----------------------------------
Summary: Table Store sink continuously fails with "Trying to add
file which is already added" when snapshot committing is slow
Key: FLINK-29805
URL: https://issues.apache.org/jira/browse/FLINK-29805
Project: Flink
Issue Type: Bug
Components: Table Store
Affects Versions: table-store-0.3.0, table-store-0.2.2
Reporter: Caizhi Weng
Assignee: Caizhi Weng
Fix For: table-store-0.3.0, table-store-0.2.2
Table Store sink continuously fails with "Trying to add file which is already
added" when snapshot committing is slow.
This is due to a bug in {{FileStoreCommitImpl#filterCommitted}}. When this
method finds an identifier, it removes the identifier from a map. However
different snapshots may have the same identifier (for example an APPEND commit
and the following COMPACT commit will have the same identifier), so we need to
use another set to check for identifiers.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
