Lee SeungMin created FLINK-35740: ------------------------------------ Summary: [mysql] Allow column as chunk key even if not in Primary Keys Key: FLINK-35740 URL: https://issues.apache.org/jira/browse/FLINK-35740 Project: Flink Issue Type: Improvement Components: Flink CDC Reporter: Lee SeungMin
Change the input chunk key to allow it even if it is not in the primary keys. There are cases where the primary key is not a numeric type, such as varchar or varbinary. In this case, the `distributed factor` and `chunk range` may be calculated incorrectly, resulting in one chunk containing many records. This may cause out of memory in the task manager. Actually, in our company, there was a mysql tables that PK is a varbinary column and the above situation occurred. -- This message was sent by Atlassian Jira (v8.20.10#820010)