yuxiqian opened a new pull request, #4007: URL: https://github.com/apache/flink-cdc/pull/4007
This closes FLINK-37741. PR #3986 refactored transform operator by cleaning up code and simplifying logic. However, `Schema#getColumnDataTypes` are repeatedly invoked for every `DataChangeEvent`, which isn't cached and severely degrades the performance. <img width="1465" src="https://github.com/user-attachments/assets/f5be2d3b-1b15-472a-8439-6f24d76f70ef"; /> Tested locally with 10000000 records grabbed from MySQL, 40% ~ 60% throughput degradation could be noticed. Applied this patch appears to resolve this issue. <img width="434" alt="image" src="https://github.com/user-attachments/assets/8a286e57-594b-4e2d-895a-06c539f342af"; /> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
