[
https://issues.apache.org/jira/browse/FLINK-25485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ada Wong updated FLINK-25485:
-----------------------------
Description:
When we directly use buffer-flush options of the mysql sink, buffer-flush
options(sink.buffer-flush.max-rows, sink.buffer-flush.interval) can not
increase throughput.
We must set 'rewriteBatchedStatements=true' into mysql jdbc url, for
'sink.buffer-flush' to take effect.
I want add a method appendUrlSuffix in MySQLDialect to auto set this jdbc
option.
Many users forget or don't know this option.
Inspired by alibaba DataX.
[https://github.com/alibaba/DataX/blob/master/plugin-rdbms-util/src/main/java/com/alibaba/datax/plugin/rdbms/util/DataBaseType.java]
was:
When we directly use mysql sink, buffer-flush
options(sink.buffer-flush.max-rows, sink.buffer-flush.interval) can not
increase throughput.
We must set 'rewriteBatchedStatements=true' into mysql jdbc url, for
'sink.buffer-flush' to take effect.
I want add a method appendUrlSuffix in MySQLDialect to auto set this jdbc
option.
Many users forget or don't know this option.
Inspired by alibaba DataX.
[https://github.com/alibaba/DataX/blob/master/plugin-rdbms-util/src/main/java/com/alibaba/datax/plugin/rdbms/util/DataBaseType.java]
> JDBC connector implicitly append url options when use mysql
> -----------------------------------------------------------
>
> Key: FLINK-25485
> URL: https://issues.apache.org/jira/browse/FLINK-25485
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / JDBC
> Affects Versions: 1.14.2
> Reporter: Ada Wong
> Priority: Major
>
> When we directly use buffer-flush options of the mysql sink, buffer-flush
> options(sink.buffer-flush.max-rows, sink.buffer-flush.interval) can not
> increase throughput.
> We must set 'rewriteBatchedStatements=true' into mysql jdbc url, for
> 'sink.buffer-flush' to take effect.
> I want add a method appendUrlSuffix in MySQLDialect to auto set this jdbc
> option.
> Many users forget or don't know this option.
> Inspired by alibaba DataX.
> [https://github.com/alibaba/DataX/blob/master/plugin-rdbms-util/src/main/java/com/alibaba/datax/plugin/rdbms/util/DataBaseType.java]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
