This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git
The following commit(s) were added to refs/heads/master by this push:
new ea4ad1a [doc] Add sync job fe configuration item description (#8349)
ea4ad1a is described below
commit ea4ad1a99c9af7c0ccc89ccb29e84d2548c018ab
Author: jiafeng.zhang <zhang...@gmail.com>
AuthorDate: Sun Mar 6 13:49:59 2022 +0800
[doc] Add sync job fe configuration item description (#8349)
---
docs/en/administrator-guide/config/fe_config.md | 50 +++++++++++++++++++++
docs/zh-CN/administrator-guide/config/fe_config.md | 52 +++++++++++++++++++++-
2 files changed, 101 insertions(+), 1 deletion(-)
diff --git a/docs/en/administrator-guide/config/fe_config.md
b/docs/en/administrator-guide/config/fe_config.md
index c6a7cd8..bf30f92 100644
--- a/docs/en/administrator-guide/config/fe_config.md
+++ b/docs/en/administrator-guide/config/fe_config.md
@@ -2154,3 +2154,53 @@ Dynamically configured: true
Only for Master FE: false
If set to true, the compaction slower replica will be skipped when select get
queryable replicas
+
+### enable_create_sync_job
+
+Enable Mysql data synchronization job function. The default is false, this
function is turned off
+
+Default: false
+
+Is it possible to configure dynamically: true
+
+Whether it is a configuration item unique to the Master FE node: true
+
+### sync_commit_interval_second
+
+The maximum time interval for committing transactions. If there is still data
in the channel that has not been submitted after this time, the consumer will
notify the channel to submit the transaction.
+
+Default: 10 (seconds)
+
+Is it possible to configure dynamically: true
+
+Whether it is a configuration item unique to the Master FE node: true
+
+### min_sync_commit_size
+
+The minimum number of events that must be satisfied to commit a transaction.
If the number of events received by Fe is less than it, it will continue to
wait for the next batch of data until the time exceeds
`sync_commit_interval_second`. The default value is 10000 events. If you want
to modify this configuration, please make sure that this value is smaller than
the `canal.instance.memory.buffer.size` configuration on the canal side
(default 16384), otherwise Fe will try to get the queue [...]
+
+Default: 10000
+
+Is it possible to configure dynamically: true
+
+Whether it is a configuration item unique to the Master FE node: true
+
+### min_bytes_sync_commit
+
+The minimum data size required to commit a transaction. If the data size
received by Fe is smaller than it, it will continue to wait for the next batch
of data until the time exceeds `sync_commit_interval_second`. The default value
is 15MB, if you want to modify this configuration, please make sure this value
is less than the product of `canal.instance.memory.buffer.size` and
`canal.instance.memory.buffer.memunit` on the canal side (default 16MB),
otherwise Before the ack, Fe will try to [...]
+
+Default: 15*1024*1024 (15M)
+
+Is it possible to configure dynamically: true
+
+Whether it is a configuration item unique to the Master FE node: true
+
+### max_bytes_sync_commit
+
+ The maximum number of threads in the data synchronization job thread pool.
There is only one thread pool in the entire FE, which is used to process all
data synchronization tasks in the FE that send data to the BE. The
implementation of the thread pool is in the `SyncTaskPool` class.
+
+Default: 10
+
+Is it possible to dynamically configure: false
+
+Is it a configuration item unique to the Master FE node: false
diff --git a/docs/zh-CN/administrator-guide/config/fe_config.md
b/docs/zh-CN/administrator-guide/config/fe_config.md
index 1035907..6b9b123 100644
--- a/docs/zh-CN/administrator-guide/config/fe_config.md
+++ b/docs/zh-CN/administrator-guide/config/fe_config.md
@@ -2175,4 +2175,54 @@ load 标签清理器将每隔 `label_clean_interval_second` 运行一次以清
是否为 Master FE 节点独有的配置项：false
-如果设置为true，则在选择可查询副本时，将跳过 compaction 较慢的副本
\ No newline at end of file
+如果设置为true，则在选择可查询副本时，将跳过 compaction 较慢的副本
+
+### enable_create_sync_job
+
+开启 MySQL 数据同步作业功能。默认是 false，关闭此功能
+
+默认值：false
+
+是否可以动态配置：true
+
+是否为 Master FE 节点独有的配置项：true
+
+### sync_commit_interval_second
+
+提交事务的最大时间间隔。若超过了这个时间 channel 中还有数据没有提交，consumer 会通知 channel 提交事务。
+
+默认值：10（秒）
+
+是否可以动态配置：true
+
+是否为 Master FE 节点独有的配置项：true
+
+### min_sync_commit_size
+
+提交事务需满足的最小 event 数量。若 Fe 接收到的 event 数量小于它，会继续等待下一批数据直到时间超过了
`sync_commit_interval_second ` 为止。默认值是 10000 个 events，如果你想修改此配置，请确保此值小于 canal
端的 `canal.instance.memory.buffer.size` 配置（默认16384），否则在 ack 前Fe会尝试获取比 store
队列长度更多的 event，导致 store 队列阻塞至超时为止。
+
+默认值：10000
+
+是否可以动态配置：true
+
+是否为 Master FE 节点独有的配置项：true
+
+### min_bytes_sync_commit
+
+提交事务需满足的最小数据大小。若 Fe 接收到的数据大小小于它，会继续等待下一批数据直到时间超过了
`sync_commit_interval_second` 为止。默认值是 15 MB，如果你想修改此配置，请确保此值小于 canal 端的
`canal.instance.memory.buffer.size` 和 `canal.instance.memory.buffer.memunit`
的乘积（默认 16 MB），否则在 ack 前 Fe 会尝试获取比 store 空间更大的数据，导致 store 队列阻塞至超时为止。
+
+默认值：15 * 1024 * 1024（15M）
+
+是否可以动态配置：true
+
+是否为 Master FE 节点独有的配置项：true
+
+### max_bytes_sync_commit
+
+ 数据同步作业线程池中的最大线程数量。此线程池整个FE中只有一个，用于处理FE中所有数据同步作业向BE发送数据的任务 task，线程池的实现在
`SyncTaskPool` 类。
+
+默认值：10
+
+是否可以动态配置：false
+
+是否为 Master FE 节点独有的配置项：false
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
