This is an automated email from the ASF dual-hosted git repository.
w41ter pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push:
new 33f260acaa Add config max_backup_tablets_per_job (#1056)
33f260acaa is described below
commit 33f260acaa5e9d64bebaa3555e77b4919b110ecd
Author: walter <w41te...@gmail.com>
AuthorDate: Wed Sep 4 16:16:11 2024 +0800
Add config max_backup_tablets_per_job (#1056)
---
docs/admin-manual/config/fe-config.md | 12 +++++++++++-
.../current/admin-manual/config/fe-config.md | 10 ++++++++++
.../version-2.0/admin-manual/config/fe-config.md | 14 ++++++++++++++
.../version-2.1/admin-manual/config/fe-config.md | 14 ++++++++++++++
.../version-3.0/admin-manual/config/fe-config.md | 10 ++++++++++
.../version-2.0/admin-manual/config/fe-config.md | 14 ++++++++++++++
.../version-2.1/admin-manual/config/fe-config.md | 14 ++++++++++++++
.../version-3.0/admin-manual/config/fe-config.md | 12 +++++++++++-
8 files changed, 98 insertions(+), 2 deletions(-)
diff --git a/docs/admin-manual/config/fe-config.md
b/docs/admin-manual/config/fe-config.md
index ed546d125e..e2c93896af 100644
--- a/docs/admin-manual/config/fe-config.md
+++ b/docs/admin-manual/config/fe-config.md
@@ -2584,6 +2584,16 @@ Default: 10
This configuration is mainly used to control the number of backup/restore
tasks recorded in each database.
+#### `max_backup_tablets_per_job`
+
+Default: 300000
+
+IsMutable：true
+
+MasterOnly：true
+
+Control the max num of tablets per backup job involved, to avoid FE OOM caused
by saving too much metadata.
+
#### `enable_quantile_state_type`
Default：false
@@ -2747,4 +2757,4 @@ To ensure compatibility with the MySQL ecosystem, Doris
includes a built-in data
Default value: 2000
-For auto-partitioned tables to prevent users from accidentally creating a
large number of partitions, the number of partitions allowed per OLAP table is
`max_auto_partition_num`. Default 2000.
\ No newline at end of file
+For auto-partitioned tables to prevent users from accidentally creating a
large number of partitions, the number of partitions allowed per OLAP table is
`max_auto_partition_num`. Default 2000.
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/config/fe-config.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/config/fe-config.md
index cc5354c53e..2b53ac8c56 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/config/fe-config.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/config/fe-config.md
@@ -2583,6 +2583,16 @@ SmallFileMgr 中存储的最大文件数
此配置用于控制每个 DB 能够记录的 backup/restore 任务的数量
+#### `max_backup_tablets_per_job`
+
+默认值：300000
+
+是否可以动态配置：true
+
+是否为 Master FE 节点独有的配置项：true
+
+此配置用于控制每个 backup job 最大涉及的 tablets 数量，以避免因保存过多元数据导致 FE OOM。
+
#### `enable_quantile_state_type`
默认值：false
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/admin-manual/config/fe-config.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/admin-manual/config/fe-config.md
index de8ad6320b..505113ccab 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/admin-manual/config/fe-config.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/admin-manual/config/fe-config.md
@@ -2584,6 +2584,20 @@ SmallFileMgr 中存储的最大文件数
此配置用于控制每个 DB 能够记录的 backup/restore 任务的数量
+#### `max_backup_tablets_per_job`
+
+默认值：300000
+
+是否可以动态配置：true
+
+是否为 Master FE 节点独有的配置项：true
+
+此配置用于控制每个 backup job 最大涉及的 tablets 数量，以避免因保存过多元数据导致 FE OOM。
+
+:::tips 提示
+从 Apache Doris 2.0.15 开始支持该配置
+:::
+
#### `enable_quantile_state_type`
默认值：false
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/admin-manual/config/fe-config.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/admin-manual/config/fe-config.md
index c897069986..573eedb1b6 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/admin-manual/config/fe-config.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/admin-manual/config/fe-config.md
@@ -2611,6 +2611,20 @@ SmallFileMgr 中存储的最大文件数
此配置用于控制每个 DB 能够记录的 backup/restore 任务的数量
+#### `max_backup_tablets_per_job`
+
+默认值：300000
+
+是否可以动态配置：true
+
+是否为 Master FE 节点独有的配置项：true
+
+此配置用于控制每个 backup job 最大涉及的 tablets 数量，以避免因保存过多元数据导致 FE OOM。
+
+:::tips 提示
+从 Apache Doris 2.1.6 开始支持该配置
+:::
+
#### `enable_quantile_state_type`
默认值：false
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/admin-manual/config/fe-config.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/admin-manual/config/fe-config.md
index cc5354c53e..2b53ac8c56 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/admin-manual/config/fe-config.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/admin-manual/config/fe-config.md
@@ -2583,6 +2583,16 @@ SmallFileMgr 中存储的最大文件数
此配置用于控制每个 DB 能够记录的 backup/restore 任务的数量
+#### `max_backup_tablets_per_job`
+
+默认值：300000
+
+是否可以动态配置：true
+
+是否为 Master FE 节点独有的配置项：true
+
+此配置用于控制每个 backup job 最大涉及的 tablets 数量，以避免因保存过多元数据导致 FE OOM。
+
#### `enable_quantile_state_type`
默认值：false
diff --git a/versioned_docs/version-2.0/admin-manual/config/fe-config.md
b/versioned_docs/version-2.0/admin-manual/config/fe-config.md
index 3122e6ff3b..abb635bd61 100644
--- a/versioned_docs/version-2.0/admin-manual/config/fe-config.md
+++ b/versioned_docs/version-2.0/admin-manual/config/fe-config.md
@@ -2591,6 +2591,20 @@ Default: 10
This configuration is mainly used to control the number of backup/restore
tasks recorded in each database.
+#### `max_backup_tablets_per_job`
+
+Default: 300000
+
+IsMutable：true
+
+MasterOnly：true
+
+Control the max num of tablets per backup job involved, to avoid FE OOM caused
by saving too much metadata.
+
+:::tips TIPS
+This configuration is supported since the Apache Doris 2.0.15 version
+:::
+
#### `enable_quantile_state_type`
Default：false
diff --git a/versioned_docs/version-2.1/admin-manual/config/fe-config.md
b/versioned_docs/version-2.1/admin-manual/config/fe-config.md
index 57bbc9b3f1..d198b08dd0 100644
--- a/versioned_docs/version-2.1/admin-manual/config/fe-config.md
+++ b/versioned_docs/version-2.1/admin-manual/config/fe-config.md
@@ -2608,6 +2608,20 @@ Default: 10
This configuration is mainly used to control the number of backup/restore
tasks recorded in each database.
+#### `max_backup_tablets_per_job`
+
+Default: 300000
+
+IsMutable：true
+
+MasterOnly：true
+
+Control the max num of tablets per backup job involved, to avoid FE OOM caused
by saving too much metadata.
+
+:::tips TIPS
+This configuration is supported since the Apache Doris 2.1.6 version
+:::
+
#### `enable_quantile_state_type`
Default：false
diff --git a/versioned_docs/version-3.0/admin-manual/config/fe-config.md
b/versioned_docs/version-3.0/admin-manual/config/fe-config.md
index ed546d125e..e2c93896af 100644
--- a/versioned_docs/version-3.0/admin-manual/config/fe-config.md
+++ b/versioned_docs/version-3.0/admin-manual/config/fe-config.md
@@ -2584,6 +2584,16 @@ Default: 10
This configuration is mainly used to control the number of backup/restore
tasks recorded in each database.
+#### `max_backup_tablets_per_job`
+
+Default: 300000
+
+IsMutable：true
+
+MasterOnly：true
+
+Control the max num of tablets per backup job involved, to avoid FE OOM caused
by saving too much metadata.
+
#### `enable_quantile_state_type`
Default：false
@@ -2747,4 +2757,4 @@ To ensure compatibility with the MySQL ecosystem, Doris
includes a built-in data
Default value: 2000
-For auto-partitioned tables to prevent users from accidentally creating a
large number of partitions, the number of partitions allowed per OLAP table is
`max_auto_partition_num`. Default 2000.
\ No newline at end of file
+For auto-partitioned tables to prevent users from accidentally creating a
large number of partitions, the number of partitions allowed per OLAP table is
`max_auto_partition_num`. Default 2000.
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
