This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong-website.git
The following commit(s) were added to refs/heads/master by this push: new 2acd7730e6 [INLONG-544][Sort] Modify doc for JDBC support ingest all changelog data (#545) 2acd7730e6 is described below commit 2acd7730e6a5377a640113259b7517d4557a9c76 Author: thesumery <107393625+thesum...@users.noreply.github.com> AuthorDate: Tue Sep 13 18:55:44 2022 +0800 [INLONG-544][Sort] Modify doc for JDBC support ingest all changelog data (#545) Co-authored-by: thesumery <158971...@qq.com> --- docs/data_node/load_node/clickhouse.md | 1 + docs/data_node/load_node/greenplum.md | 1 + docs/data_node/load_node/oracle.md | 1 + docs/data_node/load_node/postgresql.md | 1 + docs/data_node/load_node/sqlserver.md | 1 + docs/data_node/load_node/tdsql-postgresql.md | 1 + .../current/data_node/load_node/clickhouse.md | 1 + .../current/data_node/load_node/greenplum.md | 1 + .../docusaurus-plugin-content-docs/current/data_node/load_node/oracle.md | 1 + .../current/data_node/load_node/postgresql.md | 1 + .../current/data_node/load_node/sqlserver.md | 1 + .../current/data_node/load_node/tdsql-postgresql.md | 1 + 12 files changed, 12 insertions(+) diff --git a/docs/data_node/load_node/clickhouse.md b/docs/data_node/load_node/clickhouse.md index 98ea388e14..b7fe70e041 100644 --- a/docs/data_node/load_node/clickhouse.md +++ b/docs/data_node/load_node/clickhouse.md @@ -99,6 +99,7 @@ TODO: It will be supported in the future. | sink.buffer-flush.interval | optional | 1s | Duration | The flush interval mills, over this time, asynchronous threads will flush data. Can be set to '0' to disable it. Note, 'sink.buffer-flush.max-rows' can be set to '0' with the flush interval set allowing for complete async processing of buffered actions. | | | sink.max-retries | optional | 3 | Integer | The max retry times if writing records to database failed. | | sink.parallelism | optional | (none) | Integer | Defines the parallelism of the JDBC sink operator. By default, the parallelism is determined by the framework using the same parallelism of the upstream chained operator. | +| sink.ignore.changelog | optional | false | Boolean | Ignore all `RowKind`, ingest them as `INSERT`. | | inlong.metric | optional | (none) | String | Inlong metric label, format of value is groupId&streamId&nodeId. | ## Data Type Mapping diff --git a/docs/data_node/load_node/greenplum.md b/docs/data_node/load_node/greenplum.md index 29778b0fa6..20594c9bae 100644 --- a/docs/data_node/load_node/greenplum.md +++ b/docs/data_node/load_node/greenplum.md @@ -97,6 +97,7 @@ TODO: It will be supported in the future. | sink.buffer-flush.interval | optional | 1s | Duration | The flush interval mills, over this time, asynchronous threads will flush data. Can be set to '0' to disable it. Note, 'sink.buffer-flush.max-rows' can be set to '0' with the flush interval set allowing for complete async processing of buffered actions. | | | sink.max-retries | optional | 3 | Integer | The max retry times if writing records to database failed. | | sink.parallelism | optional | (none) | Integer | Defines the parallelism of the JDBC sink operator. By default, the parallelism is determined by the framework using the same parallelism of the upstream chained operator. | +| sink.ignore.changelog | optional | false | Boolean | Ignore all `RowKind`, ingest them as `INSERT`. | | inlong.metric | optional | (none) | String | Inlong metric label, format of value is groupId&streamId&nodeId. | ## Data Type Mapping diff --git a/docs/data_node/load_node/oracle.md b/docs/data_node/load_node/oracle.md index a2f98884e3..a7201772d4 100644 --- a/docs/data_node/load_node/oracle.md +++ b/docs/data_node/load_node/oracle.md @@ -97,6 +97,7 @@ TODO: It will be supported in the future. | sink.buffer-flush.interval | optional | 1s | Duration | The flush interval mills, over this time, asynchronous threads will flush data. Can be set to '0' to disable it. Note, 'sink.buffer-flush.max-rows' can be set to '0' with the flush interval set allowing for complete async processing of buffered actions. | | | sink.max-retries | optional | 3 | Integer | The max retry times if writing records to database failed. | | sink.parallelism | optional | (none) | Integer | Defines the parallelism of the JDBC sink operator. By default, the parallelism is determined by the framework using the same parallelism of the upstream chained operator. | +| sink.ignore.changelog | optional | false | Boolean | Ignore all `RowKind`, ingest them as `INSERT`. | | inlong.metric | optional | (none) | String | Inlong metric label, format of value is groupId&streamId&nodeId. | ## Data Type Mapping diff --git a/docs/data_node/load_node/postgresql.md b/docs/data_node/load_node/postgresql.md index c987c82c33..ef3ae7c049 100644 --- a/docs/data_node/load_node/postgresql.md +++ b/docs/data_node/load_node/postgresql.md @@ -96,6 +96,7 @@ TODO: It will be supported in the future. | sink.buffer-flush.interval | optional | 1s | Duration | The flush interval mills, over this time, asynchronous threads will flush data. Can be set to '0' to disable it. Note, 'sink.buffer-flush.max-rows' can be set to '0' with the flush interval set allowing for complete async processing of buffered actions. | | | sink.max-retries | optional | 3 | Integer | The max retry times if writing records to database failed. | | sink.parallelism | optional | (none) | Integer | Defines the parallelism of the JDBC sink operator. By default, the parallelism is determined by the framework using the same parallelism of the upstream chained operator. | +| sink.ignore.changelog | optional | false | Boolean | Ignore all `RowKind`, ingest them as `INSERT`. | | inlong.metric | optional | (none) | String | Inlong metric label, format of value is groupId&streamId&nodeId. | ## Data Type Mapping diff --git a/docs/data_node/load_node/sqlserver.md b/docs/data_node/load_node/sqlserver.md index 3475ca9c35..1315f252c7 100644 --- a/docs/data_node/load_node/sqlserver.md +++ b/docs/data_node/load_node/sqlserver.md @@ -95,6 +95,7 @@ TODO: It will be supported in the future. | sink.buffer-flush.interval | optional | 1s | Duration | The flush interval mills, over this time, asynchronous threads will flush data. Can be set to '0' to disable it. Note, 'sink.buffer-flush.max-rows' can be set to '0' with the flush interval set allowing for complete async processing of buffered actions. | | | sink.max-retries | optional | 3 | Integer | The max retry times if writing records to database failed. | | sink.parallelism | optional | (none) | Integer | Defines the parallelism of the JDBC sink operator. By default, the parallelism is determined by the framework using the same parallelism of the upstream chained operator. | +| sink.ignore.changelog | optional | false | Boolean | Ignore all `RowKind`, ingest them as `INSERT`. | | inlong.metric | optional | (none) | String | Inlong metric label, format of value is groupId&streamId&nodeId. | ## Data Type Mapping diff --git a/docs/data_node/load_node/tdsql-postgresql.md b/docs/data_node/load_node/tdsql-postgresql.md index 40d0eff8c8..d737a296ec 100644 --- a/docs/data_node/load_node/tdsql-postgresql.md +++ b/docs/data_node/load_node/tdsql-postgresql.md @@ -95,6 +95,7 @@ TODO: It will be supported in the future. | sink.buffer-flush.interval | optional | 1s | Duration | The flush interval mills, over this time, asynchronous threads will flush data. Can be set to '0' to disable it. Note, 'sink.buffer-flush.max-rows' can be set to '0' with the flush interval set allowing for complete async processing of buffered actions. | | | sink.max-retries | optional | 3 | Integer | The max retry times if writing records to database failed. | | sink.parallelism | optional | (none) | Integer | Defines the parallelism of the JDBC sink operator. By default, the parallelism is determined by the framework using the same parallelism of the upstream chained operator. | +| sink.ignore.changelog | optional | false | Boolean | Ignore all `RowKind`, ingest them as `INSERT`. | | inlong.metric | optional | (none) | String | Inlong metric label, format of value is groupId&streamId&nodeId. | ## Data Type Mapping diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/clickhouse.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/clickhouse.md index 5aba3a0aab..67cdf8d11e 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/clickhouse.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/clickhouse.md @@ -97,6 +97,7 @@ TODO: 将在未来支持此功能。 | sink.buffer-flush.interval | 可选 | 1s | Duration | flush 间隔时间,超过该时间后异步线程将 flush 数据。可以设置为 '0' 来禁用它。注意, 为了完全异步地处理缓存的 flush 事件,可以将 'sink.buffer-flush.max-rows' 设置为 '0' 并配置适当的 flush 时间间隔。 | | sink.max-retries | 可选 | 3 | Integer | 写入记录到数据库失败后的最大重试次数。 | | sink.parallelism | 可选 | (none) | Integer | 用于定义 JDBC sink 算子的并行度。默认情况下,并行度是由框架决定:使用与上游链式算子相同的并行度。 | +| sink.ignore.changelog | 可选 | false | Boolean | 忽略所有 RowKind 类型的变更日志,将它们当作 INSERT 的数据来采集。 | | inlong.metric | 可选 | (none) | String | inlong metric 的标签值,该值的构成为groupId&streamId&nodeId。| ## 数据类型映射 diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/greenplum.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/greenplum.md index 668ac9c02a..5b886d7540 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/greenplum.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/greenplum.md @@ -95,6 +95,7 @@ TODO: 将在未来支持此功能。 | sink.buffer-flush.interval | 可选 | 1s | Duration | flush 间隔时间,超过该时间后异步线程将 flush 数据。可以设置为 '0' 来禁用它。注意, 为了完全异步地处理缓存的 flush 事件,可以将 'sink.buffer-flush.max-rows' 设置为 '0' 并配置适当的 flush 时间间隔。 | | sink.max-retries | 可选 | 3 | Integer | 写入记录到数据库失败后的最大重试次数。 | | sink.parallelism | 可选 | (none) | Integer | 用于定义 JDBC sink 算子的并行度。默认情况下,并行度是由框架决定:使用与上游链式算子相同的并行度。 | +| sink.ignore.changelog | 可选 | false | Boolean | 忽略所有 RowKind 类型的变更日志,将它们当作 INSERT 的数据来采集。 | | inlong.metric | 可选 | (none) | String | inlong metric 的标签值,该值的构成为groupId&streamId&nodeId。| ## 数据类型映射 diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/oracle.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/oracle.md index 98f6db1b4f..c15eece9f5 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/oracle.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/oracle.md @@ -94,6 +94,7 @@ TODO: 将在未来支持此功能。 | sink.buffer-flush.interval | 可选 | 1s | Duration | flush 间隔时间,超过该时间后异步线程将 flush 数据。可以设置为 '0' 来禁用它。注意, 为了完全异步地处理缓存的 flush 事件,可以将 'sink.buffer-flush.max-rows' 设置为 '0' 并配置适当的 flush 时间间隔。 | | sink.max-retries | 可选 | 3 | Integer | 写入记录到数据库失败后的最大重试次数。 | | sink.parallelism | 可选 | (none) | Integer | 用于定义 JDBC sink 算子的并行度。默认情况下,并行度是由框架决定:使用与上游链式算子相同的并行度。 | +| sink.ignore.changelog | 可选 | false | Boolean | 忽略所有 RowKind 类型的变更日志,将它们当作 INSERT 的数据来采集。 | | inlong.metric | 可选 | (none) | String | inlong metric 的标签值,该值的构成为groupId&streamId&nodeId。| ## 数据类型映射 diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/postgresql.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/postgresql.md index 918d669276..182d1c3e11 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/postgresql.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/postgresql.md @@ -95,6 +95,7 @@ TODO: 将在未来支持此功能。 | sink.buffer-flush.interval | 可选 | 1s | Duration | flush 间隔时间,超过该时间后异步线程将 flush 数据。可以设置为 '0' 来禁用它。注意, 为了完全异步地处理缓存的 flush 事件,可以将 'sink.buffer-flush.max-rows' 设置为 '0' 并配置适当的 flush 时间间隔。 | | sink.max-retries | 可选 | 3 | Integer | 写入记录到数据库失败后的最大重试次数。 | | sink.parallelism | 可选 | (none) | Integer | 用于定义 JDBC sink 算子的并行度。默认情况下,并行度是由框架决定:使用与上游链式算子相同的并行度。 | +| sink.ignore.changelog | 可选 | false | Boolean | 忽略所有 RowKind 类型的变更日志,将它们当作 INSERT 的数据来采集。 | | inlong.metric | 可选 | (none) | String | inlong metric 的标签值,该值的构成为groupId&streamId&nodeId。| ## 数据类型映射 diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/sqlserver.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/sqlserver.md index a317406963..954909f618 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/sqlserver.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/sqlserver.md @@ -93,6 +93,7 @@ TODO: 将在未来支持此功能。 | sink.buffer-flush.interval | 可选 | 1s | Duration | flush 间隔时间,超过该时间后异步线程将 flush 数据。可以设置为 '0' 来禁用它。注意, 为了完全异步地处理缓存的 flush 事件,可以将 'sink.buffer-flush.max-rows' 设置为 '0' 并配置适当的 flush 时间间隔。 | | sink.max-retries | 可选 | 3 | Integer | 写入记录到数据库失败后的最大重试次数。 | | sink.parallelism | 可选 | (none) | Integer | 用于定义 JDBC sink 算子的并行度。默认情况下,并行度是由框架决定:使用与上游链式算子相同的并行度。 | +| sink.ignore.changelog | 可选 | false | Boolean | 忽略所有 RowKind 类型的变更日志,将它们当作 INSERT 的数据来采集。 | | inlong.metric | 可选 | (none) | String | inlong metric 的标签值,该值的构成为groupId&streamId&nodeId。| ## 数据映射 diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/tdsql-postgresql.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/tdsql-postgresql.md index 583601884d..9c5e320f4a 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/tdsql-postgresql.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/tdsql-postgresql.md @@ -93,6 +93,7 @@ TODO: 将在未来支持此功能。 | sink.buffer-flush.interval | 可选 | 1s | Duration | flush 间隔时间,超过该时间后异步线程将 flush 数据。可以设置为 '0' 来禁用它。注意, 为了完全异步地处理缓存的 flush 事件,可以将 'sink.buffer-flush.max-rows' 设置为 '0' 并配置适当的 flush 时间间隔。 | | sink.max-retries | 可选 | 3 | Integer | 写入记录到数据库失败后的最大重试次数。 | | sink.parallelism | 可选 | (none) | Integer | 用于定义 JDBC sink 算子的并行度。默认情况下,并行度是由框架决定:使用与上游链式算子相同的并行度。 | +| sink.ignore.changelog | 可选 | false | Boolean | 忽略所有 RowKind 类型的变更日志,将它们当作 INSERT 的数据来采集。 | | inlong.metric | 可选 | (none) | String | inlong metric 的标签值,该值的构成为groupId&streamId&nodeId。| ## 数据类型映射