yunqingmoswu commented on code in PR #672: URL: https://github.com/apache/inlong-website/pull/672#discussion_r1066646201
########## docs/modules/sort/metrics.md: ########## @@ -12,21 +12,68 @@ Sort will export metric by flink metric group, So user can use [metric reporter] ### supporting extract node Review Comment: 首字母大写 ########## docs/modules/sort/metrics.md: ########## @@ -12,21 +12,68 @@ Sort will export metric by flink metric group, So user can use [metric reporter] ### supporting extract node +#### node level metric + | metric name | extract node | description | Review Comment: 首字母大写 ########## docs/modules/sort/metrics.md: ########## @@ -12,21 +12,68 @@ Sort will export metric by flink metric group, So user can use [metric reporter] ### supporting extract node +#### node level metric + | metric name | extract node | description | |-------------|--------------|-------------| | groupId_streamId_nodeId_numRecordsIn | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | input records number | | groupId_streamId_nodeId_numBytesIn | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | input bytes number | | groupId_streamId_nodeId_numRecordsInPerSecond | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | input records per second | | groupId_streamId_nodeId_numBytesInPerSecond | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | input bytes number per second | +#### table level metric + It is used for all database sync. + +| metric name | extract node | description | +|-------------|--------------|-------------| +| groupId_streamId_nodeId_database_table_numRecordsIn | mysql-cdc | input records number | +| groupId_streamId_nodeId_database_schema_table_numRecordsIn | oracle-cdc,postgresql-cdc | input records number | +| groupId_streamId_nodeId_database_collection_numRecordsIn | mongodb-cdc | input records number | +| groupId_streamId_nodeId_database_table_numBytesIn | mysql-cdc | input records number | +| groupId_streamId_nodeId_database_schema_table_numBytesIn | oracle-cdc,postgresql-cdc | input records number | +| groupId_streamId_nodeId_database_collection_numBytesIn | mongodb-cdc | input bytes number | +| groupId_streamId_nodeId_database_table_numRecordsInPerSecond | mysql-cdc | input records number per second | +| groupId_streamId_nodeId_database_schema_table_numRecordsInPerSecond | oracle-cdc,postgresql-cdc | input records number per second | +| groupId_streamId_nodeId_database_collection_numRecordsInPerSecond | mongodb-cdc | input records number per second | +| groupId_streamId_nodeId_database_table_numBytesInPerSecond | mysql-cdc | input bytes number per second | +| groupId_streamId_nodeId_database_schema_table_numBytesInPerSecond | oracle-cdc,postgresql-cdc | input bytes number per second | +| groupId_streamId_nodeId_database_collection_numBytesInPerSecond | mongodb-cdc | input bytes number per second | + ### supporting load node +#### node level metric Review Comment: 首字母大写 ########## docs/modules/sort/metrics.md: ########## @@ -12,21 +12,68 @@ Sort will export metric by flink metric group, So user can use [metric reporter] ### supporting extract node +#### node level metric + | metric name | extract node | description | |-------------|--------------|-------------| | groupId_streamId_nodeId_numRecordsIn | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | input records number | | groupId_streamId_nodeId_numBytesIn | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | input bytes number | | groupId_streamId_nodeId_numRecordsInPerSecond | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | input records per second | | groupId_streamId_nodeId_numBytesInPerSecond | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | input bytes number per second | +#### table level metric + It is used for all database sync. + +| metric name | extract node | description | +|-------------|--------------|-------------| +| groupId_streamId_nodeId_database_table_numRecordsIn | mysql-cdc | input records number | +| groupId_streamId_nodeId_database_schema_table_numRecordsIn | oracle-cdc,postgresql-cdc | input records number | +| groupId_streamId_nodeId_database_collection_numRecordsIn | mongodb-cdc | input records number | +| groupId_streamId_nodeId_database_table_numBytesIn | mysql-cdc | input records number | +| groupId_streamId_nodeId_database_schema_table_numBytesIn | oracle-cdc,postgresql-cdc | input records number | +| groupId_streamId_nodeId_database_collection_numBytesIn | mongodb-cdc | input bytes number | +| groupId_streamId_nodeId_database_table_numRecordsInPerSecond | mysql-cdc | input records number per second | +| groupId_streamId_nodeId_database_schema_table_numRecordsInPerSecond | oracle-cdc,postgresql-cdc | input records number per second | +| groupId_streamId_nodeId_database_collection_numRecordsInPerSecond | mongodb-cdc | input records number per second | +| groupId_streamId_nodeId_database_table_numBytesInPerSecond | mysql-cdc | input bytes number per second | +| groupId_streamId_nodeId_database_schema_table_numBytesInPerSecond | oracle-cdc,postgresql-cdc | input bytes number per second | +| groupId_streamId_nodeId_database_collection_numBytesInPerSecond | mongodb-cdc | input bytes number per second | + ### supporting load node Review Comment: 首字母大写 ########## docs/modules/sort/metrics.md: ########## @@ -12,21 +12,68 @@ Sort will export metric by flink metric group, So user can use [metric reporter] ### supporting extract node +#### node level metric Review Comment: 首字母大写 ########## i18n/zh-CN/docusaurus-plugin-content-docs/version-1.4.0/modules/sort/metrics.md: ########## @@ -12,21 +12,68 @@ sidebar_position: 4 ### 支持的 extract 节点 +#### 支持节点级别指标 + | 指标名 | extract 节点 | 描述 | |-------------|--------------|-------------| | groupId_streamId_nodeId_numRecordsIn | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | 输入记录数 | | groupId_streamId_nodeId_numBytesIn | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | 输入字节数 | | groupId_streamId_nodeId_numRecordsInPerSecond | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | 每秒输入记录数 | | groupId_streamId_nodeId_numBytesInPerSecond | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | 每秒输入字节数 | +#### 支持表级别指标 +它是用于整库同步场景 + +| metric name | extract node | description | Review Comment: 首字母大写，翻译下？ ########## docs/modules/sort/metrics.md: ########## @@ -12,21 +12,68 @@ Sort will export metric by flink metric group, So user can use [metric reporter] ### supporting extract node +#### node level metric + | metric name | extract node | description | |-------------|--------------|-------------| | groupId_streamId_nodeId_numRecordsIn | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | input records number | | groupId_streamId_nodeId_numBytesIn | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | input bytes number | | groupId_streamId_nodeId_numRecordsInPerSecond | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | input records per second | | groupId_streamId_nodeId_numBytesInPerSecond | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | input bytes number per second | +#### table level metric + It is used for all database sync. + +| metric name | extract node | description | +|-------------|--------------|-------------| +| groupId_streamId_nodeId_database_table_numRecordsIn | mysql-cdc | input records number | +| groupId_streamId_nodeId_database_schema_table_numRecordsIn | oracle-cdc,postgresql-cdc | input records number | +| groupId_streamId_nodeId_database_collection_numRecordsIn | mongodb-cdc | input records number | +| groupId_streamId_nodeId_database_table_numBytesIn | mysql-cdc | input records number | +| groupId_streamId_nodeId_database_schema_table_numBytesIn | oracle-cdc,postgresql-cdc | input records number | +| groupId_streamId_nodeId_database_collection_numBytesIn | mongodb-cdc | input bytes number | +| groupId_streamId_nodeId_database_table_numRecordsInPerSecond | mysql-cdc | input records number per second | +| groupId_streamId_nodeId_database_schema_table_numRecordsInPerSecond | oracle-cdc,postgresql-cdc | input records number per second | +| groupId_streamId_nodeId_database_collection_numRecordsInPerSecond | mongodb-cdc | input records number per second | +| groupId_streamId_nodeId_database_table_numBytesInPerSecond | mysql-cdc | input bytes number per second | +| groupId_streamId_nodeId_database_schema_table_numBytesInPerSecond | oracle-cdc,postgresql-cdc | input bytes number per second | +| groupId_streamId_nodeId_database_collection_numBytesInPerSecond | mongodb-cdc | input bytes number per second | + ### supporting load node +#### node level metric + | metric name | load node | description | |-------------|-----------|-------------| | groupId_streamId_nodeId_numRecordsOut | clickhouse,elasticsearch,greenplum,hbase,<br/>hdfs,hive,iceberg,kafka,mysql,<br/>oracle,postgresql,sqlserver,tdsql-postgresql | out records number | | groupId_streamId_nodeId_numBytesOut | clickhouse,elasticsearch,greenplum,hbase,<br/>hdfs,hive,iceberg,kafka,mysql,<br/>oracle,postgresql,sqlserver,tdsql-postgresql | output byte number | | groupId_streamId_nodeId_numRecordsOutPerSecond | clickhouse,elasticsearch,greenplum,hbase,<br/>hdfs,hive,iceberg,kafka,mysql,<br/>oracle,postgresql,sqlserver,tdsql-postgresql | output records per second | | groupId_streamId_nodeId_numBytesOutPerSecond | clickhouse,elasticsearch,greenplum,hbase,<br/>hdfs,hive,iceberg,kafka,mysql,<br/>oracle,postgresql,sqlserver,tdsql-postgresql | output bytes per second | +| groupId_streamId_nodeId_dirtyRecordsOut | clickhouse,elasticsearch,greenplum,hbase,<br/>hdfs,hive,iceberg,kafka,mysql,<br/>oracle,postgresql,sqlserver,tdsql-postgresql | output records | +| groupId_streamId_nodeId_dirtyBytesOut | clickhouse,elasticsearch,greenplum,hbase,<br/>hdfs,hive,iceberg,kafka,mysql,<br/>oracle,postgresql,sqlserver,tdsql-postgresql | output bytes | + +#### table level metric Review Comment: 首字母大写 ########## i18n/zh-CN/docusaurus-plugin-content-docs/version-1.4.0/modules/sort/metrics.md: ########## @@ -12,21 +12,68 @@ sidebar_position: 4 ### 支持的 extract 节点 +#### 支持节点级别指标 + | 指标名 | extract 节点 | 描述 | |-------------|--------------|-------------| | groupId_streamId_nodeId_numRecordsIn | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | 输入记录数 | | groupId_streamId_nodeId_numBytesIn | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | 输入字节数 | | groupId_streamId_nodeId_numRecordsInPerSecond | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | 每秒输入记录数 | | groupId_streamId_nodeId_numBytesInPerSecond | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | 每秒输入字节数 | +#### 支持表级别指标 +它是用于整库同步场景 + +| metric name | extract node | description | +|-------------|--------------|-------------| +| groupId_streamId_nodeId_database_table_numRecordsIn | mysql-cdc | input records number | +| groupId_streamId_nodeId_database_schema_table_numRecordsIn | oracle-cdc,postgresql-cdc | input records number | +| groupId_streamId_nodeId_database_collection_numRecordsIn | mongodb-cdc | input records number | +| groupId_streamId_nodeId_database_table_numBytesIn | mysql-cdc | input records number | +| groupId_streamId_nodeId_database_schema_table_numBytesIn | oracle-cdc,postgresql-cdc | input records number | +| groupId_streamId_nodeId_database_collection_numBytesIn | mongodb-cdc | input bytes number | +| groupId_streamId_nodeId_database_table_numRecordsInPerSecond | mysql-cdc | input records number per second | +| groupId_streamId_nodeId_database_schema_table_numRecordsInPerSecond | oracle-cdc,postgresql-cdc | input records number per second | +| groupId_streamId_nodeId_database_collection_numRecordsInPerSecond | mongodb-cdc | input records number per second | +| groupId_streamId_nodeId_database_table_numBytesInPerSecond | mysql-cdc | input bytes number per second | +| groupId_streamId_nodeId_database_schema_table_numBytesInPerSecond | oracle-cdc,postgresql-cdc | input bytes number per second | +| groupId_streamId_nodeId_database_collection_numBytesInPerSecond | mongodb-cdc | input bytes number per second | + ### 支持的 load 节点 +#### 支持节点级别指标 + | 指标名 | load 节点 | 描述 | Review Comment: 首字母大写 ########## i18n/zh-CN/docusaurus-plugin-content-docs/version-1.4.0/modules/sort/metrics.md: ########## @@ -12,21 +12,68 @@ sidebar_position: 4 ### 支持的 extract 节点 +#### 支持节点级别指标 + | 指标名 | extract 节点 | 描述 | |-------------|--------------|-------------| | groupId_streamId_nodeId_numRecordsIn | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | 输入记录数 | | groupId_streamId_nodeId_numBytesIn | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | 输入字节数 | | groupId_streamId_nodeId_numRecordsInPerSecond | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | 每秒输入记录数 | | groupId_streamId_nodeId_numBytesInPerSecond | kafka,mongodb-cdc,mysql-cdc,oracle-cdc,postgresql-cdc,pulsar,sqlserver-cdc | 每秒输入字节数 | +#### 支持表级别指标 +它是用于整库同步场景 + +| metric name | extract node | description | +|-------------|--------------|-------------| +| groupId_streamId_nodeId_database_table_numRecordsIn | mysql-cdc | input records number | +| groupId_streamId_nodeId_database_schema_table_numRecordsIn | oracle-cdc,postgresql-cdc | input records number | +| groupId_streamId_nodeId_database_collection_numRecordsIn | mongodb-cdc | input records number | +| groupId_streamId_nodeId_database_table_numBytesIn | mysql-cdc | input records number | +| groupId_streamId_nodeId_database_schema_table_numBytesIn | oracle-cdc,postgresql-cdc | input records number | +| groupId_streamId_nodeId_database_collection_numBytesIn | mongodb-cdc | input bytes number | +| groupId_streamId_nodeId_database_table_numRecordsInPerSecond | mysql-cdc | input records number per second | +| groupId_streamId_nodeId_database_schema_table_numRecordsInPerSecond | oracle-cdc,postgresql-cdc | input records number per second | +| groupId_streamId_nodeId_database_collection_numRecordsInPerSecond | mongodb-cdc | input records number per second | +| groupId_streamId_nodeId_database_table_numBytesInPerSecond | mysql-cdc | input bytes number per second | +| groupId_streamId_nodeId_database_schema_table_numBytesInPerSecond | oracle-cdc,postgresql-cdc | input bytes number per second | +| groupId_streamId_nodeId_database_collection_numBytesInPerSecond | mongodb-cdc | input bytes number per second | + ### 支持的 load 节点 +#### 支持节点级别指标 + | 指标名 | load 节点 | 描述 | |-------------|-----------|-------------| | groupId_streamId_nodeId_numRecordsOut | clickhouse,elasticsearch,greenplum,hbase,<br/>hdfs,hive,iceberg,kafka,<br/>mysql,oracle,postgresql,sqlserver,tdsql-postgresql | 输出记录数 | | groupId_streamId_nodeId_numBytesOut | clickhouse,elasticsearch,greenplum,hbase,<br/>hdfs,hive,iceberg,kafka,<br/>mysql,oracle,postgresql,sqlserver,tdsql-postgresql | 输出字节数 | | groupId_streamId_nodeId_numRecordsOutPerSecond | clickhouse,elasticsearch,greenplum,<br/>hbase,hdfs,hive,iceberg,<br/>kafka,mysql,oracle,postgresql,sqlserver,tdsql-postgresql | 每秒输出记录数 | | groupId_streamId_nodeId_numBytesOutPerSecond | clickhouse,elasticsearch,greenplum,<br/>hbase,hdfs,hive,iceberg,kafka,<br/>mysql,oracle,postgresql,sqlserver,tdsql-postgresql | 每秒输出字节数 | +| groupId_streamId_nodeId_dirtyRecordsOut | clickhouse,elasticsearch,greenplum,hbase,<br/>hdfs,hive,iceberg,kafka,mysql,<br/>oracle,postgresql,sqlserver,tdsql-postgresql | output records | +| groupId_streamId_nodeId_dirtyBytesOut | clickhouse,elasticsearch,greenplum,hbase,<br/>hdfs,hive,iceberg,kafka,mysql,<br/>oracle,postgresql,sqlserver,tdsql-postgresql | output bytes | + +#### 支持表级别指标 + +| metric name | load node | description | Review Comment: 首字母大写 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
