This is an automated email from the ASF dual-hosted git repository.
jiafengzheng pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git
The following commit(s) were added to refs/heads/master by this push:
new 34457cd768 add show load warning (#9051)
34457cd768 is described below
commit 34457cd768a3027683b7a7e5a0397624b6d6698a
Author: jiafeng.zhang <zhang...@gmail.com>
AuthorDate: Fri Apr 15 18:53:20 2022 +0800
add show load warning (#9051)
add show load warning
---
.../Show-Statements/SHOW-LOAD-PROFILE.md | 147 +++++++++++++++++++++
.../Show-Statements/SHOW-LOAD-WARNINGS.md | 28 ++++
.../Show-Statements/SHOW-LOAD-PROFILE.md | 147 +++++++++++++++++++++
.../Show-Statements/SHOW-LOAD-WARNINGS.md | 28 ++++
4 files changed, 350 insertions(+)
diff --git
a/new-docs/en/sql-manual/sql-reference-v2/Show-Statements/SHOW-LOAD-PROFILE.md
b/new-docs/en/sql-manual/sql-reference-v2/Show-Statements/SHOW-LOAD-PROFILE.md
index 9bdcad5da3..1382f81642 100644
---
a/new-docs/en/sql-manual/sql-reference-v2/Show-Statements/SHOW-LOAD-PROFILE.md
+++
b/new-docs/en/sql-manual/sql-reference-v2/Show-Statements/SHOW-LOAD-PROFILE.md
@@ -26,10 +26,157 @@ under the License.
## SHOW-LOAD-PROFILE
+### Name
+
+SHOW LOAD PROFILE
+
### Description
+This statement is used to view the Profile information of the import
operation. This function requires the user to open the Profile settings. The
versions before 0.15 perform the following settings:
+
+```sql
+SET is_report_success=true;
+````
+
+Versions 0.15 and later perform the following settings:
+
+```sql
+SET [GLOBAL] enable_profile=true;
+````
+
+grammar:
+
+```sql
+show load profile "/";
+
+show load profile "/[queryId]"
+````
+
+This command will list all currently saved import profiles. Each line
corresponds to one import. where the QueryId column is the ID of the import
job. This ID can also be viewed through the SHOW LOAD statement. We can select
the QueryId corresponding to the Profile we want to see to see the specific
situation
+
### Example
+1. List all Load Profiles
+
+ ```sql
+ mysql> show load profile "/";
+
+---------+------+-----------+------+-----------+---------------------+---------------------+-----------+------------+
+ | QueryId | User | DefaultDb | SQL | QueryType | StartTime |
EndTime | TotalTime | QueryState |
+
+---------+------+-----------+------+-----------+---------------------+---------------------+-----------+------------+
+ | 10441 | N/A | N/A | N/A | Load | 2021-04-10 22:15:37 |
2021-04-10 22:18:54 | 3m17s | N/A |
+
+---------+------+-----------+------+-----------+---------------------+---------------------+-----------+------------+
+ 2 rows in set (0.00 sec)
+ ````
+
+2. View an overview of the subtasks with imported jobs:
+
+ ```sql
+ mysql> show load profile "/10441";
+ +-----------------------------------+------------+
+ | TaskId | ActiveTime |
+ +-----------------------------------+------------+
+ | 980014623046410a-88e260f0c43031f1 | 3m14s |
+ +-----------------------------------+------------+
+ ````
+
+3. View the Instance overview of the specified subtask
+
+ ```sql
+ mysql> show load profile "/10441/980014623046410a-88e260f0c43031f1";
+ +-----------------------------------+------------------+------------+
+ | Instances | Host | ActiveTime |
+ +-----------------------------------+------------------+------------+
+ | 980014623046410a-88e260f0c43031f2 | 10.81.85.89:9067 | 3m7s |
+ | 980014623046410a-88e260f0c43031f3 | 10.81.85.89:9067 | 3m6s |
+ | 980014623046410a-88e260f0c43031f4 | 10.81.85.89:9067 | 3m10s |
+ | 980014623046410a-88e260f0c43031f5 | 10.81.85.89:9067 | 3m14s |
+ +-----------------------------------+------------------+------------+
+ ````
+
+4. Continue to view the detailed Profile of each operator on a specific
Instance
+
+ ```sql
+ mysql> show load profile
"/10441/980014623046410a-88e260f0c43031f1/980014623046410a-88e260f0c43031f5"\G
+
+ *************************** 1. row ***************************
+
+ Instance:
+
+ ┌-----------------------------------------┐
+
+ │[-1: OlapTableSink] │
+
+ │(Active: 2m17s, non-child: 70.91) │
+
+ │ - Counters: │
+
+ │ - CloseWaitTime: 1m53s │
+
+ │ - ConvertBatchTime: 0ns │
+
+ │ - MaxAddBatchExecTime: 1m46s │
+
+ │ - NonBlockingSendTime: 3m11s │
+
+ │ - NumberBatchAdded: 782 │
+
+ │ - NumberNodeChannels: 1 │
+
+ │ - OpenTime: 743.822us │
+
+ │ - RowsFiltered: 0 │
+
+ │ - RowsRead: 1.599729M (1599729) │
+
+ │ - RowsReturned: 1.599729M (1599729)│
+
+ │ - SendDataTime: 11s761ms │
+
+ │ - TotalAddBatchExecTime: 1m46s │
+
+ │ - ValidateDataTime: 9s802ms │
+
+ └-----------------------------------------┘
+
+ │
+
+ ┌-----------------------------------------------------┐
+
+ │[0: BROKER_SCAN_NODE] │
+
+ │(Active: 56s537ms, non-child: 29.06) │
+
+ │ - Counters: │
+
+ │ - BytesDecompressed: 0.00 │
+
+ │ - BytesRead: 5.77 GB │
+
+ │ - DecompressTime: 0ns │
+
+ │ - FileReadTime: 34s263ms │
+
+ │ - MaterializeTupleTime(*): 45s54ms │
+
+ │ - NumDiskAccess: 0 │
+
+ │ - PeakMemoryUsage: 33.03 MB │
+
+ │ - RowsRead: 1.599729M (1599729) │
+
+ │ - RowsReturned: 1.599729M (1599729) │
+
+ │ - RowsReturnedRate: 28.295K sec │
+
+ │ - TotalRawReadTime(*): 1m20s │
+
+ │ - TotalReadThroughput: 30.39858627319336 MB/sec│
+
+ │ - WaitScannerTime: 56s528ms │
+
+ └-----------------------------------------------------┘
+ ````
+
### Keywords
SHOW, LOAD, PROFILE
diff --git
a/new-docs/en/sql-manual/sql-reference-v2/Show-Statements/SHOW-LOAD-WARNINGS.md
b/new-docs/en/sql-manual/sql-reference-v2/Show-Statements/SHOW-LOAD-WARNINGS.md
index 09fef2eb22..eb5d8d5700 100644
---
a/new-docs/en/sql-manual/sql-reference-v2/Show-Statements/SHOW-LOAD-WARNINGS.md
+++
b/new-docs/en/sql-manual/sql-reference-v2/Show-Statements/SHOW-LOAD-WARNINGS.md
@@ -26,10 +26,38 @@ under the License.
## SHOW-LOAD-WARNINGS
+### Name
+
+SHOW LOAD WARNINGS
+
### Description
+If the import task fails and the error message is `ETL_QUALITY_UNSATISFIED`,
it means that there is an import quality problem. If you want to see these
import tasks with quality problems, change the statement to complete this
operation.
+
+grammar:
+
+```sql
+SHOW LOAD WARNINGS
+[FROM db_name]
+[
+ WHERE
+ [LABEL[="your_label"]]
+ [LOAD_JOB_ID = ["job id"]]
+]
+````
+
+1) If db_name is not specified, the current default db is used
+1) If LABEL = is used, it matches the specified label exactly
+1) If LOAD_JOB_ID is specified, match the specified JOB ID exactly
+
### Example
+1. Display the data with quality problems in the import task of the specified
db, and specify the label as "load_demo_20210112"
+
+ ```sql
+ SHOW LOAD WARNINGS FROM demo WHERE LABEL = "load_demo_20210112"
+ ````
+
### Keywords
SHOW, LOAD, WARNINGS
diff --git
a/new-docs/zh-CN/sql-manual/sql-reference-v2/Show-Statements/SHOW-LOAD-PROFILE.md
b/new-docs/zh-CN/sql-manual/sql-reference-v2/Show-Statements/SHOW-LOAD-PROFILE.md
index ec893a7f7f..763fa5a3db 100644
---
a/new-docs/zh-CN/sql-manual/sql-reference-v2/Show-Statements/SHOW-LOAD-PROFILE.md
+++
b/new-docs/zh-CN/sql-manual/sql-reference-v2/Show-Statements/SHOW-LOAD-PROFILE.md
@@ -26,10 +26,157 @@ under the License.
## SHOW-LOAD-PROFILE
+### Name
+
+SHOW LOAD PROFILE
+
### Description
+该语句是用来查看导入操作的Profile信息，该功能需要用户打开 Profile 设置，0.15 之前版本执行下面的设置：
+
+```sql
+SET is_report_success=true;
+```
+
+0.15 及之后的版本执行下面的设置：
+
+```sql
+SET [GLOBAL] enable_profile=true;
+```
+
+语法：
+
+```sql
+show load profile "/";
+
+show load profile "/[queryId]"
+```
+
+这个命令会列出当前保存的所有导入 Profile。每行对应一个导入。其中 QueryId 列为导入作业的 ID。这个 ID 也可以通过 SHOW LOAD
语句查看拿到。我们可以选择我们想看的 Profile 对应的 QueryId，查看具体情况
+
### Example
+1. 列出所有的 Load Profile
+
+ ```sql
+ mysql> show load profile "/";
+
+---------+------+-----------+------+-----------+---------------------+---------------------+-----------+------------+
+ | QueryId | User | DefaultDb | SQL | QueryType | StartTime |
EndTime | TotalTime | QueryState |
+
+---------+------+-----------+------+-----------+---------------------+---------------------+-----------+------------+
+ | 10441 | N/A | N/A | N/A | Load | 2021-04-10 22:15:37 |
2021-04-10 22:18:54 | 3m17s | N/A |
+
+---------+------+-----------+------+-----------+---------------------+---------------------+-----------+------------+
+ 2 rows in set (0.00 sec)
+ ```
+
+2. 查看有导入作业的子任务概况：
+
+ ```sql
+ mysql> show load profile "/10441";
+ +-----------------------------------+------------+
+ | TaskId | ActiveTime |
+ +-----------------------------------+------------+
+ | 980014623046410a-88e260f0c43031f1 | 3m14s |
+ +-----------------------------------+------------+
+ ```
+
+3. 查看指定子任务的 Instance 概况
+
+ ```sql
+ mysql> show load profile "/10441/980014623046410a-88e260f0c43031f1";
+ +-----------------------------------+------------------+------------+
+ | Instances | Host | ActiveTime |
+ +-----------------------------------+------------------+------------+
+ | 980014623046410a-88e260f0c43031f2 | 10.81.85.89:9067 | 3m7s |
+ | 980014623046410a-88e260f0c43031f3 | 10.81.85.89:9067 | 3m6s |
+ | 980014623046410a-88e260f0c43031f4 | 10.81.85.89:9067 | 3m10s |
+ | 980014623046410a-88e260f0c43031f5 | 10.81.85.89:9067 | 3m14s |
+ +-----------------------------------+------------------+------------+
+ ```
+
+4. 继续查看某一个具体的 Instance 上各个算子的详细 Profile
+
+ ```sql
+ mysql> show load profile
"/10441/980014623046410a-88e260f0c43031f1/980014623046410a-88e260f0c43031f5"\G
+
+ *************************** 1. row ***************************
+
+ Instance:
+
+ ┌-----------------------------------------┐
+
+ │[-1: OlapTableSink] │
+
+ │(Active: 2m17s, non-child: 70.91) │
+
+ │ - Counters: │
+
+ │ - CloseWaitTime: 1m53s │
+
+ │ - ConvertBatchTime: 0ns │
+
+ │ - MaxAddBatchExecTime: 1m46s │
+
+ │ - NonBlockingSendTime: 3m11s │
+
+ │ - NumberBatchAdded: 782 │
+
+ │ - NumberNodeChannels: 1 │
+
+ │ - OpenTime: 743.822us │
+
+ │ - RowsFiltered: 0 │
+
+ │ - RowsRead: 1.599729M (1599729) │
+
+ │ - RowsReturned: 1.599729M (1599729)│
+
+ │ - SendDataTime: 11s761ms │
+
+ │ - TotalAddBatchExecTime: 1m46s │
+
+ │ - ValidateDataTime: 9s802ms │
+
+ └-----------------------------------------┘
+
+ │
+
+ ┌-----------------------------------------------------┐
+
+ │[0: BROKER_SCAN_NODE] │
+
+ │(Active: 56s537ms, non-child: 29.06) │
+
+ │ - Counters: │
+
+ │ - BytesDecompressed: 0.00 │
+
+ │ - BytesRead: 5.77 GB │
+
+ │ - DecompressTime: 0ns │
+
+ │ - FileReadTime: 34s263ms │
+
+ │ - MaterializeTupleTime(*): 45s54ms │
+
+ │ - NumDiskAccess: 0 │
+
+ │ - PeakMemoryUsage: 33.03 MB │
+
+ │ - RowsRead: 1.599729M (1599729) │
+
+ │ - RowsReturned: 1.599729M (1599729) │
+
+ │ - RowsReturnedRate: 28.295K sec │
+
+ │ - TotalRawReadTime(*): 1m20s │
+
+ │ - TotalReadThroughput: 30.39858627319336 MB/sec│
+
+ │ - WaitScannerTime: 56s528ms │
+
+ └-----------------------------------------------------┘
+ ```
+
### Keywords
SHOW, LOAD, PROFILE
diff --git
a/new-docs/zh-CN/sql-manual/sql-reference-v2/Show-Statements/SHOW-LOAD-WARNINGS.md
b/new-docs/zh-CN/sql-manual/sql-reference-v2/Show-Statements/SHOW-LOAD-WARNINGS.md
index 5c077c47bb..af32a4588f 100644
---
a/new-docs/zh-CN/sql-manual/sql-reference-v2/Show-Statements/SHOW-LOAD-WARNINGS.md
+++
b/new-docs/zh-CN/sql-manual/sql-reference-v2/Show-Statements/SHOW-LOAD-WARNINGS.md
@@ -26,10 +26,38 @@ under the License.
## SHOW-LOAD-WARNINGS
+### Name
+
+SHOW LOAD WARNINGS
+
### Description
+如果导入任务失败且错误信息为 `ETL_QUALITY_UNSATISFIED`，则说明存在导入质量问题,
如果想看到这些有质量问题的导入任务，改语句就是完成这个操作的。
+
+语法：
+
+```sql
+SHOW LOAD WARNINGS
+[FROM db_name]
+[
+ WHERE
+ [LABEL [ = "your_label" ]]
+ [LOAD_JOB_ID = ["job id"]]
+]
+```
+
+1) 如果不指定 db_name，使用当前默认db
+1) 如果使用 LABEL = ，则精确匹配指定的 label
+1) 如果指定了 LOAD_JOB_ID，则精确匹配指定的 JOB ID
+
### Example
+1. 展示指定 db 的导入任务中存在质量问题的数据，指定 label 为 "load_demo_20210112"
+
+ ```sql
+ SHOW LOAD WARNINGS FROM demo WHERE LABEL = "load_demo_20210112"
+ ```
+
### Keywords
SHOW, LOAD, WARNINGS
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
