Re: [PR] [refactor](nereids)use nereids to implement TableQueryPlanAction [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #39627:
URL: https://github.com/apache/doris/pull/39627#issuecomment-2320278741

   
   
   TPC-H: Total hot run time: 38149 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 9eb806f8b2ef96ac7c18fd39b886dffb9636c7fc, 
data reload: false
   
   -- Round 1 --
   q1   17874   448244134413
   q2   2587179 183 179
   q3   11003   1187
   q4   10690   754 823 754
   q5   7833290328672867
   q6   233 145 142 142
   q7   978 623 629 623
   q8   9434208220572057
   q9   7269655265306530
   q10  7006219122682191
   q11  473 244 236 236
   q12  397 227 225 225
   q13  17751   303130393031
   q14  297 232 240 232
   q15  522 477 495 477
   q16  593 502 497 497
   q17  965 689 683 683
   q18  7387681567996799
   q19  1408968 1135968
   q20  677 333 332 332
   q21  3878280131592801
   q22  1104100110301001
   Total cold run time: 110359 ms
   Total hot run time: 38149 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4319429742634263
   q2   376 275 270 270
   q3   2861272226192619
   q4   1966162916641629
   q5   5431539853715371
   q6   225 130 130 130
   q7   2089171217561712
   q8   3213339033103310
   q9   8412847584318431
   q10  3454323332313231
   q11  606 519 508 508
   q12  775 620 596 596
   q13  9400303530663035
   q14  311 279 274 274
   q15  519 473 487 473
   q16  651 565 553 553
   q17  1797152114781478
   q18  7784748473537353
   q19  1661151614931493
   q20  2054181918231819
   q21  5373529952365236
   q22  1108106110011001
   Total cold run time: 64385 ms
   Total hot run time: 54785 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Feat](Job)After a job is paused, it can be manually triggered to execute. [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #39565:
URL: https://github.com/apache/doris/pull/39565#issuecomment-2320278018

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Feat](Job)After a job is paused, it can be manually triggered to execute. [doris]

2024-08-30 Thread via GitHub


CalvinKirs merged PR #39565:
URL: https://github.com/apache/doris/pull/39565


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch master updated: [Feat](Job)After a job is paused, it can be manually triggered to execute. (#39565)

2024-08-30 Thread kirs
This is an automated email from the ASF dual-hosted git repository.

kirs pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


The following commit(s) were added to refs/heads/master by this push:
 new 55de454a0c9 [Feat](Job)After a job is paused, it can be manually 
triggered to execute. (#39565)
55de454a0c9 is described below

commit 55de454a0c9bac16bd01ec7ea2b0a09a0d9b3ec2
Author: Calvin Kirs 
AuthorDate: Fri Aug 30 15:03:24 2024 +0800

[Feat](Job)After a job is paused, it can be manually triggered to execute. 
(#39565)

## Proposed changes
- After a job is paused, it can be manually triggered to execute.
- Update the return fields of the Insert task query to include a new
start time field.
---
 .../org/apache/doris/job/base/AbstractJob.java | 26 +-
 .../doris/job/extensions/insert/InsertTask.java|  8 ++-
 .../apache/doris/job/scheduler/JobScheduler.java   |  5 ++---
 3 files changed, 29 insertions(+), 10 deletions(-)

diff --git 
a/fe/fe-core/src/main/java/org/apache/doris/job/base/AbstractJob.java 
b/fe/fe-core/src/main/java/org/apache/doris/job/base/AbstractJob.java
index 3f595d6daf5..94a0b0146cd 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/job/base/AbstractJob.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/job/base/AbstractJob.java
@@ -212,8 +212,9 @@ public abstract class AbstractJob implements Job commonCreateTasks(TaskType taskType, C taskContext) {
-if (!getJobStatus().equals(JobStatus.RUNNING)) {
-log.warn("job is not running, job id is {}", jobId);
+if (!canCreateTask(taskType)) {
+log.info("job is not ready for scheduling, job id is {},job status 
is {}, taskType is {}", jobId,
+jobStatus, taskType);
 return new ArrayList<>();
 }
 if (!isReadyForScheduling(taskContext)) {
@@ -235,6 +236,19 @@ public abstract class AbstractJob implements Job tasks, TaskType taskType) {
 tasks.forEach(task -> {
 task.setTaskType(taskType);
@@ -307,7 +321,7 @@ public abstract class AbstractJob implements Job implements Job, C> 
implements Closeable {
 clearEndJob(job);
 continue;
 }
-if (!job.getJobStatus().equals(JobStatus.RUNNING) && 
!job.getJobConfig().checkIsTimerJob()) {
-continue;
+if (job.getJobStatus().equals(JobStatus.RUNNING) && 
job.getJobConfig().checkIsTimerJob()) {
+cycleTimerJobScheduler(job, lastTimeWindowMs);
 }
-cycleTimerJobScheduler(job, lastTimeWindowMs);
 }
 }
 


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Feat](nereids) add max/min filter push down rewrite rule [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #39252:
URL: https://github.com/apache/doris/pull/39252#issuecomment-2320280623

   
   
   TPC-DS: Total hot run time: 193316 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit fb3d16864ddca5f6c85a559822631e15ea2442e9, 
data reload: false
   
   query1   1237899 851 851
   query2   6287192818991899
   query3   10604   396238183818
   query4   59519   24290   23217   23217
   query5   5286511 503 503
   query6   399 161 161 161
   query7   5764300 299 299
   query8   294 216 229 216
   query9   8862247424872474
   query10  488 284 261 261
   query11  18507   15241   15222   15222
   query12  166 111 110 110
   query13  1584391 385 385
   query14  10148   757174757475
   query15  263 177 179 177
   query16  7107519 488 488
   query17  1106573 588 573
   query18  1848328 313 313
   query19  299 155 157 155
   query20  119 119 113 113
   query21  220 116 107 107
   query22  4497440244374402
   query23  34384   33379   33496   33379
   query24  6046288228692869
   query25  547 399 402 399
   query26  691 161 160 160
   query27  1777286 286 286
   query28  4032211620922092
   query29  673 419 423 419
   query30  233 160 218 160
   query31  924 755 753 753
   query32  88  54  57  54
   query33  439 281 279 279
   query34  849 495 498 495
   query35  814 703 723 703
   query36  1053958 900 900
   query37  144 94  93  93
   query38  4007381839993818
   query39  1443140013771377
   query40  196 120 118 118
   query41  47  46  44  44
   query42  120 96  108 96
   query43  498 462 474 462
   query44  1083745 762 745
   query45  193 163 161 161
   query46  1087746 719 719
   query47  1863178318101783
   query48  375 287 297 287
   query49  755 426 449 426
   query50  829 410 426 410
   query51  7138699570026995
   query52  100 87  87  87
   query53  252 181 179 179
   query54  562 445 445 445
   query55  81  77  78  77
   query56  282 247 250 247
   query57  1204108510611061
   query58  218 234 221 221
   query59  3080281527512751
   query60  288 278 265 265
   query61  101 101 101 101
   query62  756 654 645 645
   query63  211 187 189 187
   query64  2834677 709 677
   query65  3212313531533135
   query66  690 338 340 338
   query67  15481   15187   15317   15187
   query68  3240577 565 565
   query69  403 283 280 280
   query70  1131114511321132
   query71  370 278 280 278
   query72  6343406440734064
   query73  750 330 332 330
   query74  9284898988948894
   query75  3363268827362688
   query76  14901004984 984
   query77  503 314 314 314
   query78  968610007   92179217
   query79  1070533 525 525
   query80  778 515 566 515
   query81  559 240 234 234
   query82  256 138 151 138
   query83  171 151 149 149
   query84  271 79  75  75
   query85  743 285 286 285
   query86  321 288 297 288
   query87  4547426242764262
   query88  3257232723262326
   query89  397 303 286 286
   query90  1859203 195 195
   query91  124 97  106 97
   query92  67  55  54  54
   query93  1058520 530 520
   query94  765 311 296 296
   query95  356 261 267 261
   query96  588 271 272 271
   query97  3188306430793064
   query98  214 207 203 203
   query99  1660122212631222
   Total cold run time: 305096 ms
   Total hot run time: 193316 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to 

Re: [PR] [test](perf) test using assert cast in release mode [doris]

2024-08-30 Thread via GitHub


yiguolei closed pull request #37970: [test](perf) test using assert cast in 
release mode
URL: https://github.com/apache/doris/pull/37970


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](ut) Fix ThreadMemTrackerMgrTest TEST_F [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40175:
URL: https://github.com/apache/doris/pull/40175#issuecomment-2320282146

   
   
   ClickBench: Total hot run time: 31.72 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 2309ae6782c06ebae5fb4dd76a6aa2b40edfbdaa, 
data reload: false
   
   query1   0.040.040.04
   query2   0.080.040.04
   query3   0.220.050.05
   query4   1.680.080.08
   query5   0.520.480.48
   query6   1.140.730.72
   query7   0.020.020.01
   query8   0.050.040.05
   query9   0.540.480.49
   query10  0.550.550.57
   query11  0.160.110.12
   query12  0.140.120.12
   query13  0.600.590.58
   query14  2.122.062.12
   query15  0.890.830.82
   query16  0.380.370.37
   query17  0.981.041.01
   query18  0.220.210.21
   query19  1.831.731.78
   query20  0.010.010.01
   query21  15.40   0.680.67
   query22  3.978.541.57
   query23  18.26   1.371.33
   query24  2.150.220.21
   query25  0.160.080.08
   query26  0.270.180.17
   query27  0.080.080.08
   query28  13.26   1.021.00
   query29  12.63   3.313.32
   query30  0.250.060.05
   query31  2.860.390.39
   query32  3.280.480.47
   query33  2.953.012.97
   query34  16.98   4.394.40
   query35  4.484.444.48
   query36  0.650.460.50
   query37  0.190.160.16
   query38  0.150.150.15
   query39  0.050.040.04
   query40  0.160.130.13
   query41  0.100.050.05
   query42  0.050.050.05
   query43  0.040.040.04
   Total cold run time: 110.54 s
   Total hot run time: 31.72 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](s3) s3 load provider should be case insensitive [doris]

2024-08-30 Thread via GitHub


kaijchen commented on code in PR #39957:
URL: https://github.com/apache/doris/pull/39957#discussion_r1738060772


##
be/src/util/s3_util.cpp:
##
@@ -370,7 +370,7 @@ Status S3ClientFactory::convert_properties_to_s3_conf(
 }
 }
 if (auto it = properties.find(S3_PROVIDER); it != properties.end()) {
-if (0 == strcmp(it->second.c_str(), AZURE_PROVIDER_STRING)) {
+if (0 == strcasecmp(it->second.c_str(), AZURE_PROVIDER_STRING)) {

Review Comment:
   ```suggestion
   // S3 Provider properties should be case insensitive.
   if (0 == strcasecmp(it->second.c_str(), AZURE_PROVIDER_STRING)) {
   ```



##
fe/fe-core/src/main/java/org/apache/doris/analysis/StageProperties.java:
##
@@ -135,7 +135,7 @@ private void analyzeStorageProperties() throws 
AnalysisException {
 }
 properties.put(PREFIX, prefix);
 // analyze provider
-String provider = properties.get(PROVIDER);
+String provider = properties.get(PROVIDER).toUpperCase();

Review Comment:
   ```suggestion
   // S3 Provider properties should be case insensitive.
   String provider = properties.get(PROVIDER).toUpperCase();
   ```



##
fe/fe-core/src/main/java/org/apache/doris/analysis/LoadStmt.java:
##
@@ -527,7 +527,7 @@ private String getProviderFromEndpoint() {
 Map properties = brokerDesc.getProperties();
 for (Map.Entry entry : properties.entrySet()) {
 if (entry.getKey().equalsIgnoreCase(S3Properties.PROVIDER)) {
-return entry.getValue();
+return entry.getValue().toUpperCase();

Review Comment:
   ```suggestion
   // S3 Provider properties should be case insensitive.
   return entry.getValue().toUpperCase();
   ```



##
fe/fe-core/src/main/java/org/apache/doris/analysis/CopyStmt.java:
##
@@ -205,7 +205,7 @@ private void analyzeStagePB(StagePB stagePB) throws 
AnalysisException {
 }
 brokerProperties.put(S3_BUCKET, objInfo.getBucket());
 brokerProperties.put(S3_PREFIX, objInfo.getPrefix());
-brokerProperties.put(S3Properties.PROVIDER, 
objInfo.getProvider().toString());
+brokerProperties.put(S3Properties.PROVIDER, 
objInfo.getProvider().toString().toUpperCase());

Review Comment:
   ```suggestion
   // S3 Provider properties should be case insensitive.
   brokerProperties.put(S3Properties.PROVIDER, 
objInfo.getProvider().toString().toUpperCase());
   ```



##
fe/fe-core/src/main/java/org/apache/doris/datasource/property/constants/S3Properties.java:
##
@@ -330,7 +330,7 @@ public static Cloud.ObjectStoreInfoPB.Builder 
getObjStoreInfoPB(Map properties = brokerDesc.getProperties();
 for (Map.Entry entry : properties.entrySet()) {
 if (entry.getKey().equalsIgnoreCase(S3Properties.PROVIDER)) {
-return entry.getValue();
+return entry.getValue().toUpperCase();

Review Comment:
   ```suggestion
   // S3 Provider properties should be case insensitive.
   return entry.getValue().toUpperCase();
   ```



##
fe/fe-core/src/main/java/org/apache/doris/datasource/property/constants/S3Properties.java:
##
@@ -197,7 +197,7 @@ public static Map 
requiredS3TVFProperties(Map pr
 private static void checkProvider(Map properties) throws 
DdlException {
 if (properties.containsKey(PROVIDER)) {
 properties.put(PROVIDER, properties.get(PROVIDER).toUpperCase());
-if (!PROVIDERS.stream().anyMatch(s -> 
s.equals(properties.get(PROVIDER {
+if (!PROVIDERS.stream().anyMatch(s -> 
s.equals(properties.get(PROVIDER).toUpperCase( {

Review Comment:
   ```suggestion
   // S3 Provider properties should be case insensitive.
   if (!PROVIDERS.stream().anyMatch(s -> 
s.equals(properties.get(PROVIDER).toUpperCase( {
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](auth)fix case should grant after create view [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40108:
URL: https://github.com/apache/doris/pull/40108#issuecomment-2320286464

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](auth)fix case should grant after create view [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40108:
URL: https://github.com/apache/doris/pull/40108#issuecomment-2320286527

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feat](nereids) adjust stats derive by delta row [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #39222:
URL: https://github.com/apache/doris/pull/39222#issuecomment-2320289527

   
   
   TPC-DS: Total hot run time: 189710 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 43b97a9536caee130bc02b7a228221efd3b03551, 
data reload: false
   
   query1   935 387 375 375
   query2   6460198218701870
   query3   6648210 237 210
   query4   28043   23228   23186   23186
   query5   4174523 512 512
   query6   248 169 172 169
   query7   4580307 298 298
   query8   261 211 221 211
   query9   8582247624702470
   query10  441 283 278 278
   query11  16363   15092   14973   14973
   query12  152 101 98  98
   query13  1632382 378 378
   query14  10287   756473877387
   query15  304 173 179 173
   query16  7987460 481 460
   query17  1603595 573 573
   query18  1967300 294 294
   query19  227 158 155 155
   query20  120 114 111 111
   query21  219 109 108 108
   query22  4548410641294106
   query23  34220   34581   33619   33619
   query24  11254   303729272927
   query25  570 410 417 410
   query26  1090170 166 166
   query27  2782288 287 287
   query28  7467211620952095
   query29  651 442 431 431
   query30  304 160 158 158
   query31  1001782 820 782
   query32  99  60  63  60
   query33  774 320 304 304
   query34  939 483 512 483
   query35  907 764 756 756
   query36  1069926 958 926
   query37  154 98  93  93
   query38  3996386238833862
   query39  1446140013941394
   query40  283 127 126 126
   query41  50  50  49  49
   query42  122 100 105 100
   query43  525 489 487 487
   query44  1203761 756 756
   query45  206 178 177 177
   query46  1121752 767 752
   query47  1905179618101796
   query48  386 292 303 292
   query49  1178460 455 455
   query50  830 419 430 419
   query51  7208707271027072
   query52  100 91  91  91
   query53  275 198 190 190
   query54  884 471 484 471
   query55  84  80  83  80
   query56  299 278 289 278
   query57  1220109510651065
   query58  264 254 248 248
   query59  3184283928282828
   query60  315 289 287 287
   query61  130 129 131 129
   query62  839 670 650 650
   query63  229 195 197 195
   query64  5271770 741 741
   query65  3245317531933175
   query66  1315356 361 356
   query67  15730   15365   15251   15251
   query68  4836549 567 549
   query69  435 315 289 289
   query70  1158115111431143
   query71  404 288 284 284
   query72  6279401640314016
   query73  793 332 336 332
   query74  9091883090088830
   query75  3482272826982698
   query76  28641099978 978
   query77  529 341 358 341
   query78  10498   958590579057
   query79  3166566 571 566
   query80  1810534 524 524
   query81  593 244 233 233
   query82  709 151 156 151
   query83  271 153 157 153
   query84  274 84  77  77
   query85  1032290 284 284
   query86  329 301 295 295
   query87  4731434343454343
   query88  3776234623182318
   query89  411 298 299 298
   query90  1524203 209 203
   query91  133 110 104 104
   query92  66  58  52  52
   query93  2390561 539 539
   query94  574 298 317 298
   query95  352 274 278 274
   query96  632 268 273 268
   query97  3228311730753075
   query98  235 217 209 209
   query99  1761131712651265
   Total cold run time: 291271 ms
   Total hot run time: 189710 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to 

Re: [PR] [Feat](nereids) add max/min filter push down rewrite rule [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #39252:
URL: https://github.com/apache/doris/pull/39252#issuecomment-2320293224

   
   
   ClickBench: Total hot run time: 31.96 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit fb3d16864ddca5f6c85a559822631e15ea2442e9, 
data reload: false
   
   query1   0.040.040.04
   query2   0.080.040.04
   query3   0.220.050.05
   query4   1.670.080.07
   query5   0.510.490.53
   query6   1.120.730.72
   query7   0.020.020.02
   query8   0.050.040.05
   query9   0.560.470.50
   query10  0.540.560.53
   query11  0.160.120.11
   query12  0.140.120.12
   query13  0.620.590.58
   query14  2.042.042.09
   query15  0.850.820.81
   query16  0.370.380.38
   query17  1.011.021.05
   query18  0.210.210.21
   query19  1.821.871.87
   query20  0.010.010.01
   query21  15.39   0.680.67
   query22  4.107.691.68
   query23  18.33   1.351.40
   query24  2.100.230.24
   query25  0.150.080.09
   query26  0.250.180.17
   query27  0.070.070.07
   query28  13.19   1.021.01
   query29  12.64   3.283.29
   query30  0.240.060.05
   query31  2.870.400.39
   query32  3.270.490.48
   query33  3.013.003.00
   query34  17.21   4.394.40
   query35  4.464.424.47
   query36  0.670.480.49
   query37  0.190.150.15
   query38  0.160.140.14
   query39  0.050.040.04
   query40  0.150.120.13
   query41  0.090.050.05
   query42  0.060.050.05
   query43  0.050.040.04
   Total cold run time: 110.74 s
   Total hot run time: 31.96 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [WIP](Load) Supports synchronizing MySQL data through Cdc [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #35181:
URL: https://github.com/apache/doris/pull/35181#issuecomment-2320296645

    `sh-checker report`
   
   To get the full details, please check in the 
[job]("https://github.com/apache/doris/actions/runs/10628436297";) output.
   
   
   shellcheck errors
   
   ```
   
   'shellcheck ' returned error 1 finding the following syntactical issues:
   
   --
   
   In bin/stop_be.sh line 76:
   pgid=$(eval echo $(ps -o pgid= -p ${pid}))
^--^ SC2046 (warning): Quote this 
to prevent word splitting.
 ^^ SC2086 (info): Double quote to 
prevent globbing and word splitting.
   
   Did you mean: 
   pgid=$(eval echo $(ps -o pgid= -p "${pid}"))
   
   For more information:
 https://www.shellcheck.net/wiki/SC2046 -- Quote this to prevent word 
splitt...
 https://www.shellcheck.net/wiki/SC2086 -- Double quote to prevent globbing 
...
   --
   
   You can address the above issues in one of three ways:
   1. Manually correct the issue in the offending shell script;
   2. Disable specific issues by adding the comment:
 # shellcheck disable=
   above the line that contains the issue, where  is the error code;
   3. Add '-e ' to the SHELLCHECK_OPTS setting in your .yml action file.
   
   
   
   ```
   
   
   
   shfmt errors
   
   ```
   'shfmt ' found no issues.
   
   ```
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](Nereids) handle continuous filter or project in plan [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40176:
URL: https://github.com/apache/doris/pull/40176#issuecomment-2320300688

   
   
   TPC-H: Total hot run time: 38091 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit e5fe1d4e789fad0881e6321e90c2192316cc9d1e, 
data reload: false
   
   -- Round 1 --
   q1   17649   448643174317
   q2   2006183 173 173
   q3   11848   946 1179946
   q4   10528   735 766 735
   q5   7762289628442844
   q6   230 138 141 138
   q7   958 611 605 605
   q8   9313207721072077
   q9   6985653465186518
   q10  6999221623002216
   q11  433 237 237 237
   q12  406 230 237 230
   q13  18151   303630723036
   q14  291 241 229 229
   q15  521 495 491 491
   q16  582 509 514 509
   q17  976 702 670 670
   q18  7308679268236792
   q19  1389109910301030
   q20  685 336 328 328
   q21  3947305029922992
   q22  11341000978 978
   Total cold run time: 110101 ms
   Total hot run time: 38091 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4364430042494249
   q2   383 279 268 268
   q3   2899265025992599
   q4   1941163416551634
   q5   5630568657155686
   q6   235 153 148 148
   q7   2236177418291774
   q8   3294342034033403
   q9   8862888187778777
   q10  3552335034123350
   q11  631 536 537 536
   q12  816 637 648 637
   q13  14026   322332133213
   q14  328 291 278 278
   q15  550 487 496 487
   q16  645 593 599 593
   q17  1854156515891565
   q18  8039773878987738
   q19  1732139015091390
   q20  2130190119071901
   q21  5646543555855435
   q22  1129102210151015
   Total cold run time: 70922 ms
   Total hot run time: 56676 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feat](nereids) adjust stats derive by delta row [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #39222:
URL: https://github.com/apache/doris/pull/39222#issuecomment-2320301523

   
   
   ClickBench: Total hot run time: 31.92 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 43b97a9536caee130bc02b7a228221efd3b03551, 
data reload: false
   
   query1   0.050.040.04
   query2   0.080.040.04
   query3   0.230.050.04
   query4   1.690.080.08
   query5   0.490.490.51
   query6   1.130.720.73
   query7   0.020.020.01
   query8   0.050.040.05
   query9   0.550.490.47
   query10  0.540.550.55
   query11  0.160.120.11
   query12  0.150.120.12
   query13  0.610.590.59
   query14  2.052.032.03
   query15  0.900.830.84
   query16  0.380.360.37
   query17  1.040.991.01
   query18  0.210.200.20
   query19  1.821.741.74
   query20  0.010.010.01
   query21  15.41   0.680.67
   query22  3.817.991.70
   query23  18.24   1.411.39
   query24  2.090.230.21
   query25  0.160.090.09
   query26  0.270.180.17
   query27  0.080.080.08
   query28  13.26   1.041.01
   query29  12.66   3.303.28
   query30  0.240.060.05
   query31  2.870.390.39
   query32  3.270.480.48
   query33  2.973.003.01
   query34  17.27   4.404.46
   query35  4.494.524.45
   query36  0.640.500.49
   query37  0.180.150.15
   query38  0.150.150.15
   query39  0.050.040.04
   query40  0.160.120.13
   query41  0.100.050.05
   query42  0.060.050.05
   query43  0.040.040.04
   Total cold run time: 110.63 s
   Total hot run time: 31.92 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](log) remove some invalid log [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40177:
URL: https://github.com/apache/doris/pull/40177#issuecomment-2320300606

   
   
   TPC-H: Total hot run time: 37860 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 23da3e96c4dfaa2e730092bfed597443cfb7fbda, 
data reload: false
   
   -- Round 1 --
   q1   17633   436042614261
   q2   2015187 176 176
   q3   11679   951 1002951
   q4   10520   736 778 736
   q5   7764288028342834
   q6   226 135 136 135
   q7   964 612 591 591
   q8   9312206720582058
   q9   7196653965366536
   q10  70012223
   q11  441 234 241 234
   q12  398 226 223 223
   q13  18943   304830233023
   q14  284 227 238 227
   q15  530 475 480 475
   q16  602 524 521 521
   q17  981 649 755 649
   q18  7248680067136713
   q19  13891084986 986
   q20  704 327 337 327
   q21  3917300131783001
   q22  1112997 981 981
   Total cold run time: 110859 ms
   Total hot run time: 37860 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4378430042604260
   q2   379 272 279 272
   q3   2901264026242624
   q4   1912161716511617
   q5   5597568156475647
   q6   239 138 140 138
   q7   2237178618271786
   q8   3307338334733383
   q9   8818878488338784
   q10  3538332333923323
   q11  610 533 502 502
   q12  820 642 693 642
   q13  15044   317132033171
   q14  317 294 305 294
   q15  536 497 493 493
   q16  634 563 574 563
   q17  1853152715431527
   q18  8122777978977779
   q19  1770171015041504
   q20  2150188518961885
   q21  5710557255345534
   q22  1129102410561024
   Total cold run time: 72001 ms
   Total hot run time: 56752 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](auth)fix case should grant after create view [doris]

2024-08-30 Thread via GitHub


morningman merged PR #40108:
URL: https://github.com/apache/doris/pull/40108


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch master updated (55de454a0c9 -> f852385ba3a)

2024-08-30 Thread morningman
This is an automated email from the ASF dual-hosted git repository.

morningman pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


from 55de454a0c9 [Feat](Job)After a job is paused, it can be manually 
triggered to execute. (#39565)
 add f852385ba3a [fix](auth)fix case should grant after create view (#40108)

No new revisions were added by this update.

Summary of changes:
 .../suites/external_table_p0/tvf/test_s3_tvf_with_resource.groovy  | 3 +--
 1 file changed, 1 insertion(+), 2 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](s3) s3 load provider should be case insensitive [doris]

2024-08-30 Thread via GitHub


kaijchen commented on code in PR #39957:
URL: https://github.com/apache/doris/pull/39957#discussion_r1738062875


##
fe/fe-core/src/main/java/org/apache/doris/analysis/LoadStmt.java:
##
@@ -527,7 +527,7 @@ private String getProviderFromEndpoint() {
 Map properties = brokerDesc.getProperties();
 for (Map.Entry entry : properties.entrySet()) {
 if (entry.getKey().equalsIgnoreCase(S3Properties.PROVIDER)) {
-return entry.getValue();
+return entry.getValue().toUpperCase();

Review Comment:
   ```suggestion
   // S3 Provider properties should be case insensitive.
   return entry.getValue().toUpperCase();
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [refactor](nereids)use nereids to implement TableQueryPlanAction [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #39627:
URL: https://github.com/apache/doris/pull/39627#issuecomment-2320304293

   
   
   TPC-DS: Total hot run time: 188044 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 9eb806f8b2ef96ac7c18fd39b886dffb9636c7fc, 
data reload: false
   
   query1   909 396 364 364
   query2   6466191819321918
   query3   6642208 234 208
   query4   30937   23196   23176   23176
   query5   4153496 486 486
   query6   252 160 165 160
   query7   4575291 297 291
   query8   247 205 210 205
   query9   8549248024592459
   query10  437 265 269 265
   query11  15841   14974   15076   14974
   query12  147 102 99  99
   query13  1624380 365 365
   query14  9370722369596959
   query15  260 171 169 169
   query16  8069472 451 451
   query17  1576568 556 556
   query18  2113319 281 281
   query19  196 141 137 137
   query20  117 113 108 108
   query21  214 108 105 105
   query22  4371404042524040
   query23  34356   33978   33535   33535
   query24  11630   289728942894
   query25  669 382 404 382
   query26  1756167 160 160
   query27  2904279 280 279
   query28  7596211520852085
   query29  1010406 396 396
   query30  320 163 153 153
   query31  1009749 739 739
   query32  124 58  66  58
   query33  753 290 282 282
   query34  998 491 483 483
   query35  867 736 730 730
   query36  1105946 936 936
   query37  208 93  87  87
   query38  3915392538523852
   query39  1474141013881388
   query40  275 116 116 116
   query41  50  46  49  46
   query42  115 96  97  96
   query43  514 478 473 473
   query44  1204749 740 740
   query45  199 169 170 169
   query46  1102735 738 735
   query47  1883178317961783
   query48  381 292 294 292
   query49  1166440 448 440
   query50  790 400 408 400
   query51  7236704969076907
   query52  101 85  89  85
   query53  259 184 186 184
   query54  896 455 448 448
   query55  76  78  76  76
   query56  281 251 254 251
   query57  1197109010971090
   query58  240 253 228 228
   query59  2823275226582658
   query60  302 260 265 260
   query61  100 98  108 98
   query62  806 662 669 662
   query63  220 188 183 183
   query64  5198716 645 645
   query65  3261318331783178
   query66  1193332 338 332
   query67  15476   15223   15285   15223
   query68  3572566 566 566
   query69  395 274 281 274
   query70  1157110210561056
   query71  332 276 274 274
   query72  6257408240794079
   query73  748 328 336 328
   query74  9140888089658880
   query75  3387268627822686
   query76  1968971 1000971
   query77  461 326 304 304
   query78  10372   929392949293
   query79  1061529 533 529
   query80  725 506 500 500
   query81  498 234 237 234
   query82  241 145 142 142
   query83  169 153 154 153
   query84  222 83  77  77
   query85  793 288 281 281
   query86  315 306 298 298
   query87  4352440643154315
   query88  3009233423142314
   query89  383 294 285 285
   query90  1884200 200 200
   query91  125 100 164 100
   query92  59  50  53  50
   query93  1045543 534 534
   query94  661 267 298 267
   query95  348 259 256 256
   query96  586 266 265 265
   query97  3179305930333033
   query98  223 206 204 204
   query99  1472128313091283
   Total cold run time: 284242 ms
   Total hot run time: 188044 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to th

Re: [PR] [improve](s3) s3 load provider should be case insensitive [doris]

2024-08-30 Thread via GitHub


kaijchen commented on PR #39957:
URL: https://github.com/apache/doris/pull/39957#issuecomment-2320308112

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [refactor](nereids)use nereids to implement TableQueryPlanAction [doris]

2024-08-30 Thread via GitHub


morrySnow commented on code in PR #39627:
URL: https://github.com/apache/doris/pull/39627#discussion_r1738049286


##
fe/fe-core/src/main/java/org/apache/doris/httpv2/rest/TableQueryPlanAction.java:
##
@@ -163,65 +170,78 @@ public Object query_plan(
  */
 private void handleQuery(ConnectContext context, String requestDb, String 
requestTable, String sql,
 Map result) throws DorisHttpException {
-// use SE to resolve sql
-StmtExecutor stmtExecutor = new StmtExecutor(context, new 
OriginStatement(sql, 0), false);
+List stmts = null;
 try {
-TQueryOptions tQueryOptions = 
context.getSessionVariable().toThrift();
-// Conduct Planner create SingleNodePlan#createPlanFragments
-tQueryOptions.num_nodes = 1;
-// analyze sql
-stmtExecutor.analyze(tQueryOptions);
+stmts = new NereidsParser().parseSQL(sql, 
context.getSessionVariable());
 } catch (Exception e) {
 throw new DorisHttpException(HttpResponseStatus.BAD_REQUEST, 
e.getMessage());
 }
 // the parsed logical statement
-StatementBase query = stmtExecutor.getParsedStmt();
-// only process select semantic
-if (!(query instanceof SelectStmt)) {
+StatementBase query = stmts.get(0);
+if (!(query instanceof LogicalPlanAdapter)) {
 throw new DorisHttpException(HttpResponseStatus.BAD_REQUEST,
 "Select statement needed, but found [" + sql + " ]");
 }
-SelectStmt stmt = (SelectStmt) query;
-// just only process sql like `select * from table where `, 
only support executing scan semantic
-if (stmt.hasAggInfo() || stmt.hasAnalyticInfo()
-|| stmt.hasOrderByClause() || stmt.hasOffset() || 
stmt.hasLimit() || stmt.isExplain()) {
+LogicalPlan parsedPlan = ((LogicalPlanAdapter) query).getLogicalPlan();
+// only process select semantic
+if (parsedPlan instanceof Command) {
 throw new DorisHttpException(HttpResponseStatus.BAD_REQUEST,
-"only support single table filter-prune-scan, but found [ 
" + sql + "]");
+"Select statement needed, but found [" + sql + " ]");
 }
-// process only one table by one http query
-List fromTables = stmt.getTableRefs();
-if (fromTables.size() != 1) {
+
+if 
(!parsedPlan.collectToList(LogicalSubQueryAlias.class::isInstance).isEmpty()) {
 throw new DorisHttpException(HttpResponseStatus.BAD_REQUEST,
-"Select statement must have only one table");
+"Select statement must not embed another statement");
 }
 
-TableRef fromTable = fromTables.get(0);
-if (fromTable instanceof InlineViewRef) {
+List unboundRelations = 
parsedPlan.collectToList(UnboundRelation.class::isInstance);
+if (unboundRelations.size() != 1) {
 throw new DorisHttpException(HttpResponseStatus.BAD_REQUEST,
-"Select statement must not embed another statement");
+"Select statement must have only one table");
 }
+
 // check consistent http requested resource with sql referenced
 // if consistent in this way, can avoid check privilege
-TableName tableAndDb = fromTables.get(0).getName();
-int lower = GlobalVariable.lowerCaseTableNames;
-//Determine whether table names are case-sensitive
-if (lower == 0) {
-if (!(tableAndDb.getDb().equals(requestDb) && 
tableAndDb.getTbl().equals(requestTable))) {
+List tableQualifier = RelationUtil.getQualifierName(context,
+unboundRelations.get(0).getNameParts());
+if (tableQualifier.size() != 3) {
+throw new DorisHttpException(HttpResponseStatus.BAD_REQUEST,
+"can't find table " + String.join(",", tableQualifier));
+}
+String dbName = tableQualifier.get(1);
+String tableName = tableQualifier.get(2);
+
+if (GlobalVariable.lowerCaseTableNames == 0) {
+if (!(dbName.equals(requestDb) && tableName.equals(requestTable))) 
{
 throw new DorisHttpException(HttpResponseStatus.BAD_REQUEST,
 "requested database and table must consistent with 
sql: request [ "
-+ requestDb + "." + requestTable + "]" + "and 
sql [" + tableAndDb.toString() + "]");
++ requestDb + "." + requestTable + "]" + "and 
sql [" + dbName + "." + tableName + "]");
 }
 } else {
-if (!(tableAndDb.getDb().equalsIgnoreCase(requestDb)
-&& tableAndDb.getTbl().equalsIgnoreCase(requestTable))) {
+if (!(dbName.equalsIgnoreCase(requestDb)
+&& tableName.equalsIgnoreCase(requestTable))) {
 throw

Re: [PR] [refactor](nereids)use nereids to implement TableQueryPlanAction [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #39627:
URL: https://github.com/apache/doris/pull/39627#issuecomment-2320316797

   
   
   ClickBench: Total hot run time: 32.13 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 9eb806f8b2ef96ac7c18fd39b886dffb9636c7fc, 
data reload: false
   
   query1   0.050.040.04
   query2   0.070.040.04
   query3   0.220.050.05
   query4   1.670.070.07
   query5   0.480.480.49
   query6   1.140.740.73
   query7   0.020.010.01
   query8   0.050.040.05
   query9   0.560.490.48
   query10  0.540.540.54
   query11  0.150.110.11
   query12  0.150.120.13
   query13  0.610.590.58
   query14  2.112.122.12
   query15  0.900.820.82
   query16  0.370.380.37
   query17  1.021.040.95
   query18  0.210.200.21
   query19  1.871.811.74
   query20  0.020.010.01
   query21  15.42   0.690.67
   query22  4.017.582.08
   query23  18.23   1.351.26
   query24  2.130.220.21
   query25  0.140.080.08
   query26  0.260.180.18
   query27  0.080.090.08
   query28  13.22   1.021.00
   query29  12.60   3.303.31
   query30  0.240.060.05
   query31  2.890.400.40
   query32  3.250.490.48
   query33  2.973.002.99
   query34  16.89   4.354.41
   query35  4.444.454.46
   query36  0.640.490.47
   query37  0.190.160.15
   query38  0.160.140.15
   query39  0.040.040.04
   query40  0.160.120.13
   query41  0.100.040.04
   query42  0.050.050.05
   query43  0.050.040.04
   Total cold run time: 110.37 s
   Total hot run time: 32.13 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](s3) s3 load provider should be case insensitive [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #39957:
URL: https://github.com/apache/doris/pull/39957#issuecomment-2320321209

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](log) remove some invalid log [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40177:
URL: https://github.com/apache/doris/pull/40177#issuecomment-2320328020

   
   
   TPC-DS: Total hot run time: 192623 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 23da3e96c4dfaa2e730092bfed597443cfb7fbda, 
data reload: false
   
   query1   1246877 851 851
   query2   6310186718541854
   query3   10576   401438873887
   query4   59348   25349   23344   23344
   query5   5386513 500 500
   query6   395 158 172 158
   query7   5772294 299 294
   query8   282 205 207 205
   query9   8745247524602460
   query10  487 268 258 258
   query11  18124   15063   15311   15063
   query12  152 107 102 102
   query13  1585408 394 394
   query14  11311   737975937379
   query15  235 185 174 174
   query16  7658485 465 465
   query17  1120601 584 584
   query18  2128310 325 310
   query19  287 148 146 146
   query20  123 106 108 106
   query21  206 105 107 105
   query22  4529453145374531
   query23  34258   33645   33235   33235
   query24  5867283828292829
   query25  514 378 375 375
   query26  687 155 154 154
   query27  1793282 281 281
   query28  3854209720792079
   query29  693 407 407 407
   query30  235 154 151 151
   query31  919 755 788 755
   query32  81  54  56  54
   query33  500 278 275 275
   query34  860 478 487 478
   query35  814 721 730 721
   query36  1092960 946 946
   query37  150 92  89  89
   query38  3950387238633863
   query39  1451139714091397
   query40  196 115 114 114
   query41  48  47  44  44
   query42  114 94  96  94
   query43  511 469 466 466
   query44  1100745 745 745
   query45  202 164 166 164
   query46  1082794 724 724
   query47  1923180118411801
   query48  374 288 287 287
   query49  750 420 428 420
   query50  812 406 424 406
   query51  7230711770117011
   query52  100 93  88  88
   query53  249 176 183 176
   query54  561 443 460 443
   query55  78  77  79  77
   query56  270 271 289 271
   query57  1207107510771075
   query58  236 237 250 237
   query59  2921273328372733
   query60  303 275 280 275
   query61  124 122 124 122
   query62  753 651 652 651
   query63  215 186 199 186
   query64  2933760 661 661
   query65  3217313831423138
   query66  630 369 355 355
   query67  15353   15155   15075   15075
   query68  2969567 567 567
   query69  404 276 276 276
   query70  1197110210161016
   query71  333 278 275 275
   query72  6079406338793879
   query73  750 326 337 326
   query74  9055884688348834
   query75  3373266127182661
   query76  1484981 1005981
   query77  501 324 320 320
   query78  9579911891069106
   query79  1011546 527 527
   query80  682 493 495 493
   query81  472 235 228 228
   query82  258 146 142 142
   query83  172 149 151 149
   query84  260 78  76  76
   query85  745 287 279 279
   query86  299 310 306 306
   query87  4520433742514251
   query88  3107232123082308
   query89  378 280 297 280
   query90  2082196 196 196
   query91  122 96  97  96
   query92  61  50  52  50
   query93  1047530 530 530
   query94  704 288 298 288
   query95  335 262 253 253
   query96  591 268 270 268
   query97  3199309531123095
   query98  214 205 199 199
   query99  1480127012981270
   Total cold run time: 304678 ms
   Total hot run time: 192623 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to 

Re: [PR] [enhancement](memory) add exception logic in write page and schema scanner [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40168:
URL: https://github.com/apache/doris/pull/40168#issuecomment-2320328091

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhancement](memory) add exception logic in write page and schema scanner [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40168:
URL: https://github.com/apache/doris/pull/40168#issuecomment-2320328174

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [chore](cancel) Make enable_pipeline_task_leakage_detect false by default [doris]

2024-08-30 Thread via GitHub


zhiqiang- commented on PR #40145:
URL: https://github.com/apache/doris/pull/40145#issuecomment-2320326651

   > 记得提文档pr啊大佬
   
   ok


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature](metacache) add system table catalog_meta_cache_statistics [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40155:
URL: https://github.com/apache/doris/pull/40155#issuecomment-2320340046

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](log) remove some invalid log [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40177:
URL: https://github.com/apache/doris/pull/40177#issuecomment-2320341241

   
   
   ClickBench: Total hot run time: 31.93 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 23da3e96c4dfaa2e730092bfed597443cfb7fbda, 
data reload: false
   
   query1   0.050.040.04
   query2   0.070.030.04
   query3   0.230.050.05
   query4   1.680.110.10
   query5   0.500.500.50
   query6   1.140.740.73
   query7   0.010.010.01
   query8   0.050.050.05
   query9   0.550.500.48
   query10  0.550.540.55
   query11  0.160.110.12
   query12  0.160.120.12
   query13  0.610.590.58
   query14  2.042.032.08
   query15  0.900.820.82
   query16  0.380.380.37
   query17  1.051.051.03
   query18  0.220.210.21
   query19  1.961.881.87
   query20  0.020.010.01
   query21  15.40   0.680.68
   query22  4.687.341.74
   query23  18.29   1.361.28
   query24  2.070.230.21
   query25  0.150.090.08
   query26  0.260.170.17
   query27  0.080.070.08
   query28  13.21   1.021.01
   query29  12.64   3.293.27
   query30  0.240.050.06
   query31  2.870.390.39
   query32  3.270.480.48
   query33  3.002.963.00
   query34  17.18   4.334.42
   query35  4.484.464.45
   query36  0.670.480.49
   query37  0.190.150.17
   query38  0.160.150.15
   query39  0.050.040.04
   query40  0.160.130.12
   query41  0.090.050.05
   query42  0.050.050.05
   query43  0.050.050.04
   Total cold run time: 111.57 s
   Total hot run time: 31.93 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature](Nereids) support qualify stmt [doris]

2024-08-30 Thread via GitHub


morrySnow commented on code in PR #40048:
URL: https://github.com/apache/doris/pull/40048#discussion_r1738100475


##
fe/fe-core/src/main/java/org/apache/doris/nereids/parser/LogicalPlanBuilder.java:
##
@@ -1385,6 +1390,66 @@ public LogicalPlan 
visitRegularQuerySpecification(RegularQuerySpecificationConte
 });
 }
 
+private LogicalPlan withQualifyQuery(LogicalPlan input, 
RegularQuerySpecificationContext ctx) {
+QualifyClauseContext qualifyClauseContext = ctx.qualifyClause();
+if (qualifyClauseContext != null) {
+NamedExpression qualifyExpr = 
visitNamedExpression(qualifyClauseContext.namedExpression());
+Expression filter;
+List excepts = new ArrayList<>();
+if (qualifyExpr instanceof UnboundAlias) {
+Expression cmp = qualifyExpr.child(0);
+if (!(cmp instanceof ComparisonPredicate)) {
+throw new ParseException("only support compare expr");
+}
+cmp = ExpressionRuleExecutor.normalize(cmp);
+Expression left = cmp.child(0);
+if (left instanceof WindowExpression) {
+WindowExpression windowExpression = (WindowExpression) 
left;
+String funName = 
windowExpression.getFunction().getExpressionName();
+switch (funName.toLowerCase()) {
+case "row_number":
+case "rank":
+case "dense_rank":
+break;
+default:
+throw new ParseException("not support window 
function : " + funName);
+}
+excepts.add(new UnboundSlot("_QUALIFY_COLUMN"));
+}
+if (left instanceof UnboundSlot) {
+left = new UnboundSlot(((UnboundSlot) 
left).getNameParts());
+} else {
+left = new UnboundSlot("_QUALIFY_COLUMN");
+}
+Expression right = cmp.child(1);
+if (!(right instanceof IntegerLikeLiteral)) {
+throw new ParseException("qualify expression only support 
constant compare");
+}
+if (cmp instanceof EqualTo) {
+filter = new EqualTo(left, right);
+} else if (cmp instanceof GreaterThan) {
+filter = new GreaterThan(left, right);
+} else if (cmp instanceof GreaterThanEqual) {
+filter = new GreaterThanEqual(left, right);
+} else if (cmp instanceof LessThan) {
+filter = new LessThan(left, right);
+} else if (cmp instanceof LessThanEqual) {
+filter = new LessThanEqual(left, right);
+} else {
+throw new ParseException("not support compare type " + 
cmp.getClass().getSimpleName());
+}
+} else {
+throw new ParseException("not support column type");
+}
+LogicalFilter logicalFilter = new 
LogicalFilter<>(Sets.newHashSet(filter), input);
+List output =
+Lists.newArrayList(new UnboundStar(ImmutableList.of(), 
excepts, ImmutableList.of()));
+LogicalPlan plan = withQueryOrganization(logicalFilter, 
ctx.queryOrganization());
+return new LogicalProject<>(output, plan);
+}
+return withQueryOrganization(input, ctx.queryOrganization());

Review Comment:
   do not put withQueryOrganization into withQualify



##
fe/fe-core/src/main/java/org/apache/doris/nereids/parser/LogicalPlanBuilder.java:
##
@@ -1370,8 +1374,9 @@ public LogicalPlan 
visitRegularQuerySpecification(RegularQuerySpecificationConte
 selectCtx,
 Optional.ofNullable(ctx.whereClause()),
 Optional.ofNullable(ctx.aggClause()),
-Optional.ofNullable(ctx.havingClause()));
-selectPlan = withQueryOrganization(selectPlan, 
ctx.queryOrganization());
+Optional.ofNullable(ctx.havingClause()),
+Optional.ofNullable(ctx.qualifyClause()));
+selectPlan = withQualifyQuery(selectPlan, ctx);

Review Comment:
   why pass `qualifyClause` to `withSelectQuerySpecification` but not process 
it?



##
fe/fe-core/src/main/java/org/apache/doris/nereids/parser/LogicalPlanBuilder.java:
##
@@ -1385,6 +1390,66 @@ public LogicalPlan 
visitRegularQuerySpecification(RegularQuerySpecificationConte
 });
 }
 
+private LogicalPlan withQualifyQuery(LogicalPlan input, 
RegularQuerySpecificationContext ctx) {
+QualifyClauseContext qualifyClauseContext = ctx.qualifyClause();
+if (qualifyClauseContext != null) {
+NamedExpression qualifyExpr = 
visitNamedExpres

Re: [PR] [improve](s3) s3 load provider should be case insensitive [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #39957:
URL: https://github.com/apache/doris/pull/39957#issuecomment-2320351052

   
   
   TPC-H: Total hot run time: 38291 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit beca182f55f9d39ec16004e429a91a37bb60275b, 
data reload: false
   
   -- Round 1 --
   q1   17609   437643554355
   q2   2019177 170 170
   q3   10488   110411431104
   q4   10135   760 680 680
   q5   7720285728352835
   q6   229 140 138 138
   q7   970 607 628 607
   q8   9346206820492049
   q9   7003655365346534
   q10  6994221022042204
   q11  434 244 249 244
   q12  398 222 218 218
   q13  18776   298830812988
   q14  274 232 238 232
   q15  526 486 491 486
   q16  565 507 508 507
   q17  971 736 693 693
   q18  7457692968976897
   q19  1395100810211008
   q20  698 340 333 333
   q21  4055320230003000
   q22  1109100910141009
   Total cold run time: 109171 ms
   Total hot run time: 38291 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4373432243004300
   q2   373 277 282 277
   q3   2865266826542654
   q4   1903167817351678
   q5   5442560356885603
   q6   229 133 138 133
   q7   2249183517931793
   q8   3304348034023402
   q9   8743879389628793
   q10  3617331933353319
   q11  608 507 516 507
   q12  834 624 639 624
   q13  16911   323931983198
   q14  318 291 276 276
   q15  549 494 502 494
   q16  623 596 564 564
   q17  1818153115341531
   q18  8159753674697469
   q19  1693156715981567
   q20  2081183518091809
   q21  5492515851275127
   q22  1121103010371030
   Total cold run time: 73305 ms
   Total hot run time: 56148 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](catalog) support using loading cache for db/table list in external catalog [doris]

2024-08-30 Thread via GitHub


zhangm365 commented on PR #33610:
URL: https://github.com/apache/doris/pull/33610#issuecomment-2320352624

   > `id->name`? why do I notice the code in 
`fe/fe-core/src/main/java/org/apache/doris/common/util/Util.java`:
   > 
   > ```java
   > public static long genIdByName(String... names) {
   > return Math.abs(sha256long(String.join(".", names)));
   > }
   > ```
   > 
   > So, Is it the corresponding relationship `name->id`? Or, when does the 
mean `id->name` in this case? @morningman
   
   The `name` is a combination of catalog and database. Then, the ID is 
generated by the name.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)Optimize the speed of obtaining the last update time of Hive [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40169:
URL: https://github.com/apache/doris/pull/40169#issuecomment-2320362249

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)Optimize the speed of obtaining the last update time of Hive [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40169:
URL: https://github.com/apache/doris/pull/40169#issuecomment-2320362172

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [branch-2.1][Feat](Job)After a job is paused, it can be manually triggered to execute. [doris]

2024-08-30 Thread via GitHub


CalvinKirs opened a new pull request, #40180:
URL: https://github.com/apache/doris/pull/40180

   …
   
   pick (#39565)
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [branch-2.1][Feat](Job)After a job is paused, it can be manually triggered to execute. [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40180:
URL: https://github.com/apache/doris/pull/40180#issuecomment-2320372500

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [branch-2.1][Feat](Job)After a job is paused, it can be manually triggered to execute. [doris]

2024-08-30 Thread via GitHub


CalvinKirs commented on PR #40180:
URL: https://github.com/apache/doris/pull/40180#issuecomment-2320374104

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](nereids)build agg for random distributed agg table in bindRelation phase [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40181:
URL: https://github.com/apache/doris/pull/40181#issuecomment-2320375077

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](nereids)build agg for random distributed agg table in bindRelation phase [doris]

2024-08-30 Thread via GitHub


starocean999 commented on PR #40181:
URL: https://github.com/apache/doris/pull/40181#issuecomment-2320375194

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [fix](nereids)build agg for random distributed agg table in bindRelation phase [doris]

2024-08-30 Thread via GitHub


starocean999 opened a new pull request, #40181:
URL: https://github.com/apache/doris/pull/40181

   it's better to build agg for random distributed agg table in bindRelation 
phase instead of in BuildAggForRandomDistributedTable RULE
   
   ## Proposed changes
   
   Issue Number: close #xxx
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](s3) s3 load provider should be case insensitive [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #39957:
URL: https://github.com/apache/doris/pull/39957#issuecomment-2320379887

   
   
   TPC-DS: Total hot run time: 187934 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit beca182f55f9d39ec16004e429a91a37bb60275b, 
data reload: false
   
   query1   775 373 360 360
   query2   6360194818391839
   query3   6422209 237 209
   query4   33113   23311   23310   23310
   query5   3997504 498 498
   query6   244 165 159 159
   query7   4430310 285 285
   query8   248 203 206 203
   query9   8515248024782478
   query10  449 258 263 258
   query11  16831   15068   15117   15068
   query12  145 101 99  99
   query13  1582361 375 361
   query14  9650676272856762
   query15  247 171 176 171
   query16  7855484 486 484
   query17  1478551 550 550
   query18  2106295 296 295
   query19  218 160 156 156
   query20  140 113 112 112
   query21  215 105 103 103
   query22  4437424843054248
   query23  34193   33420   33601   33420
   query24  7818289028682868
   query25  630 398 374 374
   query26  1351156 184 156
   query27  2670277 278 277
   query28  6937211620982098
   query29  851 414 401 401
   query30  308 157 150 150
   query31  935 818 770 770
   query32  94  61  60  60
   query33  597 294 283 283
   query34  877 485 484 484
   query35  869 728 721 721
   query36  1067928 951 928
   query37  161 96  90  90
   query38  4004389838873887
   query39  1439140014031400
   query40  231 119 118 118
   query41  48  45  44  44
   query42  111 97  100 97
   query43  504 457 470 457
   query44  1221757 765 757
   query45  195 169 163 163
   query46  1092723 720 720
   query47  1892179717981797
   query48  370 289 294 289
   query49  1013415 422 415
   query50  836 402 412 402
   query51  7189703769666966
   query52  99  86  86  86
   query53  257 185 183 183
   query54  598 443 440 440
   query55  79  75  75  75
   query56  276 256 261 256
   query57  1174106710651065
   query58  252 226 223 223
   query59  2912268027022680
   query60  290 283 276 276
   query61  119 121 149 121
   query62  810 653 631 631
   query63  215 189 184 184
   query64  4217672 668 668
   query65  3219317631633163
   query66  768 343 348 343
   query67  15989   15374   15197   15197
   query68  3176574 578 574
   query69  398 283 283 283
   query70  1096106811311068
   query71  341 288 274 274
   query72  6515399740403997
   query73  752 334 335 334
   query74  9062873989438739
   query75  3390263126462631
   query76  1472999 955 955
   query77  511 336 333 333
   query78  9640973991819181
   query79  1051523 531 523
   query80  746 502 497 497
   query81  559 234 239 234
   query82  252 146 153 146
   query83  227 154 155 154
   query84  238 79  75  75
   query85  900 293 332 293
   query86  310 294 291 291
   query87  4485437943334333
   query88  3221231523352315
   query89  374 294 285 285
   query90  1794195 197 195
   query91  125 100 105 100
   query92  62  55  54  54
   query93  1044535 523 523
   query94  734 322 299 299
   query95  359 255 260 255
   query96  592 268 272 268
   query97  3228309730673067
   query98  218 210 216 210
   query99  1660130112571257
   Total cold run time: 278766 ms
   Total hot run time: 187934 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to t

[PR] Dev spark load [doris]

2024-08-30 Thread via GitHub


gnehil opened a new pull request, #40182:
URL: https://github.com/apache/doris/pull/40182

   ## Proposed changes
   
   Issue Number: close #xxx
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] Dev spark load [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40182:
URL: https://github.com/apache/doris/pull/40182#issuecomment-2320388447

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](s3) s3 load provider should be case insensitive [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #39957:
URL: https://github.com/apache/doris/pull/39957#issuecomment-2320392916

   
   
   ClickBench: Total hot run time: 32.7 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit beca182f55f9d39ec16004e429a91a37bb60275b, 
data reload: false
   
   query1   0.040.040.04
   query2   0.080.040.04
   query3   0.230.050.05
   query4   1.670.080.08
   query5   0.510.510.50
   query6   1.120.730.73
   query7   0.020.010.02
   query8   0.040.040.04
   query9   0.550.490.48
   query10  0.530.540.54
   query11  0.160.120.11
   query12  0.150.120.12
   query13  0.600.580.58
   query14  2.132.062.12
   query15  0.880.820.83
   query16  0.360.380.37
   query17  1.091.131.08
   query18  0.220.200.20
   query19  2.011.891.89
   query20  0.020.010.01
   query21  15.40   0.680.68
   query22  4.366.062.48
   query23  18.26   1.411.28
   query24  2.080.220.22
   query25  0.160.080.07
   query26  0.270.180.17
   query27  0.080.080.08
   query28  13.30   1.010.99
   query29  12.66   3.273.27
   query30  0.240.060.05
   query31  2.930.400.40
   query32  3.260.460.47
   query33  2.972.953.06
   query34  16.99   4.414.38
   query35  4.404.434.42
   query36  0.660.480.48
   query37  0.190.150.15
   query38  0.150.150.15
   query39  0.060.030.04
   query40  0.160.120.13
   query41  0.100.040.05
   query42  0.070.050.04
   query43  0.050.040.04
   Total cold run time: 111.21 s
   Total hot run time: 32.7 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [fix](decompressor) consider the large_block_len is 0 [doris]

2024-08-30 Thread via GitHub


suxiaogang223 opened a new pull request, #40183:
URL: https://github.com/apache/doris/pull/40183

   ## Proposed changes
   
   If the large_block_len is 0, should not continue reading the block_len.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](decompressor) consider the large_block_len is 0 [doris]

2024-08-30 Thread via GitHub


suxiaogang223 commented on PR #40183:
URL: https://github.com/apache/doris/pull/40183#issuecomment-2320393454

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](decompressor) consider the large_block_len is 0 [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40183:
URL: https://github.com/apache/doris/pull/40183#issuecomment-2320393344

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] Dev spark load [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40182:
URL: https://github.com/apache/doris/pull/40182#issuecomment-2320403071

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](decompressor) consider the large_block_len is 0 [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40183:
URL: https://github.com/apache/doris/pull/40183#issuecomment-2320408419

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [chore](regression test) mv test_report_version_missing to p1 [doris]

2024-08-30 Thread via GitHub


yujun777 opened a new pull request, #40184:
URL: https://github.com/apache/doris/pull/40184

   (no comment)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [chore](regression test) mv test_report_version_missing to p1 [doris]

2024-08-30 Thread via GitHub


yujun777 commented on PR #40184:
URL: https://github.com/apache/doris/pull/40184#issuecomment-2320422444

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [chore](regression test) mv test_report_version_missing to p1 [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40184:
URL: https://github.com/apache/doris/pull/40184#issuecomment-2320422308

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [refactor](profile report ) Remove old profile reporting. [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40185:
URL: https://github.com/apache/doris/pull/40185#issuecomment-2320425957

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [chore](regression test) mv test_report_version_missing to p1 [doris]

2024-08-30 Thread via GitHub


yujun777 commented on PR #40184:
URL: https://github.com/apache/doris/pull/40184#issuecomment-2320426013

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [refactor](profile report ) Remove old profile reporting. [doris]

2024-08-30 Thread via GitHub


zhiqiang- opened a new pull request, #40185:
URL: https://github.com/apache/doris/pull/40185

   (no comment)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [chore](regression test) mv test_report_version_missing to p1 [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40184:
URL: https://github.com/apache/doris/pull/40184#issuecomment-2320427641

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [refactor](profile report ) Remove old profile reporting. [doris]

2024-08-30 Thread via GitHub


zhiqiang- commented on PR #40185:
URL: https://github.com/apache/doris/pull/40185#issuecomment-2320429158

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](decompressor) consider the large_block_len is 0 [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40183:
URL: https://github.com/apache/doris/pull/40183#issuecomment-2320443705

   
   
   TPC-H: Total hot run time: 38168 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 3407a799e63c38d32d2d803e9a2b4faaba1a17e1, 
data reload: false
   
   -- Round 1 --
   q1   18171   451143734373
   q2   2593180 190 180
   q3   11038   112910391039
   q4   10459   727 737 727
   q5   8170291028402840
   q6   236 141 141 141
   q7   962 627 627 627
   q8   9739205920362036
   q9   7093655865636558
   q10  7017216722372167
   q11  444 233 245 233
   q12  397 232 223 223
   q13  17811   304630383038
   q14  271 231 242 231
   q15  528 484 497 484
   q16  593 530 508 508
   q17  979 701 617 617
   q18  7319680269016802
   q19  1391113411381134
   q20  683 338 332 332
   q21  3925316028942894
   q22  11051025984 984
   Total cold run time: 110924 ms
   Total hot run time: 38168 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4376431642904290
   q2   390 272 278 272
   q3   2888268226182618
   q4   1910165816551655
   q5   5399538553745374
   q6   217 129 127 127
   q7   2080175217071707
   q8   3218339033463346
   q9   8384844683948394
   q10  3473321631783178
   q11  602 505 493 493
   q12  788 628 627 627
   q13  10393   303130203020
   q14  298 279 281 279
   q15  522 499 474 474
   q16  591 551 581 551
   q17  1771148714831483
   q18  7705747174697469
   q19  1676158916321589
   q20  2069178218291782
   q21  5469535652045204
   q22  1141100810301008
   Total cold run time: 65360 ms
   Total hot run time: 54940 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [refactor](profile report ) Remove old profile reporting. [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40185:
URL: https://github.com/apache/doris/pull/40185#issuecomment-2320443765

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](migrate) move mc cases from p2 to p0 [doris]

2024-08-30 Thread via GitHub


wsjz commented on PR #39706:
URL: https://github.com/apache/doris/pull/39706#issuecomment-2320449906

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](ut) Fix TestParseMemSpec UT [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40186:
URL: https://github.com/apache/doris/pull/40186#issuecomment-2320455976

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](ut) Fix TestParseMemSpec UT [doris]

2024-08-30 Thread via GitHub


xinyiZzz commented on PR #40186:
URL: https://github.com/apache/doris/pull/40186#issuecomment-2320456008

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [fix](ut) Fix TestParseMemSpec UT [doris]

2024-08-30 Thread via GitHub


xinyiZzz opened a new pull request, #40186:
URL: https://github.com/apache/doris/pull/40186

   (no comment)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](ut) Fix TestParseMemSpec UT [doris]

2024-08-30 Thread via GitHub


xinyiZzz commented on PR #40186:
URL: https://github.com/apache/doris/pull/40186#issuecomment-2320457810

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](nereids)build agg for random distributed agg table in bindRelation phase [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40181:
URL: https://github.com/apache/doris/pull/40181#issuecomment-2320467287

   
   
   TPC-H: Total hot run time: 37640 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 6db47b5f0b3ee2a63b895c41a653dc138b284080, 
data reload: false
   
   -- Round 1 --
   q1   17628   435642934293
   q2   2032186 175 175
   q3   11919   946 1107946
   q4   10527   765 680 680
   q5   7759282328022802
   q6   222 138 137 137
   q7   962 614 598 598
   q8   9337206020532053
   q9   7183652966096529
   q10  6991218621992186
   q11  463 239 241 239
   q12  389 224 225 224
   q13  17760   296930302969
   q14  268 245 236 236
   q15  530 476 488 476
   q16  564 510 489 489
   q17  979 660 701 660
   q18  7265684367796779
   q19  1387115010321032
   q20  714 347 326 326
   q21  3935301528072807
   q22  1103101310041004
   Total cold run time: 109917 ms
   Total hot run time: 37640 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4376431242854285
   q2   392 278 275 275
   q3   2848263926202620
   q4   1926163516641635
   q5   5581566656515651
   q6   240 132 143 132
   q7   2198178118251781
   q8   3304340033993399
   q9   8826885688308830
   q10  3583337433753374
   q11  610 509 514 509
   q12  816 642 658 642
   q13  14525   315832033158
   q14  323 300 279 279
   q15  545 496 497 496
   q16  630 582 600 582
   q17  1848151715241517
   q18  7959761778817617
   q19  1700165316021602
   q20  2184191219131912
   q21  5792554954795479
   q22  1119102910251025
   Total cold run time: 71325 ms
   Total hot run time: 56800 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [fix](cloud-schema-change) Exclude merged dropped columns from projection columns [doris]

2024-08-30 Thread via GitHub


TangSiyang2001 opened a new pull request, #40187:
URL: https://github.com/apache/doris/pull/40187

   
   ## Proposed changes
   
   schema change in cloud mode used to merge dropped columns from delete 
predicates to projection columns when reading data from base tablet, resulted 
in failure when reading rowsets after columns dropped.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](cloud-schema-change) Exclude merged dropped columns from projection columns [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40187:
URL: https://github.com/apache/doris/pull/40187#issuecomment-2320469980

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](decompressor) consider the large_block_len is 0 [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40183:
URL: https://github.com/apache/doris/pull/40183#issuecomment-2320472128

   
   
   TPC-DS: Total hot run time: 188306 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 3407a799e63c38d32d2d803e9a2b4faaba1a17e1, 
data reload: false
   
   query1   903 373 365 365
   query2   6455190919221909
   query3   6643209 222 209
   query4   31344   23121   23168   23121
   query5   4192518 495 495
   query6   266 163 174 163
   query7   4584295 284 284
   query8   262 214 211 211
   query9   8483245024612450
   query10  447 263 259 259
   query11  15515   15255   15117   15117
   query12  160 104 97  97
   query13  1617387 371 371
   query14  9817717372187173
   query15  259 167 177 167
   query16  8015469 465 465
   query17  1598576 565 565
   query18  2128301 300 300
   query19  336 151 149 149
   query20  118 115 112 112
   query21  215 105 113 105
   query22  4420421740604060
   query23  34105   33654   33246   33246
   query24  11246   285328492849
   query25  643 414 406 406
   query26  1333164 169 164
   query27  2772286 281 281
   query28  7634210020922092
   query29  868 430 426 426
   query30  308 158 159 158
   query31  976 743 781 743
   query32  97  58  65  58
   query33  769 327 301 301
   query34  913 499 475 475
   query35  863 741 728 728
   query36  1115920 988 920
   query37  172 99  96  96
   query38  4032382838483828
   query39  1458143214141414
   query40  263 122 120 120
   query41  52  48  48  48
   query42  117 99  100 99
   query43  504 457 470 457
   query44  1248760 752 752
   query45  195 171 169 169
   query46  1099735 758 735
   query47  1857177617931776
   query48  382 301 315 301
   query49  1108438 447 438
   query50  817 421 410 410
   query51  7155715470997099
   query52  101 92  91  91
   query53  269 193 191 191
   query54  993 464 467 464
   query55  78  86  88  86
   query56  295 259 267 259
   query57  1199108510411041
   query58  247 231 238 231
   query59  2920286828682868
   query60  307 282 282 282
   query61  129 123 120 120
   query62  824 653 670 653
   query63  228 192 189 189
   query64  5376789 680 680
   query65  3307317131583158
   query66  1432340 334 334
   query67  15638   15186   15156   15156
   query68  4667567 557 557
   query69  475 306 278 278
   query70  1134109210581058
   query71  415 279 282 279
   query72  7391403039873987
   query73  761 332 333 332
   query74  9121889089298890
   query75  3728266526792665
   query76  2997991 987 987
   query77  514 320 333 320
   query78  9900910891189108
   query79  1529522 533 522
   query80  924 497 498 497
   query81  590 235 240 235
   query82  816 147 143 143
   query83  249 153 148 148
   query84  235 74  83  74
   query85  1331290 319 290
   query86  383 302 300 300
   query87  4327425143234251
   query88  3029234423342334
   query89  381 293 296 293
   query90  1837205 201 201
   query91  124 104 97  97
   query92  64  53  52  52
   query93  1164538 530 530
   query94  978 304 311 304
   query95  359 266 265 265
   query96  605 268 269 268
   query97  3152309530453045
   query98  221 210 205 205
   query99  1502126312521252
   Total cold run time: 290124 ms
   Total hot run time: 188306 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to th

Re: [PR] [fix](ut) Fix TestParseMemSpec UT [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40186:
URL: https://github.com/apache/doris/pull/40186#issuecomment-2320472201

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](ut) Fix TestParseMemSpec UT [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40186:
URL: https://github.com/apache/doris/pull/40186#issuecomment-2320474075

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](cloud-schema-change) Exclude merged dropped columns from projection columns [doris]

2024-08-30 Thread via GitHub


TangSiyang2001 commented on PR #40187:
URL: https://github.com/apache/doris/pull/40187#issuecomment-2320472261

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](cloud-schema-change) Exclude merged dropped columns from projection columns [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40187:
URL: https://github.com/apache/doris/pull/40187#issuecomment-2320479086

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [branch-2.1][Feat](Job)After a job is paused, it can be manually triggered to execute. [doris]

2024-08-30 Thread via GitHub


CalvinKirs commented on PR #40180:
URL: https://github.com/apache/doris/pull/40180#issuecomment-2320479726

   run External


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv) SSB mv rewrite test use little data set for test performance [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40188:
URL: https://github.com/apache/doris/pull/40188#issuecomment-2320478383

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](cloud-schema-change) Exclude merged dropped columns from projection columns [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40187:
URL: https://github.com/apache/doris/pull/40187#issuecomment-2320479004

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improvement](tablet report) tablet report increase report version [doris]

2024-08-30 Thread via GitHub


yujun777 commented on PR #40172:
URL: https://github.com/apache/doris/pull/40172#issuecomment-2320484864

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [Bug](expr) execute expr should use local states instead of operators [doris]

2024-08-30 Thread via GitHub


zhangstar333 opened a new pull request, #40189:
URL: https://github.com/apache/doris/pull/40189

   ## Proposed changes
   The expr of operator  cannot be executed concurrently, 
   should use local state's expr.
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](decompressor) consider the large_block_len is 0 [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40183:
URL: https://github.com/apache/doris/pull/40183#issuecomment-2320485452

   
   
   ClickBench: Total hot run time: 32.35 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 3407a799e63c38d32d2d803e9a2b4faaba1a17e1, 
data reload: false
   
   query1   0.040.040.04
   query2   0.070.040.04
   query3   0.230.050.04
   query4   1.670.080.07
   query5   0.490.490.50
   query6   1.130.730.72
   query7   0.010.010.02
   query8   0.050.050.05
   query9   0.550.500.49
   query10  0.550.530.56
   query11  0.160.110.12
   query12  0.140.130.12
   query13  0.620.600.59
   query14  2.022.092.10
   query15  0.900.820.82
   query16  0.370.380.37
   query17  1.051.021.02
   query18  0.210.200.21
   query19  1.881.711.75
   query20  0.010.010.01
   query21  15.40   0.680.67
   query22  4.396.492.16
   query23  18.33   1.421.33
   query24  2.140.220.24
   query25  0.140.070.08
   query26  0.260.180.18
   query27  0.080.070.08
   query28  13.23   1.011.01
   query29  12.61   3.353.30
   query30  0.240.060.05
   query31  2.870.400.38
   query32  3.270.490.47
   query33  2.943.073.02
   query34  16.87   4.414.38
   query35  4.434.444.45
   query36  0.660.480.49
   query37  0.180.160.15
   query38  0.160.150.15
   query39  0.050.040.04
   query40  0.160.120.13
   query41  0.090.050.05
   query42  0.060.050.05
   query43  0.050.040.04
   Total cold run time: 110.76 s
   Total hot run time: 32.35 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](cloud-schema-change) Exclude merged dropped columns from projection columns [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40187:
URL: https://github.com/apache/doris/pull/40187#issuecomment-2320486985

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Bug](expr) execute expr should use local states instead of operators [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40189:
URL: https://github.com/apache/doris/pull/40189#issuecomment-2320483778

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Enhancement](DDL) check illegal partition exprs [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40158:
URL: https://github.com/apache/doris/pull/40158#issuecomment-2320487221

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Enhancement](DDL) check illegal partition exprs [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40158:
URL: https://github.com/apache/doris/pull/40158#issuecomment-2320487299

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](nereids)build agg for random distributed agg table in bindRelation phase [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40181:
URL: https://github.com/apache/doris/pull/40181#issuecomment-2320496475

   
   
   TPC-DS: Total hot run time: 192856 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 6db47b5f0b3ee2a63b895c41a653dc138b284080, 
data reload: false
   
   query1   1257887 870 870
   query2   6305194918891889
   query3   10587   396139313931
   query4   59868   25433   23175   23175
   query5   5429498 489 489
   query6   405 163 175 163
   query7   5796293 294 293
   query8   288 209 200 200
   query9   8899248124632463
   query10  485 266 256 256
   query11  18228   15048   15506   15048
   query12  150 106 105 105
   query13  1536383 375 375
   query14  11154   746373537353
   query15  222 172 178 172
   query16  7521471 432 432
   query17  1229586 554 554
   query18  1846296 288 288
   query19  315 146 145 145
   query20  116 115 114 114
   query21  205 100 107 100
   query22  4957469346934693
   query23  34266   33478   33287   33287
   query24  5911284828252825
   query25  536 374 374 374
   query26  687 157 158 157
   query27  1790282 280 280
   query28  3457211120952095
   query29  717 397 403 397
   query30  238 150 156 150
   query31  944 722 732 722
   query32  89  54  53  53
   query33  416 281 276 276
   query34  860 468 478 468
   query35  868 732 709 709
   query36  1072960 946 946
   query37  150 92  86  86
   query38  3906379838813798
   query39  1441141213901390
   query40  198 116 114 114
   query41  46  46  44  44
   query42  121 95  94  94
   query43  517 472 481 472
   query44  1089748 750 748
   query45  196 164 161 161
   query46  1083759 747 747
   query47  1922179618211796
   query48  381 289 290 289
   query49  782 421 438 421
   query50  810 425 402 402
   query51  7212700370527003
   query52  98  90  88  88
   query53  251 183 179 179
   query54  567 451 460 451
   query55  78  77  81  77
   query56  290 257 266 257
   query57  1214107410711071
   query58  231 248 223 223
   query59  3075280828502808
   query60  327 281 288 281
   query61  124 121 120 120
   query62  767 641 662 641
   query63  218 188 183 183
   query64  2871678 662 662
   query65  3223315731793157
   query66  685 337 345 337
   query67  15279   15522   15108   15108
   query68  2942560 563 560
   query69  412 285 276 276
   query70  1244112311251123
   query71  345 268 264 264
   query72  6216401640414016
   query73  756 329 326 326
   query74  9193886688638863
   query75  3331266426572657
   query76  1553108110231023
   query77  525 331 316 316
   query78  9544970590439043
   query79  1056536 523 523
   query80  699 523 512 512
   query81  541 236 233 233
   query82  238 145 147 145
   query83  172 145 152 145
   query84  260 77  78  77
   query85  750 289 340 289
   query86  305 300 306 300
   query87  4399433643324332
   query88  2939232623382326
   query89  375 284 287 284
   query90  1895192 192 192
   query91  122 99  99  99
   query92  59  56  54  54
   query93  1033526 527 526
   query94  597 300 304 300
   query95  356 262 258 258
   query96  599 273 267 267
   query97  3188310330423042
   query98  222 199 210 199
   query99  1522127812311231
   Total cold run time: 305189 ms
   Total hot run time: 192856 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to

Re: [PR] [Bug](expr) execute expr should use local states instead of operators [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40189:
URL: https://github.com/apache/doris/pull/40189#issuecomment-2320500967

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](nereids)build agg for random distributed agg table in bindRelation phase [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40181:
URL: https://github.com/apache/doris/pull/40181#issuecomment-2320510326

   
   
   ClickBench: Total hot run time: 32.16 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 6db47b5f0b3ee2a63b895c41a653dc138b284080, 
data reload: false
   
   query1   0.050.040.05
   query2   0.090.050.04
   query3   0.230.050.05
   query4   1.660.080.08
   query5   0.510.490.50
   query6   1.130.740.73
   query7   0.020.010.02
   query8   0.050.040.04
   query9   0.540.500.46
   query10  0.540.540.54
   query11  0.150.120.11
   query12  0.150.120.12
   query13  0.610.590.58
   query14  2.092.092.05
   query15  0.850.830.82
   query16  0.350.360.36
   query17  1.040.960.98
   query18  0.210.210.20
   query19  1.841.761.71
   query20  0.010.010.01
   query21  15.39   0.680.67
   query22  4.146.882.20
   query23  18.33   1.361.30
   query24  2.050.240.20
   query25  0.160.080.08
   query26  0.260.190.17
   query27  0.080.080.08
   query28  13.25   0.990.99
   query29  12.64   3.323.28
   query30  0.240.060.06
   query31  2.870.400.39
   query32  3.250.490.48
   query33  2.982.982.99
   query34  17.20   4.444.37
   query35  4.454.454.47
   query36  0.660.460.47
   query37  0.180.160.15
   query38  0.150.150.15
   query39  0.050.040.03
   query40  0.150.130.13
   query41  0.110.050.05
   query42  0.060.060.05
   query43  0.040.040.04
   Total cold run time: 110.81 s
   Total hot run time: 32.16 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [opt](partial update) Forbid partial update on merge-on-write table with sync mv [doris]

2024-08-30 Thread via GitHub


bobhan1 opened a new pull request, #40190:
URL: https://github.com/apache/doris/pull/40190

   ## Proposed changes
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](partial update) Forbid partial update on merge-on-write table with sync mv [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40190:
URL: https://github.com/apache/doris/pull/40190#issuecomment-2320516639

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Bug](expr) execute expr should use local states instead of operators [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40189:
URL: https://github.com/apache/doris/pull/40189#issuecomment-2320519975

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](partial update) Forbid partial update on merge-on-write table with sync mv [doris]

2024-08-30 Thread via GitHub


bobhan1 commented on PR #40190:
URL: https://github.com/apache/doris/pull/40190#issuecomment-2320523274

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Bug](expr) execute expr should use local states instead of operators [doris]

2024-08-30 Thread via GitHub


zhangstar333 commented on PR #40189:
URL: https://github.com/apache/doris/pull/40189#issuecomment-2320532415

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](ut) Fix TestParseMemSpec UT [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40186:
URL: https://github.com/apache/doris/pull/40186#issuecomment-2320538524

   
   
   TPC-H: Total hot run time: 38096 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 209feb4060086b1e4b943914b6a70db3719e9e2b, 
data reload: false
   
   -- Round 1 --
   q1   18602   449243234323
   q2   2015172 193 172
   q3   10477   114510751075
   q4   10152   740 774 740
   q5   7721282227592759
   q6   226 135 137 135
   q7   962 601 596 596
   q8   9340206820512051
   q9   7267655265376537
   q10  7013219321272127
   q11  451 244 250 244
   q12  399 229 219 219
   q13  18730   303130513031
   q14  293 235 231 231
   q15  529 490 478 478
   q16  575 501 524 501
   q17  980 717 740 717
   q18  7257702968036803
   q19  1397104310911043
   q20  697 328 335 328
   q21  3874294629872946
   q22  1120105010401040
   Total cold run time: 110077 ms
   Total hot run time: 38096 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4397432143254321
   q2   382 275 286 275
   q3   2904270126072607
   q4   1945158216301582
   q5   5383537753985377
   q6   242 134 131 131
   q7   2066170717481707
   q8   3193334633343334
   q9   8439840084028400
   q10  3459317731583158
   q11  606 491 506 491
   q12  803 594 609 594
   q13  11715   306530403040
   q14  313 275 276 275
   q15  536 480 477 477
   q16  625 561 579 561
   q17  1775149314861486
   q18  7765747375487473
   q19  1695149614441444
   q20  2058183418471834
   q21  5469524750445044
   q22  1119104710351035
   Total cold run time: 66889 ms
   Total hot run time: 54646 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improvement](tablet report) tablet report increase report version [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40172:
URL: https://github.com/apache/doris/pull/40172#issuecomment-2320567048

   
   
   TPC-H: Total hot run time: 38209 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit ee22a4d6b73bf0b955e02335a010eff95cb4adc6, 
data reload: false
   
   -- Round 1 --
   q1   18100   452544464446
   q2   2880186 174 174
   q3   11523   112511561125
   q4   10483   730 788 730
   q5   7790289228692869
   q6   230 146 140 140
   q7   977 619 603 603
   q8   9598206320572057
   q9   7280654065506540
   q10  7005220321842184
   q11  445 238 243 238
   q12  400 226 227 226
   q13  17753   301230063006
   q14  281 239 244 239
   q15  532 485 492 485
   q16  574 497 517 497
   q17  960 651 644 644
   q18  7332681768376817
   q19  1406982 1000982
   q20  680 343 326 326
   q21  3940295828762876
   q22  1113100510371005
   Total cold run time: 111282 ms
   Total hot run time: 38209 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4380432543164316
   q2   376 274 270 270
   q3   2886266026162616
   q4   1904163316171617
   q5   5380537153965371
   q6   222 130 130 130
   q7   2059174717261726
   q8   3206333233483332
   q9   8506841384288413
   q10  3430323131653165
   q11  602 487 505 487
   q12  784 625 627 625
   q13  9675305629942994
   q14  310 296 292 292
   q15  528 479 482 479
   q16  600 570 562 562
   q17  1753148014461446
   q18  7873743673407340
   q19  1645147715711477
   q20  2067183118511831
   q21  5493526751605160
   q22  1139102210301022
   Total cold run time: 64818 ms
   Total hot run time: 54671 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] Dev spark load [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #40182:
URL: https://github.com/apache/doris/pull/40182#issuecomment-2320570323

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](ut) Fix TestParseMemSpec UT [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40186:
URL: https://github.com/apache/doris/pull/40186#issuecomment-2320570538

   
   
   TPC-DS: Total hot run time: 187360 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 209feb4060086b1e4b943914b6a70db3719e9e2b, 
data reload: false
   
   query1   915 380 365 365
   query2   6450199419151915
   query3   6654206 216 206
   query4   33668   23178   23255   23178
   query5   4150512 502 502
   query6   253 176 187 176
   query7   4587292 281 281
   query8   249 202 206 202
   query9   8525246024302430
   query10  432 281 254 254
   query11  17716   15127   15000   15000
   query12  166 102 99  99
   query13  1638388 368 368
   query14  9951698367446744
   query15  238 179 172 172
   query16  7680503 488 488
   query17  1625548 538 538
   query18  2021286 288 286
   query19  209 141 139 139
   query20  116 110 125 110
   query21  220 102 102 102
   query22  4431409441304094
   query23  34057   33261   33357   33261
   query24  10978   287627822782
   query25  609 387 369 369
   query26  1090153 159 153
   query27  2353276 278 276
   query28  7050210520882088
   query29  773 407 401 401
   query30  308 163 149 149
   query31  986 791 774 774
   query32  103 56  55  55
   query33  752 286 272 272
   query34  1025501 484 484
   query35  849 723 710 710
   query36  1089926 963 926
   query37  167 91  89  89
   query38  3940382439073824
   query39  1461139014101390
   query40  198 118 116 116
   query41  47  46  46  46
   query42  112 97  99  97
   query43  520 459 490 459
   query44  1262752 737 737
   query45  200 167 170 167
   query46  1099741 718 718
   query47  1863180217731773
   query48  383 298 285 285
   query49  1110436 424 424
   query50  807 405 397 397
   query51  7256704471577044
   query52  103 87  90  87
   query53  249 186 215 186
   query54  994 449 447 447
   query55  76  79  77  77
   query56  291 260 245 245
   query57  1159105710921057
   query58  242 222 225 222
   query59  3177287727782778
   query60  289 258 258 258
   query61  102 98  100 98
   query62  829 645 653 645
   query63  219 185 181 181
   query64  4259699 634 634
   query65  3235316331323132
   query66  1433344 339 339
   query67  15587   15421   15147   15147
   query68  3322573 551 551
   query69  398 267 272 267
   query70  1188109210621062
   query71  337 272 268 268
   query72  6376399540023995
   query73  748 327 326 326
   query74  9181881888688818
   query75  3407269126792679
   query76  1895104410601044
   query77  497 321 384 321
   query78  9730967092959295
   query79  1043535 535 535
   query80  685 500 516 500
   query81  503 238 241 238
   query82  239 151 147 147
   query83  168 151 149 149
   query84  231 80  74  74
   query85  694 290 280 280
   query86  299 305 299 299
   query87  4373428042604260
   query88  2904231122952295
   query89  380 286 282 282
   query90  2070197 194 194
   query91  125 98  99  98
   query92  59  50  52  50
   query93  1022526 523 523
   query94  823 306 290 290
   query95  350 261 257 257
   query96  587 266 267 266
   query97  3194308430963084
   query98  232 203 206 203
   query99  1465126212661262
   Total cold run time: 285110 ms
   Total hot run time: 187360 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to th

Re: [PR] [feature](load) new insgestion load [doris]

2024-08-30 Thread via GitHub


github-actions[bot] commented on PR #36862:
URL: https://github.com/apache/doris/pull/36862#issuecomment-2320571267

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](decompressor) consider the large_block_len is 0 [doris]

2024-08-30 Thread via GitHub


suxiaogang223 commented on PR #40183:
URL: https://github.com/apache/doris/pull/40183#issuecomment-2320572758

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](cloud-schema-change) Exclude merged dropped columns from projection columns [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40187:
URL: https://github.com/apache/doris/pull/40187#issuecomment-2320576981

   
   
   TPC-H: Total hot run time: 39572 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 330837eb0925d6c2480c7565a022df6b56a59c8c, 
data reload: false
   
   -- Round 1 --
   q1   17667   501046414641
   q2   2556186 186 186
   q3   12034   100412181004
   q4   10520   767 765 765
   q5   7710292628782878
   q6   233 139 141 139
   q7   980 628 607 607
   q8   10477   212721002100
   q9   7498665966406640
   q10  7070230722982298
   q11  458 245 244 244
   q12  402 229 232 229
   q13  17848   323132513231
   q14  307 239 245 239
   q15  568 526 509 509
   q16  640 526 516 516
   q17  1006752 736 736
   q18  8793749570357035
   q19  2177105610411041
   q20  709 350 345 345
   q21  4223334231803180
   q22  1091103110091009
   Total cold run time: 114967 ms
   Total hot run time: 39572 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4579441943244324
   q2   385 286 269 269
   q3   2935270028342700
   q4   2083179317841784
   q5   5762571256175617
   q6   239 144 138 138
   q7   2253182718471827
   q8   3377350134773477
   q9   8887889489808894
   q10  3660333634543336
   q11  592 524 514 514
   q12  813 636 641 636
   q13  17201   325932233223
   q14  320 286 289 286
   q15  559 494 501 494
   q16  651 576 589 576
   q17  1932157915481548
   q18  8436798980037989
   q19  1775159115081508
   q20  2253192819281928
   q21  5897560752575257
   q22  1163107910371037
   Total cold run time: 75752 ms
   Total hot run time: 57362 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feat](nereids) adjust stats derive by delta row [doris]

2024-08-30 Thread via GitHub


englefly commented on PR #39222:
URL: https://github.com/apache/doris/pull/39222#issuecomment-2320586593

   run external


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](ut) Fix TestParseMemSpec UT [doris]

2024-08-30 Thread via GitHub


doris-robot commented on PR #40186:
URL: https://github.com/apache/doris/pull/40186#issuecomment-2320588658

   
   
   ClickBench: Total hot run time: 31.58 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 209feb4060086b1e4b943914b6a70db3719e9e2b, 
data reload: false
   
   query1   0.040.040.04
   query2   0.080.040.04
   query3   0.220.050.05
   query4   1.670.070.06
   query5   0.490.480.51
   query6   1.130.730.73
   query7   0.020.010.01
   query8   0.050.040.04
   query9   0.540.480.48
   query10  0.540.540.53
   query11  0.150.120.12
   query12  0.160.120.13
   query13  0.610.590.58
   query14  2.052.052.06
   query15  0.900.830.83
   query16  0.370.370.38
   query17  0.971.000.99
   query18  0.220.200.21
   query19  1.871.801.79
   query20  0.010.000.01
   query21  15.42   0.660.66
   query22  3.928.301.57
   query23  18.27   1.381.29
   query24  2.110.220.21
   query25  0.160.080.09
   query26  0.250.180.18
   query27  0.090.070.07
   query28  13.30   1.021.01
   query29  12.66   3.323.30
   query30  0.240.050.04
   query31  2.870.400.39
   query32  3.270.490.46
   query33  2.992.952.99
   query34  17.12   4.354.39
   query35  4.454.484.43
   query36  0.670.490.48
   query37  0.190.160.17
   query38  0.160.150.15
   query39  0.050.040.04
   query40  0.160.130.13
   query41  0.090.040.04
   query42  0.060.050.04
   query43  0.050.040.04
   Total cold run time: 110.64 s
   Total hot run time: 31.58 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



  1   2   3   4   >