Re: [PR] [bugfix](profile) support multi execution profile for brokerload [doris]
github-actions[bot] commented on PR #32280: URL: https://github.com/apache/doris/pull/32280#issuecomment-1999052489 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](compatibility) should enable windown funnel mode from 2.0 [doris]
github-actions[bot] commented on PR #32284: URL: https://github.com/apache/doris/pull/32284#issuecomment-1999052568 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [pipelineX](exchange) Make exchange buffer size configurable [doris]
Gabriel39 commented on PR #32201: URL: https://github.com/apache/doris/pull/32201#issuecomment-1999053060 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [bugfix](profile) support multi execution profile for brokerload [doris]
doris-robot commented on PR #32280: URL: https://github.com/apache/doris/pull/32280#issuecomment-1999055104 TPC-H: Total hot run time: 38636 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit e9e4dbc486df44e1791f68fd9cd37c3416dcbd29, data reload: false -- Round 1 -- q1 17686 449741954195 q2 2019154 144 144 q3 10666 1139900 900 q4 7788737 774 737 q5 7473304427982798 q6 184 119 120 119 q7 1160836 821 821 q8 9377202719931993 q9 7129645864306430 q10 8477348336353483 q11 431 229 222 222 q12 631 302 306 302 q13 18009 285728832857 q14 274 242 243 242 q15 499 463 445 445 q16 507 385 384 384 q17 959 554 606 554 q18 7229654164576457 q19 3664144914251425 q20 565 278 269 269 q21 6281356935583558 q22 360 301 346 301 Total cold run time: 111368 ms Total hot run time: 38636 ms - Round 2, with runtime_filter_mode=off - q1 4178409640854085 q2 322 219 230 219 q3 2941289528642864 q4 1859157815201520 q5 5249524852185218 q6 198 113 114 113 q7 2210184318601843 q8 3139329932603260 q9 8560854285648542 q10 3716366836663666 q11 549 438 445 438 q12 732 573 560 560 q13 16923 284728432843 q14 276 243 251 243 q15 480 445 448 445 q16 457 416 405 405 q17 1746148714701470 q18 7550712770727072 q19 1625151415381514 q20 1893172316841684 q21 4777482947364736 q22 545 450 428 428 Total cold run time: 69925 ms Total hot run time: 53168 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Variant) fix variant null bitmap set incorrect [doris]
doris-robot commented on PR #31769: URL: https://github.com/apache/doris/pull/31769#issuecomment-1999055975 TPC-H: Total hot run time: 38341 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 40648453224511c79a4e8eeaab0265a222313e38, data reload: false -- Round 1 -- q1 17627 426741514151 q2 2041153 147 147 q3 10677 1129888 888 q4 7088702 727 702 q5 7467257426662574 q6 186 121 122 121 q7 1201837 798 798 q8 9364207120302030 q9 7161644464206420 q10 8448348836023488 q11 430 221 212 212 q12 619 314 295 295 q13 17798 287228732872 q14 281 260 249 249 q15 501 453 458 453 q16 493 390 395 390 q17 967 528 507 507 q18 7183658764726472 q19 1566149514131413 q20 549 283 286 283 q21 6382366635823582 q22 371 311 294 294 Total cold run time: 108400 ms Total hot run time: 38341 ms - Round 2, with runtime_filter_mode=off - q1 4080418940574057 q2 316 223 221 221 q3 2968285028722850 q4 1822157115481548 q5 5241523452545234 q6 198 114 121 114 q7 2278186718491849 q8 3162328532753275 q9 8605860586168605 q10 3709373236523652 q11 537 436 447 436 q12 713 552 544 544 q13 16905 290728642864 q14 274 249 260 249 q15 487 438 440 438 q16 449 410 409 409 q17 1764148514681468 q18 7706709071637090 q19 1620154615431543 q20 1913173017251725 q21 4814467446104610 q22 506 422 434 422 Total cold run time: 70067 ms Total hot run time: 53203 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](s3 client)add default ca cert list for s3 client to avoid problem:'curlCode:77' [doris]
ryanzryu opened a new pull request, #32285: URL: https://github.com/apache/doris/pull/32285 ## Proposed changes Issue Number: #23163 add a be config field: ca_cert_file_paths , this is a default ca cart file list for different OS And selects a valid file for initialization of the s3 client if All ca cert file path is invalid ，s3 client will no set this config and use s3‘s default config ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](s3 client)add default ca cert list for s3 client to avoid problem:'curlCode:77' [doris]
doris-robot commented on PR #32285: URL: https://github.com/apache/doris/pull/32285#issuecomment-1999057320 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](routine-load) optimize routine load task limit [doris]
HHoflittlefish777 commented on PR #32282: URL: https://github.com/apache/doris/pull/32282#issuecomment-1999058042 run builall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](insert)implement hive table sink plan [doris]
wsjz commented on PR #31765: URL: https://github.com/apache/doris/pull/31765#issuecomment-1999059821 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refactor](nereids)unify outputTupleDesc and projection [doris]
doris-robot commented on PR #32128: URL: https://github.com/apache/doris/pull/32128#issuecomment-1999060869 TPC-H: Total hot run time: 38721 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 73d8d55f59c30bb7b417ed66074a5517d939109b, data reload: false -- Round 1 -- q1 17645 429141444144 q2 2011153 148 148 q3 10592 1098929 929 q4 789 762 762 q5 7470279628112796 q6 183 128 122 122 q7 1171825 830 825 q8 9339198720191987 q9 7325655165336533 q10 8585354936563549 q11 425 228 224 224 q12 630 300 301 300 q13 17794 283828672838 q14 273 250 247 247 q15 499 448 459 448 q16 513 399 402 399 q17 956 574 569 569 q18 7193650164006400 q19 2916145714121412 q20 545 278 267 267 q21 6238352735253525 q22 360 297 299 297 Total cold run time: 110440 ms Total hot run time: 38721 ms - Round 2, with runtime_filter_mode=off - q1 4101407040714070 q2 327 230 232 230 q3 2958284628282828 q4 1862160415611561 q5 5332529753305297 q6 195 115 123 115 q7 2262185818341834 q8 3169330433003300 q9 8738866086658660 q10 3791370937733709 q11 551 448 442 442 q12 736 560 525 525 q13 16927 286928912869 q14 284 240 250 240 q15 474 447 448 447 q16 468 399 395 395 q17 1735147014751470 q18 7513716771447144 q19 1657155715201520 q20 1923170917201709 q21 4990473346534653 q22 528 463 452 452 Total cold run time: 70521 ms Total hot run time: 53470 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [pipelineX](exchange) Make exchange buffer size configurable [doris]
github-actions[bot] commented on PR #32201: URL: https://github.com/apache/doris/pull/32201#issuecomment-1999060973 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [pipelineX](exchange) Make exchange buffer size configurable [doris]
github-actions[bot] commented on PR #32201: URL: https://github.com/apache/doris/pull/32201#issuecomment-1999061004 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Optimize](inverted index) optimize inverted index bitmap copy [doris]
doris-robot commented on PR #32279: URL: https://github.com/apache/doris/pull/32279#issuecomment-1999061568 TPC-H: Total hot run time: 38305 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 956403ce1ab2695908c9ede2daf54638111201c8, data reload: false -- Round 1 -- q1 17645 436142014201 q2 2026158 143 143 q3 10590 1081904 904 q4 6394704 701 701 q5 7473263526922635 q6 187 119 118 118 q7 1205814 797 797 q8 9325198620471986 q9 7213644963616361 q10 8513350536213505 q11 433 220 223 220 q12 805 303 310 303 q13 18133 285728732857 q14 270 246 263 246 q15 502 453 456 453 q16 507 389 382 382 q17 959 591 537 537 q18 7210648265076482 q19 4053141213911391 q20 548 295 273 273 q21 6496350135653501 q22 352 323 309 309 Total cold run time: 110839 ms Total hot run time: 38305 ms - Round 2, with runtime_filter_mode=off - q1 4136406440844064 q2 315 223 222 222 q3 3003282728362827 q4 1819152415291524 q5 5205524652495246 q6 197 130 115 115 q7 2207184518191819 q8 3155330533003300 q9 8600854585778545 q10 3696367436813674 q11 538 440 428 428 q12 703 554 551 551 q13 16924 285128312831 q14 267 252 245 245 q15 482 441 444 441 q16 443 412 411 411 q17 1734147014951470 q18 7415713371947133 q19 2643151214691469 q20 1872173016961696 q21 4822470747444707 q22 522 461 457 457 Total cold run time: 70698 ms Total hot run time: 53175 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Outfile) Fix the column type mapping in the orc/parquet file format [doris]
doris-robot commented on PR #32281: URL: https://github.com/apache/doris/pull/32281#issuecomment-1999061635 TPC-H: Total hot run time: 38252 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 3694999762d0186fc0c1cd20343445f115ae5afd, data reload: false -- Round 1 -- q1 17654 431441674167 q2 2021149 141 141 q3 10608 1086902 902 q4 7773745 718 718 q5 7468255825992558 q6 182 119 120 119 q7 1221825 800 800 q8 9325203220372032 q9 7288643464396434 q10 8551352736063527 q11 433 223 217 217 q12 806 298 303 298 q13 18017 288528602860 q14 283 252 258 252 q15 501 449 443 443 q16 507 391 382 382 q17 949 493 536 493 q18 7173639865266398 q19 4505147514051405 q20 540 296 271 271 q21 6057353136323531 q22 363 305 304 304 Total cold run time: 112225 ms Total hot run time: 38252 ms - Round 2, with runtime_filter_mode=off - q1 4168411041284110 q2 315 222 220 220 q3 2948284027902790 q4 1809152815301528 q5 5187529152495249 q6 194 114 114 114 q7 2201184618631846 q8 3179329533023295 q9 8554858185648564 q10 3739369937013699 q11 540 446 440 440 q12 699 544 561 544 q13 16918 287228142814 q14 276 257 259 257 q15 484 454 440 440 q16 442 426 417 417 q17 1739147314461446 q18 7421720071097109 q19 1607151915451519 q20 1903171617301716 q21 4787481547614761 q22 560 467 446 446 Total cold run time: 69670 ms Total hot run time: 53324 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](routine-load) optimize routine load task limit [doris]
github-actions[bot] commented on PR #32282: URL: https://github.com/apache/doris/pull/32282#issuecomment-1999063457 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](s3 client)add default ca cert list for s3 client to avoid problem:'curlCode:77' [doris]
github-actions[bot] commented on code in PR #32285:
URL: https://github.com/apache/doris/pull/32285#discussion_r1525841861
##
be/src/util/s3_util.cpp:
##
@@ -114,6 +115,18 @@ S3ClientFactory::S3ClientFactory() {
return std::make_shared(logLevel);
};
Aws::InitAPI(_aws_options);
+_ca_cert_file_path = get_valid_ca_cert_path();
+}
+
+string S3ClientFactory::get_valid_ca_cert_path() {
Review Comment:
warning: method 'get_valid_ca_cert_path' can be made static
[readability-convert-member-functions-to-static]
```suggestion
static string S3ClientFactory::get_valid_ca_cert_path() {
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](insert)implement hive table sink plan [doris]
github-actions[bot] commented on PR #31765: URL: https://github.com/apache/doris/pull/31765#issuecomment-1999064056 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](compatibility) should enable windown funnel mode from 2.0 [doris]
mrhhsg commented on PR #32284: URL: https://github.com/apache/doris/pull/32284#issuecomment-1999070229 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](compatibility) should enable windown funnel mode from 2.0 [doris]
github-actions[bot] commented on PR #32284: URL: https://github.com/apache/doris/pull/32284#issuecomment-1999074949 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Variant) fix variant null bitmap set incorrect [doris]
doris-robot commented on PR #31769: URL: https://github.com/apache/doris/pull/31769#issuecomment-1999077829 TeamCity be ut coverage result: Function Coverage: 34.94% (8573/24535) Line Coverage: 26.65% (69482/260753) Region Coverage: 25.94% (36090/139143) Branch Coverage: 22.89% (18427/80500) Coverage Report: http://coverage.selectdb-in.cc/coverage/40648453224511c79a4e8eeaab0265a222313e38_40648453224511c79a4e8eeaab0265a222313e38/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](compatibility) should enable windown funnel mode from 2.0 [doris]
github-actions[bot] commented on PR #32284: URL: https://github.com/apache/doris/pull/32284#issuecomment-1999078391 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) 01/09: Collect high priority columns. (#31235)
This is an automated email from the ASF dual-hosted git repository.
lijibing pushed a commit to branch high-priority-column
in repository https://gitbox.apache.org/repos/asf/doris.git
commit 32184b35cb400b49e19956073df30390d9187d97
Author: Jibing-Li <64681310+jibing...@users.noreply.github.com>
AuthorDate: Wed Feb 28 11:54:40 2024 +0800
Collect high priority columns. (#31235)
---
.../doris/nereids/jobs/executor/Rewriter.java | 4 +-
.../org/apache/doris/nereids/rules/RuleType.java | 1 +
.../expression/HighPriorityColumnCollector.java| 202 +
.../apache/doris/statistics/AnalysisManager.java | 44 +
.../doris/statistics/HighPriorityColumn.java | 55 ++
5 files changed, 305 insertions(+), 1 deletion(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/executor/Rewriter.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/executor/Rewriter.java
index 98721f6c48d..9d6dd07601b 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/executor/Rewriter.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/executor/Rewriter.java
@@ -32,6 +32,7 @@ import
org.apache.doris.nereids.rules.expression.CheckLegalityAfterRewrite;
import org.apache.doris.nereids.rules.expression.ExpressionNormalization;
import org.apache.doris.nereids.rules.expression.ExpressionOptimization;
import org.apache.doris.nereids.rules.expression.ExpressionRewrite;
+import org.apache.doris.nereids.rules.expression.HighPriorityColumnCollector;
import org.apache.doris.nereids.rules.rewrite.AddDefaultLimit;
import org.apache.doris.nereids.rules.rewrite.AdjustConjunctsReturnType;
import org.apache.doris.nereids.rules.rewrite.AdjustNullable;
@@ -410,7 +411,8 @@ public class Rewriter extends AbstractBatchJobExecutor {
new CollectFilterAboveConsumer(),
new CollectProjectAboveConsumer()
)
-)
+),
+topic("Collect used column", custom(RuleType.COLLECT_COLUMNS,
HighPriorityColumnCollector::new))
);
private static final List WHOLE_TREE_REWRITE_JOBS
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/RuleType.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/RuleType.java
index 9650a9147b8..a72f89618a1 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/RuleType.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/RuleType.java
@@ -303,6 +303,7 @@ public enum RuleType {
LEADING_JOIN(RuleTypeClass.REWRITE),
REWRITE_SENTINEL(RuleTypeClass.REWRITE),
+COLLECT_COLUMNS(RuleTypeClass.REWRITE),
// topn opts
DEFER_MATERIALIZE_TOP_N_RESULT(RuleTypeClass.REWRITE),
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/HighPriorityColumnCollector.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/HighPriorityColumnCollector.java
new file mode 100644
index 000..ed67ad97005
--- /dev/null
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/HighPriorityColumnCollector.java
@@ -0,0 +1,202 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+package org.apache.doris.nereids.rules.expression;
+
+import org.apache.doris.catalog.Column;
+import org.apache.doris.catalog.Env;
+import org.apache.doris.catalog.TableIf;
+import org.apache.doris.nereids.jobs.JobContext;
+import
org.apache.doris.nereids.rules.expression.HighPriorityColumnCollector.CollectorContext;
+import org.apache.doris.nereids.trees.expressions.NamedExpression;
+import org.apache.doris.nereids.trees.expressions.Slot;
+import org.apache.doris.nereids.trees.expressions.SlotReference;
+import org.apache.doris.nereids.trees.plans.Plan;
+import org.apache.doris.nereids.trees.plans.logical.LogicalAggregate;
+import org.apache.doris.nereids.trees.plans.logical.LogicalCatalogRelation;
+import org.apache.doris.nereids.trees.plans.logical.LogicalFileScan;
+import org.apache.doris.nereids.trees.plans.logical.LogicalFilter;
+import org.apache.doris.nereids.trees.plans.logical.LogicalHaving;
+import org.apache.doris.nereids.trees.plans.logical.LogicalJoin;
+im
(doris) 06/09: Check column health value earlier, show job priority. (#32064)
This is an automated email from the ASF dual-hosted git repository.
lijibing pushed a commit to branch high-priority-column
in repository https://gitbox.apache.org/repos/asf/doris.git
commit 4d426f6dbaaf9ccb85a66cbc1b4dbadd1a85a0c5
Author: Jibing-Li <64681310+jibing...@users.noreply.github.com>
AuthorDate: Mon Mar 11 19:46:20 2024 +0800
Check column health value earlier, show job priority. (#32064)
---
.../org/apache/doris/analysis/ShowAnalyzeStmt.java | 1 +
.../java/org/apache/doris/qe/SessionVariable.java | 2 +-
.../java/org/apache/doris/qe/ShowExecutor.java | 4 +-
.../org/apache/doris/statistics/AnalysisInfo.java | 8 +-
.../doris/statistics/AnalysisInfoBuilder.java | 10 +-
.../apache/doris/statistics/AnalysisManager.java | 10 +-
.../doris/statistics/FollowerColumnSender.java | 23 +++--
.../doris/statistics/HighPriorityColumn.java | 6 +-
.../org/apache/doris/statistics/JobPriority.java | 3 +-
.../doris/statistics/StatisticsAutoCollector.java | 102 -
.../doris/statistics/StatisticsJobAppender.java| 8 +-
.../doris/statistics/util/StatisticsUtil.java | 88 +-
gensrc/thrift/FrontendService.thrift | 6 +-
13 files changed, 161 insertions(+), 110 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/analysis/ShowAnalyzeStmt.java
b/fe/fe-core/src/main/java/org/apache/doris/analysis/ShowAnalyzeStmt.java
index efcfc517024..734073901fe 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/analysis/ShowAnalyzeStmt.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/analysis/ShowAnalyzeStmt.java
@@ -62,6 +62,7 @@ public class ShowAnalyzeStmt extends ShowStmt {
.add("schedule_type")
.add("start_time")
.add("end_time")
+.add("priority")
.build();
private long jobId;
diff --git a/fe/fe-core/src/main/java/org/apache/doris/qe/SessionVariable.java
b/fe/fe-core/src/main/java/org/apache/doris/qe/SessionVariable.java
index 768138ff539..5dc6f9bf921 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/qe/SessionVariable.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/qe/SessionVariable.java
@@ -1503,7 +1503,7 @@ public class SessionVariable implements Serializable,
Writable {
@VariableMgr.VarAttr(name = ENABLE_AUTO_ANALYZE_INTERNAL_CATALOG,
description = {"临时参数，收否自动收集所有内表", "Temp variable， enable to auto
collect all OlapTable."},
flag = VariableMgr.GLOBAL)
-public boolean enableAutoAnalyzeInternalCatalog = false;
+public boolean enableAutoAnalyzeInternalCatalog = true;
@VariableMgr.VarAttr(name = AUTO_ANALYZE_TABLE_WIDTH_THRESHOLD,
description = {"参与自动收集的最大表宽度，列数多于这个参数的表不参与自动收集",
diff --git a/fe/fe-core/src/main/java/org/apache/doris/qe/ShowExecutor.java
b/fe/fe-core/src/main/java/org/apache/doris/qe/ShowExecutor.java
index dda7045eabb..fa2046e5467 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/qe/ShowExecutor.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/qe/ShowExecutor.java
@@ -2859,6 +2859,7 @@ public class ShowExecutor {
java.time.ZoneId.systemDefault());
row.add(startTime.format(formatter));
row.add(endTime.format(formatter));
+row.add(analysisInfo.priority.name());
resultRows.add(row);
} catch (Exception e) {
LOG.warn("Failed to get analyze info for table {}.{}.{},
reason: {}",
@@ -2876,8 +2877,7 @@ public class ShowExecutor {
for (AutoAnalysisPendingJob job : jobs) {
try {
List row = new ArrayList<>();
-CatalogIf> c
-= StatisticsUtil.findCatalog(job.catalogName);
+CatalogIf> c =
StatisticsUtil.findCatalog(job.catalogName);
row.add(c.getName());
Optional> databaseIf =
c.getDb(job.dbName);
row.add(databaseIf.isPresent() ?
databaseIf.get().getFullName() : "DB may get deleted");
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/statistics/AnalysisInfo.java
b/fe/fe-core/src/main/java/org/apache/doris/statistics/AnalysisInfo.java
index 0c5047a53c5..24cf6f38d68 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/statistics/AnalysisInfo.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/statistics/AnalysisInfo.java
@@ -200,8 +200,12 @@ public class AnalysisInfo implements Writable {
*/
public final long tblUpdateTime;
+@SerializedName("userInject")
public final boolean userInject;
+@SerializedName("priority")
+public final JobPriority priority;
+
public AnalysisInfo(long jobId, long taskId, List taskIds, long
catalogId, long dbId, long tblId,
Map> colToPartitions, Set
partitionNames, String colName, Long indexId,
JobType jobType, AnalysisMode analysisMode, AnalysisMethod
analysisMethod, Anal
(doris) 05/09: Support show auto analyze pending jobs. (#31926)
This is an automated email from the ASF dual-hosted git repository.
lijibing pushed a commit to branch high-priority-column
in repository https://gitbox.apache.org/repos/asf/doris.git
commit f74a289e2f22a87f8124afe63cf8a415f4aa
Author: Jibing-Li <64681310+jibing...@users.noreply.github.com>
AuthorDate: Thu Mar 7 15:02:02 2024 +0800
Support show auto analyze pending jobs. (#31926)
---
fe/fe-core/src/main/cup/sql_parser.cup | 4 +
.../doris/analysis/ShowAutoAnalyzeJobsStmt.java| 210 +
.../java/org/apache/doris/qe/ShowExecutor.java | 34
.../apache/doris/statistics/AnalysisManager.java | 40 +++-
.../doris/statistics/AutoAnalysisPendingJob.java | 50 +
.../org/apache/doris/statistics/JobPriority.java | 24 +++
.../doris/statistics/StatisticsAutoCollector.java | 16 +-
.../doris/statistics/StatisticsJobAppender.java| 25 ++-
8 files changed, 383 insertions(+), 20 deletions(-)
diff --git a/fe/fe-core/src/main/cup/sql_parser.cup
b/fe/fe-core/src/main/cup/sql_parser.cup
index 23efc77cc05..799c9eeb6b7 100644
--- a/fe/fe-core/src/main/cup/sql_parser.cup
+++ b/fe/fe-core/src/main/cup/sql_parser.cup
@@ -4375,6 +4375,10 @@ show_param ::=
{:
RESULT = new ShowAnalyzeStmt(tbl, parser.where, true);
:}
+| KW_AUTO KW_JOBS opt_table_name:tbl opt_wild_where
+{:
+RESULT = new ShowAutoAnalyzeJobsStmt(tbl, parser.where);
+:}
| KW_ANALYZE KW_TASK KW_STATUS INTEGER_LITERAL:jobId
{:
RESULT = new ShowAnalyzeTaskStatus(jobId);
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/analysis/ShowAutoAnalyzeJobsStmt.java
b/fe/fe-core/src/main/java/org/apache/doris/analysis/ShowAutoAnalyzeJobsStmt.java
new file mode 100644
index 000..560387fa5bc
--- /dev/null
+++
b/fe/fe-core/src/main/java/org/apache/doris/analysis/ShowAutoAnalyzeJobsStmt.java
@@ -0,0 +1,210 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+package org.apache.doris.analysis;
+
+import org.apache.doris.catalog.Column;
+import org.apache.doris.catalog.Env;
+import org.apache.doris.catalog.ScalarType;
+import org.apache.doris.common.AnalysisException;
+import org.apache.doris.common.ErrorCode;
+import org.apache.doris.common.ErrorReport;
+import org.apache.doris.common.UserException;
+import org.apache.doris.mysql.privilege.PrivPredicate;
+import org.apache.doris.qe.ConnectContext;
+import org.apache.doris.qe.ShowResultSetMetaData;
+import org.apache.doris.statistics.JobPriority;
+
+import com.google.common.base.Preconditions;
+import com.google.common.base.Strings;
+import com.google.common.collect.ImmutableList;
+
+/**
+ * ShowAutoAnalyzeJobsStmt is used to show pending auto analysis jobs.
+ * syntax:
+ *SHOW AUTO ANALYZE JOBS
+ *[TABLE]
+ *[
+ *WHERE
+ *[PRIORITY = ["HIGH"|"MID"|"LOW"]]
+ *]
+ */
+public class ShowAutoAnalyzeJobsStmt extends ShowStmt {
+private static final String PRIORITY = "priority";
+private static final ImmutableList TITLE_NAMES = new
ImmutableList.Builder()
+.add("catalog_name")
+.add("db_name")
+.add("tbl_name")
+.add("col_list")
+.add("priority")
+.build();
+
+private final TableName tableName;
+private final Expr whereClause;
+
+public ShowAutoAnalyzeJobsStmt(TableName tableName, Expr whereClause) {
+this.tableName = tableName;
+this.whereClause = whereClause;
+}
+
+// extract from predicate
+private String jobPriority;
+
+public String getPriority() {
+Preconditions.checkArgument(isAnalyzed(),
+"The stateValue must be obtained after the parsing is
complete");
+return jobPriority;
+}
+
+public Expr getWhereClause() {
+Preconditions.checkArgument(isAnalyzed(),
+"The whereClause must be obtained after the parsing is
complete");
+return whereClause;
+}
+
+@Override
+public void analyze(Analyzer analyzer) throws UserException {
+if (!ConnectContext.get().getSessionVariable().enableStats) {
+throw new UserException("Analyze function is forbidden, you should
add `e
(doris) 03/09: Support column level health value. (#31794)
This is an automated email from the ASF dual-hosted git repository.
lijibing pushed a commit to branch high-priority-column
in repository https://gitbox.apache.org/repos/asf/doris.git
commit b8f61c4b6a78751c1d3919c38642f88467553079
Author: Jibing-Li <64681310+jibing...@users.noreply.github.com>
AuthorDate: Tue Mar 5 16:19:08 2024 +0800
Support column level health value. (#31794)
---
.../apache/doris/analysis/ShowColumnStatsStmt.java | 4 +
.../apache/doris/datasource/InternalCatalog.java | 6 +-
.../java/org/apache/doris/qe/SessionVariable.java | 7 ++
.../org/apache/doris/statistics/AnalysisInfo.java | 17 ++--
.../doris/statistics/AnalysisInfoBuilder.java | 17 ++--
.../org/apache/doris/statistics/AnalysisJob.java | 8 +-
.../apache/doris/statistics/AnalysisManager.java | 13 ++-
.../org/apache/doris/statistics/ColStatsMeta.java | 16 ++--
.../doris/statistics/StatisticsAutoCollector.java | 95 --
.../doris/statistics/StatisticsJobAppender.java| 28 +--
.../apache/doris/statistics/TableStatsMeta.java| 33
.../doris/statistics/util/StatisticsUtil.java | 10 +++
.../apache/doris/statistics/AnalysisJobTest.java | 4 +-
.../doris/statistics/AnalysisManagerTest.java | 2 +-
14 files changed, 197 insertions(+), 63 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/analysis/ShowColumnStatsStmt.java
b/fe/fe-core/src/main/java/org/apache/doris/analysis/ShowColumnStatsStmt.java
index 37be76b20df..749bfa7d360 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/analysis/ShowColumnStatsStmt.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/analysis/ShowColumnStatsStmt.java
@@ -61,6 +61,8 @@ public class ShowColumnStatsStmt extends ShowStmt {
.add("trigger")
.add("query_times")
.add("updated_time")
+.add("update_rows")
+.add("last_analyze_row_count")
.build();
private final TableName tableName;
@@ -160,6 +162,8 @@ public class ShowColumnStatsStmt extends ShowStmt {
row.add(String.valueOf(colStatsMeta == null ? "N/A" :
colStatsMeta.jobType));
row.add(String.valueOf(colStatsMeta == null ? "N/A" :
colStatsMeta.queriedTimes));
row.add(String.valueOf(p.second.updatedTime));
+row.add(String.valueOf(colStatsMeta == null ? "N/A" :
colStatsMeta.updatedRows));
+row.add(String.valueOf(colStatsMeta == null ? "N/A" :
colStatsMeta.rowCount));
result.add(row);
});
return new ShowResultSet(getMetaData(), result);
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/datasource/InternalCatalog.java
b/fe/fe-core/src/main/java/org/apache/doris/datasource/InternalCatalog.java
index e4cf1797175..3d89705dead 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/datasource/InternalCatalog.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/datasource/InternalCatalog.java
@@ -3140,7 +3140,6 @@ public class InternalCatalog implements
CatalogIf {
rowsToTruncate += partition.getBaseIndex().getRowCount();
}
} else {
-rowsToTruncate = olapTable.getRowCount();
for (Partition partition : olapTable.getPartitions()) {
// If need absolutely correct, should check running txn
here.
// But if the txn is in prepare state, cann't known which
partitions had load data.
@@ -3149,6 +3148,7 @@ public class InternalCatalog implements
CatalogIf {
}
origPartitions.put(partition.getName(), partition.getId());
partitionsDistributionInfo.put(partition.getId(),
partition.getDistributionInfo());
+rowsToTruncate += partition.getBaseIndex().getRowCount();
}
}
// if table currently has no partitions, this sql like empty
command and do nothing, should return directly.
@@ -3309,10 +3309,8 @@ public class InternalCatalog implements
CatalogIf {
if (truncateEntireTable) {
// Drop the whole table stats after truncate the entire table
Env.getCurrentEnv().getAnalysisManager().dropStats(olapTable);
-} else {
-// Update the updated rows in table stats after truncate some
partitions.
-
Env.getCurrentEnv().getAnalysisManager().updateUpdatedRows(updateRecords);
}
+
Env.getCurrentEnv().getAnalysisManager().updateUpdatedRows(updateRecords);
LOG.info("finished to truncate table {}, partitions: {}",
tblRef.getName().toSql(), tblRef.getPartitionNames());
}
diff --git a/fe/fe-core/src/main/java/org/apache/doris/qe/SessionVariable.java
b/fe/fe-core/src/main/java/org/apache/doris/qe/SessionVariable.java
index 0304000a1f0..768138ff539 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/qe/SessionVa
(doris) 08/09: Refactor. (#32273)
This is an automated email from the ASF dual-hosted git repository.
lijibing pushed a commit to branch high-priority-column
in repository https://gitbox.apache.org/repos/asf/doris.git
commit e76be97881b65920f9214f1ea799d3c6a57ee3e6
Author: Jibing-Li <64681310+jibing...@users.noreply.github.com>
AuthorDate: Fri Mar 15 10:14:30 2024 +0800
Refactor. (#32273)
---
.../main/java/org/apache/doris/common/Config.java | 2 +-
.../java/org/apache/doris/catalog/OlapTable.java | 53 ---
.../main/java/org/apache/doris/catalog/Table.java | 11
.../java/org/apache/doris/catalog/TableIf.java | 5 --
.../org/apache/doris/datasource/ExternalTable.java | 31 -
.../apache/doris/statistics/AnalysisManager.java | 76 +-
.../apache/doris/statistics/BaseAnalysisTask.java | 2 +-
.../doris/statistics/ExternalAnalysisTask.java | 4 +-
.../doris/statistics/FollowerColumnSender.java | 4 +-
.../apache/doris/statistics/OlapAnalysisTask.java | 2 +-
.../{HighPriorityColumn.java => QueryColumn.java} | 8 +--
.../doris/statistics/StatisticConstants.java | 2 +-
.../doris/statistics/StatisticsAutoCollector.java | 51 ---
.../doris/statistics/StatisticsCollector.java | 75 -
.../doris/statistics/StatisticsJobAppender.java| 62 +++---
.../doris/statistics/util/StatisticsUtil.java | 54 +++
.../doris/statistics/AnalysisManagerTest.java | 45 -
17 files changed, 137 insertions(+), 350 deletions(-)
diff --git a/fe/fe-common/src/main/java/org/apache/doris/common/Config.java
b/fe/fe-common/src/main/java/org/apache/doris/common/Config.java
index 6420b843d8e..c9875a84023 100644
--- a/fe/fe-common/src/main/java/org/apache/doris/common/Config.java
+++ b/fe/fe-common/src/main/java/org/apache/doris/common/Config.java
@@ -1602,7 +1602,7 @@ public class Config extends ConfigBase {
"This parameter controls the time interval for automatic
collection jobs to check the health of table"
+ "statistics and trigger automatic collection"
})
-public static int auto_check_statistics_in_minutes = 5;
+public static int auto_check_statistics_in_minutes = 1;
/**
* If set to TRUE, the compaction slower replica will be skipped when
select get queryable replicas
diff --git a/fe/fe-core/src/main/java/org/apache/doris/catalog/OlapTable.java
b/fe/fe-core/src/main/java/org/apache/doris/catalog/OlapTable.java
index 561cbf09b3d..71d0f07b3f4 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/catalog/OlapTable.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/catalog/OlapTable.java
@@ -59,8 +59,6 @@ import org.apache.doris.statistics.AnalysisInfo.AnalysisType;
import org.apache.doris.statistics.BaseAnalysisTask;
import org.apache.doris.statistics.HistogramTask;
import org.apache.doris.statistics.OlapAnalysisTask;
-import org.apache.doris.statistics.TableStatsMeta;
-import org.apache.doris.statistics.util.StatisticsUtil;
import org.apache.doris.system.Backend;
import org.apache.doris.system.SystemInfoService;
import org.apache.doris.thrift.TColumn;
@@ -1247,57 +1245,6 @@ public class OlapTable extends Table implements
MTMVRelatedTableIf {
}
}
-public boolean needReAnalyzeTable(TableStatsMeta tblStats) {
-if (tblStats == null) {
-return true;
-}
-if (!tblStats.analyzeColumns().containsAll(getBaseSchema()
-.stream()
-.filter(c -> !StatisticsUtil.isUnsupportedType(c.getType()))
-.map(Column::getName)
-.collect(Collectors.toSet( {
-return true;
-}
-long rowCount = getRowCount();
-if (rowCount > 0 && tblStats.rowCount == 0) {
-return true;
-}
-long updateRows = tblStats.updatedRows.get();
-int tblHealth = StatisticsUtil.getTableHealth(rowCount, updateRows);
-return tblHealth < StatisticsUtil.getTableStatsHealthThreshold();
-}
-
-@Override
-public Map> findReAnalyzeNeededPartitions() {
-TableStatsMeta tableStats =
Env.getCurrentEnv().getAnalysisManager().findTableStatsStatus(getId());
-Set allPartitions =
getPartitionNames().stream().map(this::getPartition)
-
.filter(Partition::hasData).map(Partition::getName).collect(Collectors.toSet());
-if (tableStats == null) {
-Map> ret = Maps.newHashMap();
-for (Column col : getSchemaAllIndexes(false)) {
-if (StatisticsUtil.isUnsupportedType(col.getType())) {
-continue;
-}
-ret.put(col.getName(), allPartitions);
-}
-return ret;
-}
-Map> colToPart = new HashMap<>();
-for (Column col : getSchemaAllIndexes(false)) {
-if (StatisticsUtil.isUnsupportedType(col.getType())) {
-continue;
(doris) 02/09: High priority queue and map. (#31509)
This is an automated email from the ASF dual-hosted git repository.
lijibing pushed a commit to branch high-priority-column
in repository https://gitbox.apache.org/repos/asf/doris.git
commit 452646e86d10a9d2a51f791ed80b45809e61a7d1
Author: Jibing-Li <64681310+jibing...@users.noreply.github.com>
AuthorDate: Wed Feb 28 12:01:55 2024 +0800
High priority queue and map. (#31509)
---
.../main/java/org/apache/doris/catalog/Env.java| 20 +-
.../apache/doris/statistics/AnalysisManager.java | 33 +-
.../doris/statistics/StatisticsAutoCollector.java | 202 ++--
.../doris/statistics/StatisticsCollector.java | 4 -
.../doris/statistics/StatisticsJobAppender.java| 135 +
.../statistics/StatisticsAutoCollectorTest.java| 560 -
6 files changed, 213 insertions(+), 741 deletions(-)
diff --git a/fe/fe-core/src/main/java/org/apache/doris/catalog/Env.java
b/fe/fe-core/src/main/java/org/apache/doris/catalog/Env.java
index 2c5c90ee895..1974a316ec5 100755
--- a/fe/fe-core/src/main/java/org/apache/doris/catalog/Env.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/catalog/Env.java
@@ -243,6 +243,7 @@ import org.apache.doris.statistics.AnalysisManager;
import org.apache.doris.statistics.StatisticsAutoCollector;
import org.apache.doris.statistics.StatisticsCache;
import org.apache.doris.statistics.StatisticsCleaner;
+import org.apache.doris.statistics.StatisticsJobAppender;
import org.apache.doris.statistics.query.QueryStats;
import org.apache.doris.system.Backend;
import org.apache.doris.system.Frontend;
@@ -519,6 +520,8 @@ public class Env {
private StatisticsAutoCollector statisticsAutoCollector;
+private StatisticsJobAppender statisticsJobAppender;
+
private HiveTransactionMgr hiveTransactionMgr;
private TopicPublisherThread topicPublisherThread;
@@ -748,6 +751,7 @@ public class Env {
this.analysisManager = new AnalysisManager();
this.statisticsCleaner = new StatisticsCleaner();
this.statisticsAutoCollector = new StatisticsAutoCollector();
+this.statisticsJobAppender = new StatisticsJobAppender();
this.globalFunctionMgr = new GlobalFunctionMgr();
this.workloadGroupMgr = new WorkloadGroupMgr();
this.workloadSchedPolicyMgr = new WorkloadSchedPolicyMgr();
@@ -1028,13 +1032,6 @@ public class Env {
// If not using bdb, we need to notify the FE type transfer
manually.
notifyNewFETypeTransfer(FrontendNodeType.MASTER);
}
-if (statisticsCleaner != null) {
-statisticsCleaner.start();
-}
-if (statisticsAutoCollector != null) {
-statisticsAutoCollector.start();
-}
-
queryCancelWorker.start();
TopicPublisher wgPublisher = new WorkloadGroupPublisher(this);
@@ -1672,6 +1669,11 @@ public class Env {
binlogGcer.start();
columnIdFlusher.start();
insertOverwriteManager.start();
+
+// auto analyze related threads.
+statisticsCleaner.start();
+statisticsAutoCollector.start();
+statisticsJobAppender.start();
}
// start threads that should running on all FE
@@ -6023,6 +6025,10 @@ public class Env {
return statisticsAutoCollector;
}
+public StatisticsJobAppender getStatisticsJobAppender() {
+return statisticsJobAppender;
+}
+
public void alterMTMVRefreshInfo(AlterMTMVRefreshInfo info) {
AlterMTMV alter = new AlterMTMV(info.getMvName(),
info.getRefreshInfo(), MTMVAlterOpType.ALTER_REFRESH_INFO);
this.alter.processAlterMTMV(alter, false);
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/statistics/AnalysisManager.java
b/fe/fe-core/src/main/java/org/apache/doris/statistics/AnalysisManager.java
index cf3764719ba..ab883c79f8f 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/statistics/AnalysisManager.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/statistics/AnalysisManager.java
@@ -85,6 +85,7 @@ import java.util.Collections;
import java.util.Comparator;
import java.util.HashMap;
import java.util.HashSet;
+import java.util.LinkedHashMap;
import java.util.LinkedList;
import java.util.List;
import java.util.Map;
@@ -108,15 +109,12 @@ public class AnalysisManager implements Writable {
private static final Logger LOG =
LogManager.getLogger(AnalysisManager.class);
-/**
- * Mem only.
- */
-public final Queue predicateColumns = new
ArrayBlockingQueue<>(100);
-
-/**
- * Mem only.
- */
-public final Queue queryColumns = new
ArrayBlockingQueue<>(100);
+private static final int COLUMN_QUEUE_SIZE = 1000;
+public final Queue highPriorityColumns = new
ArrayBlockingQueue<>(COLUMN_QUEUE_SIZE);
+public final Queue midPriorityColumns = new
ArrayBlockingQueue<>(COLUMN_QUEUE_SIZE);
+public final Map> highPriorityJobs = new
LinkedHashMap<>();
+public final Map> midPriorityJobs = new
LinkedHashMap<
(doris) 09/09: refactor2 (#32278)
This is an automated email from the ASF dual-hosted git repository.
lijibing pushed a commit to branch high-priority-column
in repository https://gitbox.apache.org/repos/asf/doris.git
commit 3fb4b21417201528ad00e94932dc7eee00e42b4c
Author: Jibing-Li <64681310+jibing...@users.noreply.github.com>
AuthorDate: Fri Mar 15 11:58:38 2024 +0800
refactor2 (#32278)
---
.../doris/nereids/jobs/executor/Rewriter.java | 4 +--
...umnCollector.java => QueryColumnCollector.java} | 32 +++---
.../apache/doris/statistics/AnalysisManager.java | 6 ++--
3 files changed, 21 insertions(+), 21 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/executor/Rewriter.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/executor/Rewriter.java
index 9d6dd07601b..5439f4fa9e9 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/executor/Rewriter.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/executor/Rewriter.java
@@ -32,7 +32,7 @@ import
org.apache.doris.nereids.rules.expression.CheckLegalityAfterRewrite;
import org.apache.doris.nereids.rules.expression.ExpressionNormalization;
import org.apache.doris.nereids.rules.expression.ExpressionOptimization;
import org.apache.doris.nereids.rules.expression.ExpressionRewrite;
-import org.apache.doris.nereids.rules.expression.HighPriorityColumnCollector;
+import org.apache.doris.nereids.rules.expression.QueryColumnCollector;
import org.apache.doris.nereids.rules.rewrite.AddDefaultLimit;
import org.apache.doris.nereids.rules.rewrite.AdjustConjunctsReturnType;
import org.apache.doris.nereids.rules.rewrite.AdjustNullable;
@@ -412,7 +412,7 @@ public class Rewriter extends AbstractBatchJobExecutor {
new CollectProjectAboveConsumer()
)
),
-topic("Collect used column", custom(RuleType.COLLECT_COLUMNS,
HighPriorityColumnCollector::new))
+topic("Collect used column", custom(RuleType.COLLECT_COLUMNS,
QueryColumnCollector::new))
);
private static final List WHOLE_TREE_REWRITE_JOBS
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/HighPriorityColumnCollector.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/QueryColumnCollector.java
similarity index 89%
rename from
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/HighPriorityColumnCollector.java
rename to
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/QueryColumnCollector.java
index e20363b1202..ebf361de1d3 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/HighPriorityColumnCollector.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/QueryColumnCollector.java
@@ -21,7 +21,7 @@ import org.apache.doris.catalog.Column;
import org.apache.doris.catalog.Env;
import org.apache.doris.catalog.TableIf;
import org.apache.doris.nereids.jobs.JobContext;
-import
org.apache.doris.nereids.rules.expression.HighPriorityColumnCollector.CollectorContext;
+import
org.apache.doris.nereids.rules.expression.QueryColumnCollector.CollectorContext;
import org.apache.doris.nereids.trees.expressions.NamedExpression;
import org.apache.doris.nereids.trees.expressions.Slot;
import org.apache.doris.nereids.trees.expressions.SlotReference;
@@ -51,9 +51,9 @@ import java.util.Set;
import java.util.stream.Collectors;
/**
- * Used to collect High priority column.
+ * Used to collect query column.
*/
-public class HighPriorityColumnCollector extends
DefaultPlanRewriter implements CustomRewriter {
+public class QueryColumnCollector extends
DefaultPlanRewriter implements CustomRewriter {
@Override
public Plan rewriteRoot(Plan plan, JobContext jobContext) {
@@ -64,10 +64,10 @@ public class HighPriorityColumnCollector extends
DefaultPlanRewriter projects = new HashMap<>();
-public Set usedInPredicate = new HashSet<>();
+public Set highPriority = new HashSet<>();
-public Set queried = new HashSet<>();
+public Set midPriority = new HashSet<>();
}
@Override
@@ -103,7 +103,7 @@ public class HighPriorityColumnCollector extends
DefaultPlanRewriter outputOfScan = scan.getOutput();
for (Slot slot : outputOfScan) {
if (!allUsed.contains(slot)) {
-context.queried.remove(slot);
+context.midPriority.remove(slot);
}
}
}
@@ -114,7 +114,7 @@ public class HighPriorityColumnCollector extends
DefaultPlanRewriter
join, CollectorContext context) {
join.child(0).accept(this, context);
join.child(1).accept(this, context);
-context.usedInPredicate.addAll(
+context.highPriority.addAll(
(join.isMarkJoin() ? join.getLeftConditionSlot() :
join.getConditionSlot())
.stream().flatMap(s -> backtrace(s, context).
(doris) 07/09: support window (#32094)
This is an automated email from the ASF dual-hosted git repository.
lijibing pushed a commit to branch high-priority-column
in repository https://gitbox.apache.org/repos/asf/doris.git
commit c707a66a2437e57e1fd1e6511370f275a4460144
Author: Jibing-Li <64681310+jibing...@users.noreply.github.com>
AuthorDate: Tue Mar 12 13:25:23 2024 +0800
support window (#32094)
---
.../rules/expression/HighPriorityColumnCollector.java | 13 +
1 file changed, 13 insertions(+)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/HighPriorityColumnCollector.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/HighPriorityColumnCollector.java
index ed67ad97005..e20363b1202 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/HighPriorityColumnCollector.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/HighPriorityColumnCollector.java
@@ -34,6 +34,7 @@ import
org.apache.doris.nereids.trees.plans.logical.LogicalHaving;
import org.apache.doris.nereids.trees.plans.logical.LogicalJoin;
import org.apache.doris.nereids.trees.plans.logical.LogicalOlapScan;
import org.apache.doris.nereids.trees.plans.logical.LogicalProject;
+import org.apache.doris.nereids.trees.plans.logical.LogicalWindow;
import org.apache.doris.nereids.trees.plans.visitor.CustomRewriter;
import org.apache.doris.nereids.trees.plans.visitor.DefaultPlanRewriter;
import org.apache.doris.qe.ConnectContext;
@@ -169,6 +170,18 @@ public class HighPriorityColumnCollector extends
DefaultPlanRewriter window,
CollectorContext context) {
+window.child(0).accept(this, context);
+context.usedInPredicate.addAll(window
+.getWindowExpressions()
+.stream()
+.flatMap(e -> e.>collect(n -> n instanceof
SlotReference).stream())
+.flatMap(s -> backtrace(s, context).stream())
+.collect(Collectors.toSet()));
+return window;
+}
+
private Set backtrace(Slot slot, CollectorContext context) {
return backtrace(slot, new HashSet<>(), context);
}
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch high-priority-column updated (becace04d80 -> 3fb4b214172)
This is an automated email from the ASF dual-hosted git repository. lijibing pushed a change to branch high-priority-column in repository https://gitbox.apache.org/repos/asf/doris.git discard becace04d80 refactor2 (#32278) omit b5ba91a9ec0 Refactor. (#32273) omit c73acc0b8ea support window (#32094) omit 16a1d332ae7 Check column health value earlier, show job priority. (#32064) omit b7145ca484b Support show auto analyze pending jobs. (#31926) omit 9764ef3aa89 Support follower sync query columns to master. (#31859) omit 5cac30ed252 Support column level health value. (#31794) omit 077a4c0575c High priority queue and map. (#31509) omit 0b5a2a58b8c Collect high priority columns. (#31235) add 0292dd479b4 [feature](pipelineX) support paritition tablet sink shuffle (#31689) add 43ce4864fb2 [opt](Nereids) outer join with is null stats estimation enhancement (#31875) add f3fdb306e4f [feat](nereids) add merge aggregate rule (#31811) add 684766e8ce0 [Enhancement](jdbc catalog) Add a property to test the connection when creating a Jdbc catalog (#32125) add 7786f95682a [fix](Nereids): ignore project and distribute in test_cte_filter_pushdown and push_down_expression_in_hash_join (#32083) add 7d5a64e6be2 [fix](nereids)EliminateSemiJoin should consider empty table (#32107) add e368c36589b [enhancement](Nereids) Optimize expression (#32067) add 3842427c487 [Chore](workflow) do not check java env on clang-tidy preparation (#32161) add b4f471050a7 [fix](merge-clod) fix file not found when load for mow table (#32144) add 99680e9ec13 [Bug](top-n) do not update topn filter when sort node and scan node are not in the… (#32159) add ca092139a00 [fix](Nereids): slot set in condition can be empty (#32169) add 9f628f3449b [improvement](mtmv) Remove useless code and add some doc (#32047) add 50b1aa6e3db [fix](merge-cloud) fix no cluster for common user (#32097) add 954750b59a8 [Fix](smooth-upgrade) Fix incompatibility when upgrade from 2.0 to 2.1 add 31da1bb9e42 [fix](regression-test) upgrade groovy to 4.x and enable run test by jdk17/21 again add ae7d0d2bbad [Opt](exec) Reduce unnecessary find function calls (#32165) add f2373fcc948 [fix](index compaction)Fix MOW index compaction core (#32121) add 0e344246aab [Optimization][Scanner] Skip `_init_variant_columns` when there are no variant columns, and ensure `inherit_tablet_index` is called only once (#32174) add 0b0e527ce1f [enhancement](cloud) Enable FileCache for internal statistics info table (#32142) add 191982c8782 [Fix](Variant) fix inverted index lost due to wrong column unique id (#31992) add 7137ed36be3 [fix](routineload) fix consume data too slow in partial partitions (#32126) add 65fc66072bb [fix](merge-cloud) fix cloud cumu compaction thread not initializing thread loaca context (#32181) add 67064e1442b [improvement](Nereids) Support to remove sort which is under table sink (#31751) add 50be40429f3 [enhancement](nereids) support unnest subquery with group by and having clause (#32002) add 70e1a17c82a [chore](tools) update tools config (#32193) add 3e8e3a7660e [Chore](build) add DISABLE_BE_JAVA_EXTENSIONS to generate compile_commands.json (#32189) add 74660237ed5 [fix](jdbc catalog) Fix the wrong method used in loadColumnNames of JdbcIdentifierMapping (#32168) add cfa403fb900 [fix](mysql) Fix Connection Attributes Parsing Logic for Compatibility (#32177) add 50300474cf3 [fix](script) Fix the JAVA_OPTS set on macOS (#32170) add 3a4c1ea73e7 [fix](merge-cloud) fix check failed in cloud delta writer (#32197) new 32184b35cb4 Collect high priority columns. (#31235) new 452646e86d1 High priority queue and map. (#31509) new b8f61c4b6a7 Support column level health value. (#31794) new 8bccfb5cc15 Support follower sync query columns to master. (#31859) new f74a289e2f2 Support show auto analyze pending jobs. (#31926) new 4d426f6dbaa Check column health value earlier, show job priority. (#32064) new c707a66a243 support window (#32094) new e76be97881b Refactor. (#32273) new 3fb4b214172 refactor2 (#32278) This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (becace04d80) \ N -- N -- N refs/heads/high-priority-column (3fb4b214172) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 9 revisions listed above
(doris) 04/09: Support follower sync query columns to master. (#31859)
This is an automated email from the ASF dual-hosted git repository.
lijibing pushed a commit to branch high-priority-column
in repository https://gitbox.apache.org/repos/asf/doris.git
commit 8bccfb5cc150ccb0771a4de588122e440101bf0b
Author: Jibing-Li <64681310+jibing...@users.noreply.github.com>
AuthorDate: Wed Mar 6 17:05:21 2024 +0800
Support follower sync query columns to master. (#31859)
---
.../main/java/org/apache/doris/catalog/Env.java| 8 ++
.../apache/doris/service/FrontendServiceImpl.java | 8 ++
.../apache/doris/statistics/AnalysisManager.java | 15 +++
.../doris/statistics/FollowerColumnSender.java | 120 +
.../doris/statistics/HighPriorityColumn.java | 11 ++
.../doris/statistics/StatisticsAutoCollector.java | 21 +++-
gensrc/thrift/FrontendService.thrift | 13 +++
7 files changed, 194 insertions(+), 2 deletions(-)
diff --git a/fe/fe-core/src/main/java/org/apache/doris/catalog/Env.java
b/fe/fe-core/src/main/java/org/apache/doris/catalog/Env.java
index 1974a316ec5..0c600bb5fe8 100755
--- a/fe/fe-core/src/main/java/org/apache/doris/catalog/Env.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/catalog/Env.java
@@ -240,6 +240,7 @@ import
org.apache.doris.scheduler.registry.ExportTaskRegister;
import org.apache.doris.service.ExecuteEnv;
import org.apache.doris.service.FrontendOptions;
import org.apache.doris.statistics.AnalysisManager;
+import org.apache.doris.statistics.FollowerColumnSender;
import org.apache.doris.statistics.StatisticsAutoCollector;
import org.apache.doris.statistics.StatisticsCache;
import org.apache.doris.statistics.StatisticsCleaner;
@@ -522,6 +523,8 @@ public class Env {
private StatisticsJobAppender statisticsJobAppender;
+private FollowerColumnSender followerColumnSender;
+
private HiveTransactionMgr hiveTransactionMgr;
private TopicPublisherThread topicPublisherThread;
@@ -1732,6 +1735,11 @@ public class Env {
if (analysisManager != null) {
analysisManager.getStatisticsCache().preHeat();
}
+
+if (followerColumnSender == null) {
+followerColumnSender = new FollowerColumnSender();
+followerColumnSender.start();
+}
}
// Set global variable 'lower_case_table_names' only when the cluster is
initialized.
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/service/FrontendServiceImpl.java
b/fe/fe-core/src/main/java/org/apache/doris/service/FrontendServiceImpl.java
index ef70faa2322..c4a668c8850 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/service/FrontendServiceImpl.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/service/FrontendServiceImpl.java
@@ -220,6 +220,7 @@ import
org.apache.doris.thrift.TStreamLoadMultiTablePutResult;
import org.apache.doris.thrift.TStreamLoadPutRequest;
import org.apache.doris.thrift.TStreamLoadPutResult;
import org.apache.doris.thrift.TStringLiteral;
+import org.apache.doris.thrift.TSyncQueryColumns;
import org.apache.doris.thrift.TTableIndexQueryStats;
import org.apache.doris.thrift.TTableMetadataNameIds;
import org.apache.doris.thrift.TTableQueryStats;
@@ -3731,4 +3732,11 @@ public class FrontendServiceImpl implements
FrontendService.Iface {
return result;
}
+@Override
+public TStatus syncQueryColumns(TSyncQueryColumns request) throws
TException {
+
Env.getCurrentEnv().getAnalysisManager().mergeFollowerQueryColumns(request.highPriorityColumns,
+request.midPriorityColumns);
+return new TStatus(TStatusCode.OK);
+}
+
}
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/statistics/AnalysisManager.java
b/fe/fe-core/src/main/java/org/apache/doris/statistics/AnalysisManager.java
index bac84996dd1..e2bd85a0f43 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/statistics/AnalysisManager.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/statistics/AnalysisManager.java
@@ -64,6 +64,7 @@ import org.apache.doris.statistics.util.StatisticsUtil;
import org.apache.doris.system.Frontend;
import org.apache.doris.system.SystemInfoService;
import org.apache.doris.thrift.TInvalidateFollowerStatsCacheRequest;
+import org.apache.doris.thrift.TQueryColumn;
import com.google.common.annotations.VisibleForTesting;
import com.google.common.collect.ImmutableList;
@@ -1191,4 +1192,18 @@ public class AnalysisManager implements Writable {
}
}
}
+
+public void mergeFollowerQueryColumns(Collection highColumns,
+Collection midColumns) {
+for (TQueryColumn c : highColumns) {
+if (!highPriorityColumns.offer(new HighPriorityColumn(c.catalogId,
c.dbId, c.tblId, c.colName))) {
+break;
+}
+}
+for (TQueryColumn c : midColumns) {
+if (!midPriorityColumns.offer(new HighPriorityColumn(c.catalogId,
c.dbId, c.tblId, c.colName))) {
+break;
+}
+}
+
Re: [PR] [behavior change](output) change float output format [doris]
doris-robot commented on PR #32049: URL: https://github.com/apache/doris/pull/32049#issuecomment-1999079025 TPC-H: Total hot run time: 38027 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit c6b6ff2aa6c4bfff1055193edbbe4f3ece031089, data reload: false -- Round 1 -- q1 17698 423040724072 q2 2030152 160 152 q3 10583 1107886 886 q4 7436707 704 704 q5 7459260926122609 q6 184 124 123 123 q7 1204826 799 799 q8 9323206320052005 q9 7115634964166349 q10 8460349136313491 q11 427 218 220 218 q12 806 298 300 298 q13 18112 286228392839 q14 285 251 246 246 q15 499 451 457 451 q16 500 393 388 388 q17 953 539 512 512 q18 7216653163826382 q19 3809147213741374 q20 531 288 280 280 q21 6128354536013545 q22 351 304 332 304 Total cold run time: 09 ms Total hot run time: 38027 ms - Round 2, with runtime_filter_mode=off - q1 4117410640644064 q2 321 231 222 222 q3 2926286727922792 q4 1869152715841527 q5 5193525151945194 q6 192 114 116 114 q7 2227181718161816 q8 3146326532713265 q9 8543851985168516 q10 3714366436873664 q11 536 435 444 435 q12 700 555 586 555 q13 16926 285228362836 q14 273 240 247 240 q15 486 436 449 436 q16 462 418 415 415 q17 1733148614761476 q18 7531712370817081 q19 1634153915281528 q20 1873168817311688 q21 4876474848304748 q22 537 460 449 449 Total cold run time: 69815 ms Total hot run time: 53061 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](Nereids): rewrite sum literal to sum and count [doris]
XieJiann commented on PR #32244: URL: https://github.com/apache/doris/pull/32244#issuecomment-1999080885 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](function)revert function REPEAT nullable mode [doris]
zclllyybb commented on PR #32226: URL: https://github.com/apache/doris/pull/32226#issuecomment-1999081250 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Improvement](executor)Add queue columns for active_queries [doris]
doris-robot commented on PR #32259: URL: https://github.com/apache/doris/pull/32259#issuecomment-1999081837 TPC-H: Total hot run time: 37997 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 94af99aa45e4beab758ed3b318f13d439a6041f6, data reload: false -- Round 1 -- q1 17626 417640974097 q2 2023153 142 142 q3 10613 1052896 896 q4 7086706 692 692 q5 7448261126792611 q6 181 121 120 120 q7 1182789 794 789 q8 9339192120041921 q9 7150638763966387 q10 8495352736403527 q11 438 225 211 211 q12 769 305 283 283 q13 18139 281028212810 q14 274 244 252 244 q15 497 462 442 442 q16 509 382 383 382 q17 945 557 512 512 q18 7004639665096396 q19 1567138813721372 q20 564 285 278 278 q21 6303359436633594 q22 357 291 333 291 Total cold run time: 108509 ms Total hot run time: 37997 ms - Round 2, with runtime_filter_mode=off - q1 4090419441034103 q2 318 226 229 226 q3 2928279827922792 q4 1839157915301530 q5 5230524052105210 q6 190 116 116 116 q7 2210187418441844 q8 3163328732803280 q9 8536848685048486 q10 3652370736623662 q11 540 443 458 443 q12 708 553 559 553 q13 17211 288729792887 q14 289 268 264 264 q15 482 448 449 448 q16 474 445 423 423 q17 1747147814591459 q18 7700715070317031 q19 1675145914511451 q20 1890167016951670 q21 4868463446214621 q22 539 449 436 436 Total cold run time: 70279 ms Total hot run time: 52935 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](insert)implement hive table sink plan [doris]
doris-robot commented on PR #31765: URL: https://github.com/apache/doris/pull/31765#issuecomment-1999088034 TPC-H: Total hot run time: 38573 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit f4281393c816a44513eefb52868a5d51bf557e16, data reload: false -- Round 1 -- q1 17627 421641304130 q2 2026161 147 147 q3 10599 1079917 917 q4 8121785 730 730 q5 7486258426402584 q6 195 124 125 124 q7 1181827 815 815 q8 9336200520022002 q9 7070642264186418 q10 8479351836663518 q11 431 231 221 221 q12 610 306 296 296 q13 17788 288628802880 q14 278 243 257 243 q15 499 453 452 452 q16 505 398 399 398 q17 983 606 561 561 q18 7464672465426542 q19 2592141414541414 q20 554 295 284 284 q21 6531361035823582 q22 393 315 321 315 Total cold run time: 110748 ms Total hot run time: 38573 ms - Round 2, with runtime_filter_mode=off - q1 4153412341134113 q2 322 227 218 218 q3 3045291229162912 q4 1879161315821582 q5 5247529352805280 q6 201 116 120 116 q7 2257186918401840 q8 3180333133183318 q9 8625853085808530 q10 3773370637763706 q11 543 442 438 438 q12 729 556 530 530 q13 16909 287628542854 q14 297 243 251 243 q15 490 447 447 447 q16 458 428 424 424 q17 1761149114781478 q18 7561729671957195 q19 1632154115291529 q20 1924177317501750 q21 4887473248714732 q22 549 469 458 458 Total cold run time: 70422 ms Total hot run time: 53693 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids): don't pushdown project when project contains both side of join [doris]
doris-robot commented on PR #32214: URL: https://github.com/apache/doris/pull/32214#issuecomment-1999088490 TPC-H: Total hot run time: 37988 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit fd500a256d452d6fdd9896b240ae548d531e0f7f, data reload: false -- Round 1 -- q1 17670 421640514051 q2 2013149 144 144 q3 10606 1046879 879 q4 7784735 688 688 q5 7476259826202598 q6 189 123 122 122 q7 1195826 792 792 q8 9332197219641964 q9 7172640463876387 q10 8498343736103437 q11 435 218 210 210 q12 623 292 298 292 q13 18050 282228732822 q14 278 252 247 247 q15 500 453 456 453 q16 505 384 384 384 q17 934 587 555 555 q18 7049653263976397 q19 1557138413911384 q20 549 293 276 276 q21 6209361036503610 q22 368 296 299 296 Total cold run time: 108992 ms Total hot run time: 37988 ms - Round 2, with runtime_filter_mode=off - q1 4195412041344120 q2 314 225 229 225 q3 2963291228202820 q4 1882156515341534 q5 5269533053065306 q6 208 114 119 114 q7 2262184518571845 q8 3135324933163249 q9 8735871687928716 q10 3822389038173817 q11 572 462 448 448 q12 769 569 577 569 q13 17414 290328892889 q14 275 269 270 269 q15 495 459 478 459 q16 451 434 428 428 q17 1737151714691469 q18 7568719472417194 q19 2076148015041480 q20 1911171816911691 q21 4767449246984492 q22 550 458 464 458 Total cold run time: 71370 ms Total hot run time: 53592 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [Fix](Nereids) fix leading syntax problems and data mismatched problem [doris]
LiBinfeng-01 opened a new pull request, #32286:
URL: https://github.com/apache/doris/pull/32286
## Proposed changes
- fix syntax problems of only one table used in leading or mistake usage of
brace
example: leading(t1),leading(t1 {t2})
- fix cte used in subquery of using leading
example: with cte as (select c1 from t1) select count(*) from t1 join
(select /*+ leading(cte t2) */ c2 from t2 join cte on c2 = cte.c1) as alias on
t1.c1 = alias.c2;
which cte used in subquery and subquery also have leading
- fix data mismatched with original plan cause of on predicate push to
nullable side
example: select count(*) from t1 left join t2 on c1 > 500 and c2 > 500 can
not change to select count(*) from t1 left join t2 on c2 > 500 where c1 > 500
## Further comments
If this is a relatively large or complex change, kick off the discussion at
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you
chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Nereids) fix leading syntax problems and data mismatched problem [doris]
doris-robot commented on PR #32286: URL: https://github.com/apache/doris/pull/32286#issuecomment-1999090686 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [expr](fix) Not to throw exception when close failed [doris]
Gabriel39 opened a new pull request, #32287: URL: https://github.com/apache/doris/pull/32287 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [expr](fix) Not to throw exception when close failed [doris]
doris-robot commented on PR #32287: URL: https://github.com/apache/doris/pull/32287#issuecomment-1999091818 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [expr](fix) Not to throw exception when close failed [doris]
Gabriel39 commented on PR #32287: URL: https://github.com/apache/doris/pull/32287#issuecomment-1999091989 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Outfile) Fix the column type mapping in the orc/parquet file format [doris]
doris-robot commented on PR #32281: URL: https://github.com/apache/doris/pull/32281#issuecomment-1999095858 TeamCity be ut coverage result: Function Coverage: 34.96% (8576/24534) Line Coverage: 26.66% (69510/260726) Region Coverage: 25.96% (36107/139102) Branch Coverage: 22.90% (18431/80476) Coverage Report: http://coverage.selectdb-in.cc/coverage/3694999762d0186fc0c1cd20343445f115ae5afd_3694999762d0186fc0c1cd20343445f115ae5afd/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [behavior change](output) change float output format [doris]
doris-robot commented on PR #32049: URL: https://github.com/apache/doris/pull/32049#issuecomment-1999095967 TeamCity be ut coverage result: Function Coverage: 34.94% (8573/24534) Line Coverage: 26.64% (69468/260721) Region Coverage: 25.94% (36088/139103) Branch Coverage: 22.89% (18421/80474) Coverage Report: http://coverage.selectdb-in.cc/coverage/c6b6ff2aa6c4bfff1055193edbbe4f3ece031089_c6b6ff2aa6c4bfff1055193edbbe4f3ece031089/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refactor](nereids)unify outputTupleDesc and projection [doris]
doris-robot commented on PR #32128: URL: https://github.com/apache/doris/pull/32128#issuecomment-1999096085 TeamCity be ut coverage result: Function Coverage: 34.93% (8572/24540) Line Coverage: 26.63% (69464/260842) Region Coverage: 25.93% (36087/139178) Branch Coverage: 22.88% (18424/80536) Coverage Report: http://coverage.selectdb-in.cc/coverage/73d8d55f59c30bb7b417ed66074a5517d939109b_73d8d55f59c30bb7b417ed66074a5517d939109b/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Improvement](executor)Add queue columns for active_queries [doris]
doris-robot commented on PR #32259: URL: https://github.com/apache/doris/pull/32259#issuecomment-1999096251 TeamCity be ut coverage result: Function Coverage: 34.95% (8574/24534) Line Coverage: 26.65% (69485/260731) Region Coverage: 25.94% (36087/139107) Branch Coverage: 22.90% (18427/80478) Coverage Report: http://coverage.selectdb-in.cc/coverage/94af99aa45e4beab758ed3b318f13d439a6041f6_94af99aa45e4beab758ed3b318f13d439a6041f6/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [expr](fix) Not to throw exception when close failed [doris]
github-actions[bot] commented on PR #32287: URL: https://github.com/apache/doris/pull/32287#issuecomment-1999097790 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](hive)add 'HmsCommiter' to support inserting data into hive table [doris]
wuwenchi commented on PR #32283: URL: https://github.com/apache/doris/pull/32283#issuecomment-1999098616 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](merge-cloud) Add multi cloud cluster [doris]
doris-robot commented on PR #31749: URL: https://github.com/apache/doris/pull/31749#issuecomment-1999098771 TPC-H: Total hot run time: 38479 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 44c504d990d7eb1e6f7716827b47b0c1fd6edf6b, data reload: false -- Round 1 -- q1 17661 436241704170 q2 2024158 143 143 q3 10609 1077901 901 q4 7795762 810 762 q5 7466266627012666 q6 195 122 124 122 q7 1200807 800 800 q8 9367207220232023 q9 7196645264866452 q10 8575352236643522 q11 434 218 214 214 q12 684 309 309 309 q13 17928 286328662863 q14 272 246 253 246 q15 500 455 449 449 q16 506 393 398 393 q17 962 522 546 522 q18 7185655263836383 q19 2014145714151415 q20 540 288 276 276 q21 6130354735503547 q22 374 301 331 301 Total cold run time: 109617 ms Total hot run time: 38479 ms - Round 2, with runtime_filter_mode=off - q1 4142410741264107 q2 323 218 222 218 q3 2956281928702819 q4 1857151315281513 q5 5230525252375237 q6 196 117 117 117 q7 2256188219021882 q8 3182332133103310 q9 8631858785718571 q10 3701370536763676 q11 544 438 439 438 q12 728 559 538 538 q13 16913 284728342834 q14 274 248 249 248 q15 484 438 458 438 q16 459 409 407 407 q17 1760150014551455 q18 7594712070757075 q19 2828153415551534 q20 1878173317001700 q21 4825465047014650 q22 542 456 466 456 Total cold run time: 71303 ms Total hot run time: 53223 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](function)revert function REPEAT nullable mode [doris]
doris-robot commented on PR #32226: URL: https://github.com/apache/doris/pull/32226#issuecomment-1999106965 TeamCity be ut coverage result: Function Coverage: 34.95% (8573/24527) Line Coverage: 26.66% (69481/260654) Region Coverage: 25.95% (36088/139074) Branch Coverage: 22.90% (18429/80460) Coverage Report: http://coverage.selectdb-in.cc/coverage/ee42672ab9633bc38894292ebab40ca1fb9fbcd3_ee42672ab9633bc38894292ebab40ca1fb9fbcd3/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Nereids) fix leading syntax problems and data mismatched problem [doris]
LiBinfeng-01 commented on PR #32286: URL: https://github.com/apache/doris/pull/32286#issuecomment-1999107290 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](planner)decimalv3 literal's precision and scale is not correctly set [doris]
starocean999 opened a new pull request, #32288: URL: https://github.com/apache/doris/pull/32288 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](planner)decimalv3 literal's precision and scale is not correctly set [doris]
doris-robot commented on PR #32288: URL: https://github.com/apache/doris/pull/32288#issuecomment-1999112442 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](planner)decimalv3 literal's precision and scale is not correctly set [doris]
starocean999 commented on PR #32288: URL: https://github.com/apache/doris/pull/32288#issuecomment-1999112526 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](compatibility) should enable windown funnel mode from 2.0 [doris]
doris-robot commented on PR #32284: URL: https://github.com/apache/doris/pull/32284#issuecomment-1999113529 TeamCity be ut coverage result: Function Coverage: 34.95% (8574/24534) Line Coverage: 26.65% (69473/260728) Region Coverage: 25.94% (36085/139107) Branch Coverage: 22.89% (18424/80478) Coverage Report: http://coverage.selectdb-in.cc/coverage/8c2d04037a72acc5db2a0637a53550e85c4c8d78_8c2d04037a72acc5db2a0637a53550e85c4c8d78/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](compatible) display dateV2/datetimeV2/decimalv3 as date/datetime/decimal when show column [doris]
weizuo93 commented on PR #32233: URL: https://github.com/apache/doris/pull/32233#issuecomment-1999113790 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](function)revert function REPEAT nullable mode [doris]
doris-robot commented on PR #32226: URL: https://github.com/apache/doris/pull/32226#issuecomment-1999117179 TPC-H: Total hot run time: 38352 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ee42672ab9633bc38894292ebab40ca1fb9fbcd3, data reload: false -- Round 1 -- q1 17642 438041084108 q2 2036156 151 151 q3 10726 1094911 911 q4 7603727 717 717 q5 7490268926802680 q6 188 122 121 121 q7 1193828 806 806 q8 9411200420012001 q9 7142648464486448 q10 8531352136093521 q11 433 231 216 216 q12 625 301 284 284 q13 17792 284328802843 q14 273 248 263 248 q15 496 450 451 450 q16 515 394 396 394 q17 947 628 549 549 q18 7119660864546454 q19 4279141014411410 q20 537 293 275 275 q21 6142356534583458 q22 380 312 307 307 Total cold run time: 111500 ms Total hot run time: 38352 ms - Round 2, with runtime_filter_mode=off - q1 4209406240644062 q2 320 225 220 220 q3 2970284128632841 q4 1875155915181518 q5 5214523152535231 q6 203 113 114 113 q7 2256184818451845 q8 3139329432973294 q9 8555853585968535 q10 3732366036493649 q11 547 469 430 430 q12 745 554 563 554 q13 16913 286028142814 q14 275 262 262 262 q15 489 446 460 446 q16 453 403 409 403 q17 1755147814671467 q18 7602735970837083 q19 1595155415211521 q20 1905172217291722 q21 4879464947574649 q22 524 445 460 445 Total cold run time: 70155 ms Total hot run time: 53104 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [expr](fix) Not to throw exception when close failed [doris]
doris-robot commented on PR #32287: URL: https://github.com/apache/doris/pull/32287#issuecomment-1999116516 TPC-H: Total hot run time: 38417 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 4ced3e7c7d87d02651019c0c37d5db2ee86344c0, data reload: false -- Round 1 -- q1 17641 440241204120 q2 2025154 140 140 q3 10800 1078889 889 q4 7925739 729 729 q5 7497271627072707 q6 198 124 131 124 q7 1160822 812 812 q8 9367202219871987 q9 7066644864396439 q10 8455352536393525 q11 422 218 215 215 q12 622 302 303 302 q13 17800 284028352835 q14 282 261 250 250 q15 501 450 459 450 q16 472 397 385 385 q17 965 531 595 531 q18 7373649665986496 q19 1570142414871424 q20 548 277 282 277 q21 6151347835023478 q22 366 302 305 302 Total cold run time: 109206 ms Total hot run time: 38417 ms - Round 2, with runtime_filter_mode=off - q1 4131405840984058 q2 321 231 227 227 q3 2987283528112811 q4 1843157115241524 q5 5222524152545241 q6 197 115 115 115 q7 2221182518481825 q8 3156326532753265 q9 8621857285298529 q10 3694371037013701 q11 544 447 430 430 q12 726 574 572 572 q13 16921 283628642836 q14 277 242 247 242 q15 475 448 446 446 q16 449 413 418 413 q17 1743151514711471 q18 7519736471667166 q19 2165153514991499 q20 1904169417051694 q21 4942459046064590 q22 521 439 458 439 Total cold run time: 70579 ms Total hot run time: 53094 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [I] 小批量更新的时候，BE节点CPU200%以上 [doris]
yitizi commented on issue #18349: URL: https://github.com/apache/doris/issues/18349#issuecomment-1999117528 我也用的 unique表，删除的情况也是，我使用delete form语句删除大约300万条数据，be cpu ide瞬间从80%掉到 10%。   -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [expr](fix) Not to throw exception when close failed [doris]
doris-robot commented on PR #32287: URL: https://github.com/apache/doris/pull/32287#issuecomment-1999119392 TeamCity be ut coverage result: Function Coverage: 34.95% (8574/24534) Line Coverage: 26.65% (69480/260728) Region Coverage: 25.94% (36088/139106) Branch Coverage: 22.90% (18427/80478) Coverage Report: http://coverage.selectdb-in.cc/coverage/4ced3e7c7d87d02651019c0c37d5db2ee86344c0_4ced3e7c7d87d02651019c0c37d5db2ee86344c0/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](compatibility) should enable windown funnel mode from 2.0 [doris]
doris-robot commented on PR #32284: URL: https://github.com/apache/doris/pull/32284#issuecomment-1999120409 TPC-H: Total hot run time: 38267 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 8c2d04037a72acc5db2a0637a53550e85c4c8d78, data reload: false -- Round 1 -- q1 17728 440041344134 q2 2023153 143 143 q3 10760 1076882 882 q4 7525749 740 740 q5 7469264926212621 q6 186 119 118 118 q7 1192822 790 790 q8 9334197420131974 q9 7205641763676367 q10 8537355536093555 q11 438 227 213 213 q12 580 295 311 295 q13 17793 282728232823 q14 282 241 256 241 q15 500 464 450 450 q16 519 379 386 379 q17 940 572 562 562 q18 7171642264166416 q19 1517142614131413 q20 537 284 284 284 q21 6184361135763576 q22 341 294 291 291 Total cold run time: 108761 ms Total hot run time: 38267 ms - Round 2, with runtime_filter_mode=off - q1 4082407240364036 q2 323 228 225 225 q3 2934278828312788 q4 1820157215251525 q5 5177522052325220 q6 189 114 123 114 q7 2198183718391837 q8 3143329232783278 q9 8516851385018501 q10 3675363336673633 q11 543 445 441 441 q12 717 535 541 535 q13 16921 287528112811 q14 269 259 249 249 q15 481 444 443 443 q16 451 423 400 400 q17 1711146114511451 q18 7580715671757156 q19 1602155115101510 q20 1903171516781678 q21 4810469446114611 q22 548 442 481 442 Total cold run time: 69593 ms Total hot run time: 52884 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](Nereids): rewrite sum literal to sum and count [doris]
doris-robot commented on PR #32244: URL: https://github.com/apache/doris/pull/32244#issuecomment-1999122669 TPC-H: Total hot run time: 38452 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit f5e2cba61e87b105eac508518ca18e1782ab4f1a, data reload: false -- Round 1 -- q1 17669 426541654165 q2 2031154 158 154 q3 10576 1101888 888 q4 8123765 723 723 q5 7472273627502736 q6 187 130 126 126 q7 1169830 801 801 q8 9326197219741972 q9 7099640163796379 q10 8483353135943531 q11 431 222 216 216 q12 597 301 291 291 q13 17782 284728482847 q14 276 248 255 248 q15 488 460 443 443 q16 515 395 386 386 q17 940 550 603 550 q18 7168644564556445 q19 1566143914131413 q20 531 282 276 276 q21 6434356535733565 q22 347 297 307 297 Total cold run time: 109210 ms Total hot run time: 38452 ms - Round 2, with runtime_filter_mode=off - q1 4112409940684068 q2 324 229 219 219 q3 2921282027962796 q4 1841159615161516 q5 5198522052125212 q6 195 116 116 116 q7 2219186318501850 q8 3141330532873287 q9 8605858485998584 q10 3747373137203720 q11 543 440 436 436 q12 714 558 575 558 q13 18518 289329162893 q14 286 242 251 242 q15 497 445 454 445 q16 458 431 413 413 q17 1747148014791479 q18 7618719872177198 q19 3536151415311514 q20 1918173917041704 q21 4836498648454845 q22 569 511 487 487 Total cold run time: 73543 ms Total hot run time: 53582 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](hive)add 'HmsCommiter' to support inserting data into hive table [doris]
doris-robot commented on PR #32283: URL: https://github.com/apache/doris/pull/32283#issuecomment-1999123379 TPC-H: Total hot run time: 38296 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 90c0f99f00b15e1632df0632eec20750d30353f7, data reload: false -- Round 1 -- q1 17725 519441314131 q2 2026155 147 147 q3 10683 1066900 900 q4 7107712 754 712 q5 7481264826102610 q6 182 122 121 121 q7 1202816 806 806 q8 9377201020072007 q9 7138648964576457 q10 8455350536373505 q11 416 214 221 214 q12 637 299 289 289 q13 17794 288128642864 q14 280 251 243 243 q15 497 451 458 451 q16 487 400 398 398 q17 944 551 525 525 q18 7460652464086408 q19 1577149514091409 q20 559 304 276 276 q21 6393352035613520 q22 373 328 303 303 Total cold run time: 108793 ms Total hot run time: 38296 ms - Round 2, with runtime_filter_mode=off - q1 4117408940774077 q2 319 238 224 224 q3 2967282028132813 q4 1883159615511551 q5 5249522852325228 q6 196 114 117 114 q7 2238188518771877 q8 3144329732943294 q9 8573857185918571 q10 3711370936773677 q11 538 440 439 439 q12 723 571 568 568 q13 16896 282728512827 q14 280 260 249 249 q15 476 456 472 456 q16 443 432 412 412 q17 1729148414621462 q18 7611722272427222 q19 1606152115641521 q20 1914169917301699 q21 4835467146734671 q22 514 434 452 434 Total cold run time: 69962 ms Total hot run time: 53386 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](routine-load) enhance auto resume to keep routine load stable [doris]
HHoflittlefish777 commented on PR #32239: URL: https://github.com/apache/doris/pull/32239#issuecomment-1999126869 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Nereids) fix leading syntax problems and data mismatched problem [doris]
doris-robot commented on PR #32286: URL: https://github.com/apache/doris/pull/32286#issuecomment-1999130716 TPC-H: Total hot run time: 38502 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 64b43df1828f60563b5f1d121d3950d7499cbf98, data reload: false -- Round 1 -- q1 17675 423040904090 q2 2026150 145 145 q3 10690 1063903 903 q4 7468759 716 716 q5 7528276527542754 q6 186 129 123 123 q7 1169832 800 800 q8 9419205120042004 q9 7118646464506450 q10 8505353835993538 q11 423 229 227 227 q12 626 304 290 290 q13 17822 288528682868 q14 274 242 252 242 q15 492 453 441 441 q16 477 406 397 397 q17 950 534 539 534 q18 7260655764126412 q19 2193146414231423 q20 549 302 281 281 q21 6230356535613561 q22 355 339 303 303 Total cold run time: 109435 ms Total hot run time: 38502 ms - Round 2, with runtime_filter_mode=off - q1 4110406940684068 q2 315 221 226 221 q3 2984285628562856 q4 1872158615771577 q5 5223527752635263 q6 194 114 117 114 q7 2246186618411841 q8 3148328933083289 q9 8557857085438543 q10 3671369536733673 q11 538 429 433 429 q12 715 575 540 540 q13 16905 285128482848 q14 270 249 254 249 q15 482 445 453 445 q16 467 403 410 403 q17 1729146414901464 q18 7536716170917091 q19 1639149515121495 q20 1892172417201720 q21 4616469246114611 q22 536 453 442 442 Total cold run time: 69645 ms Total hot run time: 53182 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](routine-load) self-adaption adjustment of timeout time [doris]
HHoflittlefish777 commented on PR #32227: URL: https://github.com/apache/doris/pull/32227#issuecomment-1999134506 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](planner)decimalv3 literal's precision and scale is not correctly set [doris]
doris-robot commented on PR #32288: URL: https://github.com/apache/doris/pull/32288#issuecomment-1999136420 TPC-H: Total hot run time: 38740 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 56aab7f60b17f34455ab44d001e2c29d9bd8d32a, data reload: false -- Round 1 -- q1 17659 493241344134 q2 2022155 149 149 q3 10698 1101922 922 q4 6055711 780 711 q5 7447273627042704 q6 188 122 125 122 q7 1204823 811 811 q8 9341202820082008 q9 7079648364686468 q10 8471360236393602 q11 420 220 217 217 q12 713 309 308 308 q13 17779 285428432843 q14 272 248 253 248 q15 517 459 449 449 q16 502 395 393 393 q17 965 634 542 542 q18 7354650965596509 q19 3122145114801451 q20 551 290 282 282 q21 6819353635453536 q22 355 331 335 331 Total cold run time: 109533 ms Total hot run time: 38740 ms - Round 2, with runtime_filter_mode=off - q1 4146411441174114 q2 329 231 230 230 q3 2969282528342825 q4 1844158615381538 q5 5262528152755275 q6 204 116 119 116 q7 2250186218561856 q8 3170330933163309 q9 8646866286258625 q10 3720366336993663 q11 549 447 434 434 q12 735 555 518 518 q13 16878 288028192819 q14 291 265 257 257 q15 478 450 449 449 q16 468 403 409 403 q17 1740149614821482 q18 7562710471207104 q19 1622153415781534 q20 1927175217161716 q21 4853480246434643 q22 542 430 464 430 Total cold run time: 70185 ms Total hot run time: 53340 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](Nereids): rewrite sum literal to sum and count [doris]
XieJiann commented on PR #32244: URL: https://github.com/apache/doris/pull/32244#issuecomment-1999137080 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](hive)add 'HmsCommiter' to support inserting data into hive table [doris]
wuwenchi commented on PR #32283: URL: https://github.com/apache/doris/pull/32283#issuecomment-1999138452 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](index tool)Fix index_tool build error [doris]
qidaye opened a new pull request, #32289: URL: https://github.com/apache/doris/pull/32289 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](index tool)Fix index_tool build error [doris]
doris-robot commented on PR #32289: URL: https://github.com/apache/doris/pull/32289#issuecomment-1999139074 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](index tool)Fix index_tool build error [doris]
qidaye commented on PR #32289: URL: https://github.com/apache/doris/pull/32289#issuecomment-1999139285 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] (feat) move doris docs to website repo [doris-website]
velodb-Linjiang opened a new pull request, #421: URL: https://github.com/apache/doris-website/pull/421 - [(feat) move doris docs to website repo](https://github.com/apache/doris-website/commit/fdd1d99f32a04ca3ce939072d58c2316ba5a) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [Fix](nereids) remove duplicate expr in grouping set [doris]
feiniaofeiafei opened a new pull request, #32290: URL: https://github.com/apache/doris/pull/32290 db reported a error " expression duplicate in grouping set" when there are duplicate expression in grouping set. e.g.select a from mal_test1 group by grouping sets((a,a)) This pr removes duplicate expr in grouping set : select a from mal_test1 group by grouping sets((a)) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](nereids) remove duplicate expr in grouping set [doris]
doris-robot commented on PR #32290: URL: https://github.com/apache/doris/pull/32290#issuecomment-1999142335 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](nereids) remove duplicate expr in grouping set [doris]
feiniaofeiafei commented on PR #32290: URL: https://github.com/apache/doris/pull/32290#issuecomment-1999142564 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [pipelineX](exchange) Make exchange buffer size configurable [doris]
doris-robot commented on PR #32201: URL: https://github.com/apache/doris/pull/32201#issuecomment-1999143942 TPC-H: Total hot run time: 38363 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 67e3deb8c77c63bb4c83590bb50c1f9564f9d410, data reload: false -- Round 1 -- q1 17611 424141074107 q2 2015150 144 144 q3 10595 1156924 924 q4 7784778 721 721 q5 7480269026402640 q6 186 123 124 123 q7 1216852 804 804 q8 9331196320301963 q9 7184645164396439 q10 8479348836303488 q11 425 222 214 214 q12 624 299 309 299 q13 17785 286228562856 q14 279 257 248 248 q15 493 456 451 451 q16 523 395 391 391 q17 963 580 549 549 q18 7264652963806380 q19 3698140614361406 q20 547 285 288 285 q21 6340364236603642 q22 362 323 289 289 Total cold run time: 84 ms Total hot run time: 38363 ms - Round 2, with runtime_filter_mode=off - q1 4107406840354035 q2 320 224 216 216 q3 3000286428392839 q4 1873155515831555 q5 5249525252655252 q6 195 117 120 117 q7 2225181318191813 q8 3152329532563256 q9 8536851885618518 q10 3719364737153647 q11 536 446 433 433 q12 702 556 535 535 q13 16922 282228442822 q14 262 238 245 238 q15 480 458 442 442 q16 443 414 396 396 q17 1727146414581458 q18 7553716272327162 q19 1633147915981479 q20 1870167017501670 q21 4712490848104810 q22 508 445 426 426 Total cold run time: 69724 ms Total hot run time: 53119 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] (feat) move doris docs to website repo [doris-website]
luzhijing merged PR #421: URL: https://github.com/apache/doris-website/pull/421 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](nereids) remove duplicate expr in grouping set [doris]
github-actions[bot] commented on PR #32290: URL: https://github.com/apache/doris/pull/32290#issuecomment-1999145872 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](nereids) remove duplicate expr in grouping set [doris]
github-actions[bot] commented on PR #32290: URL: https://github.com/apache/doris/pull/32290#issuecomment-1999145913 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](index tool)Fix index_tool build error [doris]
github-actions[bot] commented on PR #32289: URL: https://github.com/apache/doris/pull/32289#issuecomment-1999146298 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](ip)conversion of ipv4 or ipv6 to arrow type in branch-2.1 [doris]
vinlee19 opened a new pull request, #32291: URL: https://github.com/apache/doris/pull/32291 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](ip)conversion of ipv4 or ipv6 to arrow type in branch-2.1 [doris]
doris-robot commented on PR #32291: URL: https://github.com/apache/doris/pull/32291#issuecomment-1999148575 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [I] [Bug] Only support subquery in binary predicate in case statement [doris]
iwanttobepowerful commented on issue #31308:
URL: https://github.com/apache/doris/issues/31308#issuecomment-1999150927
`
CREATE TABLE test_varchar (
str varchar(100),
len int
)
DUPLICATE KEY(str)
DISTRIBUTED BY HASH(str) BUCKETS 10
PROPERTIES("replication_num" = "1");
insert into test_varchar select 'abcdef',100;
insert into test_varchar select 'test',256;
set enable_fallback_to_original_planner = false;
select case when len in(select len from test_varchar ) then 1 else 1 end
c1 from test_varchar t2 group by len;
`
ERROR 1105 (HY000): errCode = 2, detailMessage = Only support subquery in
binary predicate in case statement.
`
select
/*+SET_VAR(disable_nereids_rules='TRANSPOSE_LOGICAL_SEMI_JOIN_AGG_PROJECT,
TRANSPOSE_LOGICAL_SEMI_JOIN_AGG')*/ case when len in(select len from
test_varchar ) then 1 else 1 end c1 from test_varchar t2 group by len;
`
can get right result
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](index tool)Fix index_tool build error [doris]
github-actions[bot] commented on PR #32289: URL: https://github.com/apache/doris/pull/32289#issuecomment-1999152406 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [feature](fe) FE image tool support dump image [doris]
w41ter opened a new pull request, #32292: URL: https://github.com/apache/doris/pull/32292 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](fe) FE image tool support dump image [doris]
doris-robot commented on PR #32292: URL: https://github.com/apache/doris/pull/32292#issuecomment-1999155204 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](routine-load) enhance auto resume to keep routine load stable [doris]
doris-robot commented on PR #32239: URL: https://github.com/apache/doris/pull/32239#issuecomment-1999155965 TPC-H: Total hot run time: 38222 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 4db900540fdd2910815d11d1eb2d49b6cb1ddebd, data reload: false -- Round 1 -- q1 17663 434041384138 q2 2025156 148 148 q3 10682 1062899 899 q4 7439736 705 705 q5 7473269425672567 q6 187 121 124 121 q7 1187815 813 813 q8 9336202420112011 q9 7131641564176415 q10 8446352436433524 q11 426 226 221 221 q12 629 289 286 286 q13 1 281128382811 q14 281 252 243 243 q15 496 454 466 454 q16 496 392 390 390 q17 961 564 549 549 q18 7245653563926392 q19 1872149514061406 q20 562 294 275 275 q21 6257361035543554 q22 360 300 314 300 Total cold run time: 108931 ms Total hot run time: 38222 ms - Round 2, with runtime_filter_mode=off - q1 4470412140864086 q2 324 230 224 224 q3 2985281128272811 q4 1841153815161516 q5 5223524552485245 q6 192 115 117 115 q7 2250184718591847 q8 3151331732973297 q9 8538857085848570 q10 3683376436743674 q11 524 466 450 450 q12 727 543 548 543 q13 16872 285028572850 q14 287 248 257 248 q15 477 435 438 435 q16 456 419 418 418 q17 1751146614731466 q18 7553715972137159 q19 1581157615631563 q20 1885171717411717 q21 4787468446134613 q22 504 453 459 453 Total cold run time: 70061 ms Total hot run time: 53300 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [cherry-pick](ip)conversion of ipv4 or ipv6 to arrow type in branch-2.1 [doris]
github-actions[bot] commented on PR #32291: URL: https://github.com/apache/doris/pull/32291#issuecomment-1999158799 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](routine-load) self-adaption adjustment of timeout time [doris]
doris-robot commented on PR #32227: URL: https://github.com/apache/doris/pull/32227#issuecomment-1999160371 TPC-H: Total hot run time: 38503 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit fb67c1392629a3d6e308be0c264d09ed25f9f62c, data reload: false -- Round 1 -- q1 17691 456641444144 q2 2027158 159 158 q3 10688 1080904 904 q4 7463708 755 708 q5 7480270926922692 q6 182 121 122 121 q7 1181854 810 810 q8 9338200319971997 q9 7150648163956395 q10 8463352536863525 q11 428 225 222 222 q12 631 306 296 296 q13 17822 288428422842 q14 276 252 255 252 q15 506 447 450 447 q16 511 391 381 381 q17 964 544 631 544 q18 7277657764266426 q19 4488145114981451 q20 560 292 288 288 q21 6233359135843584 q22 360 318 316 316 Total cold run time: 111719 ms Total hot run time: 38503 ms - Round 2, with runtime_filter_mode=off - q1 4150407240834072 q2 319 224 227 224 q3 2916287228242824 q4 1848156315671563 q5 5254527752765276 q6 195 117 119 117 q7 2244183318781833 q8 3156330033073300 q9 8592858386198583 q10 3738369536933693 q11 558 451 439 439 q12 722 565 537 537 q13 16927 289429002894 q14 281 244 248 244 q15 487 455 455 455 q16 460 402 423 402 q17 1751149414871487 q18 7584723072427230 q19 3197153015311530 q20 1922171117221711 q21 4873460547684605 q22 514 468 508 468 Total cold run time: 71688 ms Total hot run time: 53487 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] Grouping fix same col branch2.0 [doris]
feiniaofeiafei opened a new pull request, #32293: URL: https://github.com/apache/doris/pull/32293 pick #32235 to 2.0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] Grouping fix same col branch2.0 [doris]
doris-robot commented on PR #32293: URL: https://github.com/apache/doris/pull/32293#issuecomment-1999162227 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] Grouping fix same col branch2.0 [doris]
feiniaofeiafei commented on PR #32293: URL: https://github.com/apache/doris/pull/32293#issuecomment-1999162578 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](compatible) display dateV2/datetimeV2/decimalv3 as date/datetime/decimal when show column [doris]
doris-robot commented on PR #32233: URL: https://github.com/apache/doris/pull/32233#issuecomment-1999162587 TPC-H: Total hot run time: 38014 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 63d928cec1e38eb63b329f599b7996bbc10bc5ab, data reload: false -- Round 1 -- q1 17650 432740634063 q2 2022158 144 144 q3 10659 1064898 898 q4 8133754 706 706 q5 7448271526532653 q6 191 121 128 121 q7 1159818 790 790 q8 9319198019841980 q9 7114641863846384 q10 8475350735583507 q11 434 218 211 211 q12 593 294 287 287 q13 17792 284928512849 q14 273 255 242 242 q15 495 455 451 451 q16 508 384 391 384 q17 945 528 586 528 q18 7333640862996299 q19 1568143514841435 q20 570 275 274 274 q21 6415372434963496 q22 364 312 328 312 Total cold run time: 109460 ms Total hot run time: 38014 ms - Round 2, with runtime_filter_mode=off - q1 4171409941074099 q2 317 232 225 225 q3 2925280928032803 q4 1821155515551555 q5 5180521152515211 q6 205 114 115 114 q7 2256184918921849 q8 3128327432503250 q9 8532852584748474 q10 3673368036213621 q11 537 441 462 441 q12 704 555 550 550 q13 16916 285528802855 q14 286 254 250 250 q15 491 451 455 451 q16 460 420 403 403 q17 1731149014441444 q18 7516712871437128 q19 1636146915431469 q20 1897170917491709 q21 4809478446374637 q22 526 467 452 452 Total cold run time: 69717 ms Total hot run time: 52990 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](Nereids): rewrite sum literal to sum and count [doris]
doris-robot commented on PR #32244: URL: https://github.com/apache/doris/pull/32244#issuecomment-1999162909 TPC-H: Total hot run time: 38240 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit f375f08e6ce92874f1c89162d69539b2e4bbd478, data reload: false -- Round 1 -- q1 17703 507042084208 q2 2029152 140 140 q3 10670 1079878 878 q4 7097728 707 707 q5 7479254725972547 q6 188 123 123 123 q7 1186806 808 806 q8 9326194919911949 q9 7040647864266426 q10 8454352936763529 q11 433 225 222 222 q12 668 304 300 300 q13 17804 288728472847 q14 273 248 249 248 q15 506 453 446 446 q16 477 405 395 395 q17 951 512 509 509 q18 7314666364586458 q19 3791148414131413 q20 559 286 285 285 q21 6377355234973497 q22 372 307 312 307 Total cold run time: 110697 ms Total hot run time: 38240 ms - Round 2, with runtime_filter_mode=off - q1 4227419641524152 q2 324 221 239 221 q3 2957279028612790 q4 1831154615381538 q5 5212523052595230 q6 195 116 120 116 q7 2246186218491849 q8 3173330532633263 q9 8551855485428542 q10 3669367536363636 q11 540 430 432 430 q12 709 552 539 539 q13 17209 287628422842 q14 267 251 249 249 q15 477 451 449 449 q16 452 406 425 406 q17 1745150814861486 q18 7489722770677067 q19 1632153415241524 q20 1907172617071707 q21 4699479045314531 q22 539 445 473 445 Total cold run time: 70050 ms Total hot run time: 53012 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [pipelineX](exchange) Make exchange buffer size configurable [doris]
doris-robot commented on PR #32201: URL: https://github.com/apache/doris/pull/32201#issuecomment-1999163482 TeamCity be ut coverage result: Function Coverage: 34.95% (8574/24534) Line Coverage: 26.65% (69479/260731) Region Coverage: 25.95% (36096/139107) Branch Coverage: 22.90% (18426/80478) Coverage Report: http://coverage.selectdb-in.cc/coverage/67e3deb8c77c63bb4c83590bb50c1f9564f9d410_67e3deb8c77c63bb4c83590bb50c1f9564f9d410/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](hive)add 'HmsCommiter' to support inserting data into hive table [doris]
doris-robot commented on PR #32283: URL: https://github.com/apache/doris/pull/32283#issuecomment-1999165121 TPC-H: Total hot run time: 38413 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit eef7df93b15860e8762e49970ebe7274be26c39e, data reload: false -- Round 1 -- q1 17631 420941474147 q2 2016154 156 154 q3 10593 1080902 902 q4 6385711 790 711 q5 7470262825452545 q6 191 122 120 120 q7 1220824 817 817 q8 9411200020002000 q9 8704642164166416 q10 8547349436463494 q11 421 225 219 219 q12 1294310 304 304 q13 18123 288628552855 q14 279 261 245 245 q15 503 456 457 456 q16 508 380 403 380 q17 957 578 538 538 q18 7250659765326532 q19 1570141014041404 q20 558 289 278 278 q21 6393360136183601 q22 350 295 313 295 Total cold run time: 110374 ms Total hot run time: 38413 ms - Round 2, with runtime_filter_mode=off - q1 4105408940494049 q2 320 218 228 218 q3 2962283028372830 q4 1841157815181518 q5 5198528452545254 q6 203 114 114 114 q7 2248184918921849 q8 3160330732823282 q9 8537854185918541 q10 3707368736833683 q11 536 441 449 441 q12 715 543 563 543 q13 8250287628592859 q14 304 249 273 249 q15 477 445 450 445 q16 466 417 417 417 q17 1744147414671467 q18 7502720270627062 q19 1592151215451512 q20 1907170317391703 q21 4867453846684538 q22 522 467 472 467 Total cold run time: 61163 ms Total hot run time: 53041 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](index tool)Fix index_tool build error [doris]
doris-robot commented on PR #32289: URL: https://github.com/apache/doris/pull/32289#issuecomment-1999166203 TPC-H: Total hot run time: 38644 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 1beca68070d917ba8e458430ed67654a042e0676, data reload: false -- Round 1 -- q1 17641 434941394139 q2 2033156 149 149 q3 10669 1076912 912 q4 7795741 781 741 q5 7446279227452745 q6 190 123 122 122 q7 1170827 820 820 q8 9444206020022002 q9 7619645065006450 q10 8542355736503557 q11 427 212 221 212 q12 1122304 297 297 q13 18130 285628392839 q14 272 256 252 252 q15 511 467 453 453 q16 510 398 397 397 q17 967 600 513 513 q18 7198664365216521 q19 1555150613891389 q20 546 291 275 275 q21 5902354136063541 q22 353 318 336 318 Total cold run time: 110042 ms Total hot run time: 38644 ms - Round 2, with runtime_filter_mode=off - q1 4099409840734073 q2 323 234 230 230 q3 2991285228482848 q4 1860161515371537 q5 5242529252835283 q6 193 123 119 119 q7 2270184918411841 q8 3177332732933293 q9 8578855685458545 q10 3715367237263672 q11 536 437 434 434 q12 728 589 590 589 q13 10159 291628542854 q14 279 250 261 250 q15 486 460 465 460 q16 452 421 438 421 q17 1728147214831472 q18 7428724272337233 q19 1614158115301530 q20 1917168017271680 q21 4912458046964580 q22 596 451 446 446 Total cold run time: 63283 ms Total hot run time: 53390 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](index tool)Fix index_tool build error [doris]
github-actions[bot] commented on PR #32289: URL: https://github.com/apache/doris/pull/32289#issuecomment-1999169000 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](nereids) remove duplicate expr in grouping set [doris]
doris-robot commented on PR #32290: URL: https://github.com/apache/doris/pull/32290#issuecomment-1999173306 TPC-H: Total hot run time: 38466 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit bccc8bfd8b1138b1fbdf8970d5a8415fac742b65, data reload: false -- Round 1 -- q1 17655 443841104110 q2 2026150 152 150 q3 10685 1127898 898 q4 7463710 734 710 q5 7470260826392608 q6 185 123 122 122 q7 1203823 815 815 q8 9332204520192019 q9 7125647164066406 q10 8444356136473561 q11 421 227 214 214 q12 631 310 306 306 q13 17798 286328402840 q14 273 242 253 242 q15 492 466 456 456 q16 484 398 399 398 q17 969 560 529 529 q18 7330667065496549 q19 5606150213961396 q20 551 296 285 285 q21 6195354435803544 q22 365 324 308 308 Total cold run time: 112703 ms Total hot run time: 38466 ms - Round 2, with runtime_filter_mode=off - q1 4166407140684068 q2 325 229 222 222 q3 2997283228122812 q4 1851155215421542 q5 5208525052375237 q6 197 116 115 115 q7 2259182418081808 q8 3156329933073299 q9 8595859685418541 q10 3747360436503604 q11 558 441 456 441 q12 730 523 570 523 q13 16904 289328332833 q14 286 245 269 245 q15 480 448 447 447 q16 449 418 408 408 q17 1751150414671467 q18 7507723172047204 q19 1843153315171517 q20 1880169017191690 q21 4771469347294693 q22 539 440 444 440 Total cold run time: 70199 ms Total hot run time: 53156 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
